2026-02-24T09:03:51.170 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-24T09:03:51.189 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T09:03:51.271 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/vshankar-2026-02-24_05:06:44-fs-wip-vshankar-testing-20260223.155722-testing-default-trial/67086 branch: wip-vshankar-testing-20260223.155722 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated-and-quota} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/suites/iozone}} email: vshankar@redhat.com first_in_suite: false flavor: default job_id: '67086' kernel: sha1: 8dec4b357aab872d3b63ec979924962a64be83dd last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: vshankar-2026-02-24_05:06:44-fs-wip-vshankar-testing-20260223.155722-testing-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20260223.155722 ceph: cephfs: ec_profile: - disabled max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds use global snaprealm seq for subvol: false mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mgr/snap_schedule/log_level: debug mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: client_fscrypt_dummy_encryption: true mds: mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.2 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded mgr-modules: - snap_schedule sha1: 5bc9a1ffc19df681248ece8c3c8c7191a571745b subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount dry_run: true install: ceph: flavor: default sha1: 5bc9a1ffc19df681248ece8c3c8c7191a571745b kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20260223.155722 sha1: 5bc9a1ffc19df681248ece8c3c8c7191a571745b owner: scheduled_vshankar@soko04.front.sepia.ceph.com priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 2406 sha1: 5bc9a1ffc19df681248ece8c3c8c7191a571745b sleep_before_teardown: 0 subset: 283/1024 suite: fs suite_branch: wip-vshankar-testing-20260223.155722 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_5bc9a1ffc19df681248ece8c3c8c7191a571745b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 5bc9a1ffc19df681248ece8c3c8c7191a571745b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial028.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAFKXIkdZvWa2ijhhN2/1lLpH5Yf9CLNLLQHxQAMQofR6OmgK2ZsdrXuaeiUeFGgdfYWvKcreeSUmWhTyHpoYp0= trial074.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGRM3q/tspWC1czzLU4G3wfHlZCK8mX/ZbQ4ve0QvufMz2JgIyhuYZsivAefr5GsYhEQUbeQwjr8XSOmy6+SFsg= trial159.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPnLU0B4ede1S0R6oEivUR8zIbUiMU4FyL7ohSu55pHhmlfDMFEuDzOZRF0ioSOtP4pB2P8ndh5YErS4mu8RFLo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.20 - check-counter: {} - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((800-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/iozone.sh teuthology: fragments_dropped: [] meta: {} postmerge: - "local kernel = py_attrgetter(yaml).get('kernel')\nif kernel ~= nil then\n local\ \ branch = py_attrgetter(kernel).get('branch')\n if branch and not kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\"\ , kernel)\n py_attrgetter(kernel).pop('branch', nil)\n py_attrgetter(kernel).pop('deb',\ \ nil)\n py_attrgetter(kernel).pop('flavor', nil)\n py_attrgetter(kernel).pop('kdb',\ \ nil)\n py_attrgetter(kernel).pop('koji', nil)\n py_attrgetter(kernel).pop('koji_task',\ \ nil)\n py_attrgetter(kernel).pop('rpm', nil)\n py_attrgetter(kernel).pop('sha1',\ \ nil)\n py_attrgetter(kernel).pop('tag', nil)\n end\nend\n" - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-24_05:06:44 tube: trial user: vshankar verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.904699 2026-02-24T09:03:51.271 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_5bc9a1ffc19df681248ece8c3c8c7191a571745b/qa; will attempt to use it 2026-02-24T09:03:51.272 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_5bc9a1ffc19df681248ece8c3c8c7191a571745b/qa/tasks 2026-02-24T09:03:51.272 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-24T09:03:51.273 INFO:teuthology.task.internal:Checking packages... 2026-02-24T09:03:51.273 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '5bc9a1ffc19df681248ece8c3c8c7191a571745b' 2026-02-24T09:03:51.273 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-24T09:03:51.273 INFO:teuthology.packaging:ref: None 2026-02-24T09:03:51.273 INFO:teuthology.packaging:tag: None 2026-02-24T09:03:51.273 INFO:teuthology.packaging:branch: wip-vshankar-testing-20260223.155722 2026-02-24T09:03:51.273 INFO:teuthology.packaging:sha1: 5bc9a1ffc19df681248ece8c3c8c7191a571745b 2026-02-24T09:03:51.274 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20260223.155722 2026-02-24T09:03:51.399 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5537.g5bc9a1ff 2026-02-24T09:03:51.400 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-24T09:03:51.412 INFO:teuthology.task.internal:no buildpackages task found 2026-02-24T09:03:51.412 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-24T09:03:51.426 INFO:teuthology.task.internal:Saving configuration 2026-02-24T09:03:51.437 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-24T09:03:51.448 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-24T09:03:51.507 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial028.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/vshankar-2026-02-24_05:06:44-fs-wip-vshankar-testing-20260223.155722-testing-default-trial/67086', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-24 09:00:21.769298', 'locked_by': 'scheduled_vshankar@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAFKXIkdZvWa2ijhhN2/1lLpH5Yf9CLNLLQHxQAMQofR6OmgK2ZsdrXuaeiUeFGgdfYWvKcreeSUmWhTyHpoYp0='} 2026-02-24T09:03:51.564 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial074.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/vshankar-2026-02-24_05:06:44-fs-wip-vshankar-testing-20260223.155722-testing-default-trial/67086', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-24 09:00:21.768657', 'locked_by': 'scheduled_vshankar@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGRM3q/tspWC1czzLU4G3wfHlZCK8mX/ZbQ4ve0QvufMz2JgIyhuYZsivAefr5GsYhEQUbeQwjr8XSOmy6+SFsg='} 2026-02-24T09:03:51.621 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial159.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/vshankar-2026-02-24_05:06:44-fs-wip-vshankar-testing-20260223.155722-testing-default-trial/67086', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-24 09:00:21.769733', 'locked_by': 'scheduled_vshankar@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPnLU0B4ede1S0R6oEivUR8zIbUiMU4FyL7ohSu55pHhmlfDMFEuDzOZRF0ioSOtP4pB2P8ndh5YErS4mu8RFLo='} 2026-02-24T09:03:51.621 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-24T09:03:51.632 INFO:teuthology.task.internal:roles: ubuntu@trial028.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2026-02-24T09:03:51.632 INFO:teuthology.task.internal:roles: ubuntu@trial074.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2026-02-24T09:03:51.632 INFO:teuthology.task.internal:roles: ubuntu@trial159.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2026-02-24T09:03:51.632 INFO:teuthology.run_tasks:Running task console_log... 2026-02-24T09:03:51.821 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7650d3f2a980>, signals=[15]) 2026-02-24T09:03:51.821 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-24T09:03:51.832 INFO:teuthology.task.internal:Opening connections... 2026-02-24T09:03:51.832 DEBUG:teuthology.task.internal:connecting to ubuntu@trial028.front.sepia.ceph.com 2026-02-24T09:03:51.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T09:03:51.895 DEBUG:teuthology.task.internal:connecting to ubuntu@trial074.front.sepia.ceph.com 2026-02-24T09:03:51.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial074.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T09:03:51.956 DEBUG:teuthology.task.internal:connecting to ubuntu@trial159.front.sepia.ceph.com 2026-02-24T09:03:51.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T09:03:52.016 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-24T09:03:52.028 DEBUG:teuthology.orchestra.run.trial028:> uname -m 2026-02-24T09:03:52.043 INFO:teuthology.orchestra.run.trial028.stdout:x86_64 2026-02-24T09:03:52.043 DEBUG:teuthology.orchestra.run.trial028:> cat /etc/os-release 2026-02-24T09:03:52.098 INFO:teuthology.orchestra.run.trial028.stdout:NAME="CentOS Stream" 2026-02-24T09:03:52.098 INFO:teuthology.orchestra.run.trial028.stdout:VERSION="9" 2026-02-24T09:03:52.098 INFO:teuthology.orchestra.run.trial028.stdout:ID="centos" 2026-02-24T09:03:52.098 INFO:teuthology.orchestra.run.trial028.stdout:ID_LIKE="rhel fedora" 2026-02-24T09:03:52.098 INFO:teuthology.orchestra.run.trial028.stdout:VERSION_ID="9" 2026-02-24T09:03:52.098 INFO:teuthology.orchestra.run.trial028.stdout:PLATFORM_ID="platform:el9" 2026-02-24T09:03:52.098 INFO:teuthology.orchestra.run.trial028.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T09:03:52.098 INFO:teuthology.orchestra.run.trial028.stdout:ANSI_COLOR="0;31" 2026-02-24T09:03:52.098 INFO:teuthology.orchestra.run.trial028.stdout:LOGO="fedora-logo-icon" 2026-02-24T09:03:52.098 INFO:teuthology.orchestra.run.trial028.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T09:03:52.098 INFO:teuthology.orchestra.run.trial028.stdout:HOME_URL="https://centos.org/" 2026-02-24T09:03:52.099 INFO:teuthology.orchestra.run.trial028.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T09:03:52.099 INFO:teuthology.orchestra.run.trial028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T09:03:52.099 INFO:teuthology.orchestra.run.trial028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T09:03:52.099 INFO:teuthology.lock.ops:Updating trial028.front.sepia.ceph.com on lock server 2026-02-24T09:03:52.165 DEBUG:teuthology.orchestra.run.trial074:> uname -m 2026-02-24T09:03:52.179 INFO:teuthology.orchestra.run.trial074.stdout:x86_64 2026-02-24T09:03:52.180 DEBUG:teuthology.orchestra.run.trial074:> cat /etc/os-release 2026-02-24T09:03:52.235 INFO:teuthology.orchestra.run.trial074.stdout:NAME="CentOS Stream" 2026-02-24T09:03:52.235 INFO:teuthology.orchestra.run.trial074.stdout:VERSION="9" 2026-02-24T09:03:52.235 INFO:teuthology.orchestra.run.trial074.stdout:ID="centos" 2026-02-24T09:03:52.235 INFO:teuthology.orchestra.run.trial074.stdout:ID_LIKE="rhel fedora" 2026-02-24T09:03:52.235 INFO:teuthology.orchestra.run.trial074.stdout:VERSION_ID="9" 2026-02-24T09:03:52.235 INFO:teuthology.orchestra.run.trial074.stdout:PLATFORM_ID="platform:el9" 2026-02-24T09:03:52.235 INFO:teuthology.orchestra.run.trial074.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T09:03:52.236 INFO:teuthology.orchestra.run.trial074.stdout:ANSI_COLOR="0;31" 2026-02-24T09:03:52.236 INFO:teuthology.orchestra.run.trial074.stdout:LOGO="fedora-logo-icon" 2026-02-24T09:03:52.236 INFO:teuthology.orchestra.run.trial074.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T09:03:52.236 INFO:teuthology.orchestra.run.trial074.stdout:HOME_URL="https://centos.org/" 2026-02-24T09:03:52.236 INFO:teuthology.orchestra.run.trial074.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T09:03:52.236 INFO:teuthology.orchestra.run.trial074.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T09:03:52.236 INFO:teuthology.orchestra.run.trial074.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T09:03:52.236 INFO:teuthology.lock.ops:Updating trial074.front.sepia.ceph.com on lock server 2026-02-24T09:03:52.308 DEBUG:teuthology.orchestra.run.trial159:> uname -m 2026-02-24T09:03:52.323 INFO:teuthology.orchestra.run.trial159.stdout:x86_64 2026-02-24T09:03:52.323 DEBUG:teuthology.orchestra.run.trial159:> cat /etc/os-release 2026-02-24T09:03:52.379 INFO:teuthology.orchestra.run.trial159.stdout:NAME="CentOS Stream" 2026-02-24T09:03:52.379 INFO:teuthology.orchestra.run.trial159.stdout:VERSION="9" 2026-02-24T09:03:52.379 INFO:teuthology.orchestra.run.trial159.stdout:ID="centos" 2026-02-24T09:03:52.379 INFO:teuthology.orchestra.run.trial159.stdout:ID_LIKE="rhel fedora" 2026-02-24T09:03:52.379 INFO:teuthology.orchestra.run.trial159.stdout:VERSION_ID="9" 2026-02-24T09:03:52.380 INFO:teuthology.orchestra.run.trial159.stdout:PLATFORM_ID="platform:el9" 2026-02-24T09:03:52.380 INFO:teuthology.orchestra.run.trial159.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T09:03:52.380 INFO:teuthology.orchestra.run.trial159.stdout:ANSI_COLOR="0;31" 2026-02-24T09:03:52.380 INFO:teuthology.orchestra.run.trial159.stdout:LOGO="fedora-logo-icon" 2026-02-24T09:03:52.380 INFO:teuthology.orchestra.run.trial159.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T09:03:52.380 INFO:teuthology.orchestra.run.trial159.stdout:HOME_URL="https://centos.org/" 2026-02-24T09:03:52.380 INFO:teuthology.orchestra.run.trial159.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T09:03:52.380 INFO:teuthology.orchestra.run.trial159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T09:03:52.380 INFO:teuthology.orchestra.run.trial159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T09:03:52.380 INFO:teuthology.lock.ops:Updating trial159.front.sepia.ceph.com on lock server 2026-02-24T09:03:52.453 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-24T09:03:52.471 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-24T09:03:52.481 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-24T09:03:52.481 DEBUG:teuthology.orchestra.run.trial028:> test '!' -e /home/ubuntu/cephtest 2026-02-24T09:03:52.483 DEBUG:teuthology.orchestra.run.trial074:> test '!' -e /home/ubuntu/cephtest 2026-02-24T09:03:52.485 DEBUG:teuthology.orchestra.run.trial159:> test '!' -e /home/ubuntu/cephtest 2026-02-24T09:03:52.500 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-24T09:03:52.512 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-24T09:03:52.512 DEBUG:teuthology.orchestra.run.trial028:> test -z $(ls -A /var/lib/ceph) 2026-02-24T09:03:52.539 DEBUG:teuthology.orchestra.run.trial074:> test -z $(ls -A /var/lib/ceph) 2026-02-24T09:03:52.540 DEBUG:teuthology.orchestra.run.trial159:> test -z $(ls -A /var/lib/ceph) 2026-02-24T09:03:52.556 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-24T09:03:52.736 INFO:teuthology.run_tasks:Running task kernel... 2026-02-24T09:03:52.755 INFO:teuthology.task.kernel:normalize config orig: {'sha1': '8dec4b357aab872d3b63ec979924962a64be83dd'} 2026-02-24T09:03:52.755 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': '8dec4b357aab872d3b63ec979924962a64be83dd'}, 'mon.b': {'sha1': '8dec4b357aab872d3b63ec979924962a64be83dd'}, 'mon.c': {'sha1': '8dec4b357aab872d3b63ec979924962a64be83dd'}}, timeout 300 2026-02-24T09:03:52.755 DEBUG:teuthology.orchestra.run.trial028:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-24T09:03:52.756 DEBUG:teuthology.orchestra.run.trial074:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-24T09:03:52.756 DEBUG:teuthology.orchestra.run.trial159:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-24T09:03:52.770 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T09:03:52.770 DEBUG:teuthology.task.kernel:sha1 for mon.b is 8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-24T09:03:52.770 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "8dec4b357aab872d3b63ec979924962a64be83dd"... 2026-02-24T09:03:52.770 DEBUG:teuthology.orchestra.run.trial074:> uname -r 2026-02-24T09:03:52.771 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T09:03:52.771 DEBUG:teuthology.task.kernel:sha1 for mon.c is 8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-24T09:03:52.771 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "8dec4b357aab872d3b63ec979924962a64be83dd"... 2026-02-24T09:03:52.771 DEBUG:teuthology.orchestra.run.trial159:> uname -r 2026-02-24T09:03:52.771 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T09:03:52.771 DEBUG:teuthology.task.kernel:sha1 for mon.a is 8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-24T09:03:52.771 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "8dec4b357aab872d3b63ec979924962a64be83dd"... 2026-02-24T09:03:52.771 DEBUG:teuthology.orchestra.run.trial028:> uname -r 2026-02-24T09:03:52.826 INFO:teuthology.orchestra.run.trial159.stdout:5.14.0-681.el9.x86_64 2026-02-24T09:03:52.826 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-24T09:03:52.827 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2026-02-24T09:03:52.827 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-24T09:03:52.829 INFO:teuthology.orchestra.run.trial028.stdout:5.14.0-681.el9.x86_64 2026-02-24T09:03:52.829 INFO:teuthology.orchestra.run.trial074.stdout:5.14.0-681.el9.x86_64 2026-02-24T09:03:52.830 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-24T09:03:52.830 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2026-02-24T09:03:52.830 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-24T09:03:52.830 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-24T09:03:52.830 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2026-02-24T09:03:52.831 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-24T09:03:53.030 DEBUG:teuthology.orchestra.run.trial074:> sudo yum upgrade -y linux-firmware 2026-02-24T09:03:53.030 DEBUG:teuthology.orchestra.run.trial159:> sudo yum upgrade -y linux-firmware 2026-02-24T09:03:53.038 DEBUG:teuthology.orchestra.run.trial028:> sudo yum upgrade -y linux-firmware 2026-02-24T09:03:56.182 INFO:teuthology.orchestra.run.trial159.stdout:CentOS Stream 9 - BaseOS 3.2 MB/s | 8.9 MB 00:02 2026-02-24T09:03:56.656 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - BaseOS 2.7 MB/s | 8.9 MB 00:03 2026-02-24T09:03:59.214 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - AppStream 13 MB/s | 27 MB 00:02 2026-02-24T09:03:59.920 INFO:teuthology.orchestra.run.trial159.stdout:CentOS Stream 9 - AppStream 8.4 MB/s | 27 MB 00:03 2026-02-24T09:04:02.043 INFO:teuthology.orchestra.run.trial074.stdout:CentOS Stream 9 - BaseOS 1.0 MB/s | 8.9 MB 00:08 2026-02-24T09:04:03.091 INFO:teuthology.orchestra.run.trial074.stdout:CentOS Stream 9 - AppStream 51 MB/s | 27 MB 00:00 2026-02-24T09:04:03.499 INFO:teuthology.orchestra.run.trial159.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 8.0 MB 00:01 2026-02-24T09:04:03.556 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 8.0 MB 00:01 2026-02-24T09:04:04.416 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - Extras packages 170 kB/s | 20 kB 00:00 2026-02-24T09:04:04.476 INFO:teuthology.orchestra.run.trial159.stdout:CentOS Stream 9 - Extras packages 111 kB/s | 20 kB 00:00 2026-02-24T09:04:05.156 INFO:teuthology.orchestra.run.trial159.stdout:Extra Packages for Enterprise Linux 33 MB/s | 20 MB 00:00 2026-02-24T09:04:05.456 INFO:teuthology.orchestra.run.trial028.stdout:Extra Packages for Enterprise Linux 21 MB/s | 20 MB 00:00 2026-02-24T09:04:07.057 INFO:teuthology.orchestra.run.trial074.stdout:CentOS Stream 9 - CRB 5.0 MB/s | 8.0 MB 00:01 2026-02-24T09:04:08.438 INFO:teuthology.orchestra.run.trial074.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 20 kB 00:00 2026-02-24T09:04:08.524 INFO:teuthology.orchestra.run.trial159.stdout:lab-extras 1.4 MB/s | 50 kB 00:00 2026-02-24T09:04:08.663 INFO:teuthology.orchestra.run.trial028.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-24T09:04:08.808 INFO:teuthology.orchestra.run.trial074.stdout:Extra Packages for Enterprise Linux 66 MB/s | 20 MB 00:00 2026-02-24T09:04:09.559 INFO:teuthology.orchestra.run.trial159.stdout:Dependencies resolved. 2026-02-24T09:04:09.560 INFO:teuthology.orchestra.run.trial159.stdout:Nothing to do. 2026-02-24T09:04:09.560 INFO:teuthology.orchestra.run.trial159.stdout:Complete! 2026-02-24T09:04:09.583 INFO:teuthology.task.kernel:Downloading kernel 8dec4b357aab872d3b63ec979924962a64be83dd on mon.c... 2026-02-24T09:04:09.584 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-24T09:04:09.695 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-24T09:04:09.695 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-24T09:04:09.695 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-24T09:04:09.718 INFO:teuthology.task.kernel:Downloading kernel 8dec4b357aab872d3b63ec979924962a64be83dd on mon.a... 2026-02-24T09:04:09.718 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-24T09:04:09.816 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/8dec4b357aab872d3b63ec979924962a64be83dd/centos/9/flavors/default/x86_64/ 2026-02-24T09:04:09.816 DEBUG:teuthology.orchestra.run.trial159:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.19.0_g8dec4b357aab-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/8dec4b357aab872d3b63ec979924962a64be83dd/centos/9/flavors/default/x86_64/ --input-file=- 2026-02-24T09:04:09.818 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@trial159.front.sepia.ceph.com to complete... 2026-02-24T09:04:09.846 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/8dec4b357aab872d3b63ec979924962a64be83dd/centos/9/flavors/default/x86_64/ 2026-02-24T09:04:09.846 DEBUG:teuthology.orchestra.run.trial028:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.19.0_g8dec4b357aab-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/8dec4b357aab872d3b63ec979924962a64be83dd/centos/9/flavors/default/x86_64/ --input-file=- 2026-02-24T09:04:09.848 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@trial028.front.sepia.ceph.com to complete... 2026-02-24T09:04:11.998 INFO:teuthology.orchestra.run.trial074.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-24T09:04:13.028 INFO:teuthology.orchestra.run.trial074.stdout:Dependencies resolved. 2026-02-24T09:04:13.029 INFO:teuthology.orchestra.run.trial074.stdout:Nothing to do. 2026-02-24T09:04:13.029 INFO:teuthology.orchestra.run.trial074.stdout:Complete! 2026-02-24T09:04:13.051 INFO:teuthology.task.kernel:Downloading kernel 8dec4b357aab872d3b63ec979924962a64be83dd on mon.b... 2026-02-24T09:04:13.052 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-24T09:04:13.221 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/8dec4b357aab872d3b63ec979924962a64be83dd/centos/9/flavors/default/x86_64/ 2026-02-24T09:04:13.221 DEBUG:teuthology.orchestra.run.trial074:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.19.0_g8dec4b357aab-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/8dec4b357aab872d3b63ec979924962a64be83dd/centos/9/flavors/default/x86_64/ --input-file=- 2026-02-24T09:04:13.223 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@trial074.front.sepia.ceph.com to complete... 2026-02-24T09:04:21.357 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24 09:04:21 URL:https://2.chacra.ceph.com/r/kernel/testing/8dec4b357aab872d3b63ec979924962a64be83dd/centos/9/flavors/default/x86_64/kernel-6.19.0_g8dec4b357aab-1.x86_64.rpm [387870085/387870085] -> "/tmp/kernel.x86_64.rpm" [1] 2026-02-24T09:04:21.357 INFO:teuthology.orchestra.run.trial159.stderr:FINISHED --2026-02-24 09:04:21-- 2026-02-24T09:04:21.357 INFO:teuthology.orchestra.run.trial159.stderr:Total wall clock time: 12s 2026-02-24T09:04:21.357 INFO:teuthology.orchestra.run.trial159.stderr:Downloaded: 1 files, 370M in 11s (32.5 MB/s) 2026-02-24T09:04:21.362 INFO:teuthology.task.kernel:Installing kernel 8dec4b357aab872d3b63ec979924962a64be83dd on mon.c... 2026-02-24T09:04:21.362 DEBUG:teuthology.orchestra.run.trial159:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2026-02-24T09:04:22.492 INFO:teuthology.orchestra.run.trial159.stdout:Verifying... ######################################## 2026-02-24T09:04:22.543 INFO:teuthology.orchestra.run.trial159.stdout:Preparing... ######################################## 2026-02-24T09:04:22.561 INFO:teuthology.orchestra.run.trial159.stdout:Updating / installing... 2026-02-24T09:04:25.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24 09:04:25 URL:https://2.chacra.ceph.com/r/kernel/testing/8dec4b357aab872d3b63ec979924962a64be83dd/centos/9/flavors/default/x86_64/kernel-6.19.0_g8dec4b357aab-1.x86_64.rpm [387870085/387870085] -> "/tmp/kernel.x86_64.rpm" [1] 2026-02-24T09:04:25.743 INFO:teuthology.orchestra.run.trial028.stderr:FINISHED --2026-02-24 09:04:25-- 2026-02-24T09:04:25.743 INFO:teuthology.orchestra.run.trial028.stderr:Total wall clock time: 16s 2026-02-24T09:04:25.743 INFO:teuthology.orchestra.run.trial028.stderr:Downloaded: 1 files, 370M in 16s (23.5 MB/s) 2026-02-24T09:04:25.747 INFO:teuthology.task.kernel:Installing kernel 8dec4b357aab872d3b63ec979924962a64be83dd on mon.a... 2026-02-24T09:04:25.747 DEBUG:teuthology.orchestra.run.trial028:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2026-02-24T09:04:25.762 INFO:teuthology.orchestra.run.trial159.stdout:kernel-6.19.0_g8dec4b357aab-1 ######################################## 2026-02-24T09:04:26.880 INFO:teuthology.orchestra.run.trial028.stdout:Verifying... ######################################## 2026-02-24T09:04:26.931 INFO:teuthology.orchestra.run.trial028.stdout:Preparing... ######################################## 2026-02-24T09:04:26.948 INFO:teuthology.orchestra.run.trial028.stdout:Updating / installing... 2026-02-24T09:04:29.335 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24 09:04:29 URL:https://2.chacra.ceph.com/r/kernel/testing/8dec4b357aab872d3b63ec979924962a64be83dd/centos/9/flavors/default/x86_64/kernel-6.19.0_g8dec4b357aab-1.x86_64.rpm [387870085/387870085] -> "/tmp/kernel.x86_64.rpm" [1] 2026-02-24T09:04:29.335 INFO:teuthology.orchestra.run.trial074.stderr:FINISHED --2026-02-24 09:04:29-- 2026-02-24T09:04:29.335 INFO:teuthology.orchestra.run.trial074.stderr:Total wall clock time: 16s 2026-02-24T09:04:29.335 INFO:teuthology.orchestra.run.trial074.stderr:Downloaded: 1 files, 370M in 16s (23.6 MB/s) 2026-02-24T09:04:29.338 INFO:teuthology.task.kernel:Installing kernel 8dec4b357aab872d3b63ec979924962a64be83dd on mon.b... 2026-02-24T09:04:29.338 DEBUG:teuthology.orchestra.run.trial074:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2026-02-24T09:04:30.158 INFO:teuthology.orchestra.run.trial028.stdout:kernel-6.19.0_g8dec4b357aab-1 ######################################## 2026-02-24T09:04:30.512 INFO:teuthology.orchestra.run.trial074.stdout:Verifying... ######################################## 2026-02-24T09:04:30.563 INFO:teuthology.orchestra.run.trial074.stdout:Preparing... ######################################## 2026-02-24T09:04:30.581 INFO:teuthology.orchestra.run.trial074.stdout:Updating / installing... 2026-02-24T09:04:33.787 INFO:teuthology.orchestra.run.trial074.stdout:kernel-6.19.0_g8dec4b357aab-1 ######################################## 2026-02-24T09:04:42.759 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial159.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2026-02-24T09:04:42.759 DEBUG:teuthology.orchestra.run.trial159:> rpm -qlp /tmp/kernel.x86_64.rpm 2026-02-24T09:04:42.787 INFO:teuthology.orchestra.run.trial159.stdout:/boot/System.map-6.19.0-g8dec4b357aab 2026-02-24T09:04:42.787 INFO:teuthology.orchestra.run.trial159.stdout:/boot/config-6.19.0-g8dec4b357aab 2026-02-24T09:04:42.787 INFO:teuthology.orchestra.run.trial159.stdout:/boot/vmlinuz-6.19.0-g8dec4b357aab 2026-02-24T09:04:42.787 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab 2026-02-24T09:04:42.787 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/System.map 2026-02-24T09:04:42.787 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/config 2026-02-24T09:04:42.787 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel 2026-02-24T09:04:42.787 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch 2026-02-24T09:04:42.787 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86 2026-02-24T09:04:42.787 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto 2026-02-24T09:04:42.787 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/blowfish-x86_64.ko 2026-02-24T09:04:42.787 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2026-02-24T09:04:42.787 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2026-02-24T09:04:42.787 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/camellia-x86_64.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/serpent-avx2.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/twofish-x86_64.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel/cpu 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel/cpu/mce 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm/kvm-amd.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm/kvm-intel.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm/kvm.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/anubis.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/arc4.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_memcpy.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_pq.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_raid6_recov.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_tx.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_xor.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/raid6test.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/authenc.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/authencesn.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/blake2b.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/blowfish_common.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/blowfish_generic.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/camellia_generic.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cast5_generic.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cast6_generic.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cast_common.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/ccm.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cmac.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/crc32-cryptoapi.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/crypto_engine.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/crypto_user.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/des_generic.ko 2026-02-24T09:04:42.788 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/dh_generic.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/echainiv.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/essiv.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/fcrypt.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/khazad.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/krb5 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/krb5/krb5.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/krb5enc.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/lz4.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/lz4hc.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/md4.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/michael_mic.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/pcbc.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/pcrypt.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/rmd160.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/seed.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/serpent_generic.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/tea.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/twofish_common.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/twofish_generic.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/wp512.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/xcbc.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/xor.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/xxhash_generic.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/acpi_ipmi.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/acpi_pad.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/ec_sys.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/platform_profile.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/sbs.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/sbshc.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/video.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/acard-ahci.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/ahci_platform.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/ata_generic.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/libahci_platform.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_acpi.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ali.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_amd.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_artop.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_atiixp.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_atp867x.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_cmd640.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_cmd64x.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_cypress.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_efar.ko 2026-02-24T09:04:42.789 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt366.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt37x.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt3x2n.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt3x3.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_it8213.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_it821x.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_jmicron.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_marvell.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_mpiix.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_netcell.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ninja32.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ns87410.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ns87415.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_oldpiix.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_opti.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_optidma.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_pcmcia.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_pdc2027x.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_pdc202xx_old.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_piccolo.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_rdc.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sch.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_serverworks.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sil680.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sis.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sl82c105.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_triflex.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_via.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pdc_adma.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_inic162x.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_mv.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_nv.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_promise.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_qstor.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sil.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sil24.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sis.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_svw.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sx4.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_uli.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_via.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_vsc.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/auxdisplay 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/auxdisplay/ks0108.ko 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base/regmap 2026-02-24T09:04:42.790 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base/regmap/regmap-i2c.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base/regmap/regmap-mmio.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/bcma 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/bcma/bcma.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/aoe 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/aoe/aoe.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/brd.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/drbd 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/drbd/drbd.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/floppy.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/loop.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/mtip32xx 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/mtip32xx/mtip32xx.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/nbd.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/null_blk 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/null_blk/null_blk.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/rbd.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/virtio_blk.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/xen-blkback 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/xen-blkback/xen-blkback.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/xen-blkfront.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/zram 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/zram/zram.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hangcheck-timer.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/amd-rng.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/intel-rng.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/timeriomem-rng.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/via-rng.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/virtio-rng.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_devintf.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_si.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_ssif.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/lp.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/mwave 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/mwave/mwave.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ppdev.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tlclk.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_atmel.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_infineon.ko 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_nsc.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_tis.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_tis_core.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/uv_mmtimer.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/virtio_console.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/acpi-cpufreq.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/p4-clockmod.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/pcc-cpufreq.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/powernow-k8.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/speedstep-lib.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/ccp 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/ccp/ccp-crypto.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/ccp/ccp.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_common 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/padlock-aes.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/padlock-sha.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/virtio 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/virtio/virtio_crypto.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dca 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dca/dca.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/devfreq 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/devfreq/governor_simpleondemand.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/dw 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/dw/dw_dmac.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/ioat 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/ioat/ioatdma.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/amd64_edac.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/e752x_edac.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/edac_mce_amd.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i3000_edac.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i3200_edac.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i5100_edac.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i5400_edac.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i7300_edac.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i7core_edac.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i82975x_edac.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/ie31200_edac.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/sb_edac.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/x38_edac.ko 2026-02-24T09:04:42.792 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/firmware 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/firmware/edd.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/firmware/iscsi_ibft.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/gpio 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/gpio/gpio-ich.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/gpio/gpio-viperboard.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-appleir.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-aureal.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-axff.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-dr.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-elecom.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-elo.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-emsff.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-gaff.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-gt683r.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-gyration.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-holtek-kbd.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-holtek-mouse.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-holtekff.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-icade.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-keytouch.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-kye.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-lcpower.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-led.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-lenovo.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-multitouch.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-ortek.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-penmount.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-petalynx.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-picolcd.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-pl.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-plantronics.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-primax.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-rmi.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-arvo.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-common.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-isku.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-kone.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-koneplus.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-konepure.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-kovaplus.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-lua.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-pyra.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-ryos.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-savu.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat.ko 2026-02-24T09:04:42.793 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-saitek.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-samsung.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sensor-hub.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sjoy.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sony.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-speedlink.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-steelseries.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sunplus.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-thrustmaster.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-tivo.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-tmff.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-topseed.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-twinhan.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-uclogic.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-waltop.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-wiimote.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-xinmo.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-zpff.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-zydacron.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/uhid.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/wacom.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/abituguru.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/abituguru3.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/acpi_power_meter.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ad7414.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ad7418.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adc128d818.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1025.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1026.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1029.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1031.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm9240.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ads7828.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7410.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7411.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7462.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7470.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7475.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7x10.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/amc6821.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/applesmc.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/asb100.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/asc7621.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/asus_atk0110.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/atxp1.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/coretemp.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/dell-smm-hwmon.ko 2026-02-24T09:04:42.794 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/dme1737.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ds1621.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ds620.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/emc1403.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/emc6w201.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/f71805f.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/f71882fg.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/f75375s.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/fam15h_power.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/fschmd.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/g760a.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/g762.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/gl518sm.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/gl520sm.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/hwmon-vid.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/i5500_temp.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/i5k_amb.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ibmaem.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ibmpex.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ina209.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ina2xx.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/it87.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/k10temp.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/k8temp.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lineage-pem.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm63.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm73.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm75.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm77.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm78.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm80.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm83.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm85.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm87.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm90.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm92.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm93.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm95234.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm95241.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm95245.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc2945.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4151.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4215.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4222.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4245.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4260.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4261.ko 2026-02-24T09:04:42.795 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max16065.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max1619.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max1668.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max197.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max6639.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max6650.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max6697.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/mcp3021.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct6683.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct6775-core.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct6775.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct7802.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pc87360.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pc87427.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pcf8591.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/adm1275.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/lm25066.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/ltc2978.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/max16064.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/max34440.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/max8688.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/pmbus.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/tps40422.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/ucd9000.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/ucd9200.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/zl6100.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/powr1220.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sch5627.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sch5636.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sch56xx-common.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sht15.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sht21.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/shtc1.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sis5595.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/smsc47b397.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/smsc47m1.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/smsc47m192.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/thmc50.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp102.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp103.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp401.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp421.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/via-cputemp.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/via686a.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/vt1211.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/vt8231.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83627ehf.ko 2026-02-24T09:04:42.796 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83627hf.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83781d.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83791d.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83792d.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83793.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83795.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83l785ts.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83l786ng.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/algos 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-amd756.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-amd8111.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-designware-core.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-i801.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-isch.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-ismt.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-nforce2.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-parport.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-piix4.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-scmi.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-simtec.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-sis96x.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-via.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-viapro.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-viperboard.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-dev.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-mux.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-slave-eeprom.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-smbus.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-stub.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_cm.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_core.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_umad.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_uverbs.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/iw_cm.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/rdma_cm.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/rdma_ucm.ko 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/cxgb4 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx4 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx5 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mthca 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/ipoib 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/iser 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/isert 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srp 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srpt 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport/emu10k1-gp.ko 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport/fm801-gp.ko 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport/gameport.ko 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/joydev.ko 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/keyboard 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/keyboard/gpio_keys.ko 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/appletouch.ko 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/bcm5974.ko 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/cyapatp.ko 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/elan_i2c.ko 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/sermouse.ko 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/synaptics_i2c.ko 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/synaptics_usb.ko 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/vsxxxaa.ko 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/rmi4 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/rmi4/rmi_core.ko 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio/altera_ps2.ko 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio/arc_ps2.ko 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio/serio_raw.ko 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/sparse-keymap.ko 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-blinkm.ko 2026-02-24T09:04:42.798 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-lm3530.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-lp3944.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-ss4200.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-camera.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-timer.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-transient.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/bcache 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/bcache/bcache.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-bio-prison.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-cache-smq.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-cache.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-crypt.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-delay.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-flakey.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-log-userspace.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-multipath.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-queue-length.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-raid.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-round-robin.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-service-time.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-switch.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-thin-pool.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-verity.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/linear.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/persistent-data 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid0.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid1.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid10.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid456.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptbase.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptctl.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptfc.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptlan.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptsas.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptscsih.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptspi.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/lpc_ich.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/lpc_sch.ko 2026-02-24T09:04:42.799 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/mfd-core.ko 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/sm501.ko 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/viperboard.ko 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/vx855.ko 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/altera-stapl 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/apds9802als.ko 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/apds990x.ko 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/bh1770glc.ko 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/cb710 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/cb710/cb710.ko 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/eeprom 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/eeprom/at24.ko 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/eeprom/max6875.ko 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/enclosure.ko 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/hpilo.ko 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/isl29003.ko 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/isl29020.ko 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/lis3lv02d 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei/mei-me.ko 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei/mei-txe.ko 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei/mei.ko 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-gru 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-gru/gru.ko 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp/xp.ko 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp/xpc.ko 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp/xpnet.ko 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/tifm_7xx1.ko 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/tifm_core.ko 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/tsl2550.ko 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/vmw_balloon.ko 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/vmw_vmci 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/bonding 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/bonding/bonding.ko 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/b53 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/b53/b53_common.ko 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/bcm-sf2.ko 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/mv88e6060.ko 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/mv88e6xxx 2026-02-24T09:04:42.800 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dummy.ko 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/eql.ko 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/3c59x.ko 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/typhoon.ko 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/8390.ko 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/adaptec 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/adaptec/starfire.ko 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/agere 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/agere/et131x.ko 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/alteon 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/alteon/acenic.ko 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/altera 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/altera/altera_tse.ko 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd/amd8111e.ko 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd/pcnet32.ko 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/alx 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1c 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1e 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atlx 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/b44.ko 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/bnx2x 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/cnic.ko 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/genet 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/tg3.ko 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/brocade 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/brocade/bna 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio 2026-02-24T09:04:42.801 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb3 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/libcxgb 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/cisco 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/cisco/enic 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dlink 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dlink/dl2k.ko 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dlink/sundance.ko 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dnet.ko 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/emulex 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/emulex/benet 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/ethoc.ko 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/fealnx.ko 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e100.ko 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000e 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/fm10k 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/i40e 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/iavf 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ice 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ice/ice.ko 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igb 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igb/igb.ko 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igbvf 2026-02-24T09:04:42.802 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbe 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbevf 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libeth 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libeth/libeth_xdp.ko 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie/libie.ko 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie/libie_adminq.ko 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie/libie_fwlog.ko 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/jme.ko 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell/skge.ko 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell/sky2.ko 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx4 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx5 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx5/core 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/micrel 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/myricom 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/myricom/myri10ge 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/natsemi 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/neterion 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/neterion/s2io.ko 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/nvidia 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/packetengines 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/netxen 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/qlcnic 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rdc 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rdc/r6040.ko 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/8139cp.ko 2026-02-24T09:04:42.803 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/8139too.ko 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/atp.ko 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/r8169.ko 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rocker 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rocker/rocker.ko 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sfc 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sfc/sfc.ko 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/silan 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/silan/sc92031.ko 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sis 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sis/sis190.ko 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sis/sis900.ko 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/epic100.ko 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro/stmmac 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/cassini.ko 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/niu.ko 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/sungem.ko 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/sunhme.ko 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/tehuti 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/ti 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/ti/tlan.ko 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/via 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/via/via-rhine.ko 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/via/via-velocity.ko 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/wiznet 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/wiznet/w5100.ko 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/wiznet/w5300.ko 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/xircom 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/geneve.ko 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ieee802154 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ieee802154/fakelb.ko 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ifb.ko 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ipvlan 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ipvlan/ipvlan.ko 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/macvlan.ko 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/macvtap.ko 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio.ko 2026-02-24T09:04:42.804 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio/mdio-bitbang.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio/mdio-regmap.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mii.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/net_failover.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/netconsole.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/nlmon.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/pcs 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/pcs/pcs-lynx.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/pcs/pcs_xpcs.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/amd.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm-phy-lib.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm-phy-ptp.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm7xxx.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm87xx.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/broadcom.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/cicada.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/davicom.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/dp83640.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/et1011c.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/icplus.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/lxt.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/marvell.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/micrel.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/national.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/phy_package.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/phylink.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/qsemi.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/realtek 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/realtek/realtek.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/smsc.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/ste10Xp.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/vitesse.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/bsd_comp.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_async.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_deflate.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_generic.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_mppe.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_synctty.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/pppoe.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/pppox.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/pptp.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/slip 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/slip/slhc.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/slip/slip.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/sungem_phy.ko 2026-02-24T09:04:42.805 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/tap.ko 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team.ko 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_activebackup.ko 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_broadcast.ko 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_loadbalance.ko 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_random.ko 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_roundrobin.ko 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/tun.ko 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/veth.ko 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/virtio_net.ko 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vmxnet3 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vmxnet3/vmxnet3.ko 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vxlan 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vxlan/vxlan.ko 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/xen-netback 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/xen-netback/xen-netback.ko 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/xen-netfront.ko 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ntb 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ntb/ntb.ko 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme/host 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme/host/nvme-core.ko 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme/host/nvme.ko 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport.ko 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport_cs.ko 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport_pc.ko 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport_serial.ko 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/hotplug 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/pcie 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/pcie/aer_inject.ko 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/xen-pcifront.ko 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia/i82092.ko 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia/pd6729.ko 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia/yenta_socket.ko 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pinctrl 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pinctrl/intel 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/wmi 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/wmi/wmi.ko 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/acer-wmi.ko 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/acerhdf.ko 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/apple-gmux.ko 2026-02-24T09:04:42.806 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/asus-laptop.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/asus-nb-wmi.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/asus-wmi.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/classmate-laptop.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/eeepc-laptop.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/eeepc-wmi.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/fujitsu-laptop.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/fujitsu-tablet.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/hdaps.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/intel 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/intel/intel-rst.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/intel_ips.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/msi-wmi.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/mxm-wmi.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/panasonic-laptop.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/samsung-laptop.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/samsung-q10.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/topstar-laptop.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/toshiba_haps.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/wmi-bmof.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/powercap 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/powercap/intel_rapl_common.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/powercap/intel_rapl_msr.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients/pps-gpio.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients/pps-ldisc.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients/pps_parport.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/pps_core.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp/ptp.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp/ptp_kvm.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp/ptp_vmclock.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd/atl 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd/atl/amd_atl.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd/fmpm.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-bq32k.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1286.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1307.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1374.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1511.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1553.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1672.ko 2026-02-24T09:04:42.807 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1742.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds2404.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds3232.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-em3027.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-fm3130.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-isl12022.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-isl1208.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-m41t80.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-m48t35.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-m48t59.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-max6900.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-msm6242.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf2127.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf85063.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf8523.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf8563.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf8583.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rp5c01.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rs5c372.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rv3029c2.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rx8025.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rx8581.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-stk17ta8.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-x1205.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/3w-9xxx.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/3w-sas.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/3w-xxxx.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/BusLogic.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/a100u2w.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aacraid 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aacraid/aacraid.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/advansys.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aic7xxx 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/am53c974.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/arcmsr 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/arcmsr/arcmsr.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/atp870u.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/be2iscsi 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bfa 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bfa/bfa.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2fc 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2i 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2i/bnx2i.ko 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ch.ko 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/csiostor 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/csiostor/csiostor.ko 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb3i 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb4i 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/dc395x.ko 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/dmx3191d.ko 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/esas2r 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/esas2r/esas2r.ko 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/esp_scsi.ko 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fcoe 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fcoe/fcoe.ko 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fcoe/libfcoe.ko 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fnic 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fnic/fnic.ko 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/hpsa.ko 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/hptiop.ko 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/initio.ko 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ipr.ko 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ips.ko 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/isci 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/isci/isci.ko 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/iscsi_tcp.ko 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libfc 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libfc/libfc.ko 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libiscsi.ko 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libiscsi_tcp.ko 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libsas 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libsas/libsas.ko 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/lpfc 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/lpfc/lpfc.ko 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid.ko 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mpt3sas 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mvsas 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mvsas/mvsas.ko 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mvumi.ko 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/pm8001 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/pm8001/pm80xx.ko 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/pmcraid.ko 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla1280.ko 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla2xxx 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla4xxx 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/raid_class.ko 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_debug.ko 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_fc.ko 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_iscsi.ko 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_sas.ko 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_spi.ko 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_srp.ko 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ses.ko 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/st.ko 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/stex.ko 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/sym53c8xx_2 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/virtio_scsi.ko 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/vmw_pvscsi.ko 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/wd719x.ko 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ssb 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ssb/ssb.ko 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/iscsi 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/loopback 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/loopback/tcm_loop.ko 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_file.ko 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_iblock.ko 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_mod.ko 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_pscsi.ko 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_user.ko 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/tcm_fc 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/tcm_fc/tcm_fc.ko 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2026-02-24T09:04:42.810 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/platform_temperature_control.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_soc_slider.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/ipwireless 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/ipwireless/ipwireless.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/n_gsm.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/n_hdlc.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/nozomi.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/8250 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/8250/serial_cs.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/arc_uart.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/jsm 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/jsm/jsm.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/core 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/core/ufshcd-core.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/host 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/host/ufshcd-pci.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_aec.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_cif.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_pci_generic.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_sercos3.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/cdc-acm.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/cdc-wdm.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/usblp.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/usbtmc.ko 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/host 2026-02-24T09:04:42.811 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/host/sl811-hcd.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/image 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/image/mdc800.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/image/microtek.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/adutux.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/appledisplay.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/emi26.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/emi62.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/ezusb.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/idmouse.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/iowarrior.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/isight_firmware.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/ldusb.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/legousbtower.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/sisusbvga 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/trancevibrator.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/usb3503.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/usblcd.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/usbsevseg.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/uss720.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/yurex.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/phy 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/phy/phy-generic.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/aircable.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ark3116.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/belkin_sa.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ch341.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/cp210x.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/cyberjack.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/cypress_m8.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/digi_acceleport.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/empeg.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ftdi_sio.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/garmin_gps.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/io_edgeport.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/io_ti.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ipaq.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ipw.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ir-usb.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/iuu_phoenix.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/keyspan.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/keyspan_pda.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/kl5kusb105.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/kobil_sct.ko 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/mct_u232.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/mos7720.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/mos7840.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/navman.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/omninet.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/opticon.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/option.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/oti6858.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/pl2303.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/qcaux.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/qcserial.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/quatech2.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/safe_serial.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/sierra.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/spcp8x5.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ssu100.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/symbolserial.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/usb-serial-simple.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/usb_debug.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/usb_wwan.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/visor.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/whiteheat.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/xsens_mt.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/uas.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-alauda.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-cypress.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-datafab.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-eneub6250.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-freecom.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-isd200.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-jumpshot.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-karma.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-onetouch.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-realtek.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-sddr09.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-sddr55.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-usbat.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/usb-storage.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip/usbip-core.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip/usbip-host.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip/vhci-hcd.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/pci 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/pci/vfio-pci-core.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/pci/vfio-pci.ko 2026-02-24T09:04:42.813 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/vfio.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/vfio_iommu_type1.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost_iotlb.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost_net.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost_scsi.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight/apple_bl.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight/lcd.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight/platform_lcd.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_balloon.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_mmio.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_pci.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_ring.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/masters 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/masters/ds2482.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/masters/ds2490.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2406.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2408.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2413.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2423.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2431.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2433.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2780.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2781.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds28e04.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_smem.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_therm.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/wire.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/alim1535_wdt.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/alim7101_wdt.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/f71808e_wdt.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/hpwdt.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/i6300esb.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/iTCO_vendor_support.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/iTCO_wdt.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/ib700wdt.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/ibmasr.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/ie6xx_wdt.ko 2026-02-24T09:04:42.814 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/it8712f_wdt.ko 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/it87_wdt.ko 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/machzwd.ko 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/nv_tco.ko 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/pcwd_pci.ko 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/pcwd_usb.ko 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/sch311x_wdt.ko 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/softdog.ko 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/sp5100_tco.ko 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/via_wdt.ko 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/w83627hf_wdt.ko 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/w83877f_wdt.ko 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/w83977f_wdt.ko 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/wdt_pci.ko 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/xen_wdt.ko 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-acpi-processor.ko 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-evtchn.ko 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-gntalloc.ko 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-gntdev.ko 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-pciback 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-privcmd.ko 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xenfs 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xenfs/xenfs.ko 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/9p 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/9p/9p.ko 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/affs 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/affs/affs.ko 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/befs 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/befs/befs.ko 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/binfmt_misc.ko 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/btrfs 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/btrfs/btrfs.ko 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cachefiles 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cachefiles/cachefiles.ko 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ceph 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ceph/ceph.ko 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/coda 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/coda/coda.ko 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cramfs 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cramfs/cramfs.ko 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/dlm 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/dlm/dlm.ko 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ecryptfs 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ecryptfs/ecryptfs.ko 2026-02-24T09:04:42.815 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/f2fs 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/f2fs/f2fs.ko 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat/fat.ko 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat/msdos.ko 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat/vfat.ko 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fuse 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fuse/cuse.ko 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fuse/fuse.ko 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/gfs2 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/gfs2/gfs2.ko 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfs 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfs/hfs.ko 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfsplus 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfsplus/hfsplus.ko 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/isofs 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/isofs/isofs.ko 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/jfs 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/jfs/jfs.ko 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/lockd 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/lockd/lockd.ko 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/minix 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/minix/minix.ko 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/netfs 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/netfs/netfs.ko 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/blocklayout 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/filelayout 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/flexfilelayout 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/nfs.ko 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/nfsv3.ko 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/nfsv4.ko 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs_common 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs_common/grace.ko 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs_common/nfs_acl.ko 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfsd 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfsd/nfsd.ko 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nilfs2 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nilfs2/nilfs2.ko 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-celtic.ko 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-centeuro.ko 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-croatian.ko 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-cyrillic.ko 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-gaelic.ko 2026-02-24T09:04:42.816 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-greek.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-iceland.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-inuit.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-roman.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-romanian.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-turkish.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp1250.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp1251.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp1255.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp737.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp775.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp850.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp852.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp855.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp857.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp860.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp861.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp862.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp863.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp864.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp865.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp866.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp869.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp874.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp932.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp936.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp949.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp950.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_euc-jp.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-1.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-13.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-14.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-15.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-2.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-3.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-4.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-5.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-6.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-7.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-9.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_koi8-r.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_koi8-ru.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_koi8-u.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_ucs2_utils.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_utf8.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/cluster 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlm 2026-02-24T09:04:42.817 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlmfs 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2.ko 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2_stack_user.ko 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2_stackglue.ko 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/overlayfs 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/overlayfs/overlay.ko 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/pstore 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/pstore/ramoops.ko 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/romfs 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/romfs/romfs.ko 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/client 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/client/cifs.ko 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/common 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/common/cifs_md4.ko 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/squashfs 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/squashfs/squashfs.ko 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/udf 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/udf/udf.ko 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ufs 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ufs/ufs.ko 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/xfs 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/xfs/xfs.ko 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/rcu 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/rcu/rcutorture.ko 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/torture.ko 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/trace 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/trace/ring_buffer_benchmark.ko 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/asn1_encoder.ko 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crc 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crc/crc-itu-t.ko 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crc/crc8.ko 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto/libarc4.ko 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto/libblake2b.ko 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto/libdes.ko 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lru_cache.ko 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lz4 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lz4/lz4_compress.ko 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lz4/lz4hc_compress.ko 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/math 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/math/cordic.ko 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/raid6 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/raid6/raid6_pq.ko 2026-02-24T09:04:42.818 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/reed_solomon 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/reed_solomon/reed_solomon.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/ts_bm.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/ts_fsm.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/ts_kmp.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/zstd 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/zstd/zstd_compress.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/mm 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/mm/hwpoison-inject.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/6lowpan.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_dest.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_fragment.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_hop.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_ipv6.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_mobility.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_routing.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_udp.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/garp.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/mrp.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/psnap.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/stp.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/8021q 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/8021q/8021q.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet_fd.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet_rdma.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet_virtio.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/batman-adv 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/batman-adv/batman-adv.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/br_netfilter.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/bridge.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_802_3.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_among.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_arp.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_arpreply.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_dnat.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_ip.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_ip6.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_limit.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_log.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_mark.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_mark_m.ko 2026-02-24T09:04:42.819 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_nflog.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_pkttype.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_redirect.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_snat.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_stp.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_vlan.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ceph 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ceph/libceph.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/core 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/core/failover.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/core/pktgen.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dns_resolver 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dns_resolver/dns_resolver.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/dsa_core.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_brcm.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_dsa.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_none.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_trailer.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/6lowpan 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/ieee802154.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/ieee802154_socket.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ah4.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/esp4.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/fou.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/gre.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/inet_diag.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ip_gre.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ip_tunnel.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ip_vti.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ipcomp.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ipip.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/arpt_mangle.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_ECN.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_ah.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_bic.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_dctcp.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_diag.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_highspeed.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_htcp.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_hybla.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_illinois.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_lp.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_scalable.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_vegas.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_veno.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_westwood.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_yeah.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tunnel4.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/udp_diag.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/udp_tunnel.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/xfrm4_tunnel.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ah6.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/esp6.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/fou6.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ip6_tunnel.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ip6_udp_tunnel.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ip6_vti.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ipcomp6.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_ah.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_frag.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_mh.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_rt.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/sit.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/tunnel6.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/xfrm6_tunnel.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/key 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/key/af_key.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_core.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_debugfs.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_eth.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_ip.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_ip6.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_netlink.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_ppp.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/llc 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/llc/llc.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mac802154 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mac802154/mac802154.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mpls 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mpls/mpls_gso.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_list_set.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2026-02-24T09:04:42.822 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conncount.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_amanda.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_broadcast.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_ftp.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_h323.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_irc.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_netlink.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_pptp.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_sane.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_sip.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_snmp.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_tftp.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_dup_netdev.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_flow_table.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_flow_table_inet.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_log_syslog.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_amanda.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_ftp.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_irc.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_sip.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_tftp.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_synproxy_core.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_tables.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_acct.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_log.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_osf.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_queue.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_chain_nat.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_compat.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_ct.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_dup_netdev.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_fib.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_fwd_netdev.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_hash.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_limit.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_log.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_masq.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_nat.ko 2026-02-24T09:04:42.823 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_numgen.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_queue.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_quota.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_redir.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_reject.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_reject_inet.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_socket.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_tunnel.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_AUDIT.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CHECKSUM.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CLASSIFY.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CONNSECMARK.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CT.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_DSCP.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_HL.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_HMARK.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_IDLETIMER.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_LED.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_LOG.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_MASQUERADE.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_NETMAP.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_NFLOG.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_NFQUEUE.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_RATEEST.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_REDIRECT.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_SECMARK.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TCPMSS.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TEE.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TPROXY.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_addrtype.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_bpf.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_cgroup.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_cluster.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_comment.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connbytes.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connlabel.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connlimit.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connmark.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_conntrack.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_cpu.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_dccp.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_devgroup.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_dscp.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_ecn.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_esp.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_hashlimit.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_helper.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_hl.ko 2026-02-24T09:04:42.824 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_ipcomp.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_iprange.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_ipvs.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_l2tp.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_length.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_limit.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_mac.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_mark.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_multiport.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_nat.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_nfacct.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_osf.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_owner.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_physdev.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_pkttype.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_policy.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_quota.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_rateest.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_realm.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_recent.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_sctp.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_set.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_socket.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_state.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_statistic.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_string.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_tcpmss.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_time.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_u32.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netlink 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netlink/netlink_diag.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/nsh 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/nsh/nsh.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/openvswitch.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/vport-geneve.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/vport-gre.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/vport-vxlan.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/packet 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/packet/af_packet_diag.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds/rds.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds/rds_rdma.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds/rds_tcp.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_csum.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_gact.ko 2026-02-24T09:04:42.825 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_mirred.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_nat.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_pedit.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_police.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_simple.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_skbedit.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_vlan.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_basic.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_bpf.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_flow.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_fw.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_route.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_u32.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_cmp.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_ipset.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_meta.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_nbyte.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_text.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_u32.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_choke.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_codel.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_drr.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_fq.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_gred.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_hfsc.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_hhf.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_htb.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_ingress.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_mqprio.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_mqprio_lib.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_multiq.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_netem.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_pie.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_plug.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_prio.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_qfq.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_red.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_sfb.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_sfq.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_tbf.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_teql.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sctp 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sctp/sctp.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sctp/sctp_diag.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/auth_gss 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2026-02-24T09:04:42.826 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/sunrpc.ko 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/xprtrdma 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/tipc 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/tipc/tipc.ko 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/tipc/tipc_diag.ko 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/unix 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/unix/unix_diag.ko 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vsock.ko 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vsock_diag.ko 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vsock_loopback.ko 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/xfrm 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/xfrm/xfrm_ipcomp.ko 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/encrypted-keys 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/trusted-keys 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/trusted-keys/trusted.ko 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/virt 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/virt/lib 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/virt/lib/irqbypass.ko 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.alias 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.alias.bin 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin.alias.bin 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin.bin 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin.modinfo 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.dep 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.dep.bin 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.devname 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.order 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.softdep 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.symbols 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.symbols.bin 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.weakdep 2026-02-24T09:04:42.827 INFO:teuthology.orchestra.run.trial159.stdout:/lib/modules/6.19.0-g8dec4b357aab/vmlinuz 2026-02-24T09:04:42.830 DEBUG:teuthology.task.kernel:get_image_version: 6.19.0-g8dec4b357aab 2026-02-24T09:04:42.830 DEBUG:teuthology.orchestra.run.trial159:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2026-02-24T09:04:42.850 INFO:teuthology.orchestra.run.trial159.stdout:postinstall scriptlet (using /bin/sh): 2026-02-24T09:04:42.850 INFO:teuthology.orchestra.run.trial159.stdout:if [ -x /usr/bin/kernel-install ]; then 2026-02-24T09:04:42.850 INFO:teuthology.orchestra.run.trial159.stdout: /usr/bin/kernel-install add 6.19.0-g8dec4b357aab /lib/modules/6.19.0-g8dec4b357aab/vmlinuz 2026-02-24T09:04:42.850 INFO:teuthology.orchestra.run.trial159.stdout:fi 2026-02-24T09:04:42.850 INFO:teuthology.orchestra.run.trial159.stdout:for file in vmlinuz System.map config; do 2026-02-24T09:04:42.850 INFO:teuthology.orchestra.run.trial159.stdout: if ! cmp --silent "/lib/modules/6.19.0-g8dec4b357aab/${file}" "/boot/${file}-6.19.0-g8dec4b357aab"; then 2026-02-24T09:04:42.850 INFO:teuthology.orchestra.run.trial159.stdout: cp "/lib/modules/6.19.0-g8dec4b357aab/${file}" "/boot/${file}-6.19.0-g8dec4b357aab" 2026-02-24T09:04:42.850 INFO:teuthology.orchestra.run.trial159.stdout: fi 2026-02-24T09:04:42.850 INFO:teuthology.orchestra.run.trial159.stdout:done 2026-02-24T09:04:42.850 INFO:teuthology.orchestra.run.trial159.stdout:if [ -d "/lib/modules/6.19.0-g8dec4b357aab/dtb" ] && \ 2026-02-24T09:04:42.850 INFO:teuthology.orchestra.run.trial159.stdout: ! diff -rq "/lib/modules/6.19.0-g8dec4b357aab/dtb" "/boot/dtb-6.19.0-g8dec4b357aab" >/dev/null 2>&1; then 2026-02-24T09:04:42.850 INFO:teuthology.orchestra.run.trial159.stdout: rm -rf "/boot/dtb-6.19.0-g8dec4b357aab" 2026-02-24T09:04:42.850 INFO:teuthology.orchestra.run.trial159.stdout: cp -r "/lib/modules/6.19.0-g8dec4b357aab/dtb" "/boot/dtb-6.19.0-g8dec4b357aab" 2026-02-24T09:04:42.850 INFO:teuthology.orchestra.run.trial159.stdout:fi 2026-02-24T09:04:42.850 INFO:teuthology.orchestra.run.trial159.stdout:if [ ! -e "/lib/modules/6.19.0-g8dec4b357aab/modules.dep" ]; then 2026-02-24T09:04:42.850 INFO:teuthology.orchestra.run.trial159.stdout: /usr/sbin/depmod 6.19.0-g8dec4b357aab 2026-02-24T09:04:42.850 INFO:teuthology.orchestra.run.trial159.stdout:fi 2026-02-24T09:04:42.850 INFO:teuthology.orchestra.run.trial159.stdout:preuninstall scriptlet (using /bin/sh): 2026-02-24T09:04:42.850 INFO:teuthology.orchestra.run.trial159.stdout:if [ -x /usr/bin/kernel-install ]; then 2026-02-24T09:04:42.850 INFO:teuthology.orchestra.run.trial159.stdout:kernel-install remove 6.19.0-g8dec4b357aab 2026-02-24T09:04:42.850 INFO:teuthology.orchestra.run.trial159.stdout:fi 2026-02-24T09:04:42.851 DEBUG:teuthology.orchestra.run.trial159:> sudo rpm -qi grub2-tools 2026-02-24T09:04:42.918 INFO:teuthology.orchestra.run.trial159.stdout:Name : grub2-tools 2026-02-24T09:04:42.918 INFO:teuthology.orchestra.run.trial159.stdout:Epoch : 1 2026-02-24T09:04:42.919 INFO:teuthology.orchestra.run.trial159.stdout:Version : 2.06 2026-02-24T09:04:42.919 INFO:teuthology.orchestra.run.trial159.stdout:Release : 120.el9 2026-02-24T09:04:42.919 INFO:teuthology.orchestra.run.trial159.stdout:Architecture: x86_64 2026-02-24T09:04:42.919 INFO:teuthology.orchestra.run.trial159.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-24T09:04:42.919 INFO:teuthology.orchestra.run.trial159.stdout:Group : Unspecified 2026-02-24T09:04:42.919 INFO:teuthology.orchestra.run.trial159.stdout:Size : 9108611 2026-02-24T09:04:42.919 INFO:teuthology.orchestra.run.trial159.stdout:License : GPLv3+ 2026-02-24T09:04:42.919 INFO:teuthology.orchestra.run.trial159.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-24T09:04:42.919 INFO:teuthology.orchestra.run.trial159.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-24T09:04:42.919 INFO:teuthology.orchestra.run.trial159.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-24T09:04:42.919 INFO:teuthology.orchestra.run.trial159.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-24T09:04:42.919 INFO:teuthology.orchestra.run.trial159.stdout:Packager : builder@centos.org 2026-02-24T09:04:42.919 INFO:teuthology.orchestra.run.trial159.stdout:Vendor : CentOS 2026-02-24T09:04:42.919 INFO:teuthology.orchestra.run.trial159.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-24T09:04:42.919 INFO:teuthology.orchestra.run.trial159.stdout:Summary : Support tools for GRUB. 2026-02-24T09:04:42.919 INFO:teuthology.orchestra.run.trial159.stdout:Description : 2026-02-24T09:04:42.919 INFO:teuthology.orchestra.run.trial159.stdout: 2026-02-24T09:04:42.919 INFO:teuthology.orchestra.run.trial159.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-24T09:04:42.919 INFO:teuthology.orchestra.run.trial159.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-24T09:04:42.919 INFO:teuthology.orchestra.run.trial159.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-24T09:04:42.919 INFO:teuthology.orchestra.run.trial159.stdout:hardware devices. 2026-02-24T09:04:42.919 INFO:teuthology.orchestra.run.trial159.stdout: 2026-02-24T09:04:42.919 INFO:teuthology.orchestra.run.trial159.stdout:This subpackage provides tools for support of all platforms. 2026-02-24T09:04:42.920 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-24T09:04:42.920 INFO:teuthology.task.kernel:Updating grub on trial159 to boot 6.19.0-g8dec4b357aab 2026-02-24T09:04:42.920 DEBUG:teuthology.orchestra.run.trial159:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-24T09:04:42.983 INFO:teuthology.orchestra.run.trial159.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-24T09:04:42.985 DEBUG:teuthology.orchestra.run.trial159:> sudo command -v grubby && echo yes || echo no 2026-02-24T09:04:43.048 INFO:teuthology.orchestra.run.trial159.stdout:/sbin/grubby 2026-02-24T09:04:43.049 INFO:teuthology.orchestra.run.trial159.stdout:yes 2026-02-24T09:04:43.049 DEBUG:teuthology.orchestra.run.trial159:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.19.0-g8dec4b357aab" | head -n 1 2026-02-24T09:04:43.112 INFO:teuthology.orchestra.run.trial159.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-6.19.0-g8dec4b357aab.conf 2026-02-24T09:04:43.112 DEBUG:teuthology.orchestra.run.trial159:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-6.19.0-g8dec4b357aab 2026-02-24T09:04:43.187 DEBUG:teuthology.orchestra.run.trial159:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-24T09:04:43.392 INFO:teuthology.orchestra.run.trial159.stderr:Generating grub configuration file ... 2026-02-24T09:04:43.460 INFO:teuthology.orchestra.run.trial159.stderr:Found linux image: /boot/vmlinuz-6.19.0-g8dec4b357aab 2026-02-24T09:04:43.467 INFO:teuthology.orchestra.run.trial159.stderr:Found initrd image: /boot/initramfs-6.19.0-g8dec4b357aab.img 2026-02-24T09:04:43.716 INFO:teuthology.orchestra.run.trial159.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-24T09:04:43.723 INFO:teuthology.orchestra.run.trial159.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-24T09:04:43.757 INFO:teuthology.orchestra.run.trial159.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-24T09:04:43.763 INFO:teuthology.orchestra.run.trial159.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-24T09:04:43.795 INFO:teuthology.orchestra.run.trial159.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-24T09:04:43.801 INFO:teuthology.orchestra.run.trial159.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-24T09:04:43.824 INFO:teuthology.orchestra.run.trial159.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-24T09:04:43.831 INFO:teuthology.orchestra.run.trial159.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-24T09:04:43.919 INFO:teuthology.orchestra.run.trial159.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-24T09:04:43.928 INFO:teuthology.orchestra.run.trial159.stderr:done 2026-02-24T09:04:43.930 DEBUG:teuthology.orchestra.run.trial159:> test -d /sys/firmware/efi 2026-02-24T09:04:43.947 DEBUG:teuthology.orchestra.run.trial159:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-24T09:04:44.012 INFO:teuthology.orchestra.run.trial159.stdout:/boot/efi/EFI/BOOT 2026-02-24T09:04:44.012 INFO:teuthology.orchestra.run.trial159.stdout:/boot/efi/EFI/centos 2026-02-24T09:04:44.014 DEBUG:teuthology.orchestra.run.trial159:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-24T09:04:44.081 INFO:teuthology.orchestra.run.trial159.stdout:no 2026-02-24T09:04:44.081 DEBUG:teuthology.orchestra.run.trial159:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-24T09:04:44.146 INFO:teuthology.orchestra.run.trial159.stdout:yes 2026-02-24T09:04:44.146 DEBUG:teuthology.orchestra.run.trial159:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-24T09:04:44.209 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial159 2026-02-24T09:04:44.210 DEBUG:teuthology.orchestra.run.trial159:> sudo bash -c ' 2026-02-24T09:04:44.210 DEBUG:teuthology.orchestra.run.trial159:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-24T09:04:44.210 DEBUG:teuthology.orchestra.run.trial159:> ' 2026-02-24T09:04:47.189 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial028.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2026-02-24T09:04:47.190 DEBUG:teuthology.orchestra.run.trial028:> rpm -qlp /tmp/kernel.x86_64.rpm 2026-02-24T09:04:47.236 INFO:teuthology.orchestra.run.trial028.stdout:/boot/System.map-6.19.0-g8dec4b357aab 2026-02-24T09:04:47.236 INFO:teuthology.orchestra.run.trial028.stdout:/boot/config-6.19.0-g8dec4b357aab 2026-02-24T09:04:47.236 INFO:teuthology.orchestra.run.trial028.stdout:/boot/vmlinuz-6.19.0-g8dec4b357aab 2026-02-24T09:04:47.236 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab 2026-02-24T09:04:47.237 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/System.map 2026-02-24T09:04:47.237 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/config 2026-02-24T09:04:47.237 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel 2026-02-24T09:04:47.237 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch 2026-02-24T09:04:47.237 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86 2026-02-24T09:04:47.237 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto 2026-02-24T09:04:47.237 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/blowfish-x86_64.ko 2026-02-24T09:04:47.237 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2026-02-24T09:04:47.237 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2026-02-24T09:04:47.237 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/camellia-x86_64.ko 2026-02-24T09:04:47.237 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2026-02-24T09:04:47.238 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2026-02-24T09:04:47.238 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2026-02-24T09:04:47.238 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2026-02-24T09:04:47.238 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2026-02-24T09:04:47.238 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/serpent-avx2.ko 2026-02-24T09:04:47.238 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2026-02-24T09:04:47.238 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2026-02-24T09:04:47.238 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2026-02-24T09:04:47.238 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/twofish-x86_64.ko 2026-02-24T09:04:47.238 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel 2026-02-24T09:04:47.238 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel/cpu 2026-02-24T09:04:47.238 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel/cpu/mce 2026-02-24T09:04:47.239 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2026-02-24T09:04:47.239 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm 2026-02-24T09:04:47.239 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm/kvm-amd.ko 2026-02-24T09:04:47.239 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm/kvm-intel.ko 2026-02-24T09:04:47.239 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm/kvm.ko 2026-02-24T09:04:47.239 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto 2026-02-24T09:04:47.239 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/anubis.ko 2026-02-24T09:04:47.239 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/arc4.ko 2026-02-24T09:04:47.239 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx 2026-02-24T09:04:47.239 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_memcpy.ko 2026-02-24T09:04:47.239 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_pq.ko 2026-02-24T09:04:47.239 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_raid6_recov.ko 2026-02-24T09:04:47.239 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_tx.ko 2026-02-24T09:04:47.240 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_xor.ko 2026-02-24T09:04:47.240 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/raid6test.ko 2026-02-24T09:04:47.240 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/authenc.ko 2026-02-24T09:04:47.240 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/authencesn.ko 2026-02-24T09:04:47.240 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/blake2b.ko 2026-02-24T09:04:47.240 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/blowfish_common.ko 2026-02-24T09:04:47.240 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/blowfish_generic.ko 2026-02-24T09:04:47.240 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/camellia_generic.ko 2026-02-24T09:04:47.240 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cast5_generic.ko 2026-02-24T09:04:47.240 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cast6_generic.ko 2026-02-24T09:04:47.240 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cast_common.ko 2026-02-24T09:04:47.241 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/ccm.ko 2026-02-24T09:04:47.241 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cmac.ko 2026-02-24T09:04:47.241 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/crc32-cryptoapi.ko 2026-02-24T09:04:47.241 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/crypto_engine.ko 2026-02-24T09:04:47.241 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/crypto_user.ko 2026-02-24T09:04:47.241 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/des_generic.ko 2026-02-24T09:04:47.241 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/dh_generic.ko 2026-02-24T09:04:47.241 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/echainiv.ko 2026-02-24T09:04:47.241 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/essiv.ko 2026-02-24T09:04:47.241 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/fcrypt.ko 2026-02-24T09:04:47.241 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/khazad.ko 2026-02-24T09:04:47.241 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/krb5 2026-02-24T09:04:47.242 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/krb5/krb5.ko 2026-02-24T09:04:47.242 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/krb5enc.ko 2026-02-24T09:04:47.242 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/lz4.ko 2026-02-24T09:04:47.242 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/lz4hc.ko 2026-02-24T09:04:47.242 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/md4.ko 2026-02-24T09:04:47.242 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/michael_mic.ko 2026-02-24T09:04:47.242 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/pcbc.ko 2026-02-24T09:04:47.242 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/pcrypt.ko 2026-02-24T09:04:47.242 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/rmd160.ko 2026-02-24T09:04:47.242 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/seed.ko 2026-02-24T09:04:47.242 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/serpent_generic.ko 2026-02-24T09:04:47.242 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/tea.ko 2026-02-24T09:04:47.242 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/twofish_common.ko 2026-02-24T09:04:47.243 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/twofish_generic.ko 2026-02-24T09:04:47.243 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/wp512.ko 2026-02-24T09:04:47.243 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/xcbc.ko 2026-02-24T09:04:47.243 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/xor.ko 2026-02-24T09:04:47.243 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/xxhash_generic.ko 2026-02-24T09:04:47.243 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers 2026-02-24T09:04:47.243 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi 2026-02-24T09:04:47.243 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/acpi_ipmi.ko 2026-02-24T09:04:47.243 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/acpi_pad.ko 2026-02-24T09:04:47.243 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/ec_sys.ko 2026-02-24T09:04:47.243 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/platform_profile.ko 2026-02-24T09:04:47.243 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/sbs.ko 2026-02-24T09:04:47.243 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/sbshc.ko 2026-02-24T09:04:47.244 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/video.ko 2026-02-24T09:04:47.244 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata 2026-02-24T09:04:47.244 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/acard-ahci.ko 2026-02-24T09:04:47.244 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/ahci_platform.ko 2026-02-24T09:04:47.244 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/ata_generic.ko 2026-02-24T09:04:47.244 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/libahci_platform.ko 2026-02-24T09:04:47.244 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_acpi.ko 2026-02-24T09:04:47.244 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ali.ko 2026-02-24T09:04:47.244 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_amd.ko 2026-02-24T09:04:47.244 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_artop.ko 2026-02-24T09:04:47.244 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_atiixp.ko 2026-02-24T09:04:47.244 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_atp867x.ko 2026-02-24T09:04:47.244 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_cmd640.ko 2026-02-24T09:04:47.245 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_cmd64x.ko 2026-02-24T09:04:47.245 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_cypress.ko 2026-02-24T09:04:47.245 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_efar.ko 2026-02-24T09:04:47.245 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt366.ko 2026-02-24T09:04:47.245 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt37x.ko 2026-02-24T09:04:47.245 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt3x2n.ko 2026-02-24T09:04:47.245 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt3x3.ko 2026-02-24T09:04:47.245 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_it8213.ko 2026-02-24T09:04:47.245 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_it821x.ko 2026-02-24T09:04:47.245 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_jmicron.ko 2026-02-24T09:04:47.245 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_marvell.ko 2026-02-24T09:04:47.245 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_mpiix.ko 2026-02-24T09:04:47.245 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_netcell.ko 2026-02-24T09:04:47.246 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ninja32.ko 2026-02-24T09:04:47.246 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ns87410.ko 2026-02-24T09:04:47.246 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ns87415.ko 2026-02-24T09:04:47.246 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_oldpiix.ko 2026-02-24T09:04:47.246 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_opti.ko 2026-02-24T09:04:47.246 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_optidma.ko 2026-02-24T09:04:47.246 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_pcmcia.ko 2026-02-24T09:04:47.246 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_pdc2027x.ko 2026-02-24T09:04:47.246 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_pdc202xx_old.ko 2026-02-24T09:04:47.246 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_piccolo.ko 2026-02-24T09:04:47.246 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_rdc.ko 2026-02-24T09:04:47.246 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sch.ko 2026-02-24T09:04:47.246 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_serverworks.ko 2026-02-24T09:04:47.246 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sil680.ko 2026-02-24T09:04:47.247 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sis.ko 2026-02-24T09:04:47.247 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sl82c105.ko 2026-02-24T09:04:47.247 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_triflex.ko 2026-02-24T09:04:47.247 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_via.ko 2026-02-24T09:04:47.247 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pdc_adma.ko 2026-02-24T09:04:47.247 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_inic162x.ko 2026-02-24T09:04:47.247 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_mv.ko 2026-02-24T09:04:47.247 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_nv.ko 2026-02-24T09:04:47.247 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_promise.ko 2026-02-24T09:04:47.247 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_qstor.ko 2026-02-24T09:04:47.247 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sil.ko 2026-02-24T09:04:47.247 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sil24.ko 2026-02-24T09:04:47.247 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sis.ko 2026-02-24T09:04:47.247 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_svw.ko 2026-02-24T09:04:47.247 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sx4.ko 2026-02-24T09:04:47.248 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_uli.ko 2026-02-24T09:04:47.248 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_via.ko 2026-02-24T09:04:47.248 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_vsc.ko 2026-02-24T09:04:47.248 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/auxdisplay 2026-02-24T09:04:47.248 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/auxdisplay/ks0108.ko 2026-02-24T09:04:47.248 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base 2026-02-24T09:04:47.248 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base/regmap 2026-02-24T09:04:47.248 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base/regmap/regmap-i2c.ko 2026-02-24T09:04:47.248 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base/regmap/regmap-mmio.ko 2026-02-24T09:04:47.248 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/bcma 2026-02-24T09:04:47.248 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/bcma/bcma.ko 2026-02-24T09:04:47.248 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block 2026-02-24T09:04:47.248 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/aoe 2026-02-24T09:04:47.248 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/aoe/aoe.ko 2026-02-24T09:04:47.249 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/brd.ko 2026-02-24T09:04:47.249 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/drbd 2026-02-24T09:04:47.249 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/drbd/drbd.ko 2026-02-24T09:04:47.249 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/floppy.ko 2026-02-24T09:04:47.249 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/loop.ko 2026-02-24T09:04:47.249 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/mtip32xx 2026-02-24T09:04:47.249 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/mtip32xx/mtip32xx.ko 2026-02-24T09:04:47.249 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/nbd.ko 2026-02-24T09:04:47.249 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/null_blk 2026-02-24T09:04:47.249 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/null_blk/null_blk.ko 2026-02-24T09:04:47.249 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/rbd.ko 2026-02-24T09:04:47.249 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/virtio_blk.ko 2026-02-24T09:04:47.249 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/xen-blkback 2026-02-24T09:04:47.249 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/xen-blkback/xen-blkback.ko 2026-02-24T09:04:47.249 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/xen-blkfront.ko 2026-02-24T09:04:47.250 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/zram 2026-02-24T09:04:47.250 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/zram/zram.ko 2026-02-24T09:04:47.250 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char 2026-02-24T09:04:47.250 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hangcheck-timer.ko 2026-02-24T09:04:47.250 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random 2026-02-24T09:04:47.250 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/amd-rng.ko 2026-02-24T09:04:47.250 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/intel-rng.ko 2026-02-24T09:04:47.250 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/timeriomem-rng.ko 2026-02-24T09:04:47.250 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/via-rng.ko 2026-02-24T09:04:47.250 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/virtio-rng.ko 2026-02-24T09:04:47.250 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi 2026-02-24T09:04:47.250 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_devintf.ko 2026-02-24T09:04:47.250 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2026-02-24T09:04:47.250 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2026-02-24T09:04:47.250 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_si.ko 2026-02-24T09:04:47.250 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_ssif.ko 2026-02-24T09:04:47.250 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2026-02-24T09:04:47.251 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/lp.ko 2026-02-24T09:04:47.251 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/mwave 2026-02-24T09:04:47.251 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/mwave/mwave.ko 2026-02-24T09:04:47.251 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ppdev.ko 2026-02-24T09:04:47.251 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tlclk.ko 2026-02-24T09:04:47.251 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm 2026-02-24T09:04:47.251 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm.ko 2026-02-24T09:04:47.251 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_atmel.ko 2026-02-24T09:04:47.251 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_infineon.ko 2026-02-24T09:04:47.251 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_nsc.ko 2026-02-24T09:04:47.251 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_tis.ko 2026-02-24T09:04:47.251 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_tis_core.ko 2026-02-24T09:04:47.251 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/uv_mmtimer.ko 2026-02-24T09:04:47.251 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/virtio_console.ko 2026-02-24T09:04:47.251 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq 2026-02-24T09:04:47.251 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/acpi-cpufreq.ko 2026-02-24T09:04:47.251 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2026-02-24T09:04:47.252 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/p4-clockmod.ko 2026-02-24T09:04:47.252 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/pcc-cpufreq.ko 2026-02-24T09:04:47.252 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/powernow-k8.ko 2026-02-24T09:04:47.252 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/speedstep-lib.ko 2026-02-24T09:04:47.252 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto 2026-02-24T09:04:47.252 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/ccp 2026-02-24T09:04:47.252 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/ccp/ccp-crypto.ko 2026-02-24T09:04:47.252 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/ccp/ccp.ko 2026-02-24T09:04:47.252 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel 2026-02-24T09:04:47.252 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat 2026-02-24T09:04:47.252 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_common 2026-02-24T09:04:47.252 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2026-02-24T09:04:47.252 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2026-02-24T09:04:47.252 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2026-02-24T09:04:47.252 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/padlock-aes.ko 2026-02-24T09:04:47.252 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/padlock-sha.ko 2026-02-24T09:04:47.252 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/virtio 2026-02-24T09:04:47.253 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/virtio/virtio_crypto.ko 2026-02-24T09:04:47.253 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dca 2026-02-24T09:04:47.253 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dca/dca.ko 2026-02-24T09:04:47.253 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/devfreq 2026-02-24T09:04:47.253 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/devfreq/governor_simpleondemand.ko 2026-02-24T09:04:47.253 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma 2026-02-24T09:04:47.253 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/dw 2026-02-24T09:04:47.253 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/dw/dw_dmac.ko 2026-02-24T09:04:47.253 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/ioat 2026-02-24T09:04:47.253 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/ioat/ioatdma.ko 2026-02-24T09:04:47.253 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac 2026-02-24T09:04:47.253 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/amd64_edac.ko 2026-02-24T09:04:47.253 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/e752x_edac.ko 2026-02-24T09:04:47.253 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/edac_mce_amd.ko 2026-02-24T09:04:47.253 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i3000_edac.ko 2026-02-24T09:04:47.253 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i3200_edac.ko 2026-02-24T09:04:47.253 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i5100_edac.ko 2026-02-24T09:04:47.253 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i5400_edac.ko 2026-02-24T09:04:47.254 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i7300_edac.ko 2026-02-24T09:04:47.254 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i7core_edac.ko 2026-02-24T09:04:47.254 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i82975x_edac.ko 2026-02-24T09:04:47.254 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/ie31200_edac.ko 2026-02-24T09:04:47.254 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/sb_edac.ko 2026-02-24T09:04:47.254 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/x38_edac.ko 2026-02-24T09:04:47.254 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/firmware 2026-02-24T09:04:47.254 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/firmware/edd.ko 2026-02-24T09:04:47.254 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/firmware/iscsi_ibft.ko 2026-02-24T09:04:47.254 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/gpio 2026-02-24T09:04:47.254 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/gpio/gpio-ich.ko 2026-02-24T09:04:47.254 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/gpio/gpio-viperboard.ko 2026-02-24T09:04:47.254 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid 2026-02-24T09:04:47.254 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-appleir.ko 2026-02-24T09:04:47.254 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-aureal.ko 2026-02-24T09:04:47.254 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-axff.ko 2026-02-24T09:04:47.254 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-dr.ko 2026-02-24T09:04:47.254 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-elecom.ko 2026-02-24T09:04:47.255 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-elo.ko 2026-02-24T09:04:47.255 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-emsff.ko 2026-02-24T09:04:47.255 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-gaff.ko 2026-02-24T09:04:47.255 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-gt683r.ko 2026-02-24T09:04:47.255 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-gyration.ko 2026-02-24T09:04:47.255 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-holtek-kbd.ko 2026-02-24T09:04:47.255 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-holtek-mouse.ko 2026-02-24T09:04:47.255 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-holtekff.ko 2026-02-24T09:04:47.255 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-icade.ko 2026-02-24T09:04:47.255 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-keytouch.ko 2026-02-24T09:04:47.255 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-kye.ko 2026-02-24T09:04:47.255 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-lcpower.ko 2026-02-24T09:04:47.255 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-led.ko 2026-02-24T09:04:47.255 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-lenovo.ko 2026-02-24T09:04:47.255 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-multitouch.ko 2026-02-24T09:04:47.255 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-ortek.ko 2026-02-24T09:04:47.255 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-penmount.ko 2026-02-24T09:04:47.255 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-petalynx.ko 2026-02-24T09:04:47.256 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-picolcd.ko 2026-02-24T09:04:47.256 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-pl.ko 2026-02-24T09:04:47.256 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-plantronics.ko 2026-02-24T09:04:47.256 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-primax.ko 2026-02-24T09:04:47.256 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-rmi.ko 2026-02-24T09:04:47.256 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-arvo.ko 2026-02-24T09:04:47.256 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-common.ko 2026-02-24T09:04:47.256 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-isku.ko 2026-02-24T09:04:47.256 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-kone.ko 2026-02-24T09:04:47.256 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-koneplus.ko 2026-02-24T09:04:47.256 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-konepure.ko 2026-02-24T09:04:47.256 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-kovaplus.ko 2026-02-24T09:04:47.256 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-lua.ko 2026-02-24T09:04:47.256 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-pyra.ko 2026-02-24T09:04:47.256 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-ryos.ko 2026-02-24T09:04:47.256 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-savu.ko 2026-02-24T09:04:47.256 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat.ko 2026-02-24T09:04:47.256 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-saitek.ko 2026-02-24T09:04:47.257 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-samsung.ko 2026-02-24T09:04:47.257 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sensor-hub.ko 2026-02-24T09:04:47.257 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sjoy.ko 2026-02-24T09:04:47.257 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sony.ko 2026-02-24T09:04:47.257 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-speedlink.ko 2026-02-24T09:04:47.257 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-steelseries.ko 2026-02-24T09:04:47.257 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sunplus.ko 2026-02-24T09:04:47.257 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-thrustmaster.ko 2026-02-24T09:04:47.257 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-tivo.ko 2026-02-24T09:04:47.257 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-tmff.ko 2026-02-24T09:04:47.257 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-topseed.ko 2026-02-24T09:04:47.257 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-twinhan.ko 2026-02-24T09:04:47.257 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-uclogic.ko 2026-02-24T09:04:47.257 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-waltop.ko 2026-02-24T09:04:47.257 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-wiimote.ko 2026-02-24T09:04:47.257 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-xinmo.ko 2026-02-24T09:04:47.257 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-zpff.ko 2026-02-24T09:04:47.258 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-zydacron.ko 2026-02-24T09:04:47.258 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/uhid.ko 2026-02-24T09:04:47.258 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/wacom.ko 2026-02-24T09:04:47.258 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon 2026-02-24T09:04:47.258 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/abituguru.ko 2026-02-24T09:04:47.258 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/abituguru3.ko 2026-02-24T09:04:47.258 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/acpi_power_meter.ko 2026-02-24T09:04:47.258 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ad7414.ko 2026-02-24T09:04:47.258 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ad7418.ko 2026-02-24T09:04:47.258 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adc128d818.ko 2026-02-24T09:04:47.258 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1025.ko 2026-02-24T09:04:47.258 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1026.ko 2026-02-24T09:04:47.258 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1029.ko 2026-02-24T09:04:47.258 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1031.ko 2026-02-24T09:04:47.258 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm9240.ko 2026-02-24T09:04:47.258 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ads7828.ko 2026-02-24T09:04:47.258 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7410.ko 2026-02-24T09:04:47.258 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7411.ko 2026-02-24T09:04:47.258 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7462.ko 2026-02-24T09:04:47.259 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7470.ko 2026-02-24T09:04:47.259 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7475.ko 2026-02-24T09:04:47.259 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7x10.ko 2026-02-24T09:04:47.259 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/amc6821.ko 2026-02-24T09:04:47.259 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/applesmc.ko 2026-02-24T09:04:47.259 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/asb100.ko 2026-02-24T09:04:47.259 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/asc7621.ko 2026-02-24T09:04:47.259 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/asus_atk0110.ko 2026-02-24T09:04:47.259 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/atxp1.ko 2026-02-24T09:04:47.259 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/coretemp.ko 2026-02-24T09:04:47.259 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/dell-smm-hwmon.ko 2026-02-24T09:04:47.259 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/dme1737.ko 2026-02-24T09:04:47.259 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ds1621.ko 2026-02-24T09:04:47.259 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ds620.ko 2026-02-24T09:04:47.259 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/emc1403.ko 2026-02-24T09:04:47.259 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/emc6w201.ko 2026-02-24T09:04:47.259 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/f71805f.ko 2026-02-24T09:04:47.259 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/f71882fg.ko 2026-02-24T09:04:47.259 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/f75375s.ko 2026-02-24T09:04:47.260 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/fam15h_power.ko 2026-02-24T09:04:47.260 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/fschmd.ko 2026-02-24T09:04:47.260 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/g760a.ko 2026-02-24T09:04:47.260 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/g762.ko 2026-02-24T09:04:47.260 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/gl518sm.ko 2026-02-24T09:04:47.260 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/gl520sm.ko 2026-02-24T09:04:47.260 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/hwmon-vid.ko 2026-02-24T09:04:47.260 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/i5500_temp.ko 2026-02-24T09:04:47.260 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/i5k_amb.ko 2026-02-24T09:04:47.260 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ibmaem.ko 2026-02-24T09:04:47.260 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ibmpex.ko 2026-02-24T09:04:47.260 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ina209.ko 2026-02-24T09:04:47.260 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ina2xx.ko 2026-02-24T09:04:47.260 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/it87.ko 2026-02-24T09:04:47.260 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/k10temp.ko 2026-02-24T09:04:47.260 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/k8temp.ko 2026-02-24T09:04:47.260 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lineage-pem.ko 2026-02-24T09:04:47.260 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm63.ko 2026-02-24T09:04:47.260 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm73.ko 2026-02-24T09:04:47.261 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm75.ko 2026-02-24T09:04:47.261 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm77.ko 2026-02-24T09:04:47.261 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm78.ko 2026-02-24T09:04:47.261 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm80.ko 2026-02-24T09:04:47.261 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm83.ko 2026-02-24T09:04:47.261 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm85.ko 2026-02-24T09:04:47.261 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm87.ko 2026-02-24T09:04:47.261 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm90.ko 2026-02-24T09:04:47.261 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm92.ko 2026-02-24T09:04:47.261 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm93.ko 2026-02-24T09:04:47.261 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm95234.ko 2026-02-24T09:04:47.261 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm95241.ko 2026-02-24T09:04:47.261 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm95245.ko 2026-02-24T09:04:47.261 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc2945.ko 2026-02-24T09:04:47.261 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4151.ko 2026-02-24T09:04:47.261 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4215.ko 2026-02-24T09:04:47.261 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4222.ko 2026-02-24T09:04:47.261 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4245.ko 2026-02-24T09:04:47.261 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4260.ko 2026-02-24T09:04:47.262 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4261.ko 2026-02-24T09:04:47.262 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max16065.ko 2026-02-24T09:04:47.262 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max1619.ko 2026-02-24T09:04:47.262 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max1668.ko 2026-02-24T09:04:47.262 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max197.ko 2026-02-24T09:04:47.262 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max6639.ko 2026-02-24T09:04:47.262 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max6650.ko 2026-02-24T09:04:47.262 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max6697.ko 2026-02-24T09:04:47.262 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/mcp3021.ko 2026-02-24T09:04:47.262 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct6683.ko 2026-02-24T09:04:47.262 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct6775-core.ko 2026-02-24T09:04:47.262 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct6775.ko 2026-02-24T09:04:47.262 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct7802.ko 2026-02-24T09:04:47.262 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pc87360.ko 2026-02-24T09:04:47.262 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pc87427.ko 2026-02-24T09:04:47.262 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pcf8591.ko 2026-02-24T09:04:47.262 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus 2026-02-24T09:04:47.262 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/adm1275.ko 2026-02-24T09:04:47.262 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/lm25066.ko 2026-02-24T09:04:47.262 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/ltc2978.ko 2026-02-24T09:04:47.262 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/max16064.ko 2026-02-24T09:04:47.263 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/max34440.ko 2026-02-24T09:04:47.263 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/max8688.ko 2026-02-24T09:04:47.263 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/pmbus.ko 2026-02-24T09:04:47.263 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2026-02-24T09:04:47.263 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/tps40422.ko 2026-02-24T09:04:47.263 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/ucd9000.ko 2026-02-24T09:04:47.263 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/ucd9200.ko 2026-02-24T09:04:47.263 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/zl6100.ko 2026-02-24T09:04:47.263 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/powr1220.ko 2026-02-24T09:04:47.263 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sch5627.ko 2026-02-24T09:04:47.263 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sch5636.ko 2026-02-24T09:04:47.263 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sch56xx-common.ko 2026-02-24T09:04:47.263 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sht15.ko 2026-02-24T09:04:47.263 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sht21.ko 2026-02-24T09:04:47.263 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/shtc1.ko 2026-02-24T09:04:47.263 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sis5595.ko 2026-02-24T09:04:47.263 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/smsc47b397.ko 2026-02-24T09:04:47.263 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/smsc47m1.ko 2026-02-24T09:04:47.263 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/smsc47m192.ko 2026-02-24T09:04:47.263 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/thmc50.ko 2026-02-24T09:04:47.263 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp102.ko 2026-02-24T09:04:47.263 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp103.ko 2026-02-24T09:04:47.264 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp401.ko 2026-02-24T09:04:47.264 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp421.ko 2026-02-24T09:04:47.264 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/via-cputemp.ko 2026-02-24T09:04:47.264 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/via686a.ko 2026-02-24T09:04:47.264 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/vt1211.ko 2026-02-24T09:04:47.264 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/vt8231.ko 2026-02-24T09:04:47.264 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83627ehf.ko 2026-02-24T09:04:47.264 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83627hf.ko 2026-02-24T09:04:47.264 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83781d.ko 2026-02-24T09:04:47.264 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83791d.ko 2026-02-24T09:04:47.264 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83792d.ko 2026-02-24T09:04:47.264 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83793.ko 2026-02-24T09:04:47.264 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83795.ko 2026-02-24T09:04:47.264 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83l785ts.ko 2026-02-24T09:04:47.264 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83l786ng.ko 2026-02-24T09:04:47.264 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c 2026-02-24T09:04:47.264 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/algos 2026-02-24T09:04:47.264 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2026-02-24T09:04:47.264 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2026-02-24T09:04:47.264 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses 2026-02-24T09:04:47.264 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-amd756.ko 2026-02-24T09:04:47.264 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-amd8111.ko 2026-02-24T09:04:47.265 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2026-02-24T09:04:47.265 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-designware-core.ko 2026-02-24T09:04:47.265 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2026-02-24T09:04:47.265 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2026-02-24T09:04:47.265 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2026-02-24T09:04:47.265 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-i801.ko 2026-02-24T09:04:47.265 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-isch.ko 2026-02-24T09:04:47.265 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-ismt.ko 2026-02-24T09:04:47.265 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-nforce2.ko 2026-02-24T09:04:47.265 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-parport.ko 2026-02-24T09:04:47.265 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2026-02-24T09:04:47.265 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-piix4.ko 2026-02-24T09:04:47.265 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-scmi.ko 2026-02-24T09:04:47.265 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-simtec.ko 2026-02-24T09:04:47.265 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-sis96x.ko 2026-02-24T09:04:47.265 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2026-02-24T09:04:47.265 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-via.ko 2026-02-24T09:04:47.265 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-viapro.ko 2026-02-24T09:04:47.265 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-viperboard.ko 2026-02-24T09:04:47.265 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-dev.ko 2026-02-24T09:04:47.265 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-mux.ko 2026-02-24T09:04:47.265 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-slave-eeprom.ko 2026-02-24T09:04:47.266 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-smbus.ko 2026-02-24T09:04:47.266 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-stub.ko 2026-02-24T09:04:47.266 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband 2026-02-24T09:04:47.266 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core 2026-02-24T09:04:47.266 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_cm.ko 2026-02-24T09:04:47.266 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_core.ko 2026-02-24T09:04:47.266 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_umad.ko 2026-02-24T09:04:47.266 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_uverbs.ko 2026-02-24T09:04:47.266 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/iw_cm.ko 2026-02-24T09:04:47.266 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/rdma_cm.ko 2026-02-24T09:04:47.266 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/rdma_ucm.ko 2026-02-24T09:04:47.266 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw 2026-02-24T09:04:47.266 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/cxgb4 2026-02-24T09:04:47.266 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2026-02-24T09:04:47.266 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx4 2026-02-24T09:04:47.266 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2026-02-24T09:04:47.266 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx5 2026-02-24T09:04:47.266 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2026-02-24T09:04:47.266 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mthca 2026-02-24T09:04:47.266 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2026-02-24T09:04:47.266 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp 2026-02-24T09:04:47.266 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/ipoib 2026-02-24T09:04:47.266 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2026-02-24T09:04:47.267 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/iser 2026-02-24T09:04:47.267 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2026-02-24T09:04:47.267 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/isert 2026-02-24T09:04:47.267 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2026-02-24T09:04:47.267 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srp 2026-02-24T09:04:47.267 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2026-02-24T09:04:47.267 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srpt 2026-02-24T09:04:47.267 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2026-02-24T09:04:47.267 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input 2026-02-24T09:04:47.267 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport 2026-02-24T09:04:47.267 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport/emu10k1-gp.ko 2026-02-24T09:04:47.267 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport/fm801-gp.ko 2026-02-24T09:04:47.267 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport/gameport.ko 2026-02-24T09:04:47.267 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/joydev.ko 2026-02-24T09:04:47.267 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/keyboard 2026-02-24T09:04:47.267 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/keyboard/gpio_keys.ko 2026-02-24T09:04:47.267 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse 2026-02-24T09:04:47.267 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/appletouch.ko 2026-02-24T09:04:47.267 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/bcm5974.ko 2026-02-24T09:04:47.267 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/cyapatp.ko 2026-02-24T09:04:47.267 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/elan_i2c.ko 2026-02-24T09:04:47.267 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/sermouse.ko 2026-02-24T09:04:47.267 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/synaptics_i2c.ko 2026-02-24T09:04:47.267 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/synaptics_usb.ko 2026-02-24T09:04:47.267 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/vsxxxaa.ko 2026-02-24T09:04:47.268 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/rmi4 2026-02-24T09:04:47.268 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/rmi4/rmi_core.ko 2026-02-24T09:04:47.268 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio 2026-02-24T09:04:47.268 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio/altera_ps2.ko 2026-02-24T09:04:47.268 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio/arc_ps2.ko 2026-02-24T09:04:47.268 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio/serio_raw.ko 2026-02-24T09:04:47.268 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/sparse-keymap.ko 2026-02-24T09:04:47.268 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds 2026-02-24T09:04:47.268 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-blinkm.ko 2026-02-24T09:04:47.268 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-lm3530.ko 2026-02-24T09:04:47.268 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-lp3944.ko 2026-02-24T09:04:47.268 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-ss4200.ko 2026-02-24T09:04:47.268 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger 2026-02-24T09:04:47.268 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2026-02-24T09:04:47.268 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-camera.ko 2026-02-24T09:04:47.268 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2026-02-24T09:04:47.268 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2026-02-24T09:04:47.268 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2026-02-24T09:04:47.268 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2026-02-24T09:04:47.268 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-timer.ko 2026-02-24T09:04:47.268 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-transient.ko 2026-02-24T09:04:47.268 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md 2026-02-24T09:04:47.268 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/bcache 2026-02-24T09:04:47.268 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/bcache/bcache.ko 2026-02-24T09:04:47.268 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-bio-prison.ko 2026-02-24T09:04:47.269 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-cache-smq.ko 2026-02-24T09:04:47.269 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-cache.ko 2026-02-24T09:04:47.269 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-crypt.ko 2026-02-24T09:04:47.269 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-delay.ko 2026-02-24T09:04:47.269 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-flakey.ko 2026-02-24T09:04:47.269 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-log-userspace.ko 2026-02-24T09:04:47.269 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-multipath.ko 2026-02-24T09:04:47.269 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-queue-length.ko 2026-02-24T09:04:47.269 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-raid.ko 2026-02-24T09:04:47.269 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-round-robin.ko 2026-02-24T09:04:47.269 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-service-time.ko 2026-02-24T09:04:47.269 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-switch.ko 2026-02-24T09:04:47.269 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-thin-pool.ko 2026-02-24T09:04:47.269 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-verity.ko 2026-02-24T09:04:47.269 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/linear.ko 2026-02-24T09:04:47.269 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/persistent-data 2026-02-24T09:04:47.269 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2026-02-24T09:04:47.269 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid0.ko 2026-02-24T09:04:47.269 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid1.ko 2026-02-24T09:04:47.269 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid10.ko 2026-02-24T09:04:47.269 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid456.ko 2026-02-24T09:04:47.269 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message 2026-02-24T09:04:47.269 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion 2026-02-24T09:04:47.269 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptbase.ko 2026-02-24T09:04:47.269 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptctl.ko 2026-02-24T09:04:47.270 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptfc.ko 2026-02-24T09:04:47.270 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptlan.ko 2026-02-24T09:04:47.270 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptsas.ko 2026-02-24T09:04:47.270 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptscsih.ko 2026-02-24T09:04:47.270 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptspi.ko 2026-02-24T09:04:47.270 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd 2026-02-24T09:04:47.270 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/lpc_ich.ko 2026-02-24T09:04:47.270 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/lpc_sch.ko 2026-02-24T09:04:47.270 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/mfd-core.ko 2026-02-24T09:04:47.270 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/sm501.ko 2026-02-24T09:04:47.270 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/viperboard.ko 2026-02-24T09:04:47.270 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/vx855.ko 2026-02-24T09:04:47.270 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc 2026-02-24T09:04:47.270 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/altera-stapl 2026-02-24T09:04:47.270 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2026-02-24T09:04:47.270 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/apds9802als.ko 2026-02-24T09:04:47.270 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/apds990x.ko 2026-02-24T09:04:47.270 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/bh1770glc.ko 2026-02-24T09:04:47.270 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/cb710 2026-02-24T09:04:47.270 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/cb710/cb710.ko 2026-02-24T09:04:47.270 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/eeprom 2026-02-24T09:04:47.270 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/eeprom/at24.ko 2026-02-24T09:04:47.270 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/eeprom/max6875.ko 2026-02-24T09:04:47.270 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/enclosure.ko 2026-02-24T09:04:47.270 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/hpilo.ko 2026-02-24T09:04:47.271 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/isl29003.ko 2026-02-24T09:04:47.271 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/isl29020.ko 2026-02-24T09:04:47.271 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/lis3lv02d 2026-02-24T09:04:47.271 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2026-02-24T09:04:47.271 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2026-02-24T09:04:47.271 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei 2026-02-24T09:04:47.271 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei/mei-me.ko 2026-02-24T09:04:47.271 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei/mei-txe.ko 2026-02-24T09:04:47.271 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei/mei.ko 2026-02-24T09:04:47.271 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-gru 2026-02-24T09:04:47.271 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-gru/gru.ko 2026-02-24T09:04:47.271 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp 2026-02-24T09:04:47.271 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp/xp.ko 2026-02-24T09:04:47.271 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp/xpc.ko 2026-02-24T09:04:47.271 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp/xpnet.ko 2026-02-24T09:04:47.271 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/tifm_7xx1.ko 2026-02-24T09:04:47.271 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/tifm_core.ko 2026-02-24T09:04:47.271 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/tsl2550.ko 2026-02-24T09:04:47.271 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/vmw_balloon.ko 2026-02-24T09:04:47.271 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/vmw_vmci 2026-02-24T09:04:47.271 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2026-02-24T09:04:47.271 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net 2026-02-24T09:04:47.271 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/bonding 2026-02-24T09:04:47.272 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/bonding/bonding.ko 2026-02-24T09:04:47.272 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa 2026-02-24T09:04:47.272 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/b53 2026-02-24T09:04:47.272 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/b53/b53_common.ko 2026-02-24T09:04:47.272 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/bcm-sf2.ko 2026-02-24T09:04:47.272 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/mv88e6060.ko 2026-02-24T09:04:47.272 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/mv88e6xxx 2026-02-24T09:04:47.272 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2026-02-24T09:04:47.272 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dummy.ko 2026-02-24T09:04:47.272 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/eql.ko 2026-02-24T09:04:47.272 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet 2026-02-24T09:04:47.272 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com 2026-02-24T09:04:47.272 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2026-02-24T09:04:47.272 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2026-02-24T09:04:47.272 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/3c59x.ko 2026-02-24T09:04:47.272 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/typhoon.ko 2026-02-24T09:04:47.272 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390 2026-02-24T09:04:47.272 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/8390.ko 2026-02-24T09:04:47.272 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2026-02-24T09:04:47.272 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2026-02-24T09:04:47.272 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2026-02-24T09:04:47.272 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/adaptec 2026-02-24T09:04:47.272 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/adaptec/starfire.ko 2026-02-24T09:04:47.272 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/agere 2026-02-24T09:04:47.272 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/agere/et131x.ko 2026-02-24T09:04:47.272 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/alteon 2026-02-24T09:04:47.273 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/alteon/acenic.ko 2026-02-24T09:04:47.273 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/altera 2026-02-24T09:04:47.273 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/altera/altera_tse.ko 2026-02-24T09:04:47.273 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd 2026-02-24T09:04:47.273 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd/amd8111e.ko 2026-02-24T09:04:47.273 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2026-02-24T09:04:47.273 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd/pcnet32.ko 2026-02-24T09:04:47.273 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros 2026-02-24T09:04:47.273 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/alx 2026-02-24T09:04:47.273 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2026-02-24T09:04:47.273 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1c 2026-02-24T09:04:47.273 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2026-02-24T09:04:47.273 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1e 2026-02-24T09:04:47.273 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2026-02-24T09:04:47.273 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atlx 2026-02-24T09:04:47.273 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2026-02-24T09:04:47.273 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2026-02-24T09:04:47.273 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom 2026-02-24T09:04:47.273 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/b44.ko 2026-02-24T09:04:47.273 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2026-02-24T09:04:47.273 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/bnx2x 2026-02-24T09:04:47.273 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2026-02-24T09:04:47.273 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/cnic.ko 2026-02-24T09:04:47.273 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/genet 2026-02-24T09:04:47.273 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2026-02-24T09:04:47.274 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/tg3.ko 2026-02-24T09:04:47.274 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/brocade 2026-02-24T09:04:47.274 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/brocade/bna 2026-02-24T09:04:47.274 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2026-02-24T09:04:47.274 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio 2026-02-24T09:04:47.274 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb 2026-02-24T09:04:47.274 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2026-02-24T09:04:47.274 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb3 2026-02-24T09:04:47.274 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2026-02-24T09:04:47.274 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4 2026-02-24T09:04:47.274 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2026-02-24T09:04:47.274 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2026-02-24T09:04:47.274 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2026-02-24T09:04:47.274 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/libcxgb 2026-02-24T09:04:47.274 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2026-02-24T09:04:47.274 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/cisco 2026-02-24T09:04:47.274 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/cisco/enic 2026-02-24T09:04:47.274 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2026-02-24T09:04:47.274 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec 2026-02-24T09:04:47.274 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip 2026-02-24T09:04:47.274 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2026-02-24T09:04:47.274 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2026-02-24T09:04:47.274 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2026-02-24T09:04:47.274 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2026-02-24T09:04:47.274 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2026-02-24T09:04:47.274 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2026-02-24T09:04:47.274 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dlink 2026-02-24T09:04:47.274 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dlink/dl2k.ko 2026-02-24T09:04:47.275 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dlink/sundance.ko 2026-02-24T09:04:47.275 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dnet.ko 2026-02-24T09:04:47.275 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/emulex 2026-02-24T09:04:47.275 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/emulex/benet 2026-02-24T09:04:47.275 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2026-02-24T09:04:47.275 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/ethoc.ko 2026-02-24T09:04:47.275 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/fealnx.ko 2026-02-24T09:04:47.275 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel 2026-02-24T09:04:47.275 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e100.ko 2026-02-24T09:04:47.275 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000 2026-02-24T09:04:47.275 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2026-02-24T09:04:47.275 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000e 2026-02-24T09:04:47.275 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2026-02-24T09:04:47.275 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/fm10k 2026-02-24T09:04:47.275 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2026-02-24T09:04:47.275 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/i40e 2026-02-24T09:04:47.275 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2026-02-24T09:04:47.275 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/iavf 2026-02-24T09:04:47.275 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2026-02-24T09:04:47.275 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ice 2026-02-24T09:04:47.275 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ice/ice.ko 2026-02-24T09:04:47.275 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igb 2026-02-24T09:04:47.275 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igb/igb.ko 2026-02-24T09:04:47.275 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igbvf 2026-02-24T09:04:47.275 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2026-02-24T09:04:47.275 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbe 2026-02-24T09:04:47.275 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2026-02-24T09:04:47.276 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbevf 2026-02-24T09:04:47.276 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2026-02-24T09:04:47.276 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libeth 2026-02-24T09:04:47.276 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2026-02-24T09:04:47.276 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libeth/libeth_xdp.ko 2026-02-24T09:04:47.276 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie 2026-02-24T09:04:47.276 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie/libie.ko 2026-02-24T09:04:47.276 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie/libie_adminq.ko 2026-02-24T09:04:47.276 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie/libie_fwlog.ko 2026-02-24T09:04:47.276 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/jme.ko 2026-02-24T09:04:47.276 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell 2026-02-24T09:04:47.276 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2026-02-24T09:04:47.276 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell/skge.ko 2026-02-24T09:04:47.276 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell/sky2.ko 2026-02-24T09:04:47.276 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox 2026-02-24T09:04:47.276 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx4 2026-02-24T09:04:47.276 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2026-02-24T09:04:47.276 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2026-02-24T09:04:47.276 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx5 2026-02-24T09:04:47.276 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx5/core 2026-02-24T09:04:47.276 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2026-02-24T09:04:47.276 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/micrel 2026-02-24T09:04:47.276 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2026-02-24T09:04:47.276 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/myricom 2026-02-24T09:04:47.276 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/myricom/myri10ge 2026-02-24T09:04:47.276 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2026-02-24T09:04:47.276 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/natsemi 2026-02-24T09:04:47.276 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2026-02-24T09:04:47.276 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2026-02-24T09:04:47.276 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/neterion 2026-02-24T09:04:47.276 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/neterion/s2io.ko 2026-02-24T09:04:47.277 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/nvidia 2026-02-24T09:04:47.277 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2026-02-24T09:04:47.277 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/packetengines 2026-02-24T09:04:47.277 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2026-02-24T09:04:47.277 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2026-02-24T09:04:47.277 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic 2026-02-24T09:04:47.277 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/netxen 2026-02-24T09:04:47.277 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2026-02-24T09:04:47.277 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2026-02-24T09:04:47.277 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/qlcnic 2026-02-24T09:04:47.277 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2026-02-24T09:04:47.277 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rdc 2026-02-24T09:04:47.277 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rdc/r6040.ko 2026-02-24T09:04:47.277 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek 2026-02-24T09:04:47.277 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/8139cp.ko 2026-02-24T09:04:47.277 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/8139too.ko 2026-02-24T09:04:47.277 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/atp.ko 2026-02-24T09:04:47.277 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/r8169.ko 2026-02-24T09:04:47.277 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rocker 2026-02-24T09:04:47.277 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rocker/rocker.ko 2026-02-24T09:04:47.277 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sfc 2026-02-24T09:04:47.277 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sfc/sfc.ko 2026-02-24T09:04:47.277 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/silan 2026-02-24T09:04:47.277 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/silan/sc92031.ko 2026-02-24T09:04:47.277 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sis 2026-02-24T09:04:47.277 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sis/sis190.ko 2026-02-24T09:04:47.277 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sis/sis900.ko 2026-02-24T09:04:47.277 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc 2026-02-24T09:04:47.277 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/epic100.ko 2026-02-24T09:04:47.277 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2026-02-24T09:04:47.277 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2026-02-24T09:04:47.278 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2026-02-24T09:04:47.278 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro 2026-02-24T09:04:47.278 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro/stmmac 2026-02-24T09:04:47.278 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2026-02-24T09:04:47.278 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2026-02-24T09:04:47.278 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun 2026-02-24T09:04:47.278 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/cassini.ko 2026-02-24T09:04:47.278 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/niu.ko 2026-02-24T09:04:47.278 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/sungem.ko 2026-02-24T09:04:47.278 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/sunhme.ko 2026-02-24T09:04:47.278 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/tehuti 2026-02-24T09:04:47.278 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2026-02-24T09:04:47.278 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/ti 2026-02-24T09:04:47.278 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/ti/tlan.ko 2026-02-24T09:04:47.278 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/via 2026-02-24T09:04:47.278 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/via/via-rhine.ko 2026-02-24T09:04:47.278 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/via/via-velocity.ko 2026-02-24T09:04:47.278 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/wiznet 2026-02-24T09:04:47.278 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/wiznet/w5100.ko 2026-02-24T09:04:47.278 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/wiznet/w5300.ko 2026-02-24T09:04:47.278 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/xircom 2026-02-24T09:04:47.278 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2026-02-24T09:04:47.278 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/geneve.ko 2026-02-24T09:04:47.278 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ieee802154 2026-02-24T09:04:47.278 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ieee802154/fakelb.ko 2026-02-24T09:04:47.278 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ifb.ko 2026-02-24T09:04:47.278 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ipvlan 2026-02-24T09:04:47.278 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ipvlan/ipvlan.ko 2026-02-24T09:04:47.278 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/macvlan.ko 2026-02-24T09:04:47.278 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/macvtap.ko 2026-02-24T09:04:47.279 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio 2026-02-24T09:04:47.279 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio.ko 2026-02-24T09:04:47.279 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2026-02-24T09:04:47.279 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio/mdio-bitbang.ko 2026-02-24T09:04:47.279 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio/mdio-regmap.ko 2026-02-24T09:04:47.279 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mii.ko 2026-02-24T09:04:47.279 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/net_failover.ko 2026-02-24T09:04:47.279 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/netconsole.ko 2026-02-24T09:04:47.279 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/nlmon.ko 2026-02-24T09:04:47.279 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/pcs 2026-02-24T09:04:47.279 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/pcs/pcs-lynx.ko 2026-02-24T09:04:47.279 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/pcs/pcs_xpcs.ko 2026-02-24T09:04:47.279 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy 2026-02-24T09:04:47.279 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/amd.ko 2026-02-24T09:04:47.279 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm-phy-lib.ko 2026-02-24T09:04:47.279 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm-phy-ptp.ko 2026-02-24T09:04:47.279 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm7xxx.ko 2026-02-24T09:04:47.279 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm87xx.ko 2026-02-24T09:04:47.279 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/broadcom.ko 2026-02-24T09:04:47.279 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/cicada.ko 2026-02-24T09:04:47.279 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/davicom.ko 2026-02-24T09:04:47.279 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/dp83640.ko 2026-02-24T09:04:47.279 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/et1011c.ko 2026-02-24T09:04:47.279 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/icplus.ko 2026-02-24T09:04:47.279 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/lxt.ko 2026-02-24T09:04:47.279 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/marvell.ko 2026-02-24T09:04:47.279 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/micrel.ko 2026-02-24T09:04:47.279 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/national.ko 2026-02-24T09:04:47.279 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/phy_package.ko 2026-02-24T09:04:47.279 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/phylink.ko 2026-02-24T09:04:47.280 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/qsemi.ko 2026-02-24T09:04:47.280 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/realtek 2026-02-24T09:04:47.280 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/realtek/realtek.ko 2026-02-24T09:04:47.280 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/smsc.ko 2026-02-24T09:04:47.280 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/ste10Xp.ko 2026-02-24T09:04:47.280 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/vitesse.ko 2026-02-24T09:04:47.280 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp 2026-02-24T09:04:47.280 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/bsd_comp.ko 2026-02-24T09:04:47.280 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_async.ko 2026-02-24T09:04:47.280 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_deflate.ko 2026-02-24T09:04:47.280 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_generic.ko 2026-02-24T09:04:47.280 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_mppe.ko 2026-02-24T09:04:47.280 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_synctty.ko 2026-02-24T09:04:47.280 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/pppoe.ko 2026-02-24T09:04:47.280 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/pppox.ko 2026-02-24T09:04:47.280 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/pptp.ko 2026-02-24T09:04:47.280 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/slip 2026-02-24T09:04:47.280 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/slip/slhc.ko 2026-02-24T09:04:47.280 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/slip/slip.ko 2026-02-24T09:04:47.280 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/sungem_phy.ko 2026-02-24T09:04:47.280 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/tap.ko 2026-02-24T09:04:47.280 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team 2026-02-24T09:04:47.280 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team.ko 2026-02-24T09:04:47.280 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_activebackup.ko 2026-02-24T09:04:47.280 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_broadcast.ko 2026-02-24T09:04:47.280 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_loadbalance.ko 2026-02-24T09:04:47.280 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_random.ko 2026-02-24T09:04:47.280 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_roundrobin.ko 2026-02-24T09:04:47.280 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/tun.ko 2026-02-24T09:04:47.280 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/veth.ko 2026-02-24T09:04:47.280 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/virtio_net.ko 2026-02-24T09:04:47.280 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vmxnet3 2026-02-24T09:04:47.280 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vmxnet3/vmxnet3.ko 2026-02-24T09:04:47.281 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vxlan 2026-02-24T09:04:47.281 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vxlan/vxlan.ko 2026-02-24T09:04:47.281 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/xen-netback 2026-02-24T09:04:47.281 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/xen-netback/xen-netback.ko 2026-02-24T09:04:47.281 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/xen-netfront.ko 2026-02-24T09:04:47.281 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ntb 2026-02-24T09:04:47.281 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ntb/ntb.ko 2026-02-24T09:04:47.281 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme 2026-02-24T09:04:47.281 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme/host 2026-02-24T09:04:47.281 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme/host/nvme-core.ko 2026-02-24T09:04:47.281 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme/host/nvme.ko 2026-02-24T09:04:47.281 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport 2026-02-24T09:04:47.281 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport.ko 2026-02-24T09:04:47.281 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport_cs.ko 2026-02-24T09:04:47.281 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport_pc.ko 2026-02-24T09:04:47.281 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport_serial.ko 2026-02-24T09:04:47.281 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci 2026-02-24T09:04:47.281 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/hotplug 2026-02-24T09:04:47.281 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2026-02-24T09:04:47.281 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/pcie 2026-02-24T09:04:47.281 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/pcie/aer_inject.ko 2026-02-24T09:04:47.281 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/xen-pcifront.ko 2026-02-24T09:04:47.281 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia 2026-02-24T09:04:47.281 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia/i82092.ko 2026-02-24T09:04:47.281 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia/pd6729.ko 2026-02-24T09:04:47.281 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia/yenta_socket.ko 2026-02-24T09:04:47.281 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pinctrl 2026-02-24T09:04:47.281 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pinctrl/intel 2026-02-24T09:04:47.281 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2026-02-24T09:04:47.281 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform 2026-02-24T09:04:47.281 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/wmi 2026-02-24T09:04:47.281 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/wmi/wmi.ko 2026-02-24T09:04:47.281 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86 2026-02-24T09:04:47.282 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/acer-wmi.ko 2026-02-24T09:04:47.282 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/acerhdf.ko 2026-02-24T09:04:47.282 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/apple-gmux.ko 2026-02-24T09:04:47.282 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/asus-laptop.ko 2026-02-24T09:04:47.282 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/asus-nb-wmi.ko 2026-02-24T09:04:47.282 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/asus-wmi.ko 2026-02-24T09:04:47.282 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/classmate-laptop.ko 2026-02-24T09:04:47.282 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/eeepc-laptop.ko 2026-02-24T09:04:47.282 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/eeepc-wmi.ko 2026-02-24T09:04:47.282 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/fujitsu-laptop.ko 2026-02-24T09:04:47.282 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/fujitsu-tablet.ko 2026-02-24T09:04:47.282 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/hdaps.ko 2026-02-24T09:04:47.282 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/intel 2026-02-24T09:04:47.282 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/intel/intel-rst.ko 2026-02-24T09:04:47.282 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/intel_ips.ko 2026-02-24T09:04:47.282 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/msi-wmi.ko 2026-02-24T09:04:47.282 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/mxm-wmi.ko 2026-02-24T09:04:47.282 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/panasonic-laptop.ko 2026-02-24T09:04:47.282 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/samsung-laptop.ko 2026-02-24T09:04:47.282 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/samsung-q10.ko 2026-02-24T09:04:47.282 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/topstar-laptop.ko 2026-02-24T09:04:47.282 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2026-02-24T09:04:47.282 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/toshiba_haps.ko 2026-02-24T09:04:47.282 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/wmi-bmof.ko 2026-02-24T09:04:47.282 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/powercap 2026-02-24T09:04:47.282 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/powercap/intel_rapl_common.ko 2026-02-24T09:04:47.282 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/powercap/intel_rapl_msr.ko 2026-02-24T09:04:47.282 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps 2026-02-24T09:04:47.282 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients 2026-02-24T09:04:47.282 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients/pps-gpio.ko 2026-02-24T09:04:47.282 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients/pps-ldisc.ko 2026-02-24T09:04:47.282 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients/pps_parport.ko 2026-02-24T09:04:47.283 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/pps_core.ko 2026-02-24T09:04:47.283 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp 2026-02-24T09:04:47.283 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp/ptp.ko 2026-02-24T09:04:47.283 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp/ptp_kvm.ko 2026-02-24T09:04:47.283 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp/ptp_vmclock.ko 2026-02-24T09:04:47.283 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras 2026-02-24T09:04:47.283 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd 2026-02-24T09:04:47.283 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd/atl 2026-02-24T09:04:47.283 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd/atl/amd_atl.ko 2026-02-24T09:04:47.283 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd/fmpm.ko 2026-02-24T09:04:47.283 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc 2026-02-24T09:04:47.283 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-bq32k.ko 2026-02-24T09:04:47.283 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1286.ko 2026-02-24T09:04:47.283 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1307.ko 2026-02-24T09:04:47.283 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1374.ko 2026-02-24T09:04:47.283 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1511.ko 2026-02-24T09:04:47.283 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1553.ko 2026-02-24T09:04:47.283 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1672.ko 2026-02-24T09:04:47.283 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1742.ko 2026-02-24T09:04:47.283 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds2404.ko 2026-02-24T09:04:47.283 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds3232.ko 2026-02-24T09:04:47.283 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-em3027.ko 2026-02-24T09:04:47.283 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-fm3130.ko 2026-02-24T09:04:47.283 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-isl12022.ko 2026-02-24T09:04:47.283 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-isl1208.ko 2026-02-24T09:04:47.283 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-m41t80.ko 2026-02-24T09:04:47.283 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-m48t35.ko 2026-02-24T09:04:47.283 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-m48t59.ko 2026-02-24T09:04:47.283 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-max6900.ko 2026-02-24T09:04:47.283 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-msm6242.ko 2026-02-24T09:04:47.283 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf2127.ko 2026-02-24T09:04:47.283 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf85063.ko 2026-02-24T09:04:47.283 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf8523.ko 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf8563.ko 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf8583.ko 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rp5c01.ko 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rs5c372.ko 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rv3029c2.ko 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rx8025.ko 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rx8581.ko 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-stk17ta8.ko 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-x1205.ko 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/3w-9xxx.ko 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/3w-sas.ko 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/3w-xxxx.ko 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/BusLogic.ko 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/a100u2w.ko 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aacraid 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aacraid/aacraid.ko 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/advansys.ko 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aic7xxx 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/am53c974.ko 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/arcmsr 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/arcmsr/arcmsr.ko 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/atp870u.ko 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/be2iscsi 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bfa 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bfa/bfa.ko 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2fc 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2i 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2i/bnx2i.ko 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ch.ko 2026-02-24T09:04:47.284 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/csiostor 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/csiostor/csiostor.ko 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb3i 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb4i 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/dc395x.ko 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/dmx3191d.ko 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/esas2r 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/esas2r/esas2r.ko 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/esp_scsi.ko 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fcoe 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fcoe/fcoe.ko 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fcoe/libfcoe.ko 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fnic 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fnic/fnic.ko 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/hpsa.ko 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/hptiop.ko 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/initio.ko 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ipr.ko 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ips.ko 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/isci 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/isci/isci.ko 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/iscsi_tcp.ko 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libfc 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libfc/libfc.ko 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libiscsi.ko 2026-02-24T09:04:47.285 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libiscsi_tcp.ko 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libsas 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libsas/libsas.ko 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/lpfc 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/lpfc/lpfc.ko 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid.ko 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mpt3sas 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mvsas 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mvsas/mvsas.ko 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mvumi.ko 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/pm8001 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/pm8001/pm80xx.ko 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/pmcraid.ko 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla1280.ko 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla2xxx 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla4xxx 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/raid_class.ko 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_debug.ko 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_fc.ko 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_iscsi.ko 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_sas.ko 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_spi.ko 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_srp.ko 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ses.ko 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/st.ko 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/stex.ko 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/sym53c8xx_2 2026-02-24T09:04:47.286 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/virtio_scsi.ko 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/vmw_pvscsi.ko 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/wd719x.ko 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ssb 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ssb/ssb.ko 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/iscsi 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/loopback 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/loopback/tcm_loop.ko 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_file.ko 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_iblock.ko 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_mod.ko 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_pscsi.ko 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_user.ko 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/tcm_fc 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/tcm_fc/tcm_fc.ko 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/platform_temperature_control.ko 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2026-02-24T09:04:47.287 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_soc_slider.ko 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/ipwireless 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/ipwireless/ipwireless.ko 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/n_gsm.ko 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/n_hdlc.ko 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/nozomi.ko 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/8250 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/8250/serial_cs.ko 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/arc_uart.ko 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/jsm 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/jsm/jsm.ko 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/core 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/core/ufshcd-core.ko 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/host 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/host/ufshcd-pci.ko 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio.ko 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_aec.ko 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_cif.ko 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_pci_generic.ko 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_sercos3.ko 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/cdc-acm.ko 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/cdc-wdm.ko 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/usblp.ko 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/usbtmc.ko 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/host 2026-02-24T09:04:47.288 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/host/sl811-hcd.ko 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/image 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/image/mdc800.ko 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/image/microtek.ko 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/adutux.ko 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/appledisplay.ko 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/emi26.ko 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/emi62.ko 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/ezusb.ko 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/idmouse.ko 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/iowarrior.ko 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/isight_firmware.ko 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/ldusb.ko 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/legousbtower.ko 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/sisusbvga 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/trancevibrator.ko 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/usb3503.ko 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/usblcd.ko 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/usbsevseg.ko 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/uss720.ko 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/yurex.ko 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/phy 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/phy/phy-generic.ko 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/aircable.ko 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ark3116.ko 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/belkin_sa.ko 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ch341.ko 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/cp210x.ko 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/cyberjack.ko 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/cypress_m8.ko 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/digi_acceleport.ko 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/empeg.ko 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ftdi_sio.ko 2026-02-24T09:04:47.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/garmin_gps.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/io_edgeport.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/io_ti.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ipaq.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ipw.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ir-usb.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/iuu_phoenix.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/keyspan.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/keyspan_pda.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/kl5kusb105.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/kobil_sct.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/mct_u232.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/mos7720.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/mos7840.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/navman.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/omninet.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/opticon.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/option.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/oti6858.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/pl2303.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/qcaux.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/qcserial.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/quatech2.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/safe_serial.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/sierra.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/spcp8x5.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ssu100.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/symbolserial.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/usb-serial-simple.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/usb_debug.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/usb_wwan.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/visor.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/whiteheat.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/xsens_mt.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/uas.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-alauda.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-cypress.ko 2026-02-24T09:04:47.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-datafab.ko 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-eneub6250.ko 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-freecom.ko 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-isd200.ko 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-jumpshot.ko 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-karma.ko 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-onetouch.ko 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-realtek.ko 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-sddr09.ko 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-sddr55.ko 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-usbat.ko 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/usb-storage.ko 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip/usbip-core.ko 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip/usbip-host.ko 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip/vhci-hcd.ko 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/pci 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/pci/vfio-pci-core.ko 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/pci/vfio-pci.ko 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/vfio.ko 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/vfio_iommu_type1.ko 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost.ko 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost_iotlb.ko 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost_net.ko 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost_scsi.ko 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight/apple_bl.ko 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight/lcd.ko 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight/platform_lcd.ko 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio.ko 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_balloon.ko 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_mmio.ko 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_pci.ko 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2026-02-24T09:04:47.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_ring.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/masters 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/masters/ds2482.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/masters/ds2490.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2406.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2408.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2413.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2423.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2431.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2433.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2780.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2781.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds28e04.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_smem.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_therm.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/wire.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/alim1535_wdt.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/alim7101_wdt.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/f71808e_wdt.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/hpwdt.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/i6300esb.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/iTCO_vendor_support.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/iTCO_wdt.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/ib700wdt.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/ibmasr.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/ie6xx_wdt.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/it8712f_wdt.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/it87_wdt.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/machzwd.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/nv_tco.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/pcwd_pci.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/pcwd_usb.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/sch311x_wdt.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/softdog.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/sp5100_tco.ko 2026-02-24T09:04:47.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/via_wdt.ko 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/w83627hf_wdt.ko 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/w83877f_wdt.ko 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/w83977f_wdt.ko 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/wdt_pci.ko 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/xen_wdt.ko 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-acpi-processor.ko 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-evtchn.ko 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-gntalloc.ko 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-gntdev.ko 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-pciback 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-privcmd.ko 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xenfs 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xenfs/xenfs.ko 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/9p 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/9p/9p.ko 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/affs 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/affs/affs.ko 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/befs 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/befs/befs.ko 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/binfmt_misc.ko 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/btrfs 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/btrfs/btrfs.ko 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cachefiles 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cachefiles/cachefiles.ko 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ceph 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ceph/ceph.ko 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/coda 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/coda/coda.ko 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cramfs 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cramfs/cramfs.ko 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/dlm 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/dlm/dlm.ko 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ecryptfs 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ecryptfs/ecryptfs.ko 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/f2fs 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/f2fs/f2fs.ko 2026-02-24T09:04:47.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat/fat.ko 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat/msdos.ko 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat/vfat.ko 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fuse 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fuse/cuse.ko 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fuse/fuse.ko 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/gfs2 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/gfs2/gfs2.ko 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfs 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfs/hfs.ko 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfsplus 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfsplus/hfsplus.ko 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/isofs 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/isofs/isofs.ko 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/jfs 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/jfs/jfs.ko 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/lockd 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/lockd/lockd.ko 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/minix 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/minix/minix.ko 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/netfs 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/netfs/netfs.ko 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/blocklayout 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/filelayout 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/flexfilelayout 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/nfs.ko 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/nfsv3.ko 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/nfsv4.ko 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs_common 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs_common/grace.ko 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs_common/nfs_acl.ko 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfsd 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfsd/nfsd.ko 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nilfs2 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nilfs2/nilfs2.ko 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls 2026-02-24T09:04:47.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-celtic.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-centeuro.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-croatian.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-cyrillic.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-gaelic.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-greek.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-iceland.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-inuit.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-roman.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-romanian.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-turkish.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp1250.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp1251.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp1255.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp737.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp775.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp850.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp852.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp855.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp857.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp860.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp861.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp862.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp863.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp864.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp865.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp866.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp869.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp874.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp932.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp936.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp949.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp950.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_euc-jp.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-1.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-13.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-14.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-15.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-2.ko 2026-02-24T09:04:47.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-3.ko 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-4.ko 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-5.ko 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-6.ko 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-7.ko 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-9.ko 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_koi8-r.ko 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_koi8-ru.ko 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_koi8-u.ko 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_ucs2_utils.ko 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_utf8.ko 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/cluster 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlm 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlmfs 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2.ko 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2_stack_user.ko 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2_stackglue.ko 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/overlayfs 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/overlayfs/overlay.ko 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/pstore 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/pstore/ramoops.ko 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/romfs 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/romfs/romfs.ko 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/client 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/client/cifs.ko 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/common 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/common/cifs_md4.ko 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/squashfs 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/squashfs/squashfs.ko 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/udf 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/udf/udf.ko 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ufs 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ufs/ufs.ko 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/xfs 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/xfs/xfs.ko 2026-02-24T09:04:47.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/rcu 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/rcu/rcutorture.ko 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/torture.ko 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/trace 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/trace/ring_buffer_benchmark.ko 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/asn1_encoder.ko 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crc 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crc/crc-itu-t.ko 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crc/crc8.ko 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto/libarc4.ko 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto/libblake2b.ko 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto/libdes.ko 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lru_cache.ko 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lz4 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lz4/lz4_compress.ko 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lz4/lz4hc_compress.ko 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/math 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/math/cordic.ko 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/raid6 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/raid6/raid6_pq.ko 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/reed_solomon 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/reed_solomon/reed_solomon.ko 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/ts_bm.ko 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/ts_fsm.ko 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/ts_kmp.ko 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/zstd 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/zstd/zstd_compress.ko 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/mm 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/mm/hwpoison-inject.ko 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/6lowpan.ko 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_dest.ko 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_fragment.ko 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_hop.ko 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_ipv6.ko 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_mobility.ko 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_routing.ko 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_udp.ko 2026-02-24T09:04:47.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/garp.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/mrp.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/psnap.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/stp.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/8021q 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/8021q/8021q.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet_fd.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet_rdma.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet_virtio.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/batman-adv 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/batman-adv/batman-adv.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/br_netfilter.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/bridge.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_802_3.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_among.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_arp.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_arpreply.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_dnat.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_ip.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_ip6.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_limit.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_log.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_mark.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_mark_m.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_nflog.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_pkttype.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_redirect.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_snat.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_stp.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_vlan.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ceph 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ceph/libceph.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/core 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/core/failover.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/core/pktgen.ko 2026-02-24T09:04:47.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dns_resolver 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dns_resolver/dns_resolver.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/dsa_core.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_brcm.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_dsa.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_none.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_trailer.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/6lowpan 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/ieee802154.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/ieee802154_socket.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ah4.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/esp4.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/fou.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/gre.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/inet_diag.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ip_gre.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ip_tunnel.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ip_vti.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ipcomp.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ipip.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/arpt_mangle.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_ECN.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_ah.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_bic.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_dctcp.ko 2026-02-24T09:04:47.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_diag.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_highspeed.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_htcp.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_hybla.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_illinois.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_lp.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_scalable.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_vegas.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_veno.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_westwood.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_yeah.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tunnel4.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/udp_diag.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/udp_tunnel.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/xfrm4_tunnel.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ah6.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/esp6.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/fou6.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ip6_tunnel.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ip6_udp_tunnel.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ip6_vti.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ipcomp6.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_ah.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_frag.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_mh.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_rt.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/sit.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/tunnel6.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/xfrm6_tunnel.ko 2026-02-24T09:04:47.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/key 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/key/af_key.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_core.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_debugfs.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_eth.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_ip.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_ip6.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_netlink.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_ppp.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/llc 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/llc/llc.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mac802154 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mac802154/mac802154.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mpls 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mpls/mpls_gso.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_list_set.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2026-02-24T09:04:47.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conncount.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_amanda.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_broadcast.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_ftp.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_h323.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_irc.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_netlink.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_pptp.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_sane.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_sip.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_snmp.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_tftp.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_dup_netdev.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_flow_table.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_flow_table_inet.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_log_syslog.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_amanda.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_ftp.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_irc.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_sip.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_tftp.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_synproxy_core.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_tables.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_acct.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_log.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_osf.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_queue.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_chain_nat.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_compat.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_ct.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_dup_netdev.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_fib.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_fwd_netdev.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_hash.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_limit.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_log.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_masq.ko 2026-02-24T09:04:47.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_nat.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_numgen.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_queue.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_quota.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_redir.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_reject.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_reject_inet.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_socket.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_tunnel.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_AUDIT.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CHECKSUM.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CLASSIFY.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CONNSECMARK.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CT.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_DSCP.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_HL.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_HMARK.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_IDLETIMER.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_LED.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_LOG.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_MASQUERADE.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_NETMAP.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_NFLOG.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_NFQUEUE.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_RATEEST.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_REDIRECT.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_SECMARK.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TCPMSS.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TEE.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TPROXY.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_addrtype.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_bpf.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_cgroup.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_cluster.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_comment.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connbytes.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connlabel.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connlimit.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connmark.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_conntrack.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_cpu.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_dccp.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_devgroup.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_dscp.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_ecn.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_esp.ko 2026-02-24T09:04:47.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_hashlimit.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_helper.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_hl.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_ipcomp.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_iprange.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_ipvs.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_l2tp.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_length.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_limit.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_mac.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_mark.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_multiport.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_nat.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_nfacct.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_osf.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_owner.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_physdev.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_pkttype.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_policy.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_quota.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_rateest.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_realm.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_recent.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_sctp.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_set.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_socket.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_state.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_statistic.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_string.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_tcpmss.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_time.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_u32.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netlink 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netlink/netlink_diag.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/nsh 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/nsh/nsh.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/openvswitch.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/vport-geneve.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/vport-gre.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/vport-vxlan.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/packet 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/packet/af_packet_diag.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds/rds.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds/rds_rdma.ko 2026-02-24T09:04:47.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds/rds_tcp.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_csum.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_gact.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_mirred.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_nat.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_pedit.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_police.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_simple.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_skbedit.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_vlan.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_basic.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_bpf.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_flow.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_fw.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_route.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_u32.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_cmp.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_ipset.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_meta.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_nbyte.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_text.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_u32.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_choke.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_codel.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_drr.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_fq.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_gred.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_hfsc.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_hhf.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_htb.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_ingress.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_mqprio.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_mqprio_lib.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_multiq.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_netem.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_pie.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_plug.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_prio.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_qfq.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_red.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_sfb.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_sfq.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_tbf.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_teql.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sctp 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sctp/sctp.ko 2026-02-24T09:04:47.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sctp/sctp_diag.ko 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/auth_gss 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/sunrpc.ko 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/xprtrdma 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/tipc 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/tipc/tipc.ko 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/tipc/tipc_diag.ko 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/unix 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/unix/unix_diag.ko 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vsock.ko 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vsock_diag.ko 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vsock_loopback.ko 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/xfrm 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/xfrm/xfrm_ipcomp.ko 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/encrypted-keys 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/trusted-keys 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/trusted-keys/trusted.ko 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/virt 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/virt/lib 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/virt/lib/irqbypass.ko 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.alias 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.alias.bin 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin.alias.bin 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin.bin 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin.modinfo 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.dep 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.dep.bin 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.devname 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.order 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.softdep 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.symbols 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.symbols.bin 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.weakdep 2026-02-24T09:04:47.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/vmlinuz 2026-02-24T09:04:47.309 DEBUG:teuthology.task.kernel:get_image_version: 6.19.0-g8dec4b357aab 2026-02-24T09:04:47.310 DEBUG:teuthology.orchestra.run.trial028:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2026-02-24T09:04:47.330 INFO:teuthology.orchestra.run.trial028.stdout:postinstall scriptlet (using /bin/sh): 2026-02-24T09:04:47.330 INFO:teuthology.orchestra.run.trial028.stdout:if [ -x /usr/bin/kernel-install ]; then 2026-02-24T09:04:47.330 INFO:teuthology.orchestra.run.trial028.stdout: /usr/bin/kernel-install add 6.19.0-g8dec4b357aab /lib/modules/6.19.0-g8dec4b357aab/vmlinuz 2026-02-24T09:04:47.330 INFO:teuthology.orchestra.run.trial028.stdout:fi 2026-02-24T09:04:47.330 INFO:teuthology.orchestra.run.trial028.stdout:for file in vmlinuz System.map config; do 2026-02-24T09:04:47.330 INFO:teuthology.orchestra.run.trial028.stdout: if ! cmp --silent "/lib/modules/6.19.0-g8dec4b357aab/${file}" "/boot/${file}-6.19.0-g8dec4b357aab"; then 2026-02-24T09:04:47.330 INFO:teuthology.orchestra.run.trial028.stdout: cp "/lib/modules/6.19.0-g8dec4b357aab/${file}" "/boot/${file}-6.19.0-g8dec4b357aab" 2026-02-24T09:04:47.330 INFO:teuthology.orchestra.run.trial028.stdout: fi 2026-02-24T09:04:47.330 INFO:teuthology.orchestra.run.trial028.stdout:done 2026-02-24T09:04:47.330 INFO:teuthology.orchestra.run.trial028.stdout:if [ -d "/lib/modules/6.19.0-g8dec4b357aab/dtb" ] && \ 2026-02-24T09:04:47.330 INFO:teuthology.orchestra.run.trial028.stdout: ! diff -rq "/lib/modules/6.19.0-g8dec4b357aab/dtb" "/boot/dtb-6.19.0-g8dec4b357aab" >/dev/null 2>&1; then 2026-02-24T09:04:47.330 INFO:teuthology.orchestra.run.trial028.stdout: rm -rf "/boot/dtb-6.19.0-g8dec4b357aab" 2026-02-24T09:04:47.330 INFO:teuthology.orchestra.run.trial028.stdout: cp -r "/lib/modules/6.19.0-g8dec4b357aab/dtb" "/boot/dtb-6.19.0-g8dec4b357aab" 2026-02-24T09:04:47.330 INFO:teuthology.orchestra.run.trial028.stdout:fi 2026-02-24T09:04:47.330 INFO:teuthology.orchestra.run.trial028.stdout:if [ ! -e "/lib/modules/6.19.0-g8dec4b357aab/modules.dep" ]; then 2026-02-24T09:04:47.330 INFO:teuthology.orchestra.run.trial028.stdout: /usr/sbin/depmod 6.19.0-g8dec4b357aab 2026-02-24T09:04:47.330 INFO:teuthology.orchestra.run.trial028.stdout:fi 2026-02-24T09:04:47.330 INFO:teuthology.orchestra.run.trial028.stdout:preuninstall scriptlet (using /bin/sh): 2026-02-24T09:04:47.330 INFO:teuthology.orchestra.run.trial028.stdout:if [ -x /usr/bin/kernel-install ]; then 2026-02-24T09:04:47.330 INFO:teuthology.orchestra.run.trial028.stdout:kernel-install remove 6.19.0-g8dec4b357aab 2026-02-24T09:04:47.330 INFO:teuthology.orchestra.run.trial028.stdout:fi 2026-02-24T09:04:47.331 DEBUG:teuthology.orchestra.run.trial028:> sudo rpm -qi grub2-tools 2026-02-24T09:04:47.399 INFO:teuthology.orchestra.run.trial028.stdout:Name : grub2-tools 2026-02-24T09:04:47.399 INFO:teuthology.orchestra.run.trial028.stdout:Epoch : 1 2026-02-24T09:04:47.399 INFO:teuthology.orchestra.run.trial028.stdout:Version : 2.06 2026-02-24T09:04:47.399 INFO:teuthology.orchestra.run.trial028.stdout:Release : 120.el9 2026-02-24T09:04:47.399 INFO:teuthology.orchestra.run.trial028.stdout:Architecture: x86_64 2026-02-24T09:04:47.399 INFO:teuthology.orchestra.run.trial028.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-24T09:04:47.399 INFO:teuthology.orchestra.run.trial028.stdout:Group : Unspecified 2026-02-24T09:04:47.399 INFO:teuthology.orchestra.run.trial028.stdout:Size : 9108611 2026-02-24T09:04:47.399 INFO:teuthology.orchestra.run.trial028.stdout:License : GPLv3+ 2026-02-24T09:04:47.399 INFO:teuthology.orchestra.run.trial028.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-24T09:04:47.399 INFO:teuthology.orchestra.run.trial028.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-24T09:04:47.399 INFO:teuthology.orchestra.run.trial028.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-24T09:04:47.399 INFO:teuthology.orchestra.run.trial028.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-24T09:04:47.399 INFO:teuthology.orchestra.run.trial028.stdout:Packager : builder@centos.org 2026-02-24T09:04:47.399 INFO:teuthology.orchestra.run.trial028.stdout:Vendor : CentOS 2026-02-24T09:04:47.399 INFO:teuthology.orchestra.run.trial028.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-24T09:04:47.399 INFO:teuthology.orchestra.run.trial028.stdout:Summary : Support tools for GRUB. 2026-02-24T09:04:47.399 INFO:teuthology.orchestra.run.trial028.stdout:Description : 2026-02-24T09:04:47.399 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:04:47.399 INFO:teuthology.orchestra.run.trial028.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-24T09:04:47.399 INFO:teuthology.orchestra.run.trial028.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-24T09:04:47.399 INFO:teuthology.orchestra.run.trial028.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-24T09:04:47.399 INFO:teuthology.orchestra.run.trial028.stdout:hardware devices. 2026-02-24T09:04:47.399 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:04:47.399 INFO:teuthology.orchestra.run.trial028.stdout:This subpackage provides tools for support of all platforms. 2026-02-24T09:04:47.401 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-24T09:04:47.401 INFO:teuthology.task.kernel:Updating grub on trial028 to boot 6.19.0-g8dec4b357aab 2026-02-24T09:04:47.401 DEBUG:teuthology.orchestra.run.trial028:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-24T09:04:47.464 INFO:teuthology.orchestra.run.trial028.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-24T09:04:47.466 DEBUG:teuthology.orchestra.run.trial028:> sudo command -v grubby && echo yes || echo no 2026-02-24T09:04:47.529 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/grubby 2026-02-24T09:04:47.531 INFO:teuthology.orchestra.run.trial028.stdout:yes 2026-02-24T09:04:47.531 DEBUG:teuthology.orchestra.run.trial028:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.19.0-g8dec4b357aab" | head -n 1 2026-02-24T09:04:47.596 INFO:teuthology.orchestra.run.trial028.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-6.19.0-g8dec4b357aab.conf 2026-02-24T09:04:47.597 DEBUG:teuthology.orchestra.run.trial028:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-6.19.0-g8dec4b357aab 2026-02-24T09:04:47.670 DEBUG:teuthology.orchestra.run.trial028:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-24T09:04:47.880 INFO:teuthology.orchestra.run.trial028.stderr:Generating grub configuration file ... 2026-02-24T09:04:47.947 INFO:teuthology.orchestra.run.trial028.stderr:Found linux image: /boot/vmlinuz-6.19.0-g8dec4b357aab 2026-02-24T09:04:47.954 INFO:teuthology.orchestra.run.trial028.stderr:Found initrd image: /boot/initramfs-6.19.0-g8dec4b357aab.img 2026-02-24T09:04:48.208 INFO:teuthology.orchestra.run.trial028.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-24T09:04:48.215 INFO:teuthology.orchestra.run.trial028.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-24T09:04:48.249 INFO:teuthology.orchestra.run.trial028.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-24T09:04:48.256 INFO:teuthology.orchestra.run.trial028.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-24T09:04:48.287 INFO:teuthology.orchestra.run.trial028.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-24T09:04:48.294 INFO:teuthology.orchestra.run.trial028.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-24T09:04:48.317 INFO:teuthology.orchestra.run.trial028.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-24T09:04:48.324 INFO:teuthology.orchestra.run.trial028.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-24T09:04:48.410 INFO:teuthology.orchestra.run.trial028.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-24T09:04:48.419 INFO:teuthology.orchestra.run.trial028.stderr:done 2026-02-24T09:04:48.421 DEBUG:teuthology.orchestra.run.trial028:> test -d /sys/firmware/efi 2026-02-24T09:04:48.438 DEBUG:teuthology.orchestra.run.trial028:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-24T09:04:48.503 INFO:teuthology.orchestra.run.trial028.stdout:/boot/efi/EFI/BOOT 2026-02-24T09:04:48.504 INFO:teuthology.orchestra.run.trial028.stdout:/boot/efi/EFI/centos 2026-02-24T09:04:48.505 DEBUG:teuthology.orchestra.run.trial028:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-24T09:04:48.570 INFO:teuthology.orchestra.run.trial028.stdout:no 2026-02-24T09:04:48.570 DEBUG:teuthology.orchestra.run.trial028:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-24T09:04:48.634 INFO:teuthology.orchestra.run.trial028.stdout:yes 2026-02-24T09:04:48.634 DEBUG:teuthology.orchestra.run.trial028:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-24T09:04:48.698 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial028 2026-02-24T09:04:48.698 DEBUG:teuthology.orchestra.run.trial028:> sudo bash -c ' 2026-02-24T09:04:48.699 DEBUG:teuthology.orchestra.run.trial028:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-24T09:04:48.699 DEBUG:teuthology.orchestra.run.trial028:> ' 2026-02-24T09:04:50.766 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial074.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2026-02-24T09:04:50.766 DEBUG:teuthology.orchestra.run.trial074:> rpm -qlp /tmp/kernel.x86_64.rpm 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/boot/System.map-6.19.0-g8dec4b357aab 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/boot/config-6.19.0-g8dec4b357aab 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/boot/vmlinuz-6.19.0-g8dec4b357aab 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/System.map 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/config 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/blowfish-x86_64.ko 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/camellia-x86_64.ko 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/serpent-avx2.ko 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/twofish-x86_64.ko 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel/cpu 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel/cpu/mce 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm/kvm-amd.ko 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm/kvm-intel.ko 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm/kvm.ko 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/anubis.ko 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/arc4.ko 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_memcpy.ko 2026-02-24T09:04:50.795 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_pq.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_raid6_recov.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_tx.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_xor.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/raid6test.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/authenc.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/authencesn.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/blake2b.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/blowfish_common.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/blowfish_generic.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/camellia_generic.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cast5_generic.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cast6_generic.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cast_common.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/ccm.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cmac.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/crc32-cryptoapi.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/crypto_engine.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/crypto_user.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/des_generic.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/dh_generic.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/echainiv.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/essiv.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/fcrypt.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/khazad.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/krb5 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/krb5/krb5.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/krb5enc.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/lz4.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/lz4hc.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/md4.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/michael_mic.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/pcbc.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/pcrypt.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/rmd160.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/seed.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/serpent_generic.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/tea.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/twofish_common.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/twofish_generic.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/wp512.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/xcbc.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/xor.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/xxhash_generic.ko 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi 2026-02-24T09:04:50.796 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/acpi_ipmi.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/acpi_pad.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/ec_sys.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/platform_profile.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/sbs.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/sbshc.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/video.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/acard-ahci.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/ahci_platform.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/ata_generic.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/libahci_platform.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_acpi.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ali.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_amd.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_artop.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_atiixp.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_atp867x.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_cmd640.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_cmd64x.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_cypress.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_efar.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt366.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt37x.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt3x2n.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt3x3.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_it8213.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_it821x.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_jmicron.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_marvell.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_mpiix.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_netcell.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ninja32.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ns87410.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ns87415.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_oldpiix.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_opti.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_optidma.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_pcmcia.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_pdc2027x.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_pdc202xx_old.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_piccolo.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_rdc.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sch.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_serverworks.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sil680.ko 2026-02-24T09:04:50.797 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sis.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sl82c105.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_triflex.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_via.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pdc_adma.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_inic162x.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_mv.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_nv.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_promise.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_qstor.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sil.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sil24.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sis.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_svw.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sx4.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_uli.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_via.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_vsc.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/auxdisplay 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/auxdisplay/ks0108.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base/regmap 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base/regmap/regmap-i2c.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base/regmap/regmap-mmio.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/bcma 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/bcma/bcma.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/aoe 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/aoe/aoe.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/brd.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/drbd 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/drbd/drbd.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/floppy.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/loop.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/mtip32xx 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/mtip32xx/mtip32xx.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/nbd.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/null_blk 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/null_blk/null_blk.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/rbd.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/virtio_blk.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/xen-blkback 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/xen-blkback/xen-blkback.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/xen-blkfront.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/zram 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/zram/zram.ko 2026-02-24T09:04:50.798 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hangcheck-timer.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/amd-rng.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/intel-rng.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/timeriomem-rng.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/via-rng.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/virtio-rng.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_devintf.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_si.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_ssif.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/lp.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/mwave 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/mwave/mwave.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ppdev.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tlclk.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_atmel.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_infineon.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_nsc.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_tis.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_tis_core.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/uv_mmtimer.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/virtio_console.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/acpi-cpufreq.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/p4-clockmod.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/pcc-cpufreq.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/powernow-k8.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/speedstep-lib.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/ccp 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/ccp/ccp-crypto.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/ccp/ccp.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_common 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/padlock-aes.ko 2026-02-24T09:04:50.799 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/padlock-sha.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/virtio 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/virtio/virtio_crypto.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dca 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dca/dca.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/devfreq 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/devfreq/governor_simpleondemand.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/dw 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/dw/dw_dmac.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/ioat 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/ioat/ioatdma.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/amd64_edac.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/e752x_edac.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/edac_mce_amd.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i3000_edac.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i3200_edac.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i5100_edac.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i5400_edac.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i7300_edac.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i7core_edac.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i82975x_edac.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/ie31200_edac.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/sb_edac.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/x38_edac.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/firmware 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/firmware/edd.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/firmware/iscsi_ibft.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/gpio 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/gpio/gpio-ich.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/gpio/gpio-viperboard.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-appleir.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-aureal.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-axff.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-dr.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-elecom.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-elo.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-emsff.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-gaff.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-gt683r.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-gyration.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-holtek-kbd.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-holtek-mouse.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-holtekff.ko 2026-02-24T09:04:50.800 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-icade.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-keytouch.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-kye.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-lcpower.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-led.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-lenovo.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-multitouch.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-ortek.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-penmount.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-petalynx.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-picolcd.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-pl.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-plantronics.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-primax.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-rmi.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-arvo.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-common.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-isku.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-kone.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-koneplus.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-konepure.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-kovaplus.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-lua.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-pyra.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-ryos.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-savu.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-saitek.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-samsung.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sensor-hub.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sjoy.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sony.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-speedlink.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-steelseries.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sunplus.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-thrustmaster.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-tivo.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-tmff.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-topseed.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-twinhan.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-uclogic.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-waltop.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-wiimote.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-xinmo.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-zpff.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-zydacron.ko 2026-02-24T09:04:50.801 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/uhid.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/wacom.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/abituguru.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/abituguru3.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/acpi_power_meter.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ad7414.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ad7418.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adc128d818.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1025.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1026.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1029.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1031.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm9240.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ads7828.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7410.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7411.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7462.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7470.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7475.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7x10.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/amc6821.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/applesmc.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/asb100.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/asc7621.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/asus_atk0110.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/atxp1.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/coretemp.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/dell-smm-hwmon.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/dme1737.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ds1621.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ds620.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/emc1403.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/emc6w201.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/f71805f.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/f71882fg.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/f75375s.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/fam15h_power.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/fschmd.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/g760a.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/g762.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/gl518sm.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/gl520sm.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/hwmon-vid.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/i5500_temp.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/i5k_amb.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ibmaem.ko 2026-02-24T09:04:50.802 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ibmpex.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ina209.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ina2xx.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/it87.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/k10temp.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/k8temp.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lineage-pem.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm63.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm73.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm75.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm77.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm78.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm80.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm83.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm85.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm87.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm90.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm92.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm93.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm95234.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm95241.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm95245.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc2945.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4151.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4215.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4222.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4245.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4260.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4261.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max16065.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max1619.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max1668.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max197.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max6639.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max6650.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max6697.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/mcp3021.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct6683.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct6775-core.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct6775.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct7802.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pc87360.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pc87427.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pcf8591.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/adm1275.ko 2026-02-24T09:04:50.803 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/lm25066.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/ltc2978.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/max16064.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/max34440.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/max8688.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/pmbus.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/tps40422.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/ucd9000.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/ucd9200.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/zl6100.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/powr1220.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sch5627.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sch5636.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sch56xx-common.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sht15.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sht21.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/shtc1.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sis5595.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/smsc47b397.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/smsc47m1.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/smsc47m192.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/thmc50.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp102.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp103.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp401.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp421.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/via-cputemp.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/via686a.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/vt1211.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/vt8231.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83627ehf.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83627hf.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83781d.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83791d.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83792d.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83793.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83795.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83l785ts.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83l786ng.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/algos 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-amd756.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-amd8111.ko 2026-02-24T09:04:50.804 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-designware-core.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-i801.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-isch.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-ismt.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-nforce2.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-parport.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-piix4.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-scmi.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-simtec.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-sis96x.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-via.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-viapro.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-viperboard.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-dev.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-mux.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-slave-eeprom.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-smbus.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-stub.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_cm.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_core.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_umad.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_uverbs.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/iw_cm.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/rdma_cm.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/rdma_ucm.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/cxgb4 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx4 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx5 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mthca 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/ipoib 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/iser 2026-02-24T09:04:50.805 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/isert 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srp 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srpt 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport/emu10k1-gp.ko 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport/fm801-gp.ko 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport/gameport.ko 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/joydev.ko 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/keyboard 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/keyboard/gpio_keys.ko 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/appletouch.ko 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/bcm5974.ko 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/cyapatp.ko 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/elan_i2c.ko 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/sermouse.ko 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/synaptics_i2c.ko 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/synaptics_usb.ko 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/vsxxxaa.ko 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/rmi4 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/rmi4/rmi_core.ko 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio/altera_ps2.ko 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio/arc_ps2.ko 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio/serio_raw.ko 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/sparse-keymap.ko 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-blinkm.ko 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-lm3530.ko 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-lp3944.ko 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-ss4200.ko 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-camera.ko 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-timer.ko 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-transient.ko 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/bcache 2026-02-24T09:04:50.806 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/bcache/bcache.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-bio-prison.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-cache-smq.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-cache.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-crypt.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-delay.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-flakey.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-log-userspace.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-multipath.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-queue-length.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-raid.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-round-robin.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-service-time.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-switch.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-thin-pool.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-verity.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/linear.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/persistent-data 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid0.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid1.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid10.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid456.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptbase.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptctl.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptfc.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptlan.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptsas.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptscsih.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptspi.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/lpc_ich.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/lpc_sch.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/mfd-core.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/sm501.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/viperboard.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/vx855.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/altera-stapl 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/apds9802als.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/apds990x.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/bh1770glc.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/cb710 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/cb710/cb710.ko 2026-02-24T09:04:50.807 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/eeprom 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/eeprom/at24.ko 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/eeprom/max6875.ko 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/enclosure.ko 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/hpilo.ko 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/isl29003.ko 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/isl29020.ko 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/lis3lv02d 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei/mei-me.ko 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei/mei-txe.ko 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei/mei.ko 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-gru 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-gru/gru.ko 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp/xp.ko 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp/xpc.ko 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp/xpnet.ko 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/tifm_7xx1.ko 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/tifm_core.ko 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/tsl2550.ko 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/vmw_balloon.ko 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/vmw_vmci 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/bonding 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/bonding/bonding.ko 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/b53 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/b53/b53_common.ko 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/bcm-sf2.ko 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/mv88e6060.ko 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/mv88e6xxx 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dummy.ko 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/eql.ko 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/3c59x.ko 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/typhoon.ko 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/8390.ko 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2026-02-24T09:04:50.808 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/adaptec 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/adaptec/starfire.ko 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/agere 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/agere/et131x.ko 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/alteon 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/alteon/acenic.ko 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/altera 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/altera/altera_tse.ko 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd/amd8111e.ko 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd/pcnet32.ko 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/alx 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1c 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1e 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atlx 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/b44.ko 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/bnx2x 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/cnic.ko 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/genet 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/tg3.ko 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/brocade 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/brocade/bna 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb3 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/libcxgb 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/cisco 2026-02-24T09:04:50.809 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/cisco/enic 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dlink 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dlink/dl2k.ko 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dlink/sundance.ko 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dnet.ko 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/emulex 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/emulex/benet 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/ethoc.ko 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/fealnx.ko 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e100.ko 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000e 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/fm10k 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/i40e 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/iavf 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ice 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ice/ice.ko 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igb 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igb/igb.ko 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igbvf 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbe 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbevf 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libeth 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libeth/libeth_xdp.ko 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie/libie.ko 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie/libie_adminq.ko 2026-02-24T09:04:50.810 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie/libie_fwlog.ko 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/jme.ko 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell/skge.ko 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell/sky2.ko 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx4 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx5 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx5/core 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/micrel 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/myricom 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/myricom/myri10ge 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/natsemi 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/neterion 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/neterion/s2io.ko 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/nvidia 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/packetengines 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/netxen 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/qlcnic 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rdc 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rdc/r6040.ko 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/8139cp.ko 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/8139too.ko 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/atp.ko 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/r8169.ko 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rocker 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rocker/rocker.ko 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sfc 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sfc/sfc.ko 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/silan 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/silan/sc92031.ko 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sis 2026-02-24T09:04:50.811 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sis/sis190.ko 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sis/sis900.ko 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/epic100.ko 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro/stmmac 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/cassini.ko 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/niu.ko 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/sungem.ko 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/sunhme.ko 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/tehuti 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/ti 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/ti/tlan.ko 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/via 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/via/via-rhine.ko 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/via/via-velocity.ko 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/wiznet 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/wiznet/w5100.ko 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/wiznet/w5300.ko 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/xircom 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/geneve.ko 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ieee802154 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ieee802154/fakelb.ko 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ifb.ko 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ipvlan 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ipvlan/ipvlan.ko 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/macvlan.ko 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/macvtap.ko 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio.ko 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio/mdio-bitbang.ko 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio/mdio-regmap.ko 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mii.ko 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/net_failover.ko 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/netconsole.ko 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/nlmon.ko 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/pcs 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/pcs/pcs-lynx.ko 2026-02-24T09:04:50.812 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/pcs/pcs_xpcs.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/amd.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm-phy-lib.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm-phy-ptp.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm7xxx.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm87xx.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/broadcom.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/cicada.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/davicom.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/dp83640.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/et1011c.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/icplus.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/lxt.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/marvell.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/micrel.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/national.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/phy_package.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/phylink.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/qsemi.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/realtek 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/realtek/realtek.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/smsc.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/ste10Xp.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/vitesse.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/bsd_comp.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_async.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_deflate.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_generic.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_mppe.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_synctty.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/pppoe.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/pppox.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/pptp.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/slip 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/slip/slhc.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/slip/slip.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/sungem_phy.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/tap.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_activebackup.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_broadcast.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_loadbalance.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_random.ko 2026-02-24T09:04:50.813 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_roundrobin.ko 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/tun.ko 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/veth.ko 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/virtio_net.ko 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vmxnet3 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vmxnet3/vmxnet3.ko 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vxlan 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vxlan/vxlan.ko 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/xen-netback 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/xen-netback/xen-netback.ko 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/xen-netfront.ko 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ntb 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ntb/ntb.ko 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme/host 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme/host/nvme-core.ko 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme/host/nvme.ko 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport.ko 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport_cs.ko 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport_pc.ko 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport_serial.ko 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/hotplug 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/pcie 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/pcie/aer_inject.ko 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/xen-pcifront.ko 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia/i82092.ko 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia/pd6729.ko 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia/yenta_socket.ko 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pinctrl 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pinctrl/intel 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/wmi 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/wmi/wmi.ko 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/acer-wmi.ko 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/acerhdf.ko 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/apple-gmux.ko 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/asus-laptop.ko 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/asus-nb-wmi.ko 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/asus-wmi.ko 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/classmate-laptop.ko 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/eeepc-laptop.ko 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/eeepc-wmi.ko 2026-02-24T09:04:50.814 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/fujitsu-laptop.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/fujitsu-tablet.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/hdaps.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/intel 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/intel/intel-rst.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/intel_ips.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/msi-wmi.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/mxm-wmi.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/panasonic-laptop.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/samsung-laptop.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/samsung-q10.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/topstar-laptop.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/toshiba_haps.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/wmi-bmof.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/powercap 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/powercap/intel_rapl_common.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/powercap/intel_rapl_msr.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients/pps-gpio.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients/pps-ldisc.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients/pps_parport.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/pps_core.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp/ptp.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp/ptp_kvm.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp/ptp_vmclock.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd/atl 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd/atl/amd_atl.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd/fmpm.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-bq32k.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1286.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1307.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1374.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1511.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1553.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1672.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1742.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds2404.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds3232.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-em3027.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-fm3130.ko 2026-02-24T09:04:50.815 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-isl12022.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-isl1208.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-m41t80.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-m48t35.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-m48t59.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-max6900.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-msm6242.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf2127.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf85063.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf8523.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf8563.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf8583.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rp5c01.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rs5c372.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rv3029c2.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rx8025.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rx8581.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-stk17ta8.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-x1205.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/3w-9xxx.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/3w-sas.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/3w-xxxx.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/BusLogic.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/a100u2w.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aacraid 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aacraid/aacraid.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/advansys.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aic7xxx 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/am53c974.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/arcmsr 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/arcmsr/arcmsr.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/atp870u.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/be2iscsi 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bfa 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bfa/bfa.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2fc 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2i 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2i/bnx2i.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ch.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/csiostor 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/csiostor/csiostor.ko 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi 2026-02-24T09:04:50.816 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb3i 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb4i 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/dc395x.ko 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/dmx3191d.ko 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/esas2r 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/esas2r/esas2r.ko 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/esp_scsi.ko 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fcoe 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fcoe/fcoe.ko 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fcoe/libfcoe.ko 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fnic 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fnic/fnic.ko 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/hpsa.ko 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/hptiop.ko 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/initio.ko 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ipr.ko 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ips.ko 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/isci 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/isci/isci.ko 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/iscsi_tcp.ko 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libfc 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libfc/libfc.ko 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libiscsi.ko 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libiscsi_tcp.ko 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libsas 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libsas/libsas.ko 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/lpfc 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/lpfc/lpfc.ko 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid.ko 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mpt3sas 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mvsas 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mvsas/mvsas.ko 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mvumi.ko 2026-02-24T09:04:50.817 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/pm8001 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/pm8001/pm80xx.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/pmcraid.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla1280.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla2xxx 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla4xxx 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/raid_class.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_debug.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_fc.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_iscsi.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_sas.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_spi.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_srp.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ses.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/st.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/stex.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/sym53c8xx_2 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/virtio_scsi.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/vmw_pvscsi.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/wd719x.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ssb 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ssb/ssb.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/iscsi 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/loopback 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/loopback/tcm_loop.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_file.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_iblock.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_mod.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_pscsi.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_user.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/tcm_fc 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/tcm_fc/tcm_fc.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2026-02-24T09:04:50.818 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/platform_temperature_control.ko 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_soc_slider.ko 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/ipwireless 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/ipwireless/ipwireless.ko 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/n_gsm.ko 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/n_hdlc.ko 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/nozomi.ko 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/8250 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/8250/serial_cs.ko 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/arc_uart.ko 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/jsm 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/jsm/jsm.ko 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/core 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/core/ufshcd-core.ko 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/host 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/host/ufshcd-pci.ko 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio.ko 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_aec.ko 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_cif.ko 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_pci_generic.ko 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_sercos3.ko 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/cdc-acm.ko 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/cdc-wdm.ko 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/usblp.ko 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/usbtmc.ko 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/host 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/host/sl811-hcd.ko 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/image 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/image/mdc800.ko 2026-02-24T09:04:50.819 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/image/microtek.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/adutux.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/appledisplay.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/emi26.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/emi62.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/ezusb.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/idmouse.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/iowarrior.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/isight_firmware.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/ldusb.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/legousbtower.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/sisusbvga 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/trancevibrator.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/usb3503.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/usblcd.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/usbsevseg.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/uss720.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/yurex.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/phy 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/phy/phy-generic.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/aircable.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ark3116.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/belkin_sa.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ch341.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/cp210x.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/cyberjack.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/cypress_m8.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/digi_acceleport.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/empeg.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ftdi_sio.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/garmin_gps.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/io_edgeport.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/io_ti.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ipaq.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ipw.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ir-usb.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/iuu_phoenix.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/keyspan.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/keyspan_pda.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/kl5kusb105.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/kobil_sct.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/mct_u232.ko 2026-02-24T09:04:50.820 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/mos7720.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/mos7840.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/navman.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/omninet.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/opticon.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/option.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/oti6858.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/pl2303.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/qcaux.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/qcserial.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/quatech2.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/safe_serial.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/sierra.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/spcp8x5.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ssu100.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/symbolserial.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/usb-serial-simple.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/usb_debug.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/usb_wwan.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/visor.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/whiteheat.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/xsens_mt.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/uas.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-alauda.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-cypress.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-datafab.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-eneub6250.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-freecom.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-isd200.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-jumpshot.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-karma.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-onetouch.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-realtek.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-sddr09.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-sddr55.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-usbat.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/usb-storage.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip/usbip-core.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip/usbip-host.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip/vhci-hcd.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/pci 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/pci/vfio-pci-core.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/pci/vfio-pci.ko 2026-02-24T09:04:50.821 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/vfio.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/vfio_iommu_type1.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost_iotlb.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost_net.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost_scsi.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight/apple_bl.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight/lcd.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight/platform_lcd.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_balloon.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_mmio.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_pci.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_ring.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/masters 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/masters/ds2482.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/masters/ds2490.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2406.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2408.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2413.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2423.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2431.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2433.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2780.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2781.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds28e04.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_smem.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_therm.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/wire.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/alim1535_wdt.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/alim7101_wdt.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/f71808e_wdt.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/hpwdt.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/i6300esb.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/iTCO_vendor_support.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/iTCO_wdt.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/ib700wdt.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/ibmasr.ko 2026-02-24T09:04:50.822 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/ie6xx_wdt.ko 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/it8712f_wdt.ko 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/it87_wdt.ko 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/machzwd.ko 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/nv_tco.ko 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/pcwd_pci.ko 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/pcwd_usb.ko 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/sch311x_wdt.ko 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/softdog.ko 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/sp5100_tco.ko 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/via_wdt.ko 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/w83627hf_wdt.ko 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/w83877f_wdt.ko 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/w83977f_wdt.ko 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/wdt_pci.ko 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/xen_wdt.ko 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-acpi-processor.ko 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-evtchn.ko 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-gntalloc.ko 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-gntdev.ko 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-pciback 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-privcmd.ko 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xenfs 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xenfs/xenfs.ko 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/9p 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/9p/9p.ko 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/affs 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/affs/affs.ko 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/befs 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/befs/befs.ko 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/binfmt_misc.ko 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/btrfs 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/btrfs/btrfs.ko 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cachefiles 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cachefiles/cachefiles.ko 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ceph 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ceph/ceph.ko 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/coda 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/coda/coda.ko 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cramfs 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cramfs/cramfs.ko 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/dlm 2026-02-24T09:04:50.823 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/dlm/dlm.ko 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ecryptfs 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ecryptfs/ecryptfs.ko 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/f2fs 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/f2fs/f2fs.ko 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat/fat.ko 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat/msdos.ko 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat/vfat.ko 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fuse 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fuse/cuse.ko 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fuse/fuse.ko 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/gfs2 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/gfs2/gfs2.ko 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfs 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfs/hfs.ko 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfsplus 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfsplus/hfsplus.ko 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/isofs 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/isofs/isofs.ko 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/jfs 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/jfs/jfs.ko 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/lockd 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/lockd/lockd.ko 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/minix 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/minix/minix.ko 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/netfs 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/netfs/netfs.ko 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/blocklayout 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/filelayout 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/flexfilelayout 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/nfs.ko 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/nfsv3.ko 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/nfsv4.ko 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs_common 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs_common/grace.ko 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs_common/nfs_acl.ko 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfsd 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfsd/nfsd.ko 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nilfs2 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nilfs2/nilfs2.ko 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-celtic.ko 2026-02-24T09:04:50.824 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-centeuro.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-croatian.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-cyrillic.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-gaelic.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-greek.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-iceland.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-inuit.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-roman.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-romanian.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-turkish.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp1250.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp1251.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp1255.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp737.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp775.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp850.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp852.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp855.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp857.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp860.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp861.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp862.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp863.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp864.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp865.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp866.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp869.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp874.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp932.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp936.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp949.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp950.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_euc-jp.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-1.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-13.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-14.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-15.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-2.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-3.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-4.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-5.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-6.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-7.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-9.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_koi8-r.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_koi8-ru.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_koi8-u.ko 2026-02-24T09:04:50.825 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_ucs2_utils.ko 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_utf8.ko 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/cluster 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlm 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlmfs 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2.ko 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2_stack_user.ko 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2_stackglue.ko 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/overlayfs 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/overlayfs/overlay.ko 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/pstore 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/pstore/ramoops.ko 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/romfs 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/romfs/romfs.ko 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/client 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/client/cifs.ko 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/common 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/common/cifs_md4.ko 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/squashfs 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/squashfs/squashfs.ko 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/udf 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/udf/udf.ko 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ufs 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ufs/ufs.ko 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/xfs 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/xfs/xfs.ko 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/rcu 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/rcu/rcutorture.ko 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/torture.ko 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/trace 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/trace/ring_buffer_benchmark.ko 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/asn1_encoder.ko 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crc 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crc/crc-itu-t.ko 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crc/crc8.ko 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto/libarc4.ko 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto/libblake2b.ko 2026-02-24T09:04:50.826 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto/libdes.ko 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lru_cache.ko 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lz4 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lz4/lz4_compress.ko 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lz4/lz4hc_compress.ko 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/math 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/math/cordic.ko 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/raid6 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/raid6/raid6_pq.ko 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/reed_solomon 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/reed_solomon/reed_solomon.ko 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/ts_bm.ko 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/ts_fsm.ko 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/ts_kmp.ko 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/zstd 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/zstd/zstd_compress.ko 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/mm 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/mm/hwpoison-inject.ko 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/6lowpan.ko 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_dest.ko 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_fragment.ko 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_hop.ko 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_ipv6.ko 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_mobility.ko 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_routing.ko 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_udp.ko 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/garp.ko 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/mrp.ko 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/psnap.ko 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/stp.ko 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/8021q 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/8021q/8021q.ko 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet.ko 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet_fd.ko 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet_rdma.ko 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet_virtio.ko 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/batman-adv 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/batman-adv/batman-adv.ko 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/br_netfilter.ko 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/bridge.ko 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_802_3.ko 2026-02-24T09:04:50.827 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_among.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_arp.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_arpreply.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_dnat.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_ip.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_ip6.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_limit.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_log.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_mark.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_mark_m.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_nflog.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_pkttype.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_redirect.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_snat.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_stp.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_vlan.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ceph 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ceph/libceph.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/core 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/core/failover.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/core/pktgen.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dns_resolver 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dns_resolver/dns_resolver.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/dsa_core.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_brcm.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_dsa.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_none.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_trailer.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/6lowpan 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/ieee802154.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/ieee802154_socket.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ah4.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/esp4.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/fou.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/gre.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/inet_diag.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ip_gre.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ip_tunnel.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ip_vti.ko 2026-02-24T09:04:50.828 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ipcomp.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ipip.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/arpt_mangle.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_ECN.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_ah.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_bic.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_dctcp.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_diag.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_highspeed.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_htcp.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_hybla.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_illinois.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_lp.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_scalable.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_vegas.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_veno.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_westwood.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_yeah.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tunnel4.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/udp_diag.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/udp_tunnel.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/xfrm4_tunnel.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ah6.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/esp6.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/fou6.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ip6_tunnel.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ip6_udp_tunnel.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ip6_vti.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ipcomp6.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2026-02-24T09:04:50.829 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_ah.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_frag.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_mh.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_rt.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/sit.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/tunnel6.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/xfrm6_tunnel.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/key 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/key/af_key.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_core.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_debugfs.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_eth.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_ip.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_ip6.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_netlink.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_ppp.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/llc 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/llc/llc.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mac802154 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mac802154/mac802154.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mpls 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mpls/mpls_gso.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2026-02-24T09:04:50.830 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_list_set.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conncount.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_amanda.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_broadcast.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_ftp.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_h323.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_irc.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_netlink.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_pptp.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_sane.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_sip.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_snmp.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_tftp.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_dup_netdev.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_flow_table.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_flow_table_inet.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_log_syslog.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_amanda.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_ftp.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_irc.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_sip.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_tftp.ko 2026-02-24T09:04:50.831 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_synproxy_core.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_tables.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_acct.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_log.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_osf.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_queue.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_chain_nat.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_compat.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_ct.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_dup_netdev.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_fib.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_fwd_netdev.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_hash.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_limit.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_log.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_masq.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_nat.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_numgen.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_queue.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_quota.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_redir.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_reject.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_reject_inet.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_socket.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_tunnel.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_AUDIT.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CHECKSUM.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CLASSIFY.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CONNSECMARK.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CT.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_DSCP.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_HL.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_HMARK.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_IDLETIMER.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_LED.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_LOG.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_MASQUERADE.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_NETMAP.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_NFLOG.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_NFQUEUE.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_RATEEST.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_REDIRECT.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_SECMARK.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TCPMSS.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TEE.ko 2026-02-24T09:04:50.832 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TPROXY.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_addrtype.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_bpf.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_cgroup.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_cluster.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_comment.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connbytes.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connlabel.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connlimit.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connmark.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_conntrack.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_cpu.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_dccp.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_devgroup.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_dscp.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_ecn.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_esp.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_hashlimit.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_helper.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_hl.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_ipcomp.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_iprange.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_ipvs.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_l2tp.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_length.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_limit.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_mac.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_mark.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_multiport.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_nat.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_nfacct.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_osf.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_owner.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_physdev.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_pkttype.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_policy.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_quota.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_rateest.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_realm.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_recent.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_sctp.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_set.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_socket.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_state.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_statistic.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_string.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_tcpmss.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_time.ko 2026-02-24T09:04:50.833 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_u32.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netlink 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netlink/netlink_diag.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/nsh 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/nsh/nsh.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/openvswitch.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/vport-geneve.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/vport-gre.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/vport-vxlan.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/packet 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/packet/af_packet_diag.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds/rds.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds/rds_rdma.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds/rds_tcp.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_csum.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_gact.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_mirred.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_nat.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_pedit.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_police.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_simple.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_skbedit.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_vlan.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_basic.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_bpf.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_flow.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_fw.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_route.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_u32.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_cmp.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_ipset.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_meta.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_nbyte.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_text.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_u32.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_choke.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_codel.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_drr.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_fq.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_gred.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_hfsc.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_hhf.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_htb.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_ingress.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_mqprio.ko 2026-02-24T09:04:50.834 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_mqprio_lib.ko 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_multiq.ko 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_netem.ko 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_pie.ko 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_plug.ko 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_prio.ko 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_qfq.ko 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_red.ko 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_sfb.ko 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_sfq.ko 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_tbf.ko 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_teql.ko 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sctp 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sctp/sctp.ko 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sctp/sctp_diag.ko 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/auth_gss 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/sunrpc.ko 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/xprtrdma 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/tipc 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/tipc/tipc.ko 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/tipc/tipc_diag.ko 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/unix 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/unix/unix_diag.ko 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vsock.ko 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vsock_diag.ko 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vsock_loopback.ko 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/xfrm 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/xfrm/xfrm_ipcomp.ko 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/encrypted-keys 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/trusted-keys 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/trusted-keys/trusted.ko 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/virt 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/virt/lib 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/virt/lib/irqbypass.ko 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.alias 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.alias.bin 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin.alias.bin 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin.bin 2026-02-24T09:04:50.835 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin.modinfo 2026-02-24T09:04:50.836 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.dep 2026-02-24T09:04:50.836 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.dep.bin 2026-02-24T09:04:50.836 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.devname 2026-02-24T09:04:50.836 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.order 2026-02-24T09:04:50.836 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.softdep 2026-02-24T09:04:50.836 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.symbols 2026-02-24T09:04:50.836 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.symbols.bin 2026-02-24T09:04:50.836 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.weakdep 2026-02-24T09:04:50.836 INFO:teuthology.orchestra.run.trial074.stdout:/lib/modules/6.19.0-g8dec4b357aab/vmlinuz 2026-02-24T09:04:50.838 DEBUG:teuthology.task.kernel:get_image_version: 6.19.0-g8dec4b357aab 2026-02-24T09:04:50.838 DEBUG:teuthology.orchestra.run.trial074:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2026-02-24T09:04:50.857 INFO:teuthology.orchestra.run.trial074.stdout:postinstall scriptlet (using /bin/sh): 2026-02-24T09:04:50.857 INFO:teuthology.orchestra.run.trial074.stdout:if [ -x /usr/bin/kernel-install ]; then 2026-02-24T09:04:50.857 INFO:teuthology.orchestra.run.trial074.stdout: /usr/bin/kernel-install add 6.19.0-g8dec4b357aab /lib/modules/6.19.0-g8dec4b357aab/vmlinuz 2026-02-24T09:04:50.857 INFO:teuthology.orchestra.run.trial074.stdout:fi 2026-02-24T09:04:50.857 INFO:teuthology.orchestra.run.trial074.stdout:for file in vmlinuz System.map config; do 2026-02-24T09:04:50.857 INFO:teuthology.orchestra.run.trial074.stdout: if ! cmp --silent "/lib/modules/6.19.0-g8dec4b357aab/${file}" "/boot/${file}-6.19.0-g8dec4b357aab"; then 2026-02-24T09:04:50.857 INFO:teuthology.orchestra.run.trial074.stdout: cp "/lib/modules/6.19.0-g8dec4b357aab/${file}" "/boot/${file}-6.19.0-g8dec4b357aab" 2026-02-24T09:04:50.857 INFO:teuthology.orchestra.run.trial074.stdout: fi 2026-02-24T09:04:50.857 INFO:teuthology.orchestra.run.trial074.stdout:done 2026-02-24T09:04:50.857 INFO:teuthology.orchestra.run.trial074.stdout:if [ -d "/lib/modules/6.19.0-g8dec4b357aab/dtb" ] && \ 2026-02-24T09:04:50.857 INFO:teuthology.orchestra.run.trial074.stdout: ! diff -rq "/lib/modules/6.19.0-g8dec4b357aab/dtb" "/boot/dtb-6.19.0-g8dec4b357aab" >/dev/null 2>&1; then 2026-02-24T09:04:50.857 INFO:teuthology.orchestra.run.trial074.stdout: rm -rf "/boot/dtb-6.19.0-g8dec4b357aab" 2026-02-24T09:04:50.857 INFO:teuthology.orchestra.run.trial074.stdout: cp -r "/lib/modules/6.19.0-g8dec4b357aab/dtb" "/boot/dtb-6.19.0-g8dec4b357aab" 2026-02-24T09:04:50.857 INFO:teuthology.orchestra.run.trial074.stdout:fi 2026-02-24T09:04:50.857 INFO:teuthology.orchestra.run.trial074.stdout:if [ ! -e "/lib/modules/6.19.0-g8dec4b357aab/modules.dep" ]; then 2026-02-24T09:04:50.857 INFO:teuthology.orchestra.run.trial074.stdout: /usr/sbin/depmod 6.19.0-g8dec4b357aab 2026-02-24T09:04:50.857 INFO:teuthology.orchestra.run.trial074.stdout:fi 2026-02-24T09:04:50.857 INFO:teuthology.orchestra.run.trial074.stdout:preuninstall scriptlet (using /bin/sh): 2026-02-24T09:04:50.857 INFO:teuthology.orchestra.run.trial074.stdout:if [ -x /usr/bin/kernel-install ]; then 2026-02-24T09:04:50.857 INFO:teuthology.orchestra.run.trial074.stdout:kernel-install remove 6.19.0-g8dec4b357aab 2026-02-24T09:04:50.857 INFO:teuthology.orchestra.run.trial074.stdout:fi 2026-02-24T09:04:50.858 DEBUG:teuthology.orchestra.run.trial074:> sudo rpm -qi grub2-tools 2026-02-24T09:04:50.926 INFO:teuthology.orchestra.run.trial074.stdout:Name : grub2-tools 2026-02-24T09:04:50.926 INFO:teuthology.orchestra.run.trial074.stdout:Epoch : 1 2026-02-24T09:04:50.926 INFO:teuthology.orchestra.run.trial074.stdout:Version : 2.06 2026-02-24T09:04:50.926 INFO:teuthology.orchestra.run.trial074.stdout:Release : 120.el9 2026-02-24T09:04:50.926 INFO:teuthology.orchestra.run.trial074.stdout:Architecture: x86_64 2026-02-24T09:04:50.926 INFO:teuthology.orchestra.run.trial074.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-24T09:04:50.926 INFO:teuthology.orchestra.run.trial074.stdout:Group : Unspecified 2026-02-24T09:04:50.926 INFO:teuthology.orchestra.run.trial074.stdout:Size : 9108611 2026-02-24T09:04:50.927 INFO:teuthology.orchestra.run.trial074.stdout:License : GPLv3+ 2026-02-24T09:04:50.927 INFO:teuthology.orchestra.run.trial074.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-24T09:04:50.927 INFO:teuthology.orchestra.run.trial074.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-24T09:04:50.927 INFO:teuthology.orchestra.run.trial074.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-24T09:04:50.927 INFO:teuthology.orchestra.run.trial074.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-24T09:04:50.927 INFO:teuthology.orchestra.run.trial074.stdout:Packager : builder@centos.org 2026-02-24T09:04:50.927 INFO:teuthology.orchestra.run.trial074.stdout:Vendor : CentOS 2026-02-24T09:04:50.927 INFO:teuthology.orchestra.run.trial074.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-24T09:04:50.927 INFO:teuthology.orchestra.run.trial074.stdout:Summary : Support tools for GRUB. 2026-02-24T09:04:50.927 INFO:teuthology.orchestra.run.trial074.stdout:Description : 2026-02-24T09:04:50.927 INFO:teuthology.orchestra.run.trial074.stdout: 2026-02-24T09:04:50.927 INFO:teuthology.orchestra.run.trial074.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-24T09:04:50.927 INFO:teuthology.orchestra.run.trial074.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-24T09:04:50.927 INFO:teuthology.orchestra.run.trial074.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-24T09:04:50.927 INFO:teuthology.orchestra.run.trial074.stdout:hardware devices. 2026-02-24T09:04:50.927 INFO:teuthology.orchestra.run.trial074.stdout: 2026-02-24T09:04:50.927 INFO:teuthology.orchestra.run.trial074.stdout:This subpackage provides tools for support of all platforms. 2026-02-24T09:04:50.928 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-24T09:04:50.928 INFO:teuthology.task.kernel:Updating grub on trial074 to boot 6.19.0-g8dec4b357aab 2026-02-24T09:04:50.928 DEBUG:teuthology.orchestra.run.trial074:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-24T09:04:50.991 INFO:teuthology.orchestra.run.trial074.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-24T09:04:50.992 DEBUG:teuthology.orchestra.run.trial074:> sudo command -v grubby && echo yes || echo no 2026-02-24T09:04:51.054 INFO:teuthology.orchestra.run.trial074.stdout:/sbin/grubby 2026-02-24T09:04:51.055 INFO:teuthology.orchestra.run.trial074.stdout:yes 2026-02-24T09:04:51.055 DEBUG:teuthology.orchestra.run.trial074:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.19.0-g8dec4b357aab" | head -n 1 2026-02-24T09:04:51.121 INFO:teuthology.orchestra.run.trial074.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-6.19.0-g8dec4b357aab.conf 2026-02-24T09:04:51.121 DEBUG:teuthology.orchestra.run.trial074:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-6.19.0-g8dec4b357aab 2026-02-24T09:04:51.194 DEBUG:teuthology.orchestra.run.trial074:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-24T09:04:51.406 INFO:teuthology.orchestra.run.trial074.stderr:Generating grub configuration file ... 2026-02-24T09:04:51.475 INFO:teuthology.orchestra.run.trial074.stderr:Found linux image: /boot/vmlinuz-6.19.0-g8dec4b357aab 2026-02-24T09:04:51.482 INFO:teuthology.orchestra.run.trial074.stderr:Found initrd image: /boot/initramfs-6.19.0-g8dec4b357aab.img 2026-02-24T09:04:51.738 INFO:teuthology.orchestra.run.trial074.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-24T09:04:51.745 INFO:teuthology.orchestra.run.trial074.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-24T09:04:51.779 INFO:teuthology.orchestra.run.trial074.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-24T09:04:51.785 INFO:teuthology.orchestra.run.trial074.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-24T09:04:51.817 INFO:teuthology.orchestra.run.trial074.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-24T09:04:51.823 INFO:teuthology.orchestra.run.trial074.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-24T09:04:51.846 INFO:teuthology.orchestra.run.trial074.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-24T09:04:51.854 INFO:teuthology.orchestra.run.trial074.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-24T09:04:51.941 INFO:teuthology.orchestra.run.trial074.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-24T09:04:51.950 INFO:teuthology.orchestra.run.trial074.stderr:done 2026-02-24T09:04:51.952 DEBUG:teuthology.orchestra.run.trial074:> test -d /sys/firmware/efi 2026-02-24T09:04:51.968 DEBUG:teuthology.orchestra.run.trial074:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-24T09:04:52.034 INFO:teuthology.orchestra.run.trial074.stdout:/boot/efi/EFI/BOOT 2026-02-24T09:04:52.034 INFO:teuthology.orchestra.run.trial074.stdout:/boot/efi/EFI/centos 2026-02-24T09:04:52.036 DEBUG:teuthology.orchestra.run.trial074:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-24T09:04:52.102 INFO:teuthology.orchestra.run.trial074.stdout:no 2026-02-24T09:04:52.103 DEBUG:teuthology.orchestra.run.trial074:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-24T09:04:52.166 INFO:teuthology.orchestra.run.trial074.stdout:yes 2026-02-24T09:04:52.167 DEBUG:teuthology.orchestra.run.trial074:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-24T09:04:52.230 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial074 2026-02-24T09:04:52.230 DEBUG:teuthology.orchestra.run.trial074:> sudo bash -c ' 2026-02-24T09:04:52.230 DEBUG:teuthology.orchestra.run.trial074:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-24T09:04:52.230 DEBUG:teuthology.orchestra.run.trial074:> ' 2026-02-24T09:05:14.253 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-24T09:05:14.254 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial159.front.sepia.ceph.com' 2026-02-24T09:05:14.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T09:05:18.740 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-24T09:05:18.740 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial028.front.sepia.ceph.com' 2026-02-24T09:05:18.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T09:05:22.272 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-24T09:05:22.272 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial074.front.sepia.ceph.com' 2026-02-24T09:05:22.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial074.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T09:06:14.308 DEBUG:teuthology.orchestra.remote:timed out 2026-02-24T09:06:18.747 DEBUG:teuthology.orchestra.remote:timed out 2026-02-24T09:06:22.279 DEBUG:teuthology.orchestra.remote:timed out 2026-02-24T09:06:23.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial159.front.sepia.ceph.com' 2026-02-24T09:06:23.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T09:06:23.468 DEBUG:teuthology.orchestra.run.trial159:> true 2026-02-24T09:06:23.721 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial159.front.sepia.ceph.com' 2026-02-24T09:06:23.721 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "6.19.0-g8dec4b357aab"... 2026-02-24T09:06:23.721 DEBUG:teuthology.orchestra.run.trial159:> uname -r 2026-02-24T09:06:23.797 INFO:teuthology.orchestra.run.trial159.stdout:6.19.0-g8dec4b357aab 2026-02-24T09:06:23.798 DEBUG:teuthology.task.kernel:current kernel version is 6.19.0-g8dec4b357aab vs 6.19.0-g8dec4b357aab 2026-02-24T09:06:23.798 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-24T09:06:23.798 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-24T09:06:24.803 DEBUG:teuthology.parallel:result is None 2026-02-24T09:06:27.748 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial028.front.sepia.ceph.com' 2026-02-24T09:06:27.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T09:06:27.853 DEBUG:teuthology.orchestra.run.trial028:> true 2026-02-24T09:06:28.108 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial028.front.sepia.ceph.com' 2026-02-24T09:06:28.108 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.19.0-g8dec4b357aab"... 2026-02-24T09:06:28.109 DEBUG:teuthology.orchestra.run.trial028:> uname -r 2026-02-24T09:06:28.186 INFO:teuthology.orchestra.run.trial028.stdout:6.19.0-g8dec4b357aab 2026-02-24T09:06:28.186 DEBUG:teuthology.task.kernel:current kernel version is 6.19.0-g8dec4b357aab vs 6.19.0-g8dec4b357aab 2026-02-24T09:06:28.187 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-24T09:06:28.187 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-24T09:06:29.192 DEBUG:teuthology.parallel:result is None 2026-02-24T09:06:31.280 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial074.front.sepia.ceph.com' 2026-02-24T09:06:31.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial074.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T09:06:31.453 DEBUG:teuthology.orchestra.run.trial074:> true 2026-02-24T09:06:31.700 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial074.front.sepia.ceph.com' 2026-02-24T09:06:31.701 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.19.0-g8dec4b357aab"... 2026-02-24T09:06:31.701 DEBUG:teuthology.orchestra.run.trial074:> uname -r 2026-02-24T09:06:31.779 INFO:teuthology.orchestra.run.trial074.stdout:6.19.0-g8dec4b357aab 2026-02-24T09:06:31.780 DEBUG:teuthology.task.kernel:current kernel version is 6.19.0-g8dec4b357aab vs 6.19.0-g8dec4b357aab 2026-02-24T09:06:31.780 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-24T09:06:31.780 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-24T09:06:32.784 DEBUG:teuthology.parallel:result is None 2026-02-24T09:06:32.785 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-24T09:06:32.792 INFO:teuthology.task.internal:Creating test directory... 2026-02-24T09:06:32.793 DEBUG:teuthology.orchestra.run.trial028:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-24T09:06:32.796 DEBUG:teuthology.orchestra.run.trial074:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-24T09:06:32.800 DEBUG:teuthology.orchestra.run.trial159:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-24T09:06:32.839 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-24T09:06:32.853 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-24T09:06:32.865 INFO:teuthology.task.internal:Creating archive directory... 2026-02-24T09:06:32.865 DEBUG:teuthology.orchestra.run.trial028:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-24T09:06:32.875 DEBUG:teuthology.orchestra.run.trial074:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-24T09:06:32.879 DEBUG:teuthology.orchestra.run.trial159:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-24T09:06:32.930 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-24T09:06:32.942 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-24T09:06:32.942 DEBUG:teuthology.orchestra.run.trial028:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-24T09:06:32.954 DEBUG:teuthology.orchestra.run.trial074:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-24T09:06:32.958 DEBUG:teuthology.orchestra.run.trial159:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-24T09:06:33.014 INFO:teuthology.orchestra.run.trial028.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T09:06:33.017 INFO:teuthology.orchestra.run.trial074.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T09:06:33.020 INFO:teuthology.orchestra.run.trial159.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T09:06:33.034 INFO:teuthology.orchestra.run.trial028.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T09:06:33.037 INFO:teuthology.orchestra.run.trial074.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T09:06:33.041 INFO:teuthology.orchestra.run.trial159.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T09:06:33.044 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-24T09:06:33.057 INFO:teuthology.task.internal:Configuring sudo... 2026-02-24T09:06:33.057 DEBUG:teuthology.orchestra.run.trial028:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-24T09:06:33.061 DEBUG:teuthology.orchestra.run.trial074:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-24T09:06:33.065 DEBUG:teuthology.orchestra.run.trial159:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-24T09:06:33.124 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-24T09:06:33.144 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-24T09:06:33.144 DEBUG:teuthology.orchestra.run.trial028:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-24T09:06:33.148 DEBUG:teuthology.orchestra.run.trial074:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-24T09:06:33.152 DEBUG:teuthology.orchestra.run.trial159:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-24T09:06:33.190 DEBUG:teuthology.orchestra.run.trial028:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T09:06:33.365 DEBUG:teuthology.orchestra.run.trial028:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T09:06:33.421 DEBUG:teuthology.orchestra.run.trial028:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T09:06:33.560 DEBUG:teuthology.orchestra.run.trial028:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T09:06:33.617 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-24T09:06:33.617 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-24T09:06:33.672 DEBUG:teuthology.orchestra.run.trial074:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T09:06:33.787 DEBUG:teuthology.orchestra.run.trial074:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T09:06:33.845 DEBUG:teuthology.orchestra.run.trial074:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T09:06:33.975 DEBUG:teuthology.orchestra.run.trial074:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T09:06:34.030 DEBUG:teuthology.orchestra.run.trial074:> set -ex 2026-02-24T09:06:34.030 DEBUG:teuthology.orchestra.run.trial074:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-24T09:06:34.085 DEBUG:teuthology.orchestra.run.trial159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T09:06:34.230 DEBUG:teuthology.orchestra.run.trial159:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T09:06:34.284 DEBUG:teuthology.orchestra.run.trial159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T09:06:34.421 DEBUG:teuthology.orchestra.run.trial159:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T09:06:34.476 DEBUG:teuthology.orchestra.run.trial159:> set -ex 2026-02-24T09:06:34.477 DEBUG:teuthology.orchestra.run.trial159:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-24T09:06:34.532 DEBUG:teuthology.orchestra.run.trial028:> sudo service rsyslog restart 2026-02-24T09:06:34.536 DEBUG:teuthology.orchestra.run.trial074:> sudo service rsyslog restart 2026-02-24T09:06:34.539 DEBUG:teuthology.orchestra.run.trial159:> sudo service rsyslog restart 2026-02-24T09:06:34.595 INFO:teuthology.orchestra.run.trial028.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T09:06:34.600 INFO:teuthology.orchestra.run.trial074.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T09:06:34.636 INFO:teuthology.orchestra.run.trial159.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T09:06:35.132 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-24T09:06:35.145 INFO:teuthology.task.internal:Starting timer... 2026-02-24T09:06:35.145 INFO:teuthology.run_tasks:Running task pcp... 2026-02-24T09:06:35.160 INFO:teuthology.run_tasks:Running task selinux... 2026-02-24T09:06:35.172 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2026-02-24T09:06:35.172 DEBUG:teuthology.orchestra.run.trial028:> sudo service auditd rotate 2026-02-24T09:06:35.240 INFO:teuthology.orchestra.run.trial028.stdout:Rotating logs: 2026-02-24T09:06:35.243 DEBUG:teuthology.orchestra.run.trial074:> sudo service auditd rotate 2026-02-24T09:06:35.312 INFO:teuthology.orchestra.run.trial074.stdout:Rotating logs: 2026-02-24T09:06:35.315 DEBUG:teuthology.orchestra.run.trial159:> sudo service auditd rotate 2026-02-24T09:06:35.381 INFO:teuthology.orchestra.run.trial159.stdout:Rotating logs: 2026-02-24T09:06:35.384 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-24T09:06:35.384 DEBUG:teuthology.orchestra.run.trial028:> /usr/sbin/getenforce 2026-02-24T09:06:35.422 INFO:teuthology.orchestra.run.trial028.stdout:Permissive 2026-02-24T09:06:35.422 DEBUG:teuthology.orchestra.run.trial074:> /usr/sbin/getenforce 2026-02-24T09:06:35.461 INFO:teuthology.orchestra.run.trial074.stdout:Permissive 2026-02-24T09:06:35.461 DEBUG:teuthology.orchestra.run.trial159:> /usr/sbin/getenforce 2026-02-24T09:06:35.499 INFO:teuthology.orchestra.run.trial159.stdout:Permissive 2026-02-24T09:06:35.500 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial028.front.sepia.ceph.com': 'permissive', 'ubuntu@trial074.front.sepia.ceph.com': 'permissive', 'ubuntu@trial159.front.sepia.ceph.com': 'permissive'} 2026-02-24T09:06:35.500 DEBUG:teuthology.orchestra.run.trial028:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2026-02-24T09:06:35.556 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T09:06:35.556 DEBUG:teuthology.orchestra.run.trial074:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2026-02-24T09:06:35.614 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T09:06:35.615 DEBUG:teuthology.orchestra.run.trial159:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2026-02-24T09:06:35.671 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T09:06:35.671 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-24T09:06:35.672 DEBUG:teuthology.orchestra.run.trial028:> sudo /usr/sbin/setenforce permissive 2026-02-24T09:06:35.727 DEBUG:teuthology.orchestra.run.trial074:> sudo /usr/sbin/setenforce permissive 2026-02-24T09:06:35.782 DEBUG:teuthology.orchestra.run.trial159:> sudo /usr/sbin/setenforce permissive 2026-02-24T09:06:35.837 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-24T09:06:35.852 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-24T09:06:35.864 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-24T09:06:35.866 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial028.front.sepia.ceph.com,trial074.front.sepia.ceph.com,trial159.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-24T09:11:02.233 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial028.front.sepia.ceph.com'), Remote(name='ubuntu@trial074.front.sepia.ceph.com'), Remote(name='ubuntu@trial159.front.sepia.ceph.com')] 2026-02-24T09:11:02.241 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial028.front.sepia.ceph.com' 2026-02-24T09:11:02.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T09:11:02.363 DEBUG:teuthology.orchestra.run.trial028:> true 2026-02-24T09:11:02.460 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial028.front.sepia.ceph.com' 2026-02-24T09:11:02.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial074.front.sepia.ceph.com' 2026-02-24T09:11:02.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial074.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T09:11:02.568 DEBUG:teuthology.orchestra.run.trial074:> true 2026-02-24T09:11:02.666 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial074.front.sepia.ceph.com' 2026-02-24T09:11:02.667 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial159.front.sepia.ceph.com' 2026-02-24T09:11:02.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T09:11:02.778 DEBUG:teuthology.orchestra.run.trial159:> true 2026-02-24T09:11:02.881 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial159.front.sepia.ceph.com' 2026-02-24T09:11:02.883 INFO:teuthology.run_tasks:Running task clock... 2026-02-24T09:11:02.902 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-24T09:11:02.903 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-24T09:11:02.904 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T09:11:02.908 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-24T09:11:02.908 DEBUG:teuthology.orchestra.run.trial074:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T09:11:02.912 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-24T09:11:02.912 DEBUG:teuthology.orchestra.run.trial159:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T09:11:02.965 INFO:teuthology.orchestra.run.trial028.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-24T09:11:02.968 INFO:teuthology.orchestra.run.trial074.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-24T09:11:02.980 INFO:teuthology.orchestra.run.trial159.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-24T09:11:02.990 INFO:teuthology.orchestra.run.trial028.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-24T09:11:02.993 INFO:teuthology.orchestra.run.trial074.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-24T09:11:03.006 INFO:teuthology.orchestra.run.trial159.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-24T09:11:03.034 INFO:teuthology.orchestra.run.trial028.stderr:sudo: ntpd: command not found 2026-02-24T09:11:03.037 INFO:teuthology.orchestra.run.trial074.stderr:sudo: ntpd: command not found 2026-02-24T09:11:03.050 INFO:teuthology.orchestra.run.trial159.stderr:sudo: ntpd: command not found 2026-02-24T09:11:03.055 INFO:teuthology.orchestra.run.trial028.stdout:506 Cannot talk to daemon 2026-02-24T09:11:03.057 INFO:teuthology.orchestra.run.trial074.stdout:506 Cannot talk to daemon 2026-02-24T09:11:03.072 INFO:teuthology.orchestra.run.trial159.stdout:506 Cannot talk to daemon 2026-02-24T09:11:03.080 INFO:teuthology.orchestra.run.trial028.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-24T09:11:03.082 INFO:teuthology.orchestra.run.trial074.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-24T09:11:03.096 INFO:teuthology.orchestra.run.trial159.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-24T09:11:03.105 INFO:teuthology.orchestra.run.trial028.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-24T09:11:03.106 INFO:teuthology.orchestra.run.trial074.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-24T09:11:03.120 INFO:teuthology.orchestra.run.trial159.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-24T09:11:03.181 INFO:teuthology.orchestra.run.trial074.stderr:bash: line 1: ntpq: command not found 2026-02-24T09:11:03.182 INFO:teuthology.orchestra.run.trial028.stderr:bash: line 1: ntpq: command not found 2026-02-24T09:11:03.200 INFO:teuthology.orchestra.run.trial159.stderr:bash: line 1: ntpq: command not found 2026-02-24T09:11:03.205 INFO:teuthology.orchestra.run.trial028.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T09:11:03.205 INFO:teuthology.orchestra.run.trial028.stdout:=============================================================================== 2026-02-24T09:11:03.206 INFO:teuthology.orchestra.run.trial028.stdout:^? ntp.speculation.org 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T09:11:03.206 INFO:teuthology.orchestra.run.trial028.stdout:^? white.web-ster.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T09:11:03.206 INFO:teuthology.orchestra.run.trial028.stdout:^? 170-187-147-56.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T09:11:03.206 INFO:teuthology.orchestra.run.trial028.stdout:^? ip229.ip-51-81-226.us 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T09:11:03.208 INFO:teuthology.orchestra.run.trial074.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T09:11:03.208 INFO:teuthology.orchestra.run.trial074.stdout:=============================================================================== 2026-02-24T09:11:03.208 INFO:teuthology.orchestra.run.trial074.stdout:^? 23.157.160.168 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T09:11:03.208 INFO:teuthology.orchestra.run.trial074.stdout:^? chi3.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T09:11:03.208 INFO:teuthology.orchestra.run.trial074.stdout:^? 172-233-189-68.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T09:11:03.209 INFO:teuthology.orchestra.run.trial074.stdout:^? 50-203-248-23-static.hfc> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T09:11:03.217 INFO:teuthology.orchestra.run.trial159.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T09:11:03.217 INFO:teuthology.orchestra.run.trial159.stdout:=============================================================================== 2026-02-24T09:11:03.217 INFO:teuthology.orchestra.run.trial159.stdout:^? 69-10-208-170.rainiercon> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T09:11:03.217 INFO:teuthology.orchestra.run.trial159.stdout:^? ip74-208-14-149.pbiaas.c> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T09:11:03.217 INFO:teuthology.orchestra.run.trial159.stdout:^? 172-238-164-57.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T09:11:03.217 INFO:teuthology.orchestra.run.trial159.stdout:^? jmpxus.no.sigint.today 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T09:11:03.219 INFO:teuthology.run_tasks:Running task install... 2026-02-24T09:11:03.233 DEBUG:teuthology.task.install:project ceph 2026-02-24T09:11:03.233 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '5bc9a1ffc19df681248ece8c3c8c7191a571745b'}} 2026-02-24T09:11:03.233 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '5bc9a1ffc19df681248ece8c3c8c7191a571745b'} 2026-02-24T09:11:03.233 INFO:teuthology.task.install:Using flavor: default 2026-02-24T09:11:03.243 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-24T09:11:03.243 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2026-02-24T09:11:03.244 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'tag': None, 'wait_for_package': False} 2026-02-24T09:11:03.245 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5bc9a1ffc19df681248ece8c3c8c7191a571745b 2026-02-24T09:11:03.248 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'tag': None, 'wait_for_package': False} 2026-02-24T09:11:03.249 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5bc9a1ffc19df681248ece8c3c8c7191a571745b 2026-02-24T09:11:03.250 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'tag': None, 'wait_for_package': False} 2026-02-24T09:11:03.250 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5bc9a1ffc19df681248ece8c3c8c7191a571745b 2026-02-24T09:11:03.483 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/flavors/default/ 2026-02-24T09:11:03.483 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5537.g5bc9a1ff 2026-02-24T09:11:03.485 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/flavors/default/ 2026-02-24T09:11:03.485 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5537.g5bc9a1ff 2026-02-24T09:11:03.492 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/flavors/default/ 2026-02-24T09:11:03.492 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5537.g5bc9a1ff 2026-02-24T09:11:03.676 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-24T09:11:03.676 DEBUG:teuthology.orchestra.run.trial159:> set -ex 2026-02-24T09:11:03.676 DEBUG:teuthology.orchestra.run.trial159:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-24T09:11:03.677 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-24T09:11:03.677 DEBUG:teuthology.orchestra.run.trial074:> set -ex 2026-02-24T09:11:03.677 DEBUG:teuthology.orchestra.run.trial074:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-24T09:11:03.688 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-24T09:11:03.688 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-24T09:11:03.688 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-24T09:11:03.733 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-24T09:11:03.733 DEBUG:teuthology.orchestra.run.trial074:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/5bc9a1ffc19df681248ece8c3c8c7191a571745b/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-24T09:11:03.733 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-24T09:11:03.733 DEBUG:teuthology.orchestra.run.trial159:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/5bc9a1ffc19df681248ece8c3c8c7191a571745b/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-24T09:11:03.744 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-24T09:11:03.744 DEBUG:teuthology.orchestra.run.trial028:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/5bc9a1ffc19df681248ece8c3c8c7191a571745b/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-24T09:11:03.830 DEBUG:teuthology.orchestra.run.trial074:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-24T09:11:03.832 DEBUG:teuthology.orchestra.run.trial159:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-24T09:11:03.840 DEBUG:teuthology.orchestra.run.trial028:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-24T09:11:03.906 DEBUG:teuthology.orchestra.run.trial074:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-24T09:11:03.908 DEBUG:teuthology.orchestra.run.trial159:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-24T09:11:03.917 DEBUG:teuthology.orchestra.run.trial028:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-24T09:11:03.963 INFO:teuthology.orchestra.run.trial074.stdout:check_obsoletes = 1 2026-02-24T09:11:03.964 INFO:teuthology.orchestra.run.trial159.stdout:check_obsoletes = 1 2026-02-24T09:11:03.965 DEBUG:teuthology.orchestra.run.trial074:> sudo yum clean all 2026-02-24T09:11:03.967 DEBUG:teuthology.orchestra.run.trial159:> sudo yum clean all 2026-02-24T09:11:03.972 INFO:teuthology.orchestra.run.trial028.stdout:check_obsoletes = 1 2026-02-24T09:11:03.975 DEBUG:teuthology.orchestra.run.trial028:> sudo yum clean all 2026-02-24T09:11:04.136 INFO:teuthology.orchestra.run.trial074.stdout:41 files removed 2026-02-24T09:11:04.136 INFO:teuthology.orchestra.run.trial159.stdout:41 files removed 2026-02-24T09:11:04.146 INFO:teuthology.orchestra.run.trial028.stdout:41 files removed 2026-02-24T09:11:04.154 DEBUG:teuthology.orchestra.run.trial074:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-24T09:11:04.156 DEBUG:teuthology.orchestra.run.trial159:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-24T09:11:04.164 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-24T09:11:04.520 INFO:teuthology.orchestra.run.trial074.stdout:ceph packages for x86_64 732 kB/s | 93 kB 00:00 2026-02-24T09:11:04.527 INFO:teuthology.orchestra.run.trial159.stdout:ceph packages for x86_64 697 kB/s | 93 kB 00:00 2026-02-24T09:11:04.535 INFO:teuthology.orchestra.run.trial028.stdout:ceph packages for x86_64 715 kB/s | 93 kB 00:00 2026-02-24T09:11:04.660 INFO:teuthology.orchestra.run.trial074.stdout:ceph noarch packages 216 kB/s | 24 kB 00:00 2026-02-24T09:11:04.668 INFO:teuthology.orchestra.run.trial159.stdout:ceph noarch packages 215 kB/s | 24 kB 00:00 2026-02-24T09:11:04.678 INFO:teuthology.orchestra.run.trial028.stdout:ceph noarch packages 211 kB/s | 24 kB 00:00 2026-02-24T09:11:04.788 INFO:teuthology.orchestra.run.trial074.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-24T09:11:04.795 INFO:teuthology.orchestra.run.trial159.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-24T09:11:04.805 INFO:teuthology.orchestra.run.trial028.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-24T09:11:05.090 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - BaseOS 34 MB/s | 8.9 MB 00:00 2026-02-24T09:11:05.651 INFO:teuthology.orchestra.run.trial159.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.9 MB 00:00 2026-02-24T09:11:06.202 INFO:teuthology.orchestra.run.trial074.stdout:CentOS Stream 9 - BaseOS 6.4 MB/s | 8.9 MB 00:01 2026-02-24T09:11:08.769 INFO:teuthology.orchestra.run.trial159.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-24T09:11:12.755 INFO:teuthology.orchestra.run.trial074.stdout:CentOS Stream 9 - AppStream 4.5 MB/s | 27 MB 00:05 2026-02-24T09:11:13.113 INFO:teuthology.orchestra.run.trial159.stdout:CentOS Stream 9 - CRB 5.1 MB/s | 8.0 MB 00:01 2026-02-24T09:11:13.134 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - AppStream 3.6 MB/s | 27 MB 00:07 2026-02-24T09:11:14.081 INFO:teuthology.orchestra.run.trial159.stdout:CentOS Stream 9 - Extras packages 164 kB/s | 20 kB 00:00 2026-02-24T09:11:14.516 INFO:teuthology.orchestra.run.trial159.stdout:Extra Packages for Enterprise Linux 55 MB/s | 20 MB 00:00 2026-02-24T09:11:16.094 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - CRB 27 MB/s | 8.0 MB 00:00 2026-02-24T09:11:17.034 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - Extras packages 176 kB/s | 20 kB 00:00 2026-02-24T09:11:17.484 INFO:teuthology.orchestra.run.trial074.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 8.0 MB 00:02 2026-02-24T09:11:17.753 INFO:teuthology.orchestra.run.trial028.stdout:Extra Packages for Enterprise Linux 31 MB/s | 20 MB 00:00 2026-02-24T09:11:18.753 INFO:teuthology.orchestra.run.trial159.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-24T09:11:19.405 INFO:teuthology.orchestra.run.trial074.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 20 kB 00:01 2026-02-24T09:11:19.779 INFO:teuthology.orchestra.run.trial074.stdout:Extra Packages for Enterprise Linux 66 MB/s | 20 MB 00:00 2026-02-24T09:11:20.029 INFO:teuthology.orchestra.run.trial159.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-24T09:11:20.029 INFO:teuthology.orchestra.run.trial159.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-24T09:11:20.035 INFO:teuthology.orchestra.run.trial159.stdout:Package NetworkManager-1:1.54.3-2.el9.x86_64 is already installed. 2026-02-24T09:11:20.035 INFO:teuthology.orchestra.run.trial159.stdout:Package iproute-6.17.0-2.el9.x86_64 is already installed. 2026-02-24T09:11:20.035 INFO:teuthology.orchestra.run.trial159.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-24T09:11:20.036 INFO:teuthology.orchestra.run.trial159.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-24T09:11:20.037 INFO:teuthology.orchestra.run.trial159.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-24T09:11:20.038 INFO:teuthology.orchestra.run.trial159.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-24T09:11:20.038 INFO:teuthology.orchestra.run.trial159.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-24T09:11:20.069 INFO:teuthology.orchestra.run.trial159.stdout:Dependencies resolved. 2026-02-24T09:11:20.075 INFO:teuthology.orchestra.run.trial159.stdout:======================================================================================= 2026-02-24T09:11:20.075 INFO:teuthology.orchestra.run.trial159.stdout: Package Arch Version Repository Size 2026-02-24T09:11:20.075 INFO:teuthology.orchestra.run.trial159.stdout:======================================================================================= 2026-02-24T09:11:20.075 INFO:teuthology.orchestra.run.trial159.stdout:Installing: 2026-02-24T09:11:20.076 INFO:teuthology.orchestra.run.trial159.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-24T09:11:20.076 INFO:teuthology.orchestra.run.trial159.stdout: ceph x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 6.5 k 2026-02-24T09:11:20.076 INFO:teuthology.orchestra.run.trial159.stdout: ceph-base x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 5.2 M 2026-02-24T09:11:20.076 INFO:teuthology.orchestra.run.trial159.stdout: ceph-fuse x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 987 k 2026-02-24T09:11:20.076 INFO:teuthology.orchestra.run.trial159.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 148 k 2026-02-24T09:11:20.076 INFO:teuthology.orchestra.run.trial159.stdout: ceph-mgr x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 950 k 2026-02-24T09:11:20.076 INFO:teuthology.orchestra.run.trial159.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 184 k 2026-02-24T09:11:20.076 INFO:teuthology.orchestra.run.trial159.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 15 M 2026-02-24T09:11:20.076 INFO:teuthology.orchestra.run.trial159.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 7.4 M 2026-02-24T09:11:20.076 INFO:teuthology.orchestra.run.trial159.stdout: ceph-mgr-rook noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 50 k 2026-02-24T09:11:20.076 INFO:teuthology.orchestra.run.trial159.stdout: ceph-osd x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 167 k 2026-02-24T09:11:20.077 INFO:teuthology.orchestra.run.trial159.stdout: ceph-osd-classic x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 16 M 2026-02-24T09:11:20.077 INFO:teuthology.orchestra.run.trial159.stdout: ceph-radosgw x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 13 M 2026-02-24T09:11:20.077 INFO:teuthology.orchestra.run.trial159.stdout: ceph-test x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 76 M 2026-02-24T09:11:20.077 INFO:teuthology.orchestra.run.trial159.stdout: ceph-volume noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 301 k 2026-02-24T09:11:20.077 INFO:teuthology.orchestra.run.trial159.stdout: cephadm noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 1.0 M 2026-02-24T09:11:20.077 INFO:teuthology.orchestra.run.trial159.stdout: cephfs-mirror x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 243 k 2026-02-24T09:11:20.077 INFO:teuthology.orchestra.run.trial159.stdout: cephfs-shell x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 27 k 2026-02-24T09:11:20.077 INFO:teuthology.orchestra.run.trial159.stdout: cephfs-top noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 18 k 2026-02-24T09:11:20.077 INFO:teuthology.orchestra.run.trial159.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-24T09:11:20.077 INFO:teuthology.orchestra.run.trial159.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-24T09:11:20.077 INFO:teuthology.orchestra.run.trial159.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-24T09:11:20.077 INFO:teuthology.orchestra.run.trial159.stdout: libcephfs-devel x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 37 k 2026-02-24T09:11:20.077 INFO:teuthology.orchestra.run.trial159.stdout: libcephfs2 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 909 k 2026-02-24T09:11:20.078 INFO:teuthology.orchestra.run.trial159.stdout: librados-devel x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 123 k 2026-02-24T09:11:20.078 INFO:teuthology.orchestra.run.trial159.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-24T09:11:20.078 INFO:teuthology.orchestra.run.trial159.stdout: libuuid-devel x86_64 2.37.4-25.el9 appstream 23 k 2026-02-24T09:11:20.078 INFO:teuthology.orchestra.run.trial159.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-24T09:11:20.078 INFO:teuthology.orchestra.run.trial159.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-24T09:11:20.078 INFO:teuthology.orchestra.run.trial159.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-24T09:11:20.078 INFO:teuthology.orchestra.run.trial159.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-24T09:11:20.078 INFO:teuthology.orchestra.run.trial159.stdout: python3-cephfs x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 204 k 2026-02-24T09:11:20.078 INFO:teuthology.orchestra.run.trial159.stdout: python3-rados x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 324 k 2026-02-24T09:11:20.078 INFO:teuthology.orchestra.run.trial159.stdout: python3-rbd x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 304 k 2026-02-24T09:11:20.078 INFO:teuthology.orchestra.run.trial159.stdout: python3-rgw x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 100 k 2026-02-24T09:11:20.078 INFO:teuthology.orchestra.run.trial159.stdout: rbd-fuse x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 84 k 2026-02-24T09:11:20.079 INFO:teuthology.orchestra.run.trial159.stdout: rbd-mirror x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 2.9 M 2026-02-24T09:11:20.079 INFO:teuthology.orchestra.run.trial159.stdout: rbd-nbd x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 172 k 2026-02-24T09:11:20.079 INFO:teuthology.orchestra.run.trial159.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-24T09:11:20.079 INFO:teuthology.orchestra.run.trial159.stdout:Upgrading: 2026-02-24T09:11:20.079 INFO:teuthology.orchestra.run.trial159.stdout: libblkid x86_64 2.37.4-25.el9 baseos 105 k 2026-02-24T09:11:20.079 INFO:teuthology.orchestra.run.trial159.stdout: libfdisk x86_64 2.37.4-25.el9 baseos 152 k 2026-02-24T09:11:20.079 INFO:teuthology.orchestra.run.trial159.stdout: libmount x86_64 2.37.4-25.el9 baseos 133 k 2026-02-24T09:11:20.079 INFO:teuthology.orchestra.run.trial159.stdout: librados2 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 3.5 M 2026-02-24T09:11:20.079 INFO:teuthology.orchestra.run.trial159.stdout: librbd1 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 2.8 M 2026-02-24T09:11:20.079 INFO:teuthology.orchestra.run.trial159.stdout: libsmartcols x86_64 2.37.4-25.el9 baseos 61 k 2026-02-24T09:11:20.079 INFO:teuthology.orchestra.run.trial159.stdout: libuuid x86_64 2.37.4-25.el9 baseos 26 k 2026-02-24T09:11:20.079 INFO:teuthology.orchestra.run.trial159.stdout: util-linux x86_64 2.37.4-25.el9 baseos 2.3 M 2026-02-24T09:11:20.079 INFO:teuthology.orchestra.run.trial159.stdout: util-linux-core x86_64 2.37.4-25.el9 baseos 458 k 2026-02-24T09:11:20.080 INFO:teuthology.orchestra.run.trial159.stdout:Installing dependencies: 2026-02-24T09:11:20.080 INFO:teuthology.orchestra.run.trial159.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-24T09:11:20.080 INFO:teuthology.orchestra.run.trial159.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-24T09:11:20.080 INFO:teuthology.orchestra.run.trial159.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-24T09:11:20.080 INFO:teuthology.orchestra.run.trial159.stdout: ceph-common x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 24 M 2026-02-24T09:11:20.080 INFO:teuthology.orchestra.run.trial159.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 57 k 2026-02-24T09:11:20.080 INFO:teuthology.orchestra.run.trial159.stdout: ceph-mds x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 2.3 M 2026-02-24T09:11:20.080 INFO:teuthology.orchestra.run.trial159.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 298 k 2026-02-24T09:11:20.080 INFO:teuthology.orchestra.run.trial159.stdout: ceph-mon x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 5.0 M 2026-02-24T09:11:20.080 INFO:teuthology.orchestra.run.trial159.stdout: ceph-osd-crimson x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 19 M 2026-02-24T09:11:20.080 INFO:teuthology.orchestra.run.trial159.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 17 k 2026-02-24T09:11:20.080 INFO:teuthology.orchestra.run.trial159.stdout: ceph-selinux x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 25 k 2026-02-24T09:11:20.080 INFO:teuthology.orchestra.run.trial159.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-24T09:11:20.081 INFO:teuthology.orchestra.run.trial159.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-24T09:11:20.081 INFO:teuthology.orchestra.run.trial159.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-24T09:11:20.081 INFO:teuthology.orchestra.run.trial159.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-24T09:11:20.081 INFO:teuthology.orchestra.run.trial159.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-24T09:11:20.081 INFO:teuthology.orchestra.run.trial159.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-24T09:11:20.081 INFO:teuthology.orchestra.run.trial159.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-24T09:11:20.081 INFO:teuthology.orchestra.run.trial159.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-24T09:11:20.081 INFO:teuthology.orchestra.run.trial159.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-24T09:11:20.081 INFO:teuthology.orchestra.run.trial159.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-24T09:11:20.081 INFO:teuthology.orchestra.run.trial159.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-24T09:11:20.081 INFO:teuthology.orchestra.run.trial159.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 26 k 2026-02-24T09:11:20.081 INFO:teuthology.orchestra.run.trial159.stdout: libcephsqlite x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 159 k 2026-02-24T09:11:20.081 INFO:teuthology.orchestra.run.trial159.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-24T09:11:20.082 INFO:teuthology.orchestra.run.trial159.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-24T09:11:20.082 INFO:teuthology.orchestra.run.trial159.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-24T09:11:20.082 INFO:teuthology.orchestra.run.trial159.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-24T09:11:20.082 INFO:teuthology.orchestra.run.trial159.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-24T09:11:20.082 INFO:teuthology.orchestra.run.trial159.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-24T09:11:20.082 INFO:teuthology.orchestra.run.trial159.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-24T09:11:20.082 INFO:teuthology.orchestra.run.trial159.stdout: libradosstriper1 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 247 k 2026-02-24T09:11:20.082 INFO:teuthology.orchestra.run.trial159.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-24T09:11:20.082 INFO:teuthology.orchestra.run.trial159.stdout: librgw2 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 6.5 M 2026-02-24T09:11:20.082 INFO:teuthology.orchestra.run.trial159.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-24T09:11:20.082 INFO:teuthology.orchestra.run.trial159.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-24T09:11:20.082 INFO:teuthology.orchestra.run.trial159.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-24T09:11:20.082 INFO:teuthology.orchestra.run.trial159.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-24T09:11:20.083 INFO:teuthology.orchestra.run.trial159.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-24T09:11:20.083 INFO:teuthology.orchestra.run.trial159.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-24T09:11:20.083 INFO:teuthology.orchestra.run.trial159.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-24T09:11:20.083 INFO:teuthology.orchestra.run.trial159.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-24T09:11:20.083 INFO:teuthology.orchestra.run.trial159.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-24T09:11:20.083 INFO:teuthology.orchestra.run.trial159.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-24T09:11:20.083 INFO:teuthology.orchestra.run.trial159.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-24T09:11:20.083 INFO:teuthology.orchestra.run.trial159.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-24T09:11:20.083 INFO:teuthology.orchestra.run.trial159.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-24T09:11:20.083 INFO:teuthology.orchestra.run.trial159.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-24T09:11:20.083 INFO:teuthology.orchestra.run.trial159.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-24T09:11:20.083 INFO:teuthology.orchestra.run.trial159.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-24T09:11:20.084 INFO:teuthology.orchestra.run.trial159.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-24T09:11:20.084 INFO:teuthology.orchestra.run.trial159.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-24T09:11:20.084 INFO:teuthology.orchestra.run.trial159.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-24T09:11:20.084 INFO:teuthology.orchestra.run.trial159.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-24T09:11:20.084 INFO:teuthology.orchestra.run.trial159.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-24T09:11:20.084 INFO:teuthology.orchestra.run.trial159.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-24T09:11:20.084 INFO:teuthology.orchestra.run.trial159.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-24T09:11:20.084 INFO:teuthology.orchestra.run.trial159.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-24T09:11:20.084 INFO:teuthology.orchestra.run.trial159.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-24T09:11:20.084 INFO:teuthology.orchestra.run.trial159.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-24T09:11:20.084 INFO:teuthology.orchestra.run.trial159.stdout: python3-ceph-argparse x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 45 k 2026-02-24T09:11:20.084 INFO:teuthology.orchestra.run.trial159.stdout: python3-ceph-common x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 186 k 2026-02-24T09:11:20.084 INFO:teuthology.orchestra.run.trial159.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-24T09:11:20.085 INFO:teuthology.orchestra.run.trial159.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-24T09:11:20.085 INFO:teuthology.orchestra.run.trial159.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-24T09:11:20.085 INFO:teuthology.orchestra.run.trial159.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-24T09:11:20.085 INFO:teuthology.orchestra.run.trial159.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-24T09:11:20.085 INFO:teuthology.orchestra.run.trial159.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-24T09:11:20.085 INFO:teuthology.orchestra.run.trial159.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-24T09:11:20.085 INFO:teuthology.orchestra.run.trial159.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-24T09:11:20.085 INFO:teuthology.orchestra.run.trial159.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-24T09:11:20.085 INFO:teuthology.orchestra.run.trial159.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-24T09:11:20.085 INFO:teuthology.orchestra.run.trial159.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-24T09:11:20.085 INFO:teuthology.orchestra.run.trial159.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-24T09:11:20.085 INFO:teuthology.orchestra.run.trial159.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-24T09:11:20.085 INFO:teuthology.orchestra.run.trial159.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-24T09:11:20.086 INFO:teuthology.orchestra.run.trial159.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-24T09:11:20.086 INFO:teuthology.orchestra.run.trial159.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-24T09:11:20.086 INFO:teuthology.orchestra.run.trial159.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-24T09:11:20.086 INFO:teuthology.orchestra.run.trial159.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-24T09:11:20.086 INFO:teuthology.orchestra.run.trial159.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-24T09:11:20.086 INFO:teuthology.orchestra.run.trial159.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-24T09:11:20.086 INFO:teuthology.orchestra.run.trial159.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-24T09:11:20.086 INFO:teuthology.orchestra.run.trial159.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-24T09:11:20.086 INFO:teuthology.orchestra.run.trial159.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-24T09:11:20.086 INFO:teuthology.orchestra.run.trial159.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-24T09:11:20.086 INFO:teuthology.orchestra.run.trial159.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-24T09:11:20.086 INFO:teuthology.orchestra.run.trial159.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-24T09:11:20.086 INFO:teuthology.orchestra.run.trial159.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-24T09:11:20.086 INFO:teuthology.orchestra.run.trial159.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-24T09:11:20.087 INFO:teuthology.orchestra.run.trial159.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-24T09:11:20.087 INFO:teuthology.orchestra.run.trial159.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-24T09:11:20.087 INFO:teuthology.orchestra.run.trial159.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-24T09:11:20.087 INFO:teuthology.orchestra.run.trial159.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-24T09:11:20.087 INFO:teuthology.orchestra.run.trial159.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-24T09:11:20.087 INFO:teuthology.orchestra.run.trial159.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-24T09:11:20.087 INFO:teuthology.orchestra.run.trial159.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-24T09:11:20.087 INFO:teuthology.orchestra.run.trial159.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-24T09:11:20.087 INFO:teuthology.orchestra.run.trial159.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-24T09:11:20.087 INFO:teuthology.orchestra.run.trial159.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-24T09:11:20.087 INFO:teuthology.orchestra.run.trial159.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-24T09:11:20.087 INFO:teuthology.orchestra.run.trial159.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-24T09:11:20.088 INFO:teuthology.orchestra.run.trial159.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-24T09:11:20.088 INFO:teuthology.orchestra.run.trial159.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-24T09:11:20.088 INFO:teuthology.orchestra.run.trial159.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-24T09:11:20.088 INFO:teuthology.orchestra.run.trial159.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-24T09:11:20.088 INFO:teuthology.orchestra.run.trial159.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-24T09:11:20.088 INFO:teuthology.orchestra.run.trial159.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-24T09:11:20.088 INFO:teuthology.orchestra.run.trial159.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-24T09:11:20.088 INFO:teuthology.orchestra.run.trial159.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-24T09:11:20.088 INFO:teuthology.orchestra.run.trial159.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-24T09:11:20.088 INFO:teuthology.orchestra.run.trial159.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-24T09:11:20.088 INFO:teuthology.orchestra.run.trial159.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-24T09:11:20.088 INFO:teuthology.orchestra.run.trial159.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-24T09:11:20.089 INFO:teuthology.orchestra.run.trial159.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-24T09:11:20.089 INFO:teuthology.orchestra.run.trial159.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-24T09:11:20.089 INFO:teuthology.orchestra.run.trial159.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-24T09:11:20.089 INFO:teuthology.orchestra.run.trial159.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-24T09:11:20.089 INFO:teuthology.orchestra.run.trial159.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-24T09:11:20.089 INFO:teuthology.orchestra.run.trial159.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-24T09:11:20.089 INFO:teuthology.orchestra.run.trial159.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-24T09:11:20.089 INFO:teuthology.orchestra.run.trial159.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-24T09:11:20.089 INFO:teuthology.orchestra.run.trial159.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-24T09:11:20.089 INFO:teuthology.orchestra.run.trial159.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-24T09:11:20.089 INFO:teuthology.orchestra.run.trial159.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-24T09:11:20.089 INFO:teuthology.orchestra.run.trial159.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-24T09:11:20.089 INFO:teuthology.orchestra.run.trial159.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-24T09:11:20.090 INFO:teuthology.orchestra.run.trial159.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-24T09:11:20.090 INFO:teuthology.orchestra.run.trial159.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-24T09:11:20.090 INFO:teuthology.orchestra.run.trial159.stdout:Installing weak dependencies: 2026-02-24T09:11:20.090 INFO:teuthology.orchestra.run.trial159.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 22 k 2026-02-24T09:11:20.090 INFO:teuthology.orchestra.run.trial159.stdout: libcephfs-daemon x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 39 k 2026-02-24T09:11:20.090 INFO:teuthology.orchestra.run.trial159.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-24T09:11:20.090 INFO:teuthology.orchestra.run.trial159.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-24T09:11:20.090 INFO:teuthology.orchestra.run.trial159.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-24T09:11:20.090 INFO:teuthology.orchestra.run.trial159.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-24T09:11:20.090 INFO:teuthology.orchestra.run.trial159.stdout: 2026-02-24T09:11:20.090 INFO:teuthology.orchestra.run.trial159.stdout:Transaction Summary 2026-02-24T09:11:20.090 INFO:teuthology.orchestra.run.trial159.stdout:======================================================================================= 2026-02-24T09:11:20.091 INFO:teuthology.orchestra.run.trial159.stdout:Install 174 Packages 2026-02-24T09:11:20.091 INFO:teuthology.orchestra.run.trial159.stdout:Upgrade 9 Packages 2026-02-24T09:11:20.091 INFO:teuthology.orchestra.run.trial159.stdout: 2026-02-24T09:11:20.092 INFO:teuthology.orchestra.run.trial159.stdout:Total download size: 296 M 2026-02-24T09:11:20.092 INFO:teuthology.orchestra.run.trial159.stdout:Downloading Packages: 2026-02-24T09:11:20.579 INFO:teuthology.orchestra.run.trial159.stdout:(1/183): ceph-20.3.0-5537.g5bc9a1ff.el9.x86_64. 41 kB/s | 6.5 kB 00:00 2026-02-24T09:11:21.280 INFO:teuthology.orchestra.run.trial159.stdout:(2/183): ceph-fuse-20.3.0-5537.g5bc9a1ff.el9.x8 1.4 MB/s | 987 kB 00:00 2026-02-24T09:11:21.389 INFO:teuthology.orchestra.run.trial159.stdout:(3/183): ceph-immutable-object-cache-20.3.0-553 1.3 MB/s | 148 kB 00:00 2026-02-24T09:11:21.933 INFO:teuthology.orchestra.run.trial028.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-24T09:11:22.080 INFO:teuthology.orchestra.run.trial159.stdout:(4/183): ceph-mds-20.3.0-5537.g5bc9a1ff.el9.x86 3.4 MB/s | 2.3 MB 00:00 2026-02-24T09:11:22.342 INFO:teuthology.orchestra.run.trial159.stdout:(5/183): ceph-mgr-20.3.0-5537.g5bc9a1ff.el9.x86 3.5 MB/s | 950 kB 00:00 2026-02-24T09:11:22.379 INFO:teuthology.orchestra.run.trial159.stdout:(6/183): ceph-base-20.3.0-5537.g5bc9a1ff.el9.x8 2.7 MB/s | 5.2 MB 00:01 2026-02-24T09:11:22.449 INFO:teuthology.orchestra.run.trial159.stdout:(7/183): ceph-osd-20.3.0-5537.g5bc9a1ff.el9.x86 2.3 MB/s | 167 kB 00:00 2026-02-24T09:11:23.000 INFO:teuthology.orchestra.run.trial159.stdout:(8/183): ceph-mon-20.3.0-5537.g5bc9a1ff.el9.x86 7.6 MB/s | 5.0 MB 00:00 2026-02-24T09:11:23.208 INFO:teuthology.orchestra.run.trial028.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-24T09:11:23.209 INFO:teuthology.orchestra.run.trial028.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-24T09:11:23.214 INFO:teuthology.orchestra.run.trial028.stdout:Package NetworkManager-1:1.54.3-2.el9.x86_64 is already installed. 2026-02-24T09:11:23.215 INFO:teuthology.orchestra.run.trial028.stdout:Package iproute-6.17.0-2.el9.x86_64 is already installed. 2026-02-24T09:11:23.215 INFO:teuthology.orchestra.run.trial028.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-24T09:11:23.215 INFO:teuthology.orchestra.run.trial028.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-24T09:11:23.216 INFO:teuthology.orchestra.run.trial028.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-24T09:11:23.217 INFO:teuthology.orchestra.run.trial028.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-24T09:11:23.218 INFO:teuthology.orchestra.run.trial028.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-24T09:11:23.249 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-24T09:11:23.255 INFO:teuthology.orchestra.run.trial028.stdout:======================================================================================= 2026-02-24T09:11:23.255 INFO:teuthology.orchestra.run.trial028.stdout: Package Arch Version Repository Size 2026-02-24T09:11:23.255 INFO:teuthology.orchestra.run.trial028.stdout:======================================================================================= 2026-02-24T09:11:23.255 INFO:teuthology.orchestra.run.trial028.stdout:Installing: 2026-02-24T09:11:23.255 INFO:teuthology.orchestra.run.trial028.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-24T09:11:23.255 INFO:teuthology.orchestra.run.trial028.stdout: ceph x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 6.5 k 2026-02-24T09:11:23.255 INFO:teuthology.orchestra.run.trial028.stdout: ceph-base x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 5.2 M 2026-02-24T09:11:23.255 INFO:teuthology.orchestra.run.trial028.stdout: ceph-fuse x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 987 k 2026-02-24T09:11:23.256 INFO:teuthology.orchestra.run.trial028.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 148 k 2026-02-24T09:11:23.256 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 950 k 2026-02-24T09:11:23.256 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 184 k 2026-02-24T09:11:23.256 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 15 M 2026-02-24T09:11:23.256 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 7.4 M 2026-02-24T09:11:23.256 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-rook noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 50 k 2026-02-24T09:11:23.256 INFO:teuthology.orchestra.run.trial028.stdout: ceph-osd x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 167 k 2026-02-24T09:11:23.256 INFO:teuthology.orchestra.run.trial028.stdout: ceph-osd-classic x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 16 M 2026-02-24T09:11:23.256 INFO:teuthology.orchestra.run.trial028.stdout: ceph-radosgw x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 13 M 2026-02-24T09:11:23.256 INFO:teuthology.orchestra.run.trial028.stdout: ceph-test x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 76 M 2026-02-24T09:11:23.256 INFO:teuthology.orchestra.run.trial028.stdout: ceph-volume noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 301 k 2026-02-24T09:11:23.256 INFO:teuthology.orchestra.run.trial028.stdout: cephadm noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 1.0 M 2026-02-24T09:11:23.257 INFO:teuthology.orchestra.run.trial028.stdout: cephfs-mirror x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 243 k 2026-02-24T09:11:23.257 INFO:teuthology.orchestra.run.trial028.stdout: cephfs-shell x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 27 k 2026-02-24T09:11:23.257 INFO:teuthology.orchestra.run.trial028.stdout: cephfs-top noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 18 k 2026-02-24T09:11:23.257 INFO:teuthology.orchestra.run.trial028.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-24T09:11:23.257 INFO:teuthology.orchestra.run.trial028.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-24T09:11:23.257 INFO:teuthology.orchestra.run.trial028.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-24T09:11:23.257 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs-devel x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 37 k 2026-02-24T09:11:23.257 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs2 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 909 k 2026-02-24T09:11:23.257 INFO:teuthology.orchestra.run.trial028.stdout: librados-devel x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 123 k 2026-02-24T09:11:23.257 INFO:teuthology.orchestra.run.trial028.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-24T09:11:23.257 INFO:teuthology.orchestra.run.trial028.stdout: libuuid-devel x86_64 2.37.4-25.el9 appstream 23 k 2026-02-24T09:11:23.257 INFO:teuthology.orchestra.run.trial028.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-24T09:11:23.258 INFO:teuthology.orchestra.run.trial028.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-24T09:11:23.258 INFO:teuthology.orchestra.run.trial028.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-24T09:11:23.258 INFO:teuthology.orchestra.run.trial028.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-24T09:11:23.258 INFO:teuthology.orchestra.run.trial028.stdout: python3-cephfs x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 204 k 2026-02-24T09:11:23.258 INFO:teuthology.orchestra.run.trial028.stdout: python3-rados x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 324 k 2026-02-24T09:11:23.258 INFO:teuthology.orchestra.run.trial028.stdout: python3-rbd x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 304 k 2026-02-24T09:11:23.258 INFO:teuthology.orchestra.run.trial028.stdout: python3-rgw x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 100 k 2026-02-24T09:11:23.258 INFO:teuthology.orchestra.run.trial028.stdout: rbd-fuse x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 84 k 2026-02-24T09:11:23.258 INFO:teuthology.orchestra.run.trial028.stdout: rbd-mirror x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 2.9 M 2026-02-24T09:11:23.258 INFO:teuthology.orchestra.run.trial028.stdout: rbd-nbd x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 172 k 2026-02-24T09:11:23.258 INFO:teuthology.orchestra.run.trial028.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-24T09:11:23.258 INFO:teuthology.orchestra.run.trial028.stdout:Upgrading: 2026-02-24T09:11:23.259 INFO:teuthology.orchestra.run.trial028.stdout: libblkid x86_64 2.37.4-25.el9 baseos 105 k 2026-02-24T09:11:23.259 INFO:teuthology.orchestra.run.trial028.stdout: libfdisk x86_64 2.37.4-25.el9 baseos 152 k 2026-02-24T09:11:23.259 INFO:teuthology.orchestra.run.trial028.stdout: libmount x86_64 2.37.4-25.el9 baseos 133 k 2026-02-24T09:11:23.259 INFO:teuthology.orchestra.run.trial028.stdout: librados2 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 3.5 M 2026-02-24T09:11:23.259 INFO:teuthology.orchestra.run.trial028.stdout: librbd1 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 2.8 M 2026-02-24T09:11:23.259 INFO:teuthology.orchestra.run.trial028.stdout: libsmartcols x86_64 2.37.4-25.el9 baseos 61 k 2026-02-24T09:11:23.259 INFO:teuthology.orchestra.run.trial028.stdout: libuuid x86_64 2.37.4-25.el9 baseos 26 k 2026-02-24T09:11:23.259 INFO:teuthology.orchestra.run.trial028.stdout: util-linux x86_64 2.37.4-25.el9 baseos 2.3 M 2026-02-24T09:11:23.259 INFO:teuthology.orchestra.run.trial028.stdout: util-linux-core x86_64 2.37.4-25.el9 baseos 458 k 2026-02-24T09:11:23.259 INFO:teuthology.orchestra.run.trial028.stdout:Installing dependencies: 2026-02-24T09:11:23.259 INFO:teuthology.orchestra.run.trial028.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-24T09:11:23.259 INFO:teuthology.orchestra.run.trial028.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-24T09:11:23.259 INFO:teuthology.orchestra.run.trial028.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-24T09:11:23.260 INFO:teuthology.orchestra.run.trial028.stdout: ceph-common x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 24 M 2026-02-24T09:11:23.260 INFO:teuthology.orchestra.run.trial028.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 57 k 2026-02-24T09:11:23.260 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mds x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 2.3 M 2026-02-24T09:11:23.260 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 298 k 2026-02-24T09:11:23.260 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mon x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 5.0 M 2026-02-24T09:11:23.260 INFO:teuthology.orchestra.run.trial028.stdout: ceph-osd-crimson x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 19 M 2026-02-24T09:11:23.260 INFO:teuthology.orchestra.run.trial028.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 17 k 2026-02-24T09:11:23.260 INFO:teuthology.orchestra.run.trial028.stdout: ceph-selinux x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 25 k 2026-02-24T09:11:23.260 INFO:teuthology.orchestra.run.trial028.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-24T09:11:23.260 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-24T09:11:23.260 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-24T09:11:23.260 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-24T09:11:23.260 INFO:teuthology.orchestra.run.trial028.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-24T09:11:23.261 INFO:teuthology.orchestra.run.trial028.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-24T09:11:23.261 INFO:teuthology.orchestra.run.trial028.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-24T09:11:23.261 INFO:teuthology.orchestra.run.trial028.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-24T09:11:23.261 INFO:teuthology.orchestra.run.trial028.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-24T09:11:23.261 INFO:teuthology.orchestra.run.trial028.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-24T09:11:23.261 INFO:teuthology.orchestra.run.trial028.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-24T09:11:23.261 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 26 k 2026-02-24T09:11:23.261 INFO:teuthology.orchestra.run.trial028.stdout: libcephsqlite x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 159 k 2026-02-24T09:11:23.261 INFO:teuthology.orchestra.run.trial028.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-24T09:11:23.261 INFO:teuthology.orchestra.run.trial028.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-24T09:11:23.261 INFO:teuthology.orchestra.run.trial028.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-24T09:11:23.261 INFO:teuthology.orchestra.run.trial028.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-24T09:11:23.261 INFO:teuthology.orchestra.run.trial028.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-24T09:11:23.262 INFO:teuthology.orchestra.run.trial028.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-24T09:11:23.262 INFO:teuthology.orchestra.run.trial028.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-24T09:11:23.262 INFO:teuthology.orchestra.run.trial028.stdout: libradosstriper1 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 247 k 2026-02-24T09:11:23.262 INFO:teuthology.orchestra.run.trial028.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-24T09:11:23.262 INFO:teuthology.orchestra.run.trial028.stdout: librgw2 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 6.5 M 2026-02-24T09:11:23.262 INFO:teuthology.orchestra.run.trial028.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-24T09:11:23.262 INFO:teuthology.orchestra.run.trial028.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-24T09:11:23.262 INFO:teuthology.orchestra.run.trial028.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-24T09:11:23.262 INFO:teuthology.orchestra.run.trial028.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-24T09:11:23.262 INFO:teuthology.orchestra.run.trial028.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-24T09:11:23.262 INFO:teuthology.orchestra.run.trial028.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-24T09:11:23.262 INFO:teuthology.orchestra.run.trial028.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-24T09:11:23.263 INFO:teuthology.orchestra.run.trial028.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-24T09:11:23.263 INFO:teuthology.orchestra.run.trial028.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-24T09:11:23.263 INFO:teuthology.orchestra.run.trial028.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-24T09:11:23.263 INFO:teuthology.orchestra.run.trial028.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-24T09:11:23.263 INFO:teuthology.orchestra.run.trial028.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-24T09:11:23.263 INFO:teuthology.orchestra.run.trial028.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-24T09:11:23.263 INFO:teuthology.orchestra.run.trial028.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-24T09:11:23.263 INFO:teuthology.orchestra.run.trial028.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-24T09:11:23.263 INFO:teuthology.orchestra.run.trial028.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-24T09:11:23.263 INFO:teuthology.orchestra.run.trial028.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-24T09:11:23.263 INFO:teuthology.orchestra.run.trial028.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-24T09:11:23.263 INFO:teuthology.orchestra.run.trial028.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-24T09:11:23.263 INFO:teuthology.orchestra.run.trial028.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-24T09:11:23.264 INFO:teuthology.orchestra.run.trial028.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-24T09:11:23.264 INFO:teuthology.orchestra.run.trial028.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-24T09:11:23.264 INFO:teuthology.orchestra.run.trial028.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-24T09:11:23.264 INFO:teuthology.orchestra.run.trial028.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-24T09:11:23.264 INFO:teuthology.orchestra.run.trial028.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-24T09:11:23.264 INFO:teuthology.orchestra.run.trial028.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-24T09:11:23.264 INFO:teuthology.orchestra.run.trial028.stdout: python3-ceph-argparse x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 45 k 2026-02-24T09:11:23.264 INFO:teuthology.orchestra.run.trial028.stdout: python3-ceph-common x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 186 k 2026-02-24T09:11:23.264 INFO:teuthology.orchestra.run.trial028.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-24T09:11:23.264 INFO:teuthology.orchestra.run.trial028.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-24T09:11:23.264 INFO:teuthology.orchestra.run.trial028.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-24T09:11:23.264 INFO:teuthology.orchestra.run.trial028.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-24T09:11:23.264 INFO:teuthology.orchestra.run.trial028.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-24T09:11:23.265 INFO:teuthology.orchestra.run.trial028.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-24T09:11:23.265 INFO:teuthology.orchestra.run.trial028.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-24T09:11:23.265 INFO:teuthology.orchestra.run.trial028.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-24T09:11:23.265 INFO:teuthology.orchestra.run.trial028.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-24T09:11:23.265 INFO:teuthology.orchestra.run.trial028.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-24T09:11:23.265 INFO:teuthology.orchestra.run.trial028.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-24T09:11:23.265 INFO:teuthology.orchestra.run.trial028.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-24T09:11:23.265 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-24T09:11:23.265 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-24T09:11:23.265 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-24T09:11:23.265 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-24T09:11:23.265 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-24T09:11:23.265 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-24T09:11:23.266 INFO:teuthology.orchestra.run.trial028.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-24T09:11:23.266 INFO:teuthology.orchestra.run.trial028.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-24T09:11:23.266 INFO:teuthology.orchestra.run.trial028.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-24T09:11:23.266 INFO:teuthology.orchestra.run.trial028.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-24T09:11:23.266 INFO:teuthology.orchestra.run.trial028.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-24T09:11:23.266 INFO:teuthology.orchestra.run.trial028.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-24T09:11:23.266 INFO:teuthology.orchestra.run.trial028.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-24T09:11:23.266 INFO:teuthology.orchestra.run.trial028.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-24T09:11:23.266 INFO:teuthology.orchestra.run.trial028.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-24T09:11:23.266 INFO:teuthology.orchestra.run.trial028.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-24T09:11:23.266 INFO:teuthology.orchestra.run.trial028.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-24T09:11:23.266 INFO:teuthology.orchestra.run.trial028.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-24T09:11:23.266 INFO:teuthology.orchestra.run.trial028.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-24T09:11:23.267 INFO:teuthology.orchestra.run.trial028.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-24T09:11:23.267 INFO:teuthology.orchestra.run.trial028.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-24T09:11:23.267 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-24T09:11:23.267 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-24T09:11:23.267 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-24T09:11:23.267 INFO:teuthology.orchestra.run.trial028.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-24T09:11:23.267 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-24T09:11:23.267 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-24T09:11:23.267 INFO:teuthology.orchestra.run.trial028.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-24T09:11:23.267 INFO:teuthology.orchestra.run.trial028.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-24T09:11:23.267 INFO:teuthology.orchestra.run.trial028.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-24T09:11:23.267 INFO:teuthology.orchestra.run.trial028.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-24T09:11:23.267 INFO:teuthology.orchestra.run.trial028.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-24T09:11:23.268 INFO:teuthology.orchestra.run.trial028.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-24T09:11:23.268 INFO:teuthology.orchestra.run.trial028.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-24T09:11:23.268 INFO:teuthology.orchestra.run.trial028.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-24T09:11:23.268 INFO:teuthology.orchestra.run.trial028.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-24T09:11:23.268 INFO:teuthology.orchestra.run.trial028.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-24T09:11:23.268 INFO:teuthology.orchestra.run.trial028.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-24T09:11:23.268 INFO:teuthology.orchestra.run.trial028.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-24T09:11:23.268 INFO:teuthology.orchestra.run.trial028.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-24T09:11:23.268 INFO:teuthology.orchestra.run.trial028.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-24T09:11:23.268 INFO:teuthology.orchestra.run.trial028.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-24T09:11:23.268 INFO:teuthology.orchestra.run.trial028.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-24T09:11:23.268 INFO:teuthology.orchestra.run.trial028.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-24T09:11:23.268 INFO:teuthology.orchestra.run.trial028.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-24T09:11:23.268 INFO:teuthology.orchestra.run.trial028.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-24T09:11:23.269 INFO:teuthology.orchestra.run.trial028.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-24T09:11:23.269 INFO:teuthology.orchestra.run.trial028.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-24T09:11:23.269 INFO:teuthology.orchestra.run.trial028.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-24T09:11:23.269 INFO:teuthology.orchestra.run.trial028.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-24T09:11:23.269 INFO:teuthology.orchestra.run.trial028.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-24T09:11:23.269 INFO:teuthology.orchestra.run.trial028.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-24T09:11:23.269 INFO:teuthology.orchestra.run.trial028.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-24T09:11:23.269 INFO:teuthology.orchestra.run.trial028.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-24T09:11:23.269 INFO:teuthology.orchestra.run.trial028.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-24T09:11:23.269 INFO:teuthology.orchestra.run.trial028.stdout:Installing weak dependencies: 2026-02-24T09:11:23.269 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 22 k 2026-02-24T09:11:23.269 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs-daemon x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 39 k 2026-02-24T09:11:23.269 INFO:teuthology.orchestra.run.trial028.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-24T09:11:23.269 INFO:teuthology.orchestra.run.trial028.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-24T09:11:23.269 INFO:teuthology.orchestra.run.trial028.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-24T09:11:23.270 INFO:teuthology.orchestra.run.trial028.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-24T09:11:23.270 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:11:23.270 INFO:teuthology.orchestra.run.trial028.stdout:Transaction Summary 2026-02-24T09:11:23.270 INFO:teuthology.orchestra.run.trial028.stdout:======================================================================================= 2026-02-24T09:11:23.270 INFO:teuthology.orchestra.run.trial028.stdout:Install 174 Packages 2026-02-24T09:11:23.270 INFO:teuthology.orchestra.run.trial028.stdout:Upgrade 9 Packages 2026-02-24T09:11:23.270 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:11:23.271 INFO:teuthology.orchestra.run.trial028.stdout:Total download size: 296 M 2026-02-24T09:11:23.271 INFO:teuthology.orchestra.run.trial028.stdout:Downloading Packages: 2026-02-24T09:11:23.980 INFO:teuthology.orchestra.run.trial074.stdout:lab-extras 2.8 MB/s | 50 kB 00:00 2026-02-24T09:11:23.989 INFO:teuthology.orchestra.run.trial028.stdout:(1/183): ceph-20.3.0-5537.g5bc9a1ff.el9.x86_64. 27 kB/s | 6.5 kB 00:00 2026-02-24T09:11:24.155 INFO:teuthology.orchestra.run.trial159.stdout:(9/183): ceph-common-20.3.0-5537.g5bc9a1ff.el9. 6.5 MB/s | 24 MB 00:03 2026-02-24T09:11:24.767 INFO:teuthology.orchestra.run.trial159.stdout:(10/183): ceph-osd-crimson-20.3.0-5537.g5bc9a1f 11 MB/s | 19 MB 00:01 2026-02-24T09:11:24.814 INFO:teuthology.orchestra.run.trial159.stdout:(11/183): ceph-selinux-20.3.0-5537.g5bc9a1ff.el 533 kB/s | 25 kB 00:00 2026-02-24T09:11:24.995 INFO:teuthology.orchestra.run.trial028.stdout:(2/183): ceph-fuse-20.3.0-5537.g5bc9a1ff.el9.x8 981 kB/s | 987 kB 00:01 2026-02-24T09:11:25.176 INFO:teuthology.orchestra.run.trial028.stdout:(3/183): ceph-immutable-object-cache-20.3.0-553 821 kB/s | 148 kB 00:00 2026-02-24T09:11:25.259 INFO:teuthology.orchestra.run.trial074.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-24T09:11:25.260 INFO:teuthology.orchestra.run.trial074.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-24T09:11:25.266 INFO:teuthology.orchestra.run.trial074.stdout:Package NetworkManager-1:1.54.3-2.el9.x86_64 is already installed. 2026-02-24T09:11:25.266 INFO:teuthology.orchestra.run.trial074.stdout:Package iproute-6.17.0-2.el9.x86_64 is already installed. 2026-02-24T09:11:25.266 INFO:teuthology.orchestra.run.trial074.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-24T09:11:25.267 INFO:teuthology.orchestra.run.trial074.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-24T09:11:25.268 INFO:teuthology.orchestra.run.trial074.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-24T09:11:25.269 INFO:teuthology.orchestra.run.trial074.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-24T09:11:25.269 INFO:teuthology.orchestra.run.trial074.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-24T09:11:25.300 INFO:teuthology.orchestra.run.trial074.stdout:Dependencies resolved. 2026-02-24T09:11:25.306 INFO:teuthology.orchestra.run.trial074.stdout:======================================================================================= 2026-02-24T09:11:25.306 INFO:teuthology.orchestra.run.trial074.stdout: Package Arch Version Repository Size 2026-02-24T09:11:25.306 INFO:teuthology.orchestra.run.trial074.stdout:======================================================================================= 2026-02-24T09:11:25.306 INFO:teuthology.orchestra.run.trial074.stdout:Installing: 2026-02-24T09:11:25.306 INFO:teuthology.orchestra.run.trial074.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-24T09:11:25.306 INFO:teuthology.orchestra.run.trial074.stdout: ceph x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 6.5 k 2026-02-24T09:11:25.306 INFO:teuthology.orchestra.run.trial074.stdout: ceph-base x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 5.2 M 2026-02-24T09:11:25.306 INFO:teuthology.orchestra.run.trial074.stdout: ceph-fuse x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 987 k 2026-02-24T09:11:25.306 INFO:teuthology.orchestra.run.trial074.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 148 k 2026-02-24T09:11:25.307 INFO:teuthology.orchestra.run.trial074.stdout: ceph-mgr x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 950 k 2026-02-24T09:11:25.307 INFO:teuthology.orchestra.run.trial074.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 184 k 2026-02-24T09:11:25.307 INFO:teuthology.orchestra.run.trial074.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 15 M 2026-02-24T09:11:25.307 INFO:teuthology.orchestra.run.trial074.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 7.4 M 2026-02-24T09:11:25.307 INFO:teuthology.orchestra.run.trial074.stdout: ceph-mgr-rook noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 50 k 2026-02-24T09:11:25.307 INFO:teuthology.orchestra.run.trial074.stdout: ceph-osd x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 167 k 2026-02-24T09:11:25.307 INFO:teuthology.orchestra.run.trial074.stdout: ceph-osd-classic x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 16 M 2026-02-24T09:11:25.307 INFO:teuthology.orchestra.run.trial074.stdout: ceph-radosgw x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 13 M 2026-02-24T09:11:25.307 INFO:teuthology.orchestra.run.trial074.stdout: ceph-test x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 76 M 2026-02-24T09:11:25.307 INFO:teuthology.orchestra.run.trial074.stdout: ceph-volume noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 301 k 2026-02-24T09:11:25.307 INFO:teuthology.orchestra.run.trial074.stdout: cephadm noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 1.0 M 2026-02-24T09:11:25.307 INFO:teuthology.orchestra.run.trial074.stdout: cephfs-mirror x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 243 k 2026-02-24T09:11:25.308 INFO:teuthology.orchestra.run.trial074.stdout: cephfs-shell x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 27 k 2026-02-24T09:11:25.308 INFO:teuthology.orchestra.run.trial074.stdout: cephfs-top noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 18 k 2026-02-24T09:11:25.308 INFO:teuthology.orchestra.run.trial074.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-24T09:11:25.308 INFO:teuthology.orchestra.run.trial074.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-24T09:11:25.308 INFO:teuthology.orchestra.run.trial074.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-24T09:11:25.308 INFO:teuthology.orchestra.run.trial074.stdout: libcephfs-devel x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 37 k 2026-02-24T09:11:25.308 INFO:teuthology.orchestra.run.trial074.stdout: libcephfs2 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 909 k 2026-02-24T09:11:25.308 INFO:teuthology.orchestra.run.trial074.stdout: librados-devel x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 123 k 2026-02-24T09:11:25.308 INFO:teuthology.orchestra.run.trial074.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-24T09:11:25.308 INFO:teuthology.orchestra.run.trial074.stdout: libuuid-devel x86_64 2.37.4-25.el9 appstream 23 k 2026-02-24T09:11:25.308 INFO:teuthology.orchestra.run.trial074.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-24T09:11:25.309 INFO:teuthology.orchestra.run.trial074.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-24T09:11:25.309 INFO:teuthology.orchestra.run.trial074.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-24T09:11:25.309 INFO:teuthology.orchestra.run.trial074.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-24T09:11:25.309 INFO:teuthology.orchestra.run.trial074.stdout: python3-cephfs x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 204 k 2026-02-24T09:11:25.309 INFO:teuthology.orchestra.run.trial074.stdout: python3-rados x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 324 k 2026-02-24T09:11:25.309 INFO:teuthology.orchestra.run.trial074.stdout: python3-rbd x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 304 k 2026-02-24T09:11:25.309 INFO:teuthology.orchestra.run.trial074.stdout: python3-rgw x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 100 k 2026-02-24T09:11:25.309 INFO:teuthology.orchestra.run.trial074.stdout: rbd-fuse x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 84 k 2026-02-24T09:11:25.309 INFO:teuthology.orchestra.run.trial074.stdout: rbd-mirror x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 2.9 M 2026-02-24T09:11:25.309 INFO:teuthology.orchestra.run.trial074.stdout: rbd-nbd x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 172 k 2026-02-24T09:11:25.309 INFO:teuthology.orchestra.run.trial074.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-24T09:11:25.309 INFO:teuthology.orchestra.run.trial074.stdout:Upgrading: 2026-02-24T09:11:25.310 INFO:teuthology.orchestra.run.trial074.stdout: libblkid x86_64 2.37.4-25.el9 baseos 105 k 2026-02-24T09:11:25.310 INFO:teuthology.orchestra.run.trial074.stdout: libfdisk x86_64 2.37.4-25.el9 baseos 152 k 2026-02-24T09:11:25.310 INFO:teuthology.orchestra.run.trial074.stdout: libmount x86_64 2.37.4-25.el9 baseos 133 k 2026-02-24T09:11:25.310 INFO:teuthology.orchestra.run.trial074.stdout: librados2 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 3.5 M 2026-02-24T09:11:25.310 INFO:teuthology.orchestra.run.trial074.stdout: librbd1 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 2.8 M 2026-02-24T09:11:25.310 INFO:teuthology.orchestra.run.trial074.stdout: libsmartcols x86_64 2.37.4-25.el9 baseos 61 k 2026-02-24T09:11:25.310 INFO:teuthology.orchestra.run.trial074.stdout: libuuid x86_64 2.37.4-25.el9 baseos 26 k 2026-02-24T09:11:25.310 INFO:teuthology.orchestra.run.trial074.stdout: util-linux x86_64 2.37.4-25.el9 baseos 2.3 M 2026-02-24T09:11:25.310 INFO:teuthology.orchestra.run.trial074.stdout: util-linux-core x86_64 2.37.4-25.el9 baseos 458 k 2026-02-24T09:11:25.310 INFO:teuthology.orchestra.run.trial074.stdout:Installing dependencies: 2026-02-24T09:11:25.310 INFO:teuthology.orchestra.run.trial074.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-24T09:11:25.310 INFO:teuthology.orchestra.run.trial074.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-24T09:11:25.311 INFO:teuthology.orchestra.run.trial074.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-24T09:11:25.311 INFO:teuthology.orchestra.run.trial074.stdout: ceph-common x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 24 M 2026-02-24T09:11:25.311 INFO:teuthology.orchestra.run.trial074.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 57 k 2026-02-24T09:11:25.311 INFO:teuthology.orchestra.run.trial074.stdout: ceph-mds x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 2.3 M 2026-02-24T09:11:25.311 INFO:teuthology.orchestra.run.trial074.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 298 k 2026-02-24T09:11:25.311 INFO:teuthology.orchestra.run.trial074.stdout: ceph-mon x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 5.0 M 2026-02-24T09:11:25.311 INFO:teuthology.orchestra.run.trial074.stdout: ceph-osd-crimson x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 19 M 2026-02-24T09:11:25.311 INFO:teuthology.orchestra.run.trial074.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 17 k 2026-02-24T09:11:25.311 INFO:teuthology.orchestra.run.trial074.stdout: ceph-selinux x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 25 k 2026-02-24T09:11:25.311 INFO:teuthology.orchestra.run.trial074.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-24T09:11:25.311 INFO:teuthology.orchestra.run.trial074.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-24T09:11:25.312 INFO:teuthology.orchestra.run.trial074.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-24T09:11:25.312 INFO:teuthology.orchestra.run.trial074.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-24T09:11:25.312 INFO:teuthology.orchestra.run.trial074.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-24T09:11:25.312 INFO:teuthology.orchestra.run.trial074.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-24T09:11:25.312 INFO:teuthology.orchestra.run.trial074.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-24T09:11:25.312 INFO:teuthology.orchestra.run.trial074.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-24T09:11:25.312 INFO:teuthology.orchestra.run.trial074.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-24T09:11:25.312 INFO:teuthology.orchestra.run.trial074.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-24T09:11:25.312 INFO:teuthology.orchestra.run.trial074.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-24T09:11:25.312 INFO:teuthology.orchestra.run.trial074.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 26 k 2026-02-24T09:11:25.312 INFO:teuthology.orchestra.run.trial074.stdout: libcephsqlite x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 159 k 2026-02-24T09:11:25.312 INFO:teuthology.orchestra.run.trial074.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-24T09:11:25.313 INFO:teuthology.orchestra.run.trial074.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-24T09:11:25.313 INFO:teuthology.orchestra.run.trial074.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-24T09:11:25.313 INFO:teuthology.orchestra.run.trial074.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-24T09:11:25.313 INFO:teuthology.orchestra.run.trial074.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-24T09:11:25.313 INFO:teuthology.orchestra.run.trial074.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-24T09:11:25.313 INFO:teuthology.orchestra.run.trial074.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-24T09:11:25.313 INFO:teuthology.orchestra.run.trial074.stdout: libradosstriper1 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 247 k 2026-02-24T09:11:25.313 INFO:teuthology.orchestra.run.trial074.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-24T09:11:25.313 INFO:teuthology.orchestra.run.trial074.stdout: librgw2 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 6.5 M 2026-02-24T09:11:25.313 INFO:teuthology.orchestra.run.trial074.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-24T09:11:25.313 INFO:teuthology.orchestra.run.trial074.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-24T09:11:25.313 INFO:teuthology.orchestra.run.trial074.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-24T09:11:25.314 INFO:teuthology.orchestra.run.trial074.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-24T09:11:25.314 INFO:teuthology.orchestra.run.trial074.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-24T09:11:25.314 INFO:teuthology.orchestra.run.trial074.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-24T09:11:25.314 INFO:teuthology.orchestra.run.trial074.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-24T09:11:25.314 INFO:teuthology.orchestra.run.trial074.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-24T09:11:25.314 INFO:teuthology.orchestra.run.trial074.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-24T09:11:25.314 INFO:teuthology.orchestra.run.trial074.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-24T09:11:25.314 INFO:teuthology.orchestra.run.trial074.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-24T09:11:25.314 INFO:teuthology.orchestra.run.trial074.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-24T09:11:25.314 INFO:teuthology.orchestra.run.trial074.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-24T09:11:25.314 INFO:teuthology.orchestra.run.trial074.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-24T09:11:25.315 INFO:teuthology.orchestra.run.trial074.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-24T09:11:25.315 INFO:teuthology.orchestra.run.trial074.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-24T09:11:25.315 INFO:teuthology.orchestra.run.trial074.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-24T09:11:25.315 INFO:teuthology.orchestra.run.trial074.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-24T09:11:25.315 INFO:teuthology.orchestra.run.trial074.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-24T09:11:25.315 INFO:teuthology.orchestra.run.trial074.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-24T09:11:25.315 INFO:teuthology.orchestra.run.trial074.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-24T09:11:25.315 INFO:teuthology.orchestra.run.trial074.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-24T09:11:25.315 INFO:teuthology.orchestra.run.trial074.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-24T09:11:25.315 INFO:teuthology.orchestra.run.trial074.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-24T09:11:25.315 INFO:teuthology.orchestra.run.trial074.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-24T09:11:25.316 INFO:teuthology.orchestra.run.trial074.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-24T09:11:25.316 INFO:teuthology.orchestra.run.trial074.stdout: python3-ceph-argparse x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 45 k 2026-02-24T09:11:25.316 INFO:teuthology.orchestra.run.trial074.stdout: python3-ceph-common x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 186 k 2026-02-24T09:11:25.316 INFO:teuthology.orchestra.run.trial074.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-24T09:11:25.316 INFO:teuthology.orchestra.run.trial074.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-24T09:11:25.316 INFO:teuthology.orchestra.run.trial074.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-24T09:11:25.316 INFO:teuthology.orchestra.run.trial074.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-24T09:11:25.316 INFO:teuthology.orchestra.run.trial074.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-24T09:11:25.316 INFO:teuthology.orchestra.run.trial074.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-24T09:11:25.316 INFO:teuthology.orchestra.run.trial074.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-24T09:11:25.316 INFO:teuthology.orchestra.run.trial074.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-24T09:11:25.316 INFO:teuthology.orchestra.run.trial074.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-24T09:11:25.316 INFO:teuthology.orchestra.run.trial074.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-24T09:11:25.317 INFO:teuthology.orchestra.run.trial074.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-24T09:11:25.317 INFO:teuthology.orchestra.run.trial074.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-24T09:11:25.317 INFO:teuthology.orchestra.run.trial074.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-24T09:11:25.317 INFO:teuthology.orchestra.run.trial074.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-24T09:11:25.317 INFO:teuthology.orchestra.run.trial074.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-24T09:11:25.317 INFO:teuthology.orchestra.run.trial074.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-24T09:11:25.317 INFO:teuthology.orchestra.run.trial074.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-24T09:11:25.317 INFO:teuthology.orchestra.run.trial074.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-24T09:11:25.317 INFO:teuthology.orchestra.run.trial074.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-24T09:11:25.317 INFO:teuthology.orchestra.run.trial074.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-24T09:11:25.317 INFO:teuthology.orchestra.run.trial074.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-24T09:11:25.317 INFO:teuthology.orchestra.run.trial074.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-24T09:11:25.317 INFO:teuthology.orchestra.run.trial074.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-24T09:11:25.318 INFO:teuthology.orchestra.run.trial074.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-24T09:11:25.318 INFO:teuthology.orchestra.run.trial074.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-24T09:11:25.318 INFO:teuthology.orchestra.run.trial074.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-24T09:11:25.318 INFO:teuthology.orchestra.run.trial074.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-24T09:11:25.318 INFO:teuthology.orchestra.run.trial074.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-24T09:11:25.318 INFO:teuthology.orchestra.run.trial074.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-24T09:11:25.318 INFO:teuthology.orchestra.run.trial074.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-24T09:11:25.318 INFO:teuthology.orchestra.run.trial074.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-24T09:11:25.318 INFO:teuthology.orchestra.run.trial074.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-24T09:11:25.318 INFO:teuthology.orchestra.run.trial074.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-24T09:11:25.318 INFO:teuthology.orchestra.run.trial074.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-24T09:11:25.318 INFO:teuthology.orchestra.run.trial074.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-24T09:11:25.319 INFO:teuthology.orchestra.run.trial074.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-24T09:11:25.319 INFO:teuthology.orchestra.run.trial074.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-24T09:11:25.319 INFO:teuthology.orchestra.run.trial074.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-24T09:11:25.319 INFO:teuthology.orchestra.run.trial074.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-24T09:11:25.319 INFO:teuthology.orchestra.run.trial074.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-24T09:11:25.319 INFO:teuthology.orchestra.run.trial074.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-24T09:11:25.319 INFO:teuthology.orchestra.run.trial074.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-24T09:11:25.319 INFO:teuthology.orchestra.run.trial074.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-24T09:11:25.319 INFO:teuthology.orchestra.run.trial074.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-24T09:11:25.319 INFO:teuthology.orchestra.run.trial074.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-24T09:11:25.319 INFO:teuthology.orchestra.run.trial074.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-24T09:11:25.319 INFO:teuthology.orchestra.run.trial074.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-24T09:11:25.320 INFO:teuthology.orchestra.run.trial074.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-24T09:11:25.320 INFO:teuthology.orchestra.run.trial074.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-24T09:11:25.320 INFO:teuthology.orchestra.run.trial074.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-24T09:11:25.320 INFO:teuthology.orchestra.run.trial074.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-24T09:11:25.320 INFO:teuthology.orchestra.run.trial074.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-24T09:11:25.320 INFO:teuthology.orchestra.run.trial074.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-24T09:11:25.320 INFO:teuthology.orchestra.run.trial074.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-24T09:11:25.320 INFO:teuthology.orchestra.run.trial074.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-24T09:11:25.320 INFO:teuthology.orchestra.run.trial074.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-24T09:11:25.320 INFO:teuthology.orchestra.run.trial074.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-24T09:11:25.320 INFO:teuthology.orchestra.run.trial074.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-24T09:11:25.320 INFO:teuthology.orchestra.run.trial074.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-24T09:11:25.320 INFO:teuthology.orchestra.run.trial074.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-24T09:11:25.321 INFO:teuthology.orchestra.run.trial074.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-24T09:11:25.321 INFO:teuthology.orchestra.run.trial074.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-24T09:11:25.321 INFO:teuthology.orchestra.run.trial074.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-24T09:11:25.321 INFO:teuthology.orchestra.run.trial074.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-24T09:11:25.321 INFO:teuthology.orchestra.run.trial074.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-24T09:11:25.321 INFO:teuthology.orchestra.run.trial074.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-24T09:11:25.321 INFO:teuthology.orchestra.run.trial074.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-24T09:11:25.321 INFO:teuthology.orchestra.run.trial074.stdout:Installing weak dependencies: 2026-02-24T09:11:25.321 INFO:teuthology.orchestra.run.trial074.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 22 k 2026-02-24T09:11:25.321 INFO:teuthology.orchestra.run.trial074.stdout: libcephfs-daemon x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 39 k 2026-02-24T09:11:25.321 INFO:teuthology.orchestra.run.trial074.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-24T09:11:25.321 INFO:teuthology.orchestra.run.trial074.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-24T09:11:25.321 INFO:teuthology.orchestra.run.trial074.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-24T09:11:25.322 INFO:teuthology.orchestra.run.trial074.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-24T09:11:25.322 INFO:teuthology.orchestra.run.trial074.stdout: 2026-02-24T09:11:25.322 INFO:teuthology.orchestra.run.trial074.stdout:Transaction Summary 2026-02-24T09:11:25.322 INFO:teuthology.orchestra.run.trial074.stdout:======================================================================================= 2026-02-24T09:11:25.322 INFO:teuthology.orchestra.run.trial074.stdout:Install 174 Packages 2026-02-24T09:11:25.322 INFO:teuthology.orchestra.run.trial074.stdout:Upgrade 9 Packages 2026-02-24T09:11:25.322 INFO:teuthology.orchestra.run.trial074.stdout: 2026-02-24T09:11:25.323 INFO:teuthology.orchestra.run.trial074.stdout:Total download size: 296 M 2026-02-24T09:11:25.323 INFO:teuthology.orchestra.run.trial074.stdout:Downloading Packages: 2026-02-24T09:11:25.452 INFO:teuthology.orchestra.run.trial159.stdout:(12/183): ceph-radosgw-20.3.0-5537.g5bc9a1ff.el 10 MB/s | 13 MB 00:01 2026-02-24T09:11:25.509 INFO:teuthology.orchestra.run.trial159.stdout:(13/183): cephfs-mirror-20.3.0-5537.g5bc9a1ff.e 4.2 MB/s | 243 kB 00:00 2026-02-24T09:11:25.563 INFO:teuthology.orchestra.run.trial159.stdout:(14/183): cephfs-shell-20.3.0-5537.g5bc9a1ff.el 502 kB/s | 27 kB 00:00 2026-02-24T09:11:25.619 INFO:teuthology.orchestra.run.trial159.stdout:(15/183): libcephfs-daemon-20.3.0-5537.g5bc9a1f 693 kB/s | 39 kB 00:00 2026-02-24T09:11:25.679 INFO:teuthology.orchestra.run.trial159.stdout:(16/183): libcephfs-devel-20.3.0-5537.g5bc9a1ff 622 kB/s | 37 kB 00:00 2026-02-24T09:11:25.742 INFO:teuthology.orchestra.run.trial159.stdout:(17/183): libcephfs-proxy2-20.3.0-5537.g5bc9a1f 420 kB/s | 26 kB 00:00 2026-02-24T09:11:25.919 INFO:teuthology.orchestra.run.trial028.stdout:(4/183): ceph-base-20.3.0-5537.g5bc9a1ff.el9.x8 2.4 MB/s | 5.2 MB 00:02 2026-02-24T09:11:25.949 INFO:teuthology.orchestra.run.trial159.stdout:(18/183): libcephfs2-20.3.0-5537.g5bc9a1ff.el9. 4.3 MB/s | 909 kB 00:00 2026-02-24T09:11:26.018 INFO:teuthology.orchestra.run.trial159.stdout:(19/183): libcephsqlite-20.3.0-5537.g5bc9a1ff.e 2.3 MB/s | 159 kB 00:00 2026-02-24T09:11:26.087 INFO:teuthology.orchestra.run.trial159.stdout:(20/183): librados-devel-20.3.0-5537.g5bc9a1ff. 1.7 MB/s | 123 kB 00:00 2026-02-24T09:11:26.149 INFO:teuthology.orchestra.run.trial159.stdout:(21/183): libradosstriper1-20.3.0-5537.g5bc9a1f 3.9 MB/s | 247 kB 00:00 2026-02-24T09:11:26.177 INFO:teuthology.orchestra.run.trial028.stdout:(5/183): ceph-mgr-20.3.0-5537.g5bc9a1ff.el9.x86 3.6 MB/s | 950 kB 00:00 2026-02-24T09:11:26.265 INFO:teuthology.orchestra.run.trial074.stdout:(1/183): ceph-20.3.0-5537.g5bc9a1ff.el9.x86_64. 26 kB/s | 6.5 kB 00:00 2026-02-24T09:11:26.892 INFO:teuthology.orchestra.run.trial159.stdout:(22/183): ceph-osd-classic-20.3.0-5537.g5bc9a1f 3.5 MB/s | 16 MB 00:04 2026-02-24T09:11:26.963 INFO:teuthology.orchestra.run.trial159.stdout:(23/183): python3-ceph-argparse-20.3.0-5537.g5b 642 kB/s | 45 kB 00:00 2026-02-24T09:11:27.032 INFO:teuthology.orchestra.run.trial159.stdout:(24/183): python3-ceph-common-20.3.0-5537.g5bc9 2.6 MB/s | 186 kB 00:00 2026-02-24T09:11:27.062 INFO:teuthology.orchestra.run.trial074.stdout:(2/183): ceph-fuse-20.3.0-5537.g5bc9a1ff.el9.x8 1.2 MB/s | 987 kB 00:00 2026-02-24T09:11:27.146 INFO:teuthology.orchestra.run.trial028.stdout:(6/183): ceph-mds-20.3.0-5537.g5bc9a1ff.el9.x86 1.2 MB/s | 2.3 MB 00:01 2026-02-24T09:11:27.160 INFO:teuthology.orchestra.run.trial159.stdout:(25/183): python3-cephfs-20.3.0-5537.g5bc9a1ff. 1.6 MB/s | 204 kB 00:00 2026-02-24T09:11:27.183 INFO:teuthology.orchestra.run.trial074.stdout:(3/183): ceph-immutable-object-cache-20.3.0-553 1.2 MB/s | 148 kB 00:00 2026-02-24T09:11:27.187 INFO:teuthology.orchestra.run.trial159.stdout:(26/183): librgw2-20.3.0-5537.g5bc9a1ff.el9.x86 6.3 MB/s | 6.5 MB 00:01 2026-02-24T09:11:27.251 INFO:teuthology.orchestra.run.trial159.stdout:(27/183): python3-rbd-20.3.0-5537.g5bc9a1ff.el9 4.7 MB/s | 304 kB 00:00 2026-02-24T09:11:27.264 INFO:teuthology.orchestra.run.trial028.stdout:(7/183): ceph-osd-20.3.0-5537.g5bc9a1ff.el9.x86 1.4 MB/s | 167 kB 00:00 2026-02-24T09:11:27.280 INFO:teuthology.orchestra.run.trial159.stdout:(28/183): python3-rados-20.3.0-5537.g5bc9a1ff.e 2.7 MB/s | 324 kB 00:00 2026-02-24T09:11:27.308 INFO:teuthology.orchestra.run.trial159.stdout:(29/183): python3-rgw-20.3.0-5537.g5bc9a1ff.el9 1.7 MB/s | 100 kB 00:00 2026-02-24T09:11:27.340 INFO:teuthology.orchestra.run.trial159.stdout:(30/183): rbd-fuse-20.3.0-5537.g5bc9a1ff.el9.x8 1.4 MB/s | 84 kB 00:00 2026-02-24T09:11:27.413 INFO:teuthology.orchestra.run.trial159.stdout:(31/183): rbd-nbd-20.3.0-5537.g5bc9a1ff.el9.x86 2.3 MB/s | 172 kB 00:00 2026-02-24T09:11:27.471 INFO:teuthology.orchestra.run.trial028.stdout:(8/183): ceph-mon-20.3.0-5537.g5bc9a1ff.el9.x86 3.8 MB/s | 5.0 MB 00:01 2026-02-24T09:11:27.484 INFO:teuthology.orchestra.run.trial159.stdout:(32/183): ceph-grafana-dashboards-20.3.0-5537.g 812 kB/s | 57 kB 00:00 2026-02-24T09:11:27.557 INFO:teuthology.orchestra.run.trial159.stdout:(33/183): ceph-mgr-cephadm-20.3.0-5537.g5bc9a1f 2.5 MB/s | 184 kB 00:00 2026-02-24T09:11:27.792 INFO:teuthology.orchestra.run.trial159.stdout:(34/183): rbd-mirror-20.3.0-5537.g5bc9a1ff.el9. 5.9 MB/s | 2.9 MB 00:00 2026-02-24T09:11:28.224 INFO:teuthology.orchestra.run.trial074.stdout:(4/183): ceph-mds-20.3.0-5537.g5bc9a1ff.el9.x86 2.2 MB/s | 2.3 MB 00:01 2026-02-24T09:11:28.703 INFO:teuthology.orchestra.run.trial074.stdout:(5/183): ceph-mgr-20.3.0-5537.g5bc9a1ff.el9.x86 1.9 MB/s | 950 kB 00:00 2026-02-24T09:11:28.920 INFO:teuthology.orchestra.run.trial159.stdout:(35/183): ceph-mgr-diskprediction-local-20.3.0- 6.6 MB/s | 7.4 MB 00:01 2026-02-24T09:11:28.931 INFO:teuthology.orchestra.run.trial074.stdout:(6/183): ceph-base-20.3.0-5537.g5bc9a1ff.el9.x8 1.8 MB/s | 5.2 MB 00:02 2026-02-24T09:11:28.977 INFO:teuthology.orchestra.run.trial159.stdout:(36/183): ceph-mgr-k8sevents-20.3.0-5537.g5bc9a 394 kB/s | 22 kB 00:00 2026-02-24T09:11:28.991 INFO:teuthology.orchestra.run.trial074.stdout:(7/183): ceph-osd-20.3.0-5537.g5bc9a1ff.el9.x86 2.7 MB/s | 167 kB 00:00 2026-02-24T09:11:29.040 INFO:teuthology.orchestra.run.trial159.stdout:(37/183): ceph-mgr-modules-core-20.3.0-5537.g5b 4.6 MB/s | 298 kB 00:00 2026-02-24T09:11:29.097 INFO:teuthology.orchestra.run.trial159.stdout:(38/183): ceph-mgr-rook-20.3.0-5537.g5bc9a1ff.e 872 kB/s | 50 kB 00:00 2026-02-24T09:11:29.159 INFO:teuthology.orchestra.run.trial159.stdout:(39/183): ceph-prometheus-alerts-20.3.0-5537.g5 282 kB/s | 17 kB 00:00 2026-02-24T09:11:29.226 INFO:teuthology.orchestra.run.trial159.stdout:(40/183): ceph-volume-20.3.0-5537.g5bc9a1ff.el9 4.4 MB/s | 301 kB 00:00 2026-02-24T09:11:29.490 INFO:teuthology.orchestra.run.trial159.stdout:(41/183): cephadm-20.3.0-5537.g5bc9a1ff.el9.noa 3.9 MB/s | 1.0 MB 00:00 2026-02-24T09:11:29.553 INFO:teuthology.orchestra.run.trial159.stdout:(42/183): cephfs-top-20.3.0-5537.g5bc9a1ff.el9. 294 kB/s | 18 kB 00:00 2026-02-24T09:11:30.350 INFO:teuthology.orchestra.run.trial159.stdout:(43/183): cryptsetup-2.8.1-3.el9.x86_64.rpm 440 kB/s | 351 kB 00:00 2026-02-24T09:11:30.577 INFO:teuthology.orchestra.run.trial159.stdout:(44/183): ceph-test-20.3.0-5537.g5bc9a1ff.el9.x 13 MB/s | 76 MB 00:05 2026-02-24T09:11:30.753 INFO:teuthology.orchestra.run.trial159.stdout:(45/183): hwloc-libs-2.4.1-6.el9.x86_64.rpm 5.2 MB/s | 2.1 MB 00:00 2026-02-24T09:11:30.888 INFO:teuthology.orchestra.run.trial074.stdout:(8/183): ceph-mon-20.3.0-5537.g5bc9a1ff.el9.x86 2.3 MB/s | 5.0 MB 00:02 2026-02-24T09:11:30.912 INFO:teuthology.orchestra.run.trial159.stdout:(46/183): libatomic-11.5.0-14.el9.x86_64.rpm 144 kB/s | 23 kB 00:00 2026-02-24T09:11:31.058 INFO:teuthology.orchestra.run.trial159.stdout:(47/183): ledmon-libs-1.1.0-3.el9.x86_64.rpm 84 kB/s | 40 kB 00:00 2026-02-24T09:11:31.072 INFO:teuthology.orchestra.run.trial159.stdout:(48/183): libconfig-1.7.2-9.el9.x86_64.rpm 451 kB/s | 72 kB 00:00 2026-02-24T09:11:31.224 INFO:teuthology.orchestra.run.trial159.stdout:(49/183): libgfortran-11.5.0-14.el9.x86_64.rpm 4.7 MB/s | 794 kB 00:00 2026-02-24T09:11:31.311 INFO:teuthology.orchestra.run.trial159.stdout:(50/183): libquadmath-11.5.0-14.el9.x86_64.rpm 773 kB/s | 184 kB 00:00 2026-02-24T09:11:31.470 INFO:teuthology.orchestra.run.trial159.stdout:(51/183): mailcap-2.1.49-5.el9.noarch.rpm 208 kB/s | 33 kB 00:00 2026-02-24T09:11:31.551 INFO:teuthology.orchestra.run.trial159.stdout:(52/183): ceph-mgr-dashboard-20.3.0-5537.g5bc9a 3.8 MB/s | 15 MB 00:03 2026-02-24T09:11:31.635 INFO:teuthology.orchestra.run.trial028.stdout:(9/183): ceph-osd-crimson-20.3.0-5537.g5bc9a1ff 4.6 MB/s | 19 MB 00:04 2026-02-24T09:11:31.641 INFO:teuthology.orchestra.run.trial159.stdout:(53/183): nvme-cli-2.16-1.el9.x86_64.rpm 6.8 MB/s | 1.2 MB 00:00 2026-02-24T09:11:31.776 INFO:teuthology.orchestra.run.trial159.stdout:(54/183): lksctp-tools-1.0.19-2.el9.x86_64.rpm 170 kB/s | 94 kB 00:00 2026-02-24T09:11:31.802 INFO:teuthology.orchestra.run.trial159.stdout:(55/183): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2026-02-24T09:11:31.916 INFO:teuthology.orchestra.run.trial074.stdout:(9/183): ceph-osd-classic-20.3.0-5537.g5bc9a1ff 5.3 MB/s | 16 MB 00:02 2026-02-24T09:11:31.947 INFO:teuthology.orchestra.run.trial159.stdout:(56/183): python3-cryptography-36.0.1-5.el9.x86 7.3 MB/s | 1.2 MB 00:00 2026-02-24T09:11:32.108 INFO:teuthology.orchestra.run.trial159.stdout:(57/183): python3-pycparser-2.20-6.el9.noarch.r 841 kB/s | 135 kB 00:00 2026-02-24T09:11:32.110 INFO:teuthology.orchestra.run.trial159.stdout:(58/183): pciutils-3.7.0-7.el9.x86_64.rpm 167 kB/s | 93 kB 00:00 2026-02-24T09:11:32.269 INFO:teuthology.orchestra.run.trial159.stdout:(59/183): python3-pyparsing-2.4.7-9.el9.noarch. 935 kB/s | 150 kB 00:00 2026-02-24T09:11:32.276 INFO:teuthology.orchestra.run.trial159.stdout:(60/183): python3-ply-3.11-14.el9.noarch.rpm 225 kB/s | 106 kB 00:00 2026-02-24T09:11:32.348 INFO:teuthology.orchestra.run.trial159.stdout:(61/183): python3-requests-2.25.1-10.el9.noarch 532 kB/s | 126 kB 00:00 2026-02-24T09:11:32.430 INFO:teuthology.orchestra.run.trial159.stdout:(62/183): python3-urllib3-1.26.5-7.el9.noarch.r 1.3 MB/s | 218 kB 00:00 2026-02-24T09:11:32.588 INFO:teuthology.orchestra.run.trial159.stdout:(63/183): zip-3.0-35.el9.x86_64.rpm 1.1 MB/s | 266 kB 00:00 2026-02-24T09:11:32.612 INFO:teuthology.orchestra.run.trial159.stdout:(64/183): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 689 kB 00:00 2026-02-24T09:11:32.660 INFO:teuthology.orchestra.run.trial159.stdout:(65/183): boost-program-options-1.75.0-13.el9.x 2.1 MB/s | 104 kB 00:00 2026-02-24T09:11:32.684 INFO:teuthology.orchestra.run.trial159.stdout:(66/183): bison-3.7.4-5.el9.x86_64.rpm 9.7 MB/s | 943 kB 00:00 2026-02-24T09:11:32.722 INFO:teuthology.orchestra.run.trial159.stdout:(67/183): elfutils-libelf-devel-0.194-1.el9.x86 1.3 MB/s | 79 kB 00:00 2026-02-24T09:11:32.729 INFO:teuthology.orchestra.run.trial159.stdout:(68/183): flex-2.6.4-9.el9.x86_64.rpm 6.8 MB/s | 313 kB 00:00 2026-02-24T09:11:32.764 INFO:teuthology.orchestra.run.trial159.stdout:(69/183): flexiblas-3.0.4-9.el9.x86_64.rpm 718 kB/s | 30 kB 00:00 2026-02-24T09:11:32.804 INFO:teuthology.orchestra.run.trial159.stdout:(70/183): flexiblas-netlib-3.0.4-9.el9.x86_64.r 40 MB/s | 3.0 MB 00:00 2026-02-24T09:11:32.805 INFO:teuthology.orchestra.run.trial159.stdout:(71/183): flexiblas-openblas-openmp-3.0.4-9.el9 355 kB/s | 15 kB 00:00 2026-02-24T09:11:32.846 INFO:teuthology.orchestra.run.trial159.stdout:(72/183): libnbd-1.20.3-4.el9.x86_64.rpm 3.9 MB/s | 164 kB 00:00 2026-02-24T09:11:32.872 INFO:teuthology.orchestra.run.trial159.stdout:(73/183): libaio-devel-0.3.111-13.el9.x86_64.rp 165 kB/s | 11 kB 00:00 2026-02-24T09:11:32.888 INFO:teuthology.orchestra.run.trial159.stdout:(74/183): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 160 kB 00:00 2026-02-24T09:11:32.907 INFO:teuthology.orchestra.run.trial159.stdout:(75/183): unzip-6.0-59.el9.x86_64.rpm 288 kB/s | 182 kB 00:00 2026-02-24T09:11:32.929 INFO:teuthology.orchestra.run.trial159.stdout:(76/183): librabbitmq-0.11.0-7.el9.x86_64.rpm 793 kB/s | 45 kB 00:00 2026-02-24T09:11:32.936 INFO:teuthology.orchestra.run.trial159.stdout:(77/183): librdkafka-1.6.1-102.el9.x86_64.rpm 14 MB/s | 662 kB 00:00 2026-02-24T09:11:32.956 INFO:teuthology.orchestra.run.trial159.stdout:(78/183): libstoragemgmt-1.10.1-1.el9.x86_64.rp 5.0 MB/s | 246 kB 00:00 2026-02-24T09:11:32.973 INFO:teuthology.orchestra.run.trial159.stdout:(79/183): libtool-2.4.6-46.el9.x86_64.rpm 13 MB/s | 581 kB 00:00 2026-02-24T09:11:32.978 INFO:teuthology.orchestra.run.trial159.stdout:(80/183): libuuid-devel-2.37.4-25.el9.x86_64.rp 538 kB/s | 23 kB 00:00 2026-02-24T09:11:33.000 INFO:teuthology.orchestra.run.trial159.stdout:(81/183): libxslt-1.1.34-12.el9.x86_64.rpm 5.1 MB/s | 233 kB 00:00 2026-02-24T09:11:33.013 INFO:teuthology.orchestra.run.trial159.stdout:(82/183): libzstd-devel-1.5.5-1.el9.x86_64.rpm 1.3 MB/s | 51 kB 00:00 2026-02-24T09:11:33.020 INFO:teuthology.orchestra.run.trial159.stdout:(83/183): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.8 MB/s | 292 kB 00:00 2026-02-24T09:11:33.039 INFO:teuthology.orchestra.run.trial159.stdout:(84/183): lua-5.4.4-4.el9.x86_64.rpm 4.7 MB/s | 188 kB 00:00 2026-02-24T09:11:33.056 INFO:teuthology.orchestra.run.trial159.stdout:(85/183): openblas-0.3.29-1.el9.x86_64.rpm 973 kB/s | 42 kB 00:00 2026-02-24T09:11:33.089 INFO:teuthology.orchestra.run.trial159.stdout:(86/183): openblas-openmp-0.3.29-1.el9.x86_64.r 76 MB/s | 5.3 MB 00:00 2026-02-24T09:11:33.099 INFO:teuthology.orchestra.run.trial159.stdout:(87/183): perl-Thread-Queue-3.14-460.el9.noarch 522 kB/s | 22 kB 00:00 2026-02-24T09:11:33.100 INFO:teuthology.orchestra.run.trial074.stdout:(10/183): ceph-common-20.3.0-5537.g5bc9a1ff.el9 3.4 MB/s | 24 MB 00:07 2026-02-24T09:11:33.133 INFO:teuthology.orchestra.run.trial159.stdout:(88/183): perl-threads-2.25-460.el9.x86_64.rpm 1.3 MB/s | 58 kB 00:00 2026-02-24T09:11:33.139 INFO:teuthology.orchestra.run.trial159.stdout:(89/183): perl-threads-shared-1.61-460.el9.x86_ 1.1 MB/s | 45 kB 00:00 2026-02-24T09:11:33.141 INFO:teuthology.orchestra.run.trial074.stdout:(11/183): ceph-selinux-20.3.0-5537.g5bc9a1ff.el 607 kB/s | 25 kB 00:00 2026-02-24T09:11:33.155 INFO:teuthology.orchestra.run.trial159.stdout:(90/183): openssl-devel-3.5.5-1.el9.x86_64.rpm 42 MB/s | 4.8 MB 00:00 2026-02-24T09:11:33.183 INFO:teuthology.orchestra.run.trial159.stdout:(91/183): postgresql-13.23-1.el9.x86_64.rpm 32 MB/s | 1.6 MB 00:00 2026-02-24T09:11:33.188 INFO:teuthology.orchestra.run.trial159.stdout:(92/183): postgresql-contrib-13.23-1.el9.x86_64 18 MB/s | 903 kB 00:00 2026-02-24T09:11:33.197 INFO:teuthology.orchestra.run.trial159.stdout:(93/183): postgresql-private-libs-13.23-1.el9.x 3.2 MB/s | 138 kB 00:00 2026-02-24T09:11:33.232 INFO:teuthology.orchestra.run.trial028.stdout:(10/183): ceph-osd-classic-20.3.0-5537.g5bc9a1f 2.6 MB/s | 16 MB 00:05 2026-02-24T09:11:33.233 INFO:teuthology.orchestra.run.trial159.stdout:(94/183): protobuf-3.14.0-17.el9.x86_64.rpm 23 MB/s | 1.0 MB 00:00 2026-02-24T09:11:33.270 INFO:teuthology.orchestra.run.trial028.stdout:(11/183): ceph-selinux-20.3.0-5537.g5bc9a1ff.el 659 kB/s | 25 kB 00:00 2026-02-24T09:11:33.286 INFO:teuthology.orchestra.run.trial159.stdout:(95/183): python3-babel-2.9.1-2.el9.noarch.rpm 67 MB/s | 6.0 MB 00:00 2026-02-24T09:11:33.299 INFO:teuthology.orchestra.run.trial159.stdout:(96/183): postgresql-server-13.23-1.el9.x86_64. 51 MB/s | 5.8 MB 00:00 2026-02-24T09:11:33.301 INFO:teuthology.orchestra.run.trial159.stdout:(97/183): python3-colorama-0.4.6-3.el9.noarch.r 896 kB/s | 61 kB 00:00 2026-02-24T09:11:33.332 INFO:teuthology.orchestra.run.trial159.stdout:(98/183): python3-devel-3.9.25-3.el9.x86_64.rpm 5.4 MB/s | 244 kB 00:00 2026-02-24T09:11:33.340 INFO:teuthology.orchestra.run.trial159.stdout:(99/183): python3-jinja2-2.11.3-8.el9.noarch.rp 5.9 MB/s | 249 kB 00:00 2026-02-24T09:11:33.341 INFO:teuthology.orchestra.run.trial159.stdout:(100/183): python3-jmespath-1.0.1-1.el9.noarch. 1.2 MB/s | 48 kB 00:00 2026-02-24T09:11:33.383 INFO:teuthology.orchestra.run.trial159.stdout:(101/183): python3-markupsafe-1.1.1-12.el9.x86_ 829 kB/s | 35 kB 00:00 2026-02-24T09:11:33.389 INFO:teuthology.orchestra.run.trial159.stdout:(102/183): python3-lxml-4.6.5-3.el9.x86_64.rpm 25 MB/s | 1.2 MB 00:00 2026-02-24T09:11:33.392 INFO:teuthology.orchestra.run.trial159.stdout:(103/183): python3-libstoragemgmt-1.10.1-1.el9. 2.9 MB/s | 177 kB 00:00 2026-02-24T09:11:33.431 INFO:teuthology.orchestra.run.trial159.stdout:(104/183): python3-packaging-20.9-5.el9.noarch. 1.9 MB/s | 77 kB 00:00 2026-02-24T09:11:33.443 INFO:teuthology.orchestra.run.trial159.stdout:(105/183): python3-numpy-f2py-1.23.5-2.el9.x86_ 8.1 MB/s | 442 kB 00:00 2026-02-24T09:11:33.458 INFO:teuthology.orchestra.run.trial159.stdout:(106/183): python3-numpy-1.23.5-2.el9.x86_64.rp 83 MB/s | 6.1 MB 00:00 2026-02-24T09:11:33.477 INFO:teuthology.orchestra.run.trial159.stdout:(107/183): python3-protobuf-3.14.0-17.el9.noarc 6.0 MB/s | 267 kB 00:00 2026-02-24T09:11:33.490 INFO:teuthology.orchestra.run.trial159.stdout:(108/183): python3-pyasn1-0.4.8-7.el9.noarch.rp 3.5 MB/s | 157 kB 00:00 2026-02-24T09:11:33.500 INFO:teuthology.orchestra.run.trial159.stdout:(109/183): python3-pyasn1-modules-0.4.8-7.el9.n 6.4 MB/s | 277 kB 00:00 2026-02-24T09:11:33.507 INFO:teuthology.orchestra.run.trial028.stdout:(12/183): ceph-radosgw-20.3.0-5537.g5bc9a1ff.el 7.1 MB/s | 13 MB 00:01 2026-02-24T09:11:33.516 INFO:teuthology.orchestra.run.trial159.stdout:(110/183): python3-requests-oauthlib-1.3.0-12.e 1.4 MB/s | 54 kB 00:00 2026-02-24T09:11:33.539 INFO:teuthology.orchestra.run.trial028.stdout:(13/183): cephfs-mirror-20.3.0-5537.g5bc9a1ff.e 7.6 MB/s | 243 kB 00:00 2026-02-24T09:11:33.557 INFO:teuthology.orchestra.run.trial159.stdout:(111/183): python3-wcwidth-0.2.5-8.el9.noarch.r 1.1 MB/s | 44 kB 00:00 2026-02-24T09:11:33.560 INFO:teuthology.orchestra.run.trial159.stdout:(112/183): python3-toml-0.10.2-6.el9.noarch.rpm 697 kB/s | 42 kB 00:00 2026-02-24T09:11:33.568 INFO:teuthology.orchestra.run.trial028.stdout:(14/183): cephfs-shell-20.3.0-5537.g5bc9a1ff.el 916 kB/s | 27 kB 00:00 2026-02-24T09:11:33.596 INFO:teuthology.orchestra.run.trial028.stdout:(15/183): libcephfs-daemon-20.3.0-5537.g5bc9a1f 1.4 MB/s | 39 kB 00:00 2026-02-24T09:11:33.607 INFO:teuthology.orchestra.run.trial159.stdout:(113/183): qatlib-25.08.0-2.el9.x86_64.rpm 4.8 MB/s | 240 kB 00:00 2026-02-24T09:11:33.608 INFO:teuthology.orchestra.run.trial159.stdout:(114/183): qatlib-service-25.08.0-2.el9.x86_64. 782 kB/s | 37 kB 00:00 2026-02-24T09:11:33.619 INFO:teuthology.orchestra.run.trial028.stdout:(16/183): libcephfs-devel-20.3.0-5537.g5bc9a1ff 1.6 MB/s | 37 kB 00:00 2026-02-24T09:11:33.643 INFO:teuthology.orchestra.run.trial028.stdout:(17/183): libcephfs-proxy2-20.3.0-5537.g5bc9a1f 1.1 MB/s | 26 kB 00:00 2026-02-24T09:11:33.647 INFO:teuthology.orchestra.run.trial159.stdout:(115/183): python3-scipy-1.9.3-2.el9.x86_64.rpm 123 MB/s | 19 MB 00:00 2026-02-24T09:11:33.649 INFO:teuthology.orchestra.run.trial159.stdout:(116/183): qatzip-libs-1.3.1-1.el9.x86_64.rpm 1.6 MB/s | 66 kB 00:00 2026-02-24T09:11:33.665 INFO:teuthology.orchestra.run.trial159.stdout:(117/183): socat-1.7.4.1-8.el9.x86_64.rpm 5.4 MB/s | 303 kB 00:00 2026-02-24T09:11:33.688 INFO:teuthology.orchestra.run.trial159.stdout:(118/183): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2026-02-24T09:11:33.689 INFO:teuthology.orchestra.run.trial159.stdout:(119/183): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 2.4 MB/s | 96 kB 00:00 2026-02-24T09:11:33.692 INFO:teuthology.orchestra.run.trial074.stdout:(12/183): ceph-radosgw-20.3.0-5537.g5bc9a1ff.el 7.5 MB/s | 13 MB 00:01 2026-02-24T09:11:33.713 INFO:teuthology.orchestra.run.trial159.stdout:(120/183): xmlsec1-1.2.29-13.el9.x86_64.rpm 3.9 MB/s | 189 kB 00:00 2026-02-24T09:11:33.727 INFO:teuthology.orchestra.run.trial074.stdout:(13/183): cephfs-mirror-20.3.0-5537.g5bc9a1ff.e 7.0 MB/s | 243 kB 00:00 2026-02-24T09:11:33.733 INFO:teuthology.orchestra.run.trial028.stdout:(18/183): libcephfs2-20.3.0-5537.g5bc9a1ff.el9. 9.9 MB/s | 909 kB 00:00 2026-02-24T09:11:33.737 INFO:teuthology.orchestra.run.trial159.stdout:(121/183): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2026-02-24T09:11:33.743 INFO:teuthology.orchestra.run.trial159.stdout:(122/183): xmlsec1-openssl-1.2.29-13.el9.x86_64 1.6 MB/s | 90 kB 00:00 2026-02-24T09:11:33.752 INFO:teuthology.orchestra.run.trial074.stdout:(14/183): cephfs-shell-20.3.0-5537.g5bc9a1ff.el 1.0 MB/s | 27 kB 00:00 2026-02-24T09:11:33.756 INFO:teuthology.orchestra.run.trial159.stdout:(123/183): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.0 MB/s | 45 kB 00:00 2026-02-24T09:11:33.758 INFO:teuthology.orchestra.run.trial028.stdout:(19/183): libcephsqlite-20.3.0-5537.g5bc9a1ff.e 6.1 MB/s | 159 kB 00:00 2026-02-24T09:11:33.780 INFO:teuthology.orchestra.run.trial074.stdout:(15/183): libcephfs-daemon-20.3.0-5537.g5bc9a1f 1.4 MB/s | 39 kB 00:00 2026-02-24T09:11:33.784 INFO:teuthology.orchestra.run.trial028.stdout:(20/183): librados-devel-20.3.0-5537.g5bc9a1ff. 4.8 MB/s | 123 kB 00:00 2026-02-24T09:11:33.806 INFO:teuthology.orchestra.run.trial074.stdout:(16/183): libcephfs-devel-20.3.0-5537.g5bc9a1ff 1.4 MB/s | 37 kB 00:00 2026-02-24T09:11:33.812 INFO:teuthology.orchestra.run.trial028.stdout:(21/183): libradosstriper1-20.3.0-5537.g5bc9a1f 8.7 MB/s | 247 kB 00:00 2026-02-24T09:11:33.814 INFO:teuthology.orchestra.run.trial159.stdout:(124/183): lua-devel-5.4.4-4.el9.x86_64.rpm 290 kB/s | 22 kB 00:00 2026-02-24T09:11:33.831 INFO:teuthology.orchestra.run.trial074.stdout:(17/183): libcephfs-proxy2-20.3.0-5537.g5bc9a1f 1.0 MB/s | 26 kB 00:00 2026-02-24T09:11:33.870 INFO:teuthology.orchestra.run.trial028.stdout:(22/183): ceph-common-20.3.0-5537.g5bc9a1ff.el9 2.4 MB/s | 24 MB 00:10 2026-02-24T09:11:33.899 INFO:teuthology.orchestra.run.trial028.stdout:(23/183): python3-ceph-argparse-20.3.0-5537.g5b 1.5 MB/s | 45 kB 00:00 2026-02-24T09:11:33.940 INFO:teuthology.orchestra.run.trial074.stdout:(18/183): libcephfs2-20.3.0-5537.g5bc9a1ff.el9. 8.2 MB/s | 909 kB 00:00 2026-02-24T09:11:33.944 INFO:teuthology.orchestra.run.trial159.stdout:(125/183): protobuf-compiler-3.14.0-17.el9.x86_ 4.2 MB/s | 862 kB 00:00 2026-02-24T09:11:33.957 INFO:teuthology.orchestra.run.trial028.stdout:(24/183): python3-ceph-common-20.3.0-5537.g5bc9 3.2 MB/s | 186 kB 00:00 2026-02-24T09:11:33.970 INFO:teuthology.orchestra.run.trial074.stdout:(19/183): libcephsqlite-20.3.0-5537.g5bc9a1ff.e 5.2 MB/s | 159 kB 00:00 2026-02-24T09:11:34.002 INFO:teuthology.orchestra.run.trial074.stdout:(20/183): librados-devel-20.3.0-5537.g5bc9a1ff. 3.8 MB/s | 123 kB 00:00 2026-02-24T09:11:34.010 INFO:teuthology.orchestra.run.trial159.stdout:(126/183): abseil-cpp-20211102.0-4.el9.x86_64.r 2.1 MB/s | 551 kB 00:00 2026-02-24T09:11:34.018 INFO:teuthology.orchestra.run.trial028.stdout:(25/183): python3-cephfs-20.3.0-5537.g5bc9a1ff. 3.3 MB/s | 204 kB 00:00 2026-02-24T09:11:34.032 INFO:teuthology.orchestra.run.trial159.stdout:(127/183): gperftools-libs-2.9.1-3.el9.x86_64.r 1.4 MB/s | 308 kB 00:00 2026-02-24T09:11:34.034 INFO:teuthology.orchestra.run.trial074.stdout:(21/183): libradosstriper1-20.3.0-5537.g5bc9a1f 7.5 MB/s | 247 kB 00:00 2026-02-24T09:11:34.042 INFO:teuthology.orchestra.run.trial159.stdout:(128/183): grpc-data-1.46.7-10.el9.noarch.rpm 198 kB/s | 19 kB 00:00 2026-02-24T09:11:34.065 INFO:teuthology.orchestra.run.trial159.stdout:(129/183): libarrow-doc-9.0.0-15.el9.noarch.rpm 744 kB/s | 25 kB 00:00 2026-02-24T09:11:34.085 INFO:teuthology.orchestra.run.trial028.stdout:(26/183): python3-rados-20.3.0-5537.g5bc9a1ff.e 4.7 MB/s | 324 kB 00:00 2026-02-24T09:11:34.102 INFO:teuthology.orchestra.run.trial159.stdout:(130/183): libunwind-1.6.2-1.el9.x86_64.rpm 1.8 MB/s | 67 kB 00:00 2026-02-24T09:11:34.115 INFO:teuthology.orchestra.run.trial159.stdout:(131/183): liboath-2.6.12-1.el9.x86_64.rpm 667 kB/s | 49 kB 00:00 2026-02-24T09:11:34.145 INFO:teuthology.orchestra.run.trial159.stdout:(132/183): luarocks-3.9.2-5.el9.noarch.rpm 3.4 MB/s | 151 kB 00:00 2026-02-24T09:11:34.153 INFO:teuthology.orchestra.run.trial028.stdout:(27/183): python3-rbd-20.3.0-5537.g5bc9a1ff.el9 4.3 MB/s | 304 kB 00:00 2026-02-24T09:11:34.163 INFO:teuthology.orchestra.run.trial159.stdout:(133/183): libarrow-9.0.0-15.el9.x86_64.rpm 29 MB/s | 4.4 MB 00:00 2026-02-24T09:11:34.189 INFO:teuthology.orchestra.run.trial028.stdout:(28/183): python3-rgw-20.3.0-5537.g5bc9a1ff.el9 2.8 MB/s | 100 kB 00:00 2026-02-24T09:11:34.198 INFO:teuthology.orchestra.run.trial159.stdout:(134/183): python3-autocommand-2.2.2-8.el9.noar 861 kB/s | 29 kB 00:00 2026-02-24T09:11:34.220 INFO:teuthology.orchestra.run.trial159.stdout:(135/183): python3-asyncssh-2.13.2-5.el9.noarch 7.2 MB/s | 548 kB 00:00 2026-02-24T09:11:34.222 INFO:teuthology.orchestra.run.trial028.stdout:(29/183): rbd-fuse-20.3.0-5537.g5bc9a1ff.el9.x8 2.5 MB/s | 84 kB 00:00 2026-02-24T09:11:34.232 INFO:teuthology.orchestra.run.trial159.stdout:(136/183): python3-backports-tarfile-1.2.0-1.el 1.7 MB/s | 60 kB 00:00 2026-02-24T09:11:34.255 INFO:teuthology.orchestra.run.trial159.stdout:(137/183): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.2 MB/s | 43 kB 00:00 2026-02-24T09:11:34.267 INFO:teuthology.orchestra.run.trial159.stdout:(138/183): python3-cachetools-4.2.4-1.el9.noarc 945 kB/s | 32 kB 00:00 2026-02-24T09:11:34.272 INFO:teuthology.orchestra.run.trial159.stdout:(139/183): parquet-libs-9.0.0-15.el9.x86_64.rpm 5.2 MB/s | 838 kB 00:00 2026-02-24T09:11:34.289 INFO:teuthology.orchestra.run.trial159.stdout:(140/183): python3-certifi-2023.05.07-4.el9.noa 412 kB/s | 14 kB 00:00 2026-02-24T09:11:34.301 INFO:teuthology.orchestra.run.trial159.stdout:(141/183): python3-cheroot-10.0.1-4.el9.noarch. 4.9 MB/s | 173 kB 00:00 2026-02-24T09:11:34.315 INFO:teuthology.orchestra.run.trial159.stdout:(142/183): python3-cherrypy-18.6.1-2.el9.noarch 8.2 MB/s | 358 kB 00:00 2026-02-24T09:11:34.330 INFO:teuthology.orchestra.run.trial159.stdout:(143/183): python3-cmd2-2.4.2-2.el9.noarch.rpm 7.2 MB/s | 303 kB 00:00 2026-02-24T09:11:34.340 INFO:teuthology.orchestra.run.trial159.stdout:(144/183): python3-google-auth-2.45.0-1.el9.noa 6.4 MB/s | 254 kB 00:00 2026-02-24T09:11:34.367 INFO:teuthology.orchestra.run.trial159.stdout:(145/183): python3-grpcio-tools-1.46.7-10.el9.x 3.9 MB/s | 144 kB 00:00 2026-02-24T09:11:34.376 INFO:teuthology.orchestra.run.trial159.stdout:(146/183): python3-influxdb-5.3.1-1.el9.noarch. 3.8 MB/s | 139 kB 00:00 2026-02-24T09:11:34.402 INFO:teuthology.orchestra.run.trial159.stdout:(147/183): python3-isodate-0.6.1-3.el9.noarch.r 1.6 MB/s | 56 kB 00:00 2026-02-24T09:11:34.406 INFO:teuthology.orchestra.run.trial159.stdout:(148/183): python3-grpcio-1.46.7-10.el9.x86_64. 22 MB/s | 2.0 MB 00:00 2026-02-24T09:11:34.410 INFO:teuthology.orchestra.run.trial159.stdout:(149/183): python3-jaraco-8.2.1-3.el9.noarch.rp 316 kB/s | 11 kB 00:00 2026-02-24T09:11:34.436 INFO:teuthology.orchestra.run.trial159.stdout:(150/183): python3-jaraco-classes-3.2.1-5.el9.n 522 kB/s | 18 kB 00:00 2026-02-24T09:11:34.440 INFO:teuthology.orchestra.run.trial159.stdout:(151/183): python3-jaraco-collections-3.0.0-8.e 683 kB/s | 23 kB 00:00 2026-02-24T09:11:34.444 INFO:teuthology.orchestra.run.trial159.stdout:(152/183): python3-jaraco-context-6.0.1-3.el9.n 581 kB/s | 20 kB 00:00 2026-02-24T09:11:34.470 INFO:teuthology.orchestra.run.trial159.stdout:(153/183): python3-jaraco-functools-3.5.0-2.el9 573 kB/s | 19 kB 00:00 2026-02-24T09:11:34.474 INFO:teuthology.orchestra.run.trial159.stdout:(154/183): python3-jaraco-text-4.0.0-2.el9.noar 775 kB/s | 26 kB 00:00 2026-02-24T09:11:34.486 INFO:teuthology.orchestra.run.trial159.stdout:(155/183): python3-kubernetes-26.1.0-3.el9.noar 24 MB/s | 1.0 MB 00:00 2026-02-24T09:11:34.505 INFO:teuthology.orchestra.run.trial159.stdout:(156/183): python3-more-itertools-8.12.0-2.el9. 2.2 MB/s | 79 kB 00:00 2026-02-24T09:11:34.509 INFO:teuthology.orchestra.run.trial159.stdout:(157/183): python3-msgpack-1.0.3-2.el9.x86_64.r 2.4 MB/s | 86 kB 00:00 2026-02-24T09:11:34.521 INFO:teuthology.orchestra.run.trial159.stdout:(158/183): python3-natsort-7.1.1-5.el9.noarch.r 1.6 MB/s | 58 kB 00:00 2026-02-24T09:11:34.529 INFO:teuthology.orchestra.run.trial028.stdout:(30/183): librgw2-20.3.0-5537.g5bc9a1ff.el9.x86 9.1 MB/s | 6.5 MB 00:00 2026-02-24T09:11:34.539 INFO:teuthology.orchestra.run.trial159.stdout:(159/183): python3-portend-3.1.0-2.el9.noarch.r 486 kB/s | 16 kB 00:00 2026-02-24T09:11:34.544 INFO:teuthology.orchestra.run.trial159.stdout:(160/183): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.6 MB/s | 90 kB 00:00 2026-02-24T09:11:34.555 INFO:teuthology.orchestra.run.trial159.stdout:(161/183): python3-pyperclip-1.8.2-2.el9.noarch 830 kB/s | 28 kB 00:00 2026-02-24T09:11:34.561 INFO:teuthology.orchestra.run.trial028.stdout:(31/183): rbd-nbd-20.3.0-5537.g5bc9a1ff.el9.x86 5.3 MB/s | 172 kB 00:00 2026-02-24T09:11:34.573 INFO:teuthology.orchestra.run.trial159.stdout:(162/183): python3-repoze-lru-0.7-16.el9.noarch 890 kB/s | 31 kB 00:00 2026-02-24T09:11:34.580 INFO:teuthology.orchestra.run.trial159.stdout:(163/183): python3-routes-2.5.1-5.el9.noarch.rp 5.0 MB/s | 188 kB 00:00 2026-02-24T09:11:34.590 INFO:teuthology.orchestra.run.trial159.stdout:(164/183): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2026-02-24T09:11:34.592 INFO:teuthology.orchestra.run.trial028.stdout:(32/183): ceph-grafana-dashboards-20.3.0-5537.g 1.8 MB/s | 57 kB 00:00 2026-02-24T09:11:34.610 INFO:teuthology.orchestra.run.trial159.stdout:(165/183): python3-saml-1.16.0-1.el9.noarch.rpm 3.4 MB/s | 125 kB 00:00 2026-02-24T09:11:34.615 INFO:teuthology.orchestra.run.trial159.stdout:(166/183): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2026-02-24T09:11:34.624 INFO:teuthology.orchestra.run.trial028.stdout:(33/183): ceph-mgr-cephadm-20.3.0-5537.g5bc9a1f 5.6 MB/s | 184 kB 00:00 2026-02-24T09:11:34.626 INFO:teuthology.orchestra.run.trial159.stdout:(167/183): python3-typing-extensions-4.15.0-1.e 2.4 MB/s | 86 kB 00:00 2026-02-24T09:11:34.646 INFO:teuthology.orchestra.run.trial159.stdout:(168/183): python3-websocket-client-1.2.3-2.el9 2.5 MB/s | 90 kB 00:00 2026-02-24T09:11:34.649 INFO:teuthology.orchestra.run.trial159.stdout:(169/183): python3-xmlsec-1.3.13-1.el9.x86_64.r 1.4 MB/s | 48 kB 00:00 2026-02-24T09:11:34.660 INFO:teuthology.orchestra.run.trial159.stdout:(170/183): python3-xmltodict-0.12.0-15.el9.noar 647 kB/s | 22 kB 00:00 2026-02-24T09:11:34.680 INFO:teuthology.orchestra.run.trial159.stdout:(171/183): python3-zc-lockfile-2.0-10.el9.noarc 588 kB/s | 20 kB 00:00 2026-02-24T09:11:34.686 INFO:teuthology.orchestra.run.trial159.stdout:(172/183): re2-20211101-20.el9.x86_64.rpm 5.1 MB/s | 191 kB 00:00 2026-02-24T09:11:34.697 INFO:teuthology.orchestra.run.trial074.stdout:(22/183): ceph-osd-crimson-20.3.0-5537.g5bc9a1f 5.0 MB/s | 19 MB 00:03 2026-02-24T09:11:34.704 INFO:teuthology.orchestra.run.trial159.stdout:(173/183): thrift-0.15.0-4.el9.x86_64.rpm 36 MB/s | 1.6 MB 00:00 2026-02-24T09:11:34.716 INFO:teuthology.orchestra.run.trial159.stdout:(174/183): yaml-cpp-0.6.3-5.el9.x86_64.rpm 3.3 MB/s | 122 kB 00:00 2026-02-24T09:11:34.729 INFO:teuthology.orchestra.run.trial074.stdout:(23/183): python3-ceph-argparse-20.3.0-5537.g5b 1.4 MB/s | 45 kB 00:00 2026-02-24T09:11:34.739 INFO:teuthology.orchestra.run.trial028.stdout:(34/183): rbd-mirror-20.3.0-5537.g5bc9a1ff.el9. 5.6 MB/s | 2.9 MB 00:00 2026-02-24T09:11:34.761 INFO:teuthology.orchestra.run.trial074.stdout:(24/183): python3-ceph-common-20.3.0-5537.g5bc9 5.7 MB/s | 186 kB 00:00 2026-02-24T09:11:34.799 INFO:teuthology.orchestra.run.trial074.stdout:(25/183): librgw2-20.3.0-5537.g5bc9a1ff.el9.x86 8.5 MB/s | 6.5 MB 00:00 2026-02-24T09:11:34.800 INFO:teuthology.orchestra.run.trial074.stdout:(26/183): python3-cephfs-20.3.0-5537.g5bc9a1ff. 5.0 MB/s | 204 kB 00:00 2026-02-24T09:11:34.865 INFO:teuthology.orchestra.run.trial074.stdout:(27/183): python3-rbd-20.3.0-5537.g5bc9a1ff.el9 4.6 MB/s | 304 kB 00:00 2026-02-24T09:11:34.867 INFO:teuthology.orchestra.run.trial074.stdout:(28/183): python3-rados-20.3.0-5537.g5bc9a1ff.e 4.6 MB/s | 324 kB 00:00 2026-02-24T09:11:34.896 INFO:teuthology.orchestra.run.trial074.stdout:(29/183): python3-rgw-20.3.0-5537.g5bc9a1ff.el9 3.1 MB/s | 100 kB 00:00 2026-02-24T09:11:34.900 INFO:teuthology.orchestra.run.trial074.stdout:(30/183): rbd-fuse-20.3.0-5537.g5bc9a1ff.el9.x8 2.6 MB/s | 84 kB 00:00 2026-02-24T09:11:34.938 INFO:teuthology.orchestra.run.trial074.stdout:(31/183): rbd-nbd-20.3.0-5537.g5bc9a1ff.el9.x86 4.4 MB/s | 172 kB 00:00 2026-02-24T09:11:34.976 INFO:teuthology.orchestra.run.trial074.stdout:(32/183): ceph-grafana-dashboards-20.3.0-5537.g 1.5 MB/s | 57 kB 00:00 2026-02-24T09:11:35.018 INFO:teuthology.orchestra.run.trial074.stdout:(33/183): ceph-mgr-cephadm-20.3.0-5537.g5bc9a1f 4.3 MB/s | 184 kB 00:00 2026-02-24T09:11:35.110 INFO:teuthology.orchestra.run.trial159.stdout:(175/183): libblkid-2.37.4-25.el9.x86_64.rpm 267 kB/s | 105 kB 00:00 2026-02-24T09:11:35.347 INFO:teuthology.orchestra.run.trial159.stdout:(176/183): libfdisk-2.37.4-25.el9.x86_64.rpm 639 kB/s | 152 kB 00:00 2026-02-24T09:11:35.383 INFO:teuthology.orchestra.run.trial159.stdout:(177/183): librados2-20.3.0-5537.g5bc9a1ff.el9. 5.0 MB/s | 3.5 MB 00:00 2026-02-24T09:11:35.507 INFO:teuthology.orchestra.run.trial159.stdout:(178/183): libmount-2.37.4-25.el9.x86_64.rpm 830 kB/s | 133 kB 00:00 2026-02-24T09:11:35.520 INFO:teuthology.orchestra.run.trial074.stdout:(34/183): rbd-mirror-20.3.0-5537.g5bc9a1ff.el9. 4.6 MB/s | 2.9 MB 00:00 2026-02-24T09:11:35.556 INFO:teuthology.orchestra.run.trial159.stdout:(179/183): librbd1-20.3.0-5537.g5bc9a1ff.el9.x8 3.3 MB/s | 2.8 MB 00:00 2026-02-24T09:11:35.667 INFO:teuthology.orchestra.run.trial159.stdout:(180/183): libuuid-2.37.4-25.el9.x86_64.rpm 161 kB/s | 26 kB 00:00 2026-02-24T09:11:35.698 INFO:teuthology.orchestra.run.trial159.stdout:(181/183): libsmartcols-2.37.4-25.el9.x86_64.rp 193 kB/s | 61 kB 00:00 2026-02-24T09:11:35.906 INFO:teuthology.orchestra.run.trial159.stdout:(182/183): util-linux-core-2.37.4-25.el9.x86_64 1.9 MB/s | 458 kB 00:00 2026-02-24T09:11:36.245 INFO:teuthology.orchestra.run.trial028.stdout:(35/183): ceph-mgr-diskprediction-local-20.3.0- 4.9 MB/s | 7.4 MB 00:01 2026-02-24T09:11:36.281 INFO:teuthology.orchestra.run.trial028.stdout:(36/183): ceph-mgr-k8sevents-20.3.0-5537.g5bc9a 607 kB/s | 22 kB 00:00 2026-02-24T09:11:36.360 INFO:teuthology.orchestra.run.trial028.stdout:(37/183): ceph-mgr-modules-core-20.3.0-5537.g5b 3.7 MB/s | 298 kB 00:00 2026-02-24T09:11:36.397 INFO:teuthology.orchestra.run.trial028.stdout:(38/183): ceph-mgr-rook-20.3.0-5537.g5bc9a1ff.e 1.3 MB/s | 50 kB 00:00 2026-02-24T09:11:36.457 INFO:teuthology.orchestra.run.trial028.stdout:(39/183): ceph-mgr-dashboard-20.3.0-5537.g5bc9a 8.2 MB/s | 15 MB 00:01 2026-02-24T09:11:36.458 INFO:teuthology.orchestra.run.trial028.stdout:(40/183): ceph-prometheus-alerts-20.3.0-5537.g5 287 kB/s | 17 kB 00:00 2026-02-24T09:11:36.495 INFO:teuthology.orchestra.run.trial028.stdout:(41/183): ceph-volume-20.3.0-5537.g5bc9a1ff.el9 8.0 MB/s | 301 kB 00:00 2026-02-24T09:11:36.530 INFO:teuthology.orchestra.run.trial028.stdout:(42/183): cephfs-top-20.3.0-5537.g5bc9a1ff.el9. 522 kB/s | 18 kB 00:00 2026-02-24T09:11:36.636 INFO:teuthology.orchestra.run.trial028.stdout:(43/183): cephadm-20.3.0-5537.g5bc9a1ff.el9.noa 5.7 MB/s | 1.0 MB 00:00 2026-02-24T09:11:36.759 INFO:teuthology.orchestra.run.trial074.stdout:(35/183): ceph-mgr-diskprediction-local-20.3.0- 6.0 MB/s | 7.4 MB 00:01 2026-02-24T09:11:36.788 INFO:teuthology.orchestra.run.trial074.stdout:(36/183): ceph-mgr-k8sevents-20.3.0-5537.g5bc9a 794 kB/s | 22 kB 00:00 2026-02-24T09:11:36.849 INFO:teuthology.orchestra.run.trial074.stdout:(37/183): ceph-mgr-modules-core-20.3.0-5537.g5b 4.8 MB/s | 298 kB 00:00 2026-02-24T09:11:36.877 INFO:teuthology.orchestra.run.trial074.stdout:(38/183): ceph-mgr-rook-20.3.0-5537.g5bc9a1ff.e 1.7 MB/s | 50 kB 00:00 2026-02-24T09:11:36.928 INFO:teuthology.orchestra.run.trial074.stdout:(39/183): ceph-mgr-dashboard-20.3.0-5537.g5bc9a 7.9 MB/s | 15 MB 00:01 2026-02-24T09:11:36.929 INFO:teuthology.orchestra.run.trial074.stdout:(40/183): ceph-prometheus-alerts-20.3.0-5537.g5 336 kB/s | 17 kB 00:00 2026-02-24T09:11:36.958 INFO:teuthology.orchestra.run.trial074.stdout:(41/183): ceph-volume-20.3.0-5537.g5bc9a1ff.el9 10 MB/s | 301 kB 00:00 2026-02-24T09:11:36.985 INFO:teuthology.orchestra.run.trial074.stdout:(42/183): cephfs-top-20.3.0-5537.g5bc9a1ff.el9. 684 kB/s | 18 kB 00:00 2026-02-24T09:11:37.065 INFO:teuthology.orchestra.run.trial074.stdout:(43/183): cephadm-20.3.0-5537.g5bc9a1ff.el9.noa 7.5 MB/s | 1.0 MB 00:00 2026-02-24T09:11:37.317 INFO:teuthology.orchestra.run.trial028.stdout:(44/183): cryptsetup-2.8.1-3.el9.x86_64.rpm 446 kB/s | 351 kB 00:00 2026-02-24T09:11:37.475 INFO:teuthology.orchestra.run.trial028.stdout:(45/183): ledmon-libs-1.1.0-3.el9.x86_64.rpm 256 kB/s | 40 kB 00:00 2026-02-24T09:11:37.516 INFO:teuthology.orchestra.run.trial159.stdout:(183/183): util-linux-2.37.4-25.el9.x86_64.rpm 1.2 MB/s | 2.3 MB 00:01 2026-02-24T09:11:37.519 INFO:teuthology.orchestra.run.trial159.stdout:-------------------------------------------------------------------------------- 2026-02-24T09:11:37.519 INFO:teuthology.orchestra.run.trial159.stdout:Total 17 MB/s | 296 MB 00:17 2026-02-24T09:11:37.632 INFO:teuthology.orchestra.run.trial028.stdout:(46/183): libatomic-11.5.0-14.el9.x86_64.rpm 145 kB/s | 23 kB 00:00 2026-02-24T09:11:37.790 INFO:teuthology.orchestra.run.trial028.stdout:(47/183): libconfig-1.7.2-9.el9.x86_64.rpm 456 kB/s | 72 kB 00:00 2026-02-24T09:11:37.820 INFO:teuthology.orchestra.run.trial028.stdout:(48/183): hwloc-libs-2.4.1-6.el9.x86_64.rpm 1.8 MB/s | 2.1 MB 00:01 2026-02-24T09:11:37.860 INFO:teuthology.orchestra.run.trial074.stdout:(44/183): cryptsetup-2.8.1-3.el9.x86_64.rpm 401 kB/s | 351 kB 00:00 2026-02-24T09:11:37.979 INFO:teuthology.orchestra.run.trial028.stdout:(49/183): libquadmath-11.5.0-14.el9.x86_64.rpm 1.1 MB/s | 184 kB 00:00 2026-02-24T09:11:38.019 INFO:teuthology.orchestra.run.trial074.stdout:(45/183): ledmon-libs-1.1.0-3.el9.x86_64.rpm 254 kB/s | 40 kB 00:00 2026-02-24T09:11:38.031 INFO:teuthology.orchestra.run.trial028.stdout:(50/183): libgfortran-11.5.0-14.el9.x86_64.rpm 3.2 MB/s | 794 kB 00:00 2026-02-24T09:11:38.138 INFO:teuthology.orchestra.run.trial028.stdout:(51/183): lksctp-tools-1.0.19-2.el9.x86_64.rpm 594 kB/s | 94 kB 00:00 2026-02-24T09:11:38.179 INFO:teuthology.orchestra.run.trial074.stdout:(46/183): libatomic-11.5.0-14.el9.x86_64.rpm 143 kB/s | 23 kB 00:00 2026-02-24T09:11:38.188 INFO:teuthology.orchestra.run.trial028.stdout:(52/183): mailcap-2.1.49-5.el9.noarch.rpm 211 kB/s | 33 kB 00:00 2026-02-24T09:11:38.284 INFO:teuthology.orchestra.run.trial074.stdout:(47/183): hwloc-libs-2.4.1-6.el9.x86_64.rpm 1.7 MB/s | 2.1 MB 00:01 2026-02-24T09:11:38.338 INFO:teuthology.orchestra.run.trial074.stdout:(48/183): libconfig-1.7.2-9.el9.x86_64.rpm 453 kB/s | 72 kB 00:00 2026-02-24T09:11:38.346 INFO:teuthology.orchestra.run.trial028.stdout:(53/183): pciutils-3.7.0-7.el9.x86_64.rpm 591 kB/s | 93 kB 00:00 2026-02-24T09:11:38.379 INFO:teuthology.orchestra.run.trial028.stdout:(54/183): nvme-cli-2.16-1.el9.x86_64.rpm 4.8 MB/s | 1.2 MB 00:00 2026-02-24T09:11:38.497 INFO:teuthology.orchestra.run.trial074.stdout:(49/183): libquadmath-11.5.0-14.el9.x86_64.rpm 1.1 MB/s | 184 kB 00:00 2026-02-24T09:11:38.507 INFO:teuthology.orchestra.run.trial028.stdout:(55/183): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2026-02-24T09:11:38.551 INFO:teuthology.orchestra.run.trial028.stdout:(56/183): python3-cryptography-36.0.1-5.el9.x86 7.3 MB/s | 1.2 MB 00:00 2026-02-24T09:11:38.602 INFO:teuthology.orchestra.run.trial074.stdout:(50/183): libgfortran-11.5.0-14.el9.x86_64.rpm 2.4 MB/s | 794 kB 00:00 2026-02-24T09:11:38.656 INFO:teuthology.orchestra.run.trial074.stdout:(51/183): lksctp-tools-1.0.19-2.el9.x86_64.rpm 591 kB/s | 94 kB 00:00 2026-02-24T09:11:38.665 INFO:teuthology.orchestra.run.trial028.stdout:(57/183): python3-ply-3.11-14.el9.noarch.rpm 674 kB/s | 106 kB 00:00 2026-02-24T09:11:38.709 INFO:teuthology.orchestra.run.trial028.stdout:(58/183): python3-pycparser-2.20-6.el9.noarch.r 853 kB/s | 135 kB 00:00 2026-02-24T09:11:38.760 INFO:teuthology.orchestra.run.trial074.stdout:(52/183): mailcap-2.1.49-5.el9.noarch.rpm 209 kB/s | 33 kB 00:00 2026-02-24T09:11:38.824 INFO:teuthology.orchestra.run.trial028.stdout:(59/183): python3-pyparsing-2.4.7-9.el9.noarch. 950 kB/s | 150 kB 00:00 2026-02-24T09:11:38.868 INFO:teuthology.orchestra.run.trial028.stdout:(60/183): python3-requests-2.25.1-10.el9.noarch 797 kB/s | 126 kB 00:00 2026-02-24T09:11:38.919 INFO:teuthology.orchestra.run.trial074.stdout:(53/183): pciutils-3.7.0-7.el9.x86_64.rpm 586 kB/s | 93 kB 00:00 2026-02-24T09:11:38.984 INFO:teuthology.orchestra.run.trial028.stdout:(61/183): python3-urllib3-1.26.5-7.el9.noarch.r 1.3 MB/s | 218 kB 00:00 2026-02-24T09:11:39.027 INFO:teuthology.orchestra.run.trial028.stdout:(62/183): unzip-6.0-59.el9.x86_64.rpm 1.1 MB/s | 182 kB 00:00 2026-02-24T09:11:39.033 INFO:teuthology.orchestra.run.trial159.stdout:Running transaction check 2026-02-24T09:11:39.050 INFO:teuthology.orchestra.run.trial074.stdout:(54/183): nvme-cli-2.16-1.el9.x86_64.rpm 2.9 MB/s | 1.2 MB 00:00 2026-02-24T09:11:39.080 INFO:teuthology.orchestra.run.trial074.stdout:(55/183): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2026-02-24T09:11:39.087 INFO:teuthology.orchestra.run.trial028.stdout:(63/183): automake-1.16.2-8.el9.noarch.rpm 11 MB/s | 689 kB 00:00 2026-02-24T09:11:39.109 INFO:teuthology.orchestra.run.trial028.stdout:(64/183): bison-3.7.4-5.el9.x86_64.rpm 42 MB/s | 943 kB 00:00 2026-02-24T09:11:39.120 INFO:teuthology.orchestra.run.trial028.stdout:(65/183): boost-program-options-1.75.0-13.el9.x 9.8 MB/s | 104 kB 00:00 2026-02-24T09:11:39.130 INFO:teuthology.orchestra.run.trial028.stdout:(66/183): elfutils-libelf-devel-0.194-1.el9.x86 7.6 MB/s | 79 kB 00:00 2026-02-24T09:11:39.138 INFO:teuthology.orchestra.run.trial159.stdout:Transaction check succeeded. 2026-02-24T09:11:39.138 INFO:teuthology.orchestra.run.trial159.stdout:Running transaction test 2026-02-24T09:11:39.142 INFO:teuthology.orchestra.run.trial028.stdout:(67/183): flex-2.6.4-9.el9.x86_64.rpm 25 MB/s | 313 kB 00:00 2026-02-24T09:11:39.146 INFO:teuthology.orchestra.run.trial028.stdout:(68/183): zip-3.0-35.el9.x86_64.rpm 1.6 MB/s | 266 kB 00:00 2026-02-24T09:11:39.151 INFO:teuthology.orchestra.run.trial028.stdout:(69/183): flexiblas-3.0.4-9.el9.x86_64.rpm 3.2 MB/s | 30 kB 00:00 2026-02-24T09:11:39.160 INFO:teuthology.orchestra.run.trial028.stdout:(70/183): flexiblas-openblas-openmp-3.0.4-9.el9 1.7 MB/s | 15 kB 00:00 2026-02-24T09:11:39.169 INFO:teuthology.orchestra.run.trial028.stdout:(71/183): libaio-devel-0.3.111-13.el9.x86_64.rp 1.3 MB/s | 11 kB 00:00 2026-02-24T09:11:39.181 INFO:teuthology.orchestra.run.trial028.stdout:(72/183): libnbd-1.20.3-4.el9.x86_64.rpm 14 MB/s | 164 kB 00:00 2026-02-24T09:11:39.192 INFO:teuthology.orchestra.run.trial028.stdout:(73/183): libpmemobj-1.12.1-1.el9.x86_64.rpm 14 MB/s | 160 kB 00:00 2026-02-24T09:11:39.202 INFO:teuthology.orchestra.run.trial028.stdout:(74/183): librabbitmq-0.11.0-7.el9.x86_64.rpm 4.7 MB/s | 45 kB 00:00 2026-02-24T09:11:39.216 INFO:teuthology.orchestra.run.trial028.stdout:(75/183): librdkafka-1.6.1-102.el9.x86_64.rpm 46 MB/s | 662 kB 00:00 2026-02-24T09:11:39.228 INFO:teuthology.orchestra.run.trial028.stdout:(76/183): flexiblas-netlib-3.0.4-9.el9.x86_64.r 36 MB/s | 3.0 MB 00:00 2026-02-24T09:11:39.231 INFO:teuthology.orchestra.run.trial028.stdout:(77/183): libstoragemgmt-1.10.1-1.el9.x86_64.rp 16 MB/s | 246 kB 00:00 2026-02-24T09:11:39.239 INFO:teuthology.orchestra.run.trial074.stdout:(56/183): python3-ply-3.11-14.el9.noarch.rpm 672 kB/s | 106 kB 00:00 2026-02-24T09:11:39.241 INFO:teuthology.orchestra.run.trial028.stdout:(78/183): libuuid-devel-2.37.4-25.el9.x86_64.rp 2.4 MB/s | 23 kB 00:00 2026-02-24T09:11:39.243 INFO:teuthology.orchestra.run.trial028.stdout:(79/183): libtool-2.4.6-46.el9.x86_64.rpm 40 MB/s | 581 kB 00:00 2026-02-24T09:11:39.252 INFO:teuthology.orchestra.run.trial028.stdout:(80/183): libxslt-1.1.34-12.el9.x86_64.rpm 21 MB/s | 233 kB 00:00 2026-02-24T09:11:39.253 INFO:teuthology.orchestra.run.trial028.stdout:(81/183): libzstd-devel-1.5.5-1.el9.x86_64.rpm 5.1 MB/s | 51 kB 00:00 2026-02-24T09:11:39.264 INFO:teuthology.orchestra.run.trial028.stdout:(82/183): lttng-ust-2.12.0-6.el9.x86_64.rpm 24 MB/s | 292 kB 00:00 2026-02-24T09:11:39.265 INFO:teuthology.orchestra.run.trial028.stdout:(83/183): lua-5.4.4-4.el9.x86_64.rpm 15 MB/s | 188 kB 00:00 2026-02-24T09:11:39.273 INFO:teuthology.orchestra.run.trial028.stdout:(84/183): openblas-0.3.29-1.el9.x86_64.rpm 4.5 MB/s | 42 kB 00:00 2026-02-24T09:11:39.307 INFO:teuthology.orchestra.run.trial028.stdout:(85/183): openblas-openmp-0.3.29-1.el9.x86_64.r 127 MB/s | 5.3 MB 00:00 2026-02-24T09:11:39.317 INFO:teuthology.orchestra.run.trial028.stdout:(86/183): perl-Thread-Queue-3.14-460.el9.noarch 2.3 MB/s | 22 kB 00:00 2026-02-24T09:11:39.326 INFO:teuthology.orchestra.run.trial028.stdout:(87/183): perl-threads-2.25-460.el9.x86_64.rpm 6.1 MB/s | 58 kB 00:00 2026-02-24T09:11:39.336 INFO:teuthology.orchestra.run.trial028.stdout:(88/183): perl-threads-shared-1.61-460.el9.x86_ 4.7 MB/s | 45 kB 00:00 2026-02-24T09:11:39.359 INFO:teuthology.orchestra.run.trial028.stdout:(89/183): postgresql-13.23-1.el9.x86_64.rpm 70 MB/s | 1.6 MB 00:00 2026-02-24T09:11:39.380 INFO:teuthology.orchestra.run.trial028.stdout:(90/183): openssl-devel-3.5.5-1.el9.x86_64.rpm 45 MB/s | 4.8 MB 00:00 2026-02-24T09:11:39.399 INFO:teuthology.orchestra.run.trial074.stdout:(57/183): python3-pycparser-2.20-6.el9.noarch.r 847 kB/s | 135 kB 00:00 2026-02-24T09:11:39.521 INFO:teuthology.orchestra.run.trial028.stdout:(91/183): ceph-test-20.3.0-5537.g5bc9a1ff.el9.x 12 MB/s | 76 MB 00:06 2026-02-24T09:11:39.523 INFO:teuthology.orchestra.run.trial028.stdout:(92/183): postgresql-private-libs-13.23-1.el9.x 969 kB/s | 138 kB 00:00 2026-02-24T09:11:39.527 INFO:teuthology.orchestra.run.trial028.stdout:(93/183): postgresql-contrib-13.23-1.el9.x86_64 5.3 MB/s | 903 kB 00:00 2026-02-24T09:11:39.546 INFO:teuthology.orchestra.run.trial028.stdout:(94/183): protobuf-3.14.0-17.el9.x86_64.rpm 44 MB/s | 1.0 MB 00:00 2026-02-24T09:11:39.557 INFO:teuthology.orchestra.run.trial028.stdout:(95/183): python3-colorama-0.4.6-3.el9.noarch.r 5.9 MB/s | 61 kB 00:00 2026-02-24T09:11:39.568 INFO:teuthology.orchestra.run.trial028.stdout:(96/183): python3-devel-3.9.25-3.el9.x86_64.rpm 21 MB/s | 244 kB 00:00 2026-02-24T09:11:39.580 INFO:teuthology.orchestra.run.trial028.stdout:(97/183): python3-jinja2-2.11.3-8.el9.noarch.rp 20 MB/s | 249 kB 00:00 2026-02-24T09:11:39.590 INFO:teuthology.orchestra.run.trial074.stdout:(58/183): ceph-test-20.3.0-5537.g5bc9a1ff.el9.x 12 MB/s | 76 MB 00:06 2026-02-24T09:11:39.591 INFO:teuthology.orchestra.run.trial028.stdout:(98/183): python3-jmespath-1.0.1-1.el9.noarch.r 4.7 MB/s | 48 kB 00:00 2026-02-24T09:11:39.595 INFO:teuthology.orchestra.run.trial074.stdout:(59/183): python3-cryptography-36.0.1-5.el9.x86 2.3 MB/s | 1.2 MB 00:00 2026-02-24T09:11:39.602 INFO:teuthology.orchestra.run.trial028.stdout:(99/183): python3-libstoragemgmt-1.10.1-1.el9.x 15 MB/s | 177 kB 00:00 2026-02-24T09:11:39.621 INFO:teuthology.orchestra.run.trial028.stdout:(100/183): python3-lxml-4.6.5-3.el9.x86_64.rpm 65 MB/s | 1.2 MB 00:00 2026-02-24T09:11:39.631 INFO:teuthology.orchestra.run.trial028.stdout:(101/183): python3-markupsafe-1.1.1-12.el9.x86_ 3.4 MB/s | 35 kB 00:00 2026-02-24T09:11:39.671 INFO:teuthology.orchestra.run.trial074.stdout:(60/183): python3-pyparsing-2.4.7-9.el9.noarch. 553 kB/s | 150 kB 00:00 2026-02-24T09:11:39.681 INFO:teuthology.orchestra.run.trial028.stdout:(102/183): python3-babel-2.9.1-2.el9.noarch.rpm 39 MB/s | 6.0 MB 00:00 2026-02-24T09:11:39.692 INFO:teuthology.orchestra.run.trial028.stdout:(103/183): python3-numpy-f2py-1.23.5-2.el9.x86_ 40 MB/s | 442 kB 00:00 2026-02-24T09:11:39.701 INFO:teuthology.orchestra.run.trial028.stdout:(104/183): python3-packaging-20.9-5.el9.noarch. 8.5 MB/s | 77 kB 00:00 2026-02-24T09:11:39.711 INFO:teuthology.orchestra.run.trial028.stdout:(105/183): python3-protobuf-3.14.0-17.el9.noarc 27 MB/s | 267 kB 00:00 2026-02-24T09:11:39.720 INFO:teuthology.orchestra.run.trial028.stdout:(106/183): python3-pyasn1-0.4.8-7.el9.noarch.rp 17 MB/s | 157 kB 00:00 2026-02-24T09:11:39.730 INFO:teuthology.orchestra.run.trial028.stdout:(107/183): python3-pyasn1-modules-0.4.8-7.el9.n 27 MB/s | 277 kB 00:00 2026-02-24T09:11:39.739 INFO:teuthology.orchestra.run.trial028.stdout:(108/183): python3-requests-oauthlib-1.3.0-12.e 6.1 MB/s | 54 kB 00:00 2026-02-24T09:11:39.751 INFO:teuthology.orchestra.run.trial074.stdout:(61/183): python3-requests-2.25.1-10.el9.noarch 789 kB/s | 126 kB 00:00 2026-02-24T09:11:39.755 INFO:teuthology.orchestra.run.trial074.stdout:(62/183): python3-urllib3-1.26.5-7.el9.noarch.r 1.3 MB/s | 218 kB 00:00 2026-02-24T09:11:39.785 INFO:teuthology.orchestra.run.trial028.stdout:(109/183): python3-numpy-1.23.5-2.el9.x86_64.rp 40 MB/s | 6.1 MB 00:00 2026-02-24T09:11:39.793 INFO:teuthology.orchestra.run.trial028.stdout:(110/183): python3-toml-0.10.2-6.el9.noarch.rpm 4.8 MB/s | 42 kB 00:00 2026-02-24T09:11:39.802 INFO:teuthology.orchestra.run.trial028.stdout:(111/183): python3-wcwidth-0.2.5-8.el9.noarch.r 5.1 MB/s | 44 kB 00:00 2026-02-24T09:11:39.812 INFO:teuthology.orchestra.run.trial028.stdout:(112/183): qatlib-25.08.0-2.el9.x86_64.rpm 24 MB/s | 240 kB 00:00 2026-02-24T09:11:39.821 INFO:teuthology.orchestra.run.trial028.stdout:(113/183): qatlib-service-25.08.0-2.el9.x86_64. 4.3 MB/s | 37 kB 00:00 2026-02-24T09:11:39.830 INFO:teuthology.orchestra.run.trial028.stdout:(114/183): qatzip-libs-1.3.1-1.el9.x86_64.rpm 7.4 MB/s | 66 kB 00:00 2026-02-24T09:11:39.831 INFO:teuthology.orchestra.run.trial074.stdout:(63/183): unzip-6.0-59.el9.x86_64.rpm 1.1 MB/s | 182 kB 00:00 2026-02-24T09:11:39.841 INFO:teuthology.orchestra.run.trial028.stdout:(115/183): socat-1.7.4.1-8.el9.x86_64.rpm 27 MB/s | 303 kB 00:00 2026-02-24T09:11:39.850 INFO:teuthology.orchestra.run.trial028.stdout:(116/183): uuid-1.6.2-55.el9.x86_64.rpm 6.6 MB/s | 58 kB 00:00 2026-02-24T09:11:39.889 INFO:teuthology.orchestra.run.trial028.stdout:(117/183): python3-scipy-1.9.3-2.el9.x86_64.rpm 129 MB/s | 19 MB 00:00 2026-02-24T09:11:39.890 INFO:teuthology.orchestra.run.trial028.stdout:(118/183): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 2.4 MB/s | 96 kB 00:00 2026-02-24T09:11:39.898 INFO:teuthology.orchestra.run.trial028.stdout:(119/183): xmlsec1-1.2.29-13.el9.x86_64.rpm 19 MB/s | 189 kB 00:00 2026-02-24T09:11:39.899 INFO:teuthology.orchestra.run.trial028.stdout:(120/183): xmlsec1-openssl-1.2.29-13.el9.x86_64 9.2 MB/s | 90 kB 00:00 2026-02-24T09:11:39.908 INFO:teuthology.orchestra.run.trial028.stdout:(121/183): xmlstarlet-1.6.1-20.el9.x86_64.rpm 7.1 MB/s | 64 kB 00:00 2026-02-24T09:11:39.908 INFO:teuthology.orchestra.run.trial028.stdout:(122/183): zlib-devel-1.2.11-41.el9.x86_64.rpm 5.1 MB/s | 45 kB 00:00 2026-02-24T09:11:39.910 INFO:teuthology.orchestra.run.trial074.stdout:(64/183): zip-3.0-35.el9.x86_64.rpm 1.6 MB/s | 266 kB 00:00 2026-02-24T09:11:39.916 INFO:teuthology.orchestra.run.trial028.stdout:(123/183): lua-devel-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 22 kB 00:00 2026-02-24T09:11:39.923 INFO:teuthology.orchestra.run.trial028.stdout:(124/183): protobuf-compiler-3.14.0-17.el9.x86_ 60 MB/s | 862 kB 00:00 2026-02-24T09:11:39.951 INFO:teuthology.orchestra.run.trial074.stdout:(65/183): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 689 kB 00:00 2026-02-24T09:11:39.977 INFO:teuthology.orchestra.run.trial074.stdout:(66/183): elfutils-libelf-devel-0.194-1.el9.x86 3.0 MB/s | 79 kB 00:00 2026-02-24T09:11:39.979 INFO:teuthology.orchestra.run.trial028.stdout:(125/183): gperftools-libs-2.9.1-3.el9.x86_64.r 5.4 MB/s | 308 kB 00:00 2026-02-24T09:11:39.984 INFO:teuthology.orchestra.run.trial028.stdout:(126/183): abseil-cpp-20211102.0-4.el9.x86_64.r 7.9 MB/s | 551 kB 00:00 2026-02-24T09:11:39.992 INFO:teuthology.orchestra.run.trial028.stdout:(127/183): grpc-data-1.46.7-10.el9.noarch.rpm 1.5 MB/s | 19 kB 00:00 2026-02-24T09:11:40.003 INFO:teuthology.orchestra.run.trial028.stdout:(128/183): libarrow-doc-9.0.0-15.el9.noarch.rpm 2.3 MB/s | 25 kB 00:00 2026-02-24T09:11:40.009 INFO:teuthology.orchestra.run.trial074.stdout:(67/183): flex-2.6.4-9.el9.x86_64.rpm 9.7 MB/s | 313 kB 00:00 2026-02-24T09:11:40.035 INFO:teuthology.orchestra.run.trial074.stdout:(68/183): bison-3.7.4-5.el9.x86_64.rpm 4.5 MB/s | 943 kB 00:00 2026-02-24T09:11:40.035 INFO:teuthology.orchestra.run.trial074.stdout:(69/183): boost-program-options-1.75.0-13.el9.x 833 kB/s | 104 kB 00:00 2026-02-24T09:11:40.036 INFO:teuthology.orchestra.run.trial074.stdout:(70/183): flexiblas-3.0.4-9.el9.x86_64.rpm 1.1 MB/s | 30 kB 00:00 2026-02-24T09:11:40.061 INFO:teuthology.orchestra.run.trial074.stdout:(71/183): flexiblas-openblas-openmp-3.0.4-9.el9 588 kB/s | 15 kB 00:00 2026-02-24T09:11:40.063 INFO:teuthology.orchestra.run.trial074.stdout:(72/183): libaio-devel-0.3.111-13.el9.x86_64.rp 425 kB/s | 11 kB 00:00 2026-02-24T09:11:40.083 INFO:teuthology.orchestra.run.trial028.stdout:(129/183): libarrow-9.0.0-15.el9.x86_64.rpm 45 MB/s | 4.4 MB 00:00 2026-02-24T09:11:40.089 INFO:teuthology.orchestra.run.trial074.stdout:(73/183): libnbd-1.20.3-4.el9.x86_64.rpm 5.7 MB/s | 164 kB 00:00 2026-02-24T09:11:40.092 INFO:teuthology.orchestra.run.trial028.stdout:(130/183): libunwind-1.6.2-1.el9.x86_64.rpm 7.5 MB/s | 67 kB 00:00 2026-02-24T09:11:40.101 INFO:teuthology.orchestra.run.trial028.stdout:(131/183): luarocks-3.9.2-5.el9.noarch.rpm 17 MB/s | 151 kB 00:00 2026-02-24T09:11:40.113 INFO:teuthology.orchestra.run.trial028.stdout:(132/183): liboath-2.6.12-1.el9.x86_64.rpm 444 kB/s | 49 kB 00:00 2026-02-24T09:11:40.119 INFO:teuthology.orchestra.run.trial074.stdout:(74/183): flexiblas-netlib-3.0.4-9.el9.x86_64.r 35 MB/s | 3.0 MB 00:00 2026-02-24T09:11:40.120 INFO:teuthology.orchestra.run.trial074.stdout:(75/183): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2026-02-24T09:11:40.121 INFO:teuthology.orchestra.run.trial074.stdout:(76/183): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.4 MB/s | 45 kB 00:00 2026-02-24T09:11:40.131 INFO:teuthology.orchestra.run.trial028.stdout:(133/183): parquet-libs-9.0.0-15.el9.x86_64.rpm 28 MB/s | 838 kB 00:00 2026-02-24T09:11:40.141 INFO:teuthology.orchestra.run.trial028.stdout:(134/183): python3-asyncssh-2.13.2-5.el9.noarch 20 MB/s | 548 kB 00:00 2026-02-24T09:11:40.141 INFO:teuthology.orchestra.run.trial028.stdout:(135/183): python3-autocommand-2.2.2-8.el9.noar 2.8 MB/s | 29 kB 00:00 2026-02-24T09:11:40.149 INFO:teuthology.orchestra.run.trial028.stdout:(136/183): python3-backports-tarfile-1.2.0-1.el 6.8 MB/s | 60 kB 00:00 2026-02-24T09:11:40.150 INFO:teuthology.orchestra.run.trial074.stdout:(77/183): librdkafka-1.6.1-102.el9.x86_64.rpm 21 MB/s | 662 kB 00:00 2026-02-24T09:11:40.151 INFO:teuthology.orchestra.run.trial028.stdout:(137/183): python3-bcrypt-3.2.2-1.el9.x86_64.rp 4.9 MB/s | 43 kB 00:00 2026-02-24T09:11:40.158 INFO:teuthology.orchestra.run.trial028.stdout:(138/183): python3-cachetools-4.2.4-1.el9.noarc 3.8 MB/s | 32 kB 00:00 2026-02-24T09:11:40.159 INFO:teuthology.orchestra.run.trial028.stdout:(139/183): python3-certifi-2023.05.07-4.el9.noa 1.7 MB/s | 14 kB 00:00 2026-02-24T09:11:40.160 INFO:teuthology.orchestra.run.trial074.stdout:(78/183): libtool-2.4.6-46.el9.x86_64.rpm 15 MB/s | 581 kB 00:00 2026-02-24T09:11:40.168 INFO:teuthology.orchestra.run.trial028.stdout:(140/183): python3-cheroot-10.0.1-4.el9.noarch. 17 MB/s | 173 kB 00:00 2026-02-24T09:11:40.171 INFO:teuthology.orchestra.run.trial028.stdout:(141/183): python3-cherrypy-18.6.1-2.el9.noarch 30 MB/s | 358 kB 00:00 2026-02-24T09:11:40.172 INFO:teuthology.orchestra.run.trial074.stdout:(79/183): libstoragemgmt-1.10.1-1.el9.x86_64.rp 4.7 MB/s | 246 kB 00:00 2026-02-24T09:11:40.176 INFO:teuthology.orchestra.run.trial074.stdout:(80/183): libuuid-devel-2.37.4-25.el9.x86_64.rp 888 kB/s | 23 kB 00:00 2026-02-24T09:11:40.182 INFO:teuthology.orchestra.run.trial028.stdout:(142/183): python3-google-auth-2.45.0-1.el9.noa 22 MB/s | 254 kB 00:00 2026-02-24T09:11:40.187 INFO:teuthology.orchestra.run.trial028.stdout:(143/183): python3-cmd2-2.4.2-2.el9.noarch.rpm 16 MB/s | 303 kB 00:00 2026-02-24T09:11:40.190 INFO:teuthology.orchestra.run.trial074.stdout:(81/183): libxslt-1.1.34-12.el9.x86_64.rpm 7.7 MB/s | 233 kB 00:00 2026-02-24T09:11:40.197 INFO:teuthology.orchestra.run.trial028.stdout:(144/183): python3-grpcio-tools-1.46.7-10.el9.x 15 MB/s | 144 kB 00:00 2026-02-24T09:11:40.198 INFO:teuthology.orchestra.run.trial074.stdout:(82/183): libzstd-devel-1.5.5-1.el9.x86_64.rpm 1.9 MB/s | 51 kB 00:00 2026-02-24T09:11:40.204 INFO:teuthology.orchestra.run.trial074.stdout:(83/183): lttng-ust-2.12.0-6.el9.x86_64.rpm 10 MB/s | 292 kB 00:00 2026-02-24T09:11:40.208 INFO:teuthology.orchestra.run.trial028.stdout:(145/183): python3-influxdb-5.3.1-1.el9.noarch. 13 MB/s | 139 kB 00:00 2026-02-24T09:11:40.216 INFO:teuthology.orchestra.run.trial028.stdout:(146/183): python3-isodate-0.6.1-3.el9.noarch.r 6.6 MB/s | 56 kB 00:00 2026-02-24T09:11:40.219 INFO:teuthology.orchestra.run.trial074.stdout:(84/183): lua-5.4.4-4.el9.x86_64.rpm 6.5 MB/s | 188 kB 00:00 2026-02-24T09:11:40.223 INFO:teuthology.orchestra.run.trial074.stdout:(85/183): openblas-0.3.29-1.el9.x86_64.rpm 1.6 MB/s | 42 kB 00:00 2026-02-24T09:11:40.224 INFO:teuthology.orchestra.run.trial028.stdout:(147/183): python3-jaraco-8.2.1-3.el9.noarch.rp 1.4 MB/s | 11 kB 00:00 2026-02-24T09:11:40.232 INFO:teuthology.orchestra.run.trial028.stdout:(148/183): python3-jaraco-classes-3.2.1-5.el9.n 2.3 MB/s | 18 kB 00:00 2026-02-24T09:11:40.240 INFO:teuthology.orchestra.run.trial028.stdout:(149/183): python3-jaraco-collections-3.0.0-8.e 3.0 MB/s | 23 kB 00:00 2026-02-24T09:11:40.249 INFO:teuthology.orchestra.run.trial074.stdout:(86/183): perl-Thread-Queue-3.14-460.el9.noarch 877 kB/s | 22 kB 00:00 2026-02-24T09:11:40.252 INFO:teuthology.orchestra.run.trial028.stdout:(150/183): python3-grpcio-1.46.7-10.el9.x86_64. 29 MB/s | 2.0 MB 00:00 2026-02-24T09:11:40.252 INFO:teuthology.orchestra.run.trial028.stdout:(151/183): python3-jaraco-context-6.0.1-3.el9.n 1.6 MB/s | 20 kB 00:00 2026-02-24T09:11:40.260 INFO:teuthology.orchestra.run.trial028.stdout:(152/183): python3-jaraco-functools-3.5.0-2.el9 2.2 MB/s | 19 kB 00:00 2026-02-24T09:11:40.261 INFO:teuthology.orchestra.run.trial028.stdout:(153/183): python3-jaraco-text-4.0.0-2.el9.noar 3.1 MB/s | 26 kB 00:00 2026-02-24T09:11:40.267 INFO:teuthology.orchestra.run.trial074.stdout:(87/183): openblas-openmp-0.3.29-1.el9.x86_64.r 84 MB/s | 5.3 MB 00:00 2026-02-24T09:11:40.271 INFO:teuthology.orchestra.run.trial028.stdout:(154/183): python3-more-itertools-8.12.0-2.el9. 8.3 MB/s | 79 kB 00:00 2026-02-24T09:11:40.276 INFO:teuthology.orchestra.run.trial074.stdout:(88/183): perl-threads-2.25-460.el9.x86_64.rpm 2.2 MB/s | 58 kB 00:00 2026-02-24T09:11:40.280 INFO:teuthology.orchestra.run.trial028.stdout:(155/183): python3-msgpack-1.0.3-2.el9.x86_64.r 9.6 MB/s | 86 kB 00:00 2026-02-24T09:11:40.286 INFO:teuthology.orchestra.run.trial028.stdout:(156/183): python3-kubernetes-26.1.0-3.el9.noar 40 MB/s | 1.0 MB 00:00 2026-02-24T09:11:40.288 INFO:teuthology.orchestra.run.trial028.stdout:(157/183): python3-natsort-7.1.1-5.el9.noarch.r 6.9 MB/s | 58 kB 00:00 2026-02-24T09:11:40.293 INFO:teuthology.orchestra.run.trial074.stdout:(89/183): perl-threads-shared-1.61-460.el9.x86_ 1.7 MB/s | 45 kB 00:00 2026-02-24T09:11:40.294 INFO:teuthology.orchestra.run.trial028.stdout:(158/183): python3-portend-3.1.0-2.el9.noarch.r 1.9 MB/s | 16 kB 00:00 2026-02-24T09:11:40.297 INFO:teuthology.orchestra.run.trial028.stdout:(159/183): python3-pyOpenSSL-21.0.0-1.el9.noarc 10 MB/s | 90 kB 00:00 2026-02-24T09:11:40.303 INFO:teuthology.orchestra.run.trial028.stdout:(160/183): python3-pyperclip-1.8.2-2.el9.noarch 3.2 MB/s | 28 kB 00:00 2026-02-24T09:11:40.305 INFO:teuthology.orchestra.run.trial028.stdout:(161/183): python3-repoze-lru-0.7-16.el9.noarch 3.9 MB/s | 31 kB 00:00 2026-02-24T09:11:40.313 INFO:teuthology.orchestra.run.trial028.stdout:(162/183): python3-routes-2.5.1-5.el9.noarch.rp 18 MB/s | 188 kB 00:00 2026-02-24T09:11:40.314 INFO:teuthology.orchestra.run.trial028.stdout:(163/183): python3-rsa-4.9-2.el9.noarch.rpm 6.0 MB/s | 59 kB 00:00 2026-02-24T09:11:40.323 INFO:teuthology.orchestra.run.trial028.stdout:(164/183): python3-tempora-5.0.0-2.el9.noarch.r 4.4 MB/s | 36 kB 00:00 2026-02-24T09:11:40.324 INFO:teuthology.orchestra.run.trial074.stdout:(90/183): postgresql-contrib-13.23-1.el9.x86_64 28 MB/s | 903 kB 00:00 2026-02-24T09:11:40.324 INFO:teuthology.orchestra.run.trial028.stdout:(165/183): python3-saml-1.16.0-1.el9.noarch.rpm 12 MB/s | 125 kB 00:00 2026-02-24T09:11:40.332 INFO:teuthology.orchestra.run.trial028.stdout:(166/183): python3-typing-extensions-4.15.0-1.e 9.5 MB/s | 86 kB 00:00 2026-02-24T09:11:40.333 INFO:teuthology.orchestra.run.trial028.stdout:(167/183): python3-websocket-client-1.2.3-2.el9 9.8 MB/s | 90 kB 00:00 2026-02-24T09:11:40.340 INFO:teuthology.orchestra.run.trial028.stdout:(168/183): python3-xmlsec-1.3.13-1.el9.x86_64.r 5.9 MB/s | 48 kB 00:00 2026-02-24T09:11:40.342 INFO:teuthology.orchestra.run.trial028.stdout:(169/183): python3-xmltodict-0.12.0-15.el9.noar 2.6 MB/s | 22 kB 00:00 2026-02-24T09:11:40.348 INFO:teuthology.orchestra.run.trial028.stdout:(170/183): python3-zc-lockfile-2.0-10.el9.noarc 2.5 MB/s | 20 kB 00:00 2026-02-24T09:11:40.359 INFO:teuthology.orchestra.run.trial074.stdout:(91/183): openssl-devel-3.5.5-1.el9.x86_64.rpm 34 MB/s | 4.8 MB 00:00 2026-02-24T09:11:40.361 INFO:teuthology.orchestra.run.trial074.stdout:(92/183): postgresql-private-libs-13.23-1.el9.x 3.7 MB/s | 138 kB 00:00 2026-02-24T09:11:40.365 INFO:teuthology.orchestra.run.trial074.stdout:(93/183): postgresql-13.23-1.el9.x86_64.rpm 18 MB/s | 1.6 MB 00:00 2026-02-24T09:11:40.396 INFO:teuthology.orchestra.run.trial074.stdout:(94/183): protobuf-3.14.0-17.el9.x86_64.rpm 29 MB/s | 1.0 MB 00:00 2026-02-24T09:11:40.397 INFO:teuthology.orchestra.run.trial159.stdout:Transaction test succeeded. 2026-02-24T09:11:40.397 INFO:teuthology.orchestra.run.trial159.stdout:Running transaction 2026-02-24T09:11:40.411 INFO:teuthology.orchestra.run.trial028.stdout:(171/183): re2-20211101-20.el9.x86_64.rpm 2.7 MB/s | 191 kB 00:00 2026-02-24T09:11:40.420 INFO:teuthology.orchestra.run.trial028.stdout:(172/183): yaml-cpp-0.6.3-5.el9.x86_64.rpm 12 MB/s | 122 kB 00:00 2026-02-24T09:11:40.433 INFO:teuthology.orchestra.run.trial074.stdout:(95/183): postgresql-server-13.23-1.el9.x86_64. 79 MB/s | 5.8 MB 00:00 2026-02-24T09:11:40.433 INFO:teuthology.orchestra.run.trial074.stdout:(96/183): python3-colorama-0.4.6-3.el9.noarch.r 1.6 MB/s | 61 kB 00:00 2026-02-24T09:11:40.444 INFO:teuthology.orchestra.run.trial028.stdout:(173/183): thrift-0.15.0-4.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2026-02-24T09:11:40.455 INFO:teuthology.orchestra.run.trial074.stdout:(97/183): python3-babel-2.9.1-2.el9.noarch.rpm 66 MB/s | 6.0 MB 00:00 2026-02-24T09:11:40.462 INFO:teuthology.orchestra.run.trial074.stdout:(98/183): python3-jinja2-2.11.3-8.el9.noarch.rp 8.7 MB/s | 249 kB 00:00 2026-02-24T09:11:40.463 INFO:teuthology.orchestra.run.trial074.stdout:(99/183): python3-devel-3.9.25-3.el9.x86_64.rpm 7.9 MB/s | 244 kB 00:00 2026-02-24T09:11:40.482 INFO:teuthology.orchestra.run.trial074.stdout:(100/183): python3-jmespath-1.0.1-1.el9.noarch. 1.8 MB/s | 48 kB 00:00 2026-02-24T09:11:40.490 INFO:teuthology.orchestra.run.trial074.stdout:(101/183): python3-libstoragemgmt-1.10.1-1.el9. 6.2 MB/s | 177 kB 00:00 2026-02-24T09:11:40.497 INFO:teuthology.orchestra.run.trial074.stdout:(102/183): python3-lxml-4.6.5-3.el9.x86_64.rpm 36 MB/s | 1.2 MB 00:00 2026-02-24T09:11:40.508 INFO:teuthology.orchestra.run.trial074.stdout:(103/183): python3-markupsafe-1.1.1-12.el9.x86_ 1.3 MB/s | 35 kB 00:00 2026-02-24T09:11:40.528 INFO:teuthology.orchestra.run.trial074.stdout:(104/183): python3-numpy-f2py-1.23.5-2.el9.x86_ 14 MB/s | 442 kB 00:00 2026-02-24T09:11:40.534 INFO:teuthology.orchestra.run.trial074.stdout:(105/183): python3-packaging-20.9-5.el9.noarch. 2.9 MB/s | 77 kB 00:00 2026-02-24T09:11:40.552 INFO:teuthology.orchestra.run.trial074.stdout:(106/183): python3-numpy-1.23.5-2.el9.x86_64.rp 100 MB/s | 6.1 MB 00:00 2026-02-24T09:11:40.557 INFO:teuthology.orchestra.run.trial074.stdout:(107/183): python3-protobuf-3.14.0-17.el9.noarc 9.1 MB/s | 267 kB 00:00 2026-02-24T09:11:40.562 INFO:teuthology.orchestra.run.trial074.stdout:(108/183): python3-pyasn1-0.4.8-7.el9.noarch.rp 5.5 MB/s | 157 kB 00:00 2026-02-24T09:11:40.563 INFO:teuthology.orchestra.run.trial028.stdout:(174/183): librados2-20.3.0-5537.g5bc9a1ff.el9. 25 MB/s | 3.5 MB 00:00 2026-02-24T09:11:40.581 INFO:teuthology.orchestra.run.trial074.stdout:(109/183): python3-pyasn1-modules-0.4.8-7.el9.n 9.4 MB/s | 277 kB 00:00 2026-02-24T09:11:40.583 INFO:teuthology.orchestra.run.trial074.stdout:(110/183): python3-requests-oauthlib-1.3.0-12.e 2.0 MB/s | 54 kB 00:00 2026-02-24T09:11:40.593 INFO:teuthology.orchestra.run.trial028.stdout:(175/183): librbd1-20.3.0-5537.g5bc9a1ff.el9.x8 19 MB/s | 2.8 MB 00:00 2026-02-24T09:11:40.607 INFO:teuthology.orchestra.run.trial074.stdout:(111/183): python3-toml-0.10.2-6.el9.noarch.rpm 1.5 MB/s | 42 kB 00:00 2026-02-24T09:11:40.609 INFO:teuthology.orchestra.run.trial074.stdout:(112/183): python3-wcwidth-0.2.5-8.el9.noarch.r 1.7 MB/s | 44 kB 00:00 2026-02-24T09:11:40.635 INFO:teuthology.orchestra.run.trial074.stdout:(113/183): qatlib-25.08.0-2.el9.x86_64.rpm 8.5 MB/s | 240 kB 00:00 2026-02-24T09:11:40.636 INFO:teuthology.orchestra.run.trial074.stdout:(114/183): qatlib-service-25.08.0-2.el9.x86_64. 1.4 MB/s | 37 kB 00:00 2026-02-24T09:11:40.660 INFO:teuthology.orchestra.run.trial074.stdout:(115/183): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.6 MB/s | 66 kB 00:00 2026-02-24T09:11:40.679 INFO:teuthology.orchestra.run.trial028.stdout:(176/183): postgresql-server-13.23-1.el9.x86_64 5.0 MB/s | 5.8 MB 00:01 2026-02-24T09:11:40.697 INFO:teuthology.orchestra.run.trial074.stdout:(116/183): python3-scipy-1.9.3-2.el9.x86_64.rpm 143 MB/s | 19 MB 00:00 2026-02-24T09:11:40.698 INFO:teuthology.orchestra.run.trial074.stdout:(117/183): uuid-1.6.2-55.el9.x86_64.rpm 1.5 MB/s | 58 kB 00:00 2026-02-24T09:11:40.700 INFO:teuthology.orchestra.run.trial074.stdout:(118/183): socat-1.7.4.1-8.el9.x86_64.rpm 4.6 MB/s | 303 kB 00:00 2026-02-24T09:11:40.724 INFO:teuthology.orchestra.run.trial074.stdout:(119/183): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 3.5 MB/s | 96 kB 00:00 2026-02-24T09:11:40.726 INFO:teuthology.orchestra.run.trial074.stdout:(120/183): xmlsec1-1.2.29-13.el9.x86_64.rpm 6.8 MB/s | 189 kB 00:00 2026-02-24T09:11:40.727 INFO:teuthology.orchestra.run.trial074.stdout:(121/183): xmlsec1-openssl-1.2.29-13.el9.x86_64 3.3 MB/s | 90 kB 00:00 2026-02-24T09:11:40.750 INFO:teuthology.orchestra.run.trial074.stdout:(122/183): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.4 MB/s | 64 kB 00:00 2026-02-24T09:11:40.752 INFO:teuthology.orchestra.run.trial074.stdout:(123/183): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.7 MB/s | 45 kB 00:00 2026-02-24T09:11:40.753 INFO:teuthology.orchestra.run.trial074.stdout:(124/183): lua-devel-5.4.4-4.el9.x86_64.rpm 872 kB/s | 22 kB 00:00 2026-02-24T09:11:40.782 INFO:teuthology.orchestra.run.trial074.stdout:(125/183): protobuf-compiler-3.14.0-17.el9.x86_ 27 MB/s | 862 kB 00:00 2026-02-24T09:11:40.801 INFO:teuthology.orchestra.run.trial028.stdout:(177/183): libblkid-2.37.4-25.el9.x86_64.rpm 443 kB/s | 105 kB 00:00 2026-02-24T09:11:40.877 INFO:teuthology.orchestra.run.trial074.stdout:(126/183): grpc-data-1.46.7-10.el9.noarch.rpm 204 kB/s | 19 kB 00:00 2026-02-24T09:11:40.915 INFO:teuthology.orchestra.run.trial028.stdout:(178/183): libfdisk-2.37.4-25.el9.x86_64.rpm 472 kB/s | 152 kB 00:00 2026-02-24T09:11:40.953 INFO:teuthology.orchestra.run.trial074.stdout:(127/183): gperftools-libs-2.9.1-3.el9.x86_64.r 1.5 MB/s | 308 kB 00:00 2026-02-24T09:11:40.959 INFO:teuthology.orchestra.run.trial028.stdout:(179/183): libsmartcols-2.37.4-25.el9.x86_64.rp 386 kB/s | 61 kB 00:00 2026-02-24T09:11:40.978 INFO:teuthology.orchestra.run.trial074.stdout:(128/183): abseil-cpp-20211102.0-4.el9.x86_64.r 2.4 MB/s | 551 kB 00:00 2026-02-24T09:11:40.987 INFO:teuthology.orchestra.run.trial074.stdout:(129/183): libarrow-doc-9.0.0-15.el9.noarch.rpm 741 kB/s | 25 kB 00:00 2026-02-24T09:11:41.012 INFO:teuthology.orchestra.run.trial074.stdout:(130/183): liboath-2.6.12-1.el9.x86_64.rpm 1.5 MB/s | 49 kB 00:00 2026-02-24T09:11:41.021 INFO:teuthology.orchestra.run.trial074.stdout:(131/183): libunwind-1.6.2-1.el9.x86_64.rpm 1.9 MB/s | 67 kB 00:00 2026-02-24T09:11:41.045 INFO:teuthology.orchestra.run.trial074.stdout:(132/183): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2026-02-24T09:11:41.072 INFO:teuthology.orchestra.run.trial028.stdout:(180/183): libuuid-2.37.4-25.el9.x86_64.rpm 163 kB/s | 26 kB 00:00 2026-02-24T09:11:41.083 INFO:teuthology.orchestra.run.trial074.stdout:(133/183): python3-asyncssh-2.13.2-5.el9.noarch 14 MB/s | 548 kB 00:00 2026-02-24T09:11:41.090 INFO:teuthology.orchestra.run.trial074.stdout:(134/183): parquet-libs-9.0.0-15.el9.x86_64.rpm 12 MB/s | 838 kB 00:00 2026-02-24T09:11:41.116 INFO:teuthology.orchestra.run.trial074.stdout:(135/183): python3-autocommand-2.2.2-8.el9.noar 891 kB/s | 29 kB 00:00 2026-02-24T09:11:41.126 INFO:teuthology.orchestra.run.trial074.stdout:(136/183): python3-backports-tarfile-1.2.0-1.el 1.7 MB/s | 60 kB 00:00 2026-02-24T09:11:41.149 INFO:teuthology.orchestra.run.trial074.stdout:(137/183): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2026-02-24T09:11:41.167 INFO:teuthology.orchestra.run.trial074.stdout:(138/183): libarrow-9.0.0-15.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2026-02-24T09:11:41.168 INFO:teuthology.orchestra.run.trial074.stdout:(139/183): python3-cachetools-4.2.4-1.el9.noarc 758 kB/s | 32 kB 00:00 2026-02-24T09:11:41.182 INFO:teuthology.orchestra.run.trial074.stdout:(140/183): python3-certifi-2023.05.07-4.el9.noa 431 kB/s | 14 kB 00:00 2026-02-24T09:11:41.203 INFO:teuthology.orchestra.run.trial074.stdout:(141/183): python3-cheroot-10.0.1-4.el9.noarch. 4.8 MB/s | 173 kB 00:00 2026-02-24T09:11:41.206 INFO:teuthology.orchestra.run.trial074.stdout:(142/183): python3-cherrypy-18.6.1-2.el9.noarch 9.4 MB/s | 358 kB 00:00 2026-02-24T09:11:41.221 INFO:teuthology.orchestra.run.trial074.stdout:(143/183): python3-cmd2-2.4.2-2.el9.noarch.rpm 7.6 MB/s | 303 kB 00:00 2026-02-24T09:11:41.239 INFO:teuthology.orchestra.run.trial074.stdout:(144/183): python3-google-auth-2.45.0-1.el9.noa 7.0 MB/s | 254 kB 00:00 2026-02-24T09:11:41.256 INFO:teuthology.orchestra.run.trial074.stdout:(145/183): python3-grpcio-tools-1.46.7-10.el9.x 4.0 MB/s | 144 kB 00:00 2026-02-24T09:11:41.274 INFO:teuthology.orchestra.run.trial074.stdout:(146/183): python3-influxdb-5.3.1-1.el9.noarch. 3.9 MB/s | 139 kB 00:00 2026-02-24T09:11:41.290 INFO:teuthology.orchestra.run.trial074.stdout:(147/183): python3-isodate-0.6.1-3.el9.noarch.r 1.6 MB/s | 56 kB 00:00 2026-02-24T09:11:41.306 INFO:teuthology.orchestra.run.trial074.stdout:(148/183): python3-jaraco-8.2.1-3.el9.noarch.rp 331 kB/s | 11 kB 00:00 2026-02-24T09:11:41.312 INFO:teuthology.orchestra.run.trial074.stdout:(149/183): python3-grpcio-1.46.7-10.el9.x86_64. 19 MB/s | 2.0 MB 00:00 2026-02-24T09:11:41.323 INFO:teuthology.orchestra.run.trial074.stdout:(150/183): python3-jaraco-classes-3.2.1-5.el9.n 537 kB/s | 18 kB 00:00 2026-02-24T09:11:41.339 INFO:teuthology.orchestra.run.trial074.stdout:(151/183): python3-jaraco-collections-3.0.0-8.e 703 kB/s | 23 kB 00:00 2026-02-24T09:11:41.346 INFO:teuthology.orchestra.run.trial074.stdout:(152/183): python3-jaraco-context-6.0.1-3.el9.n 576 kB/s | 20 kB 00:00 2026-02-24T09:11:41.356 INFO:teuthology.orchestra.run.trial074.stdout:(153/183): python3-jaraco-functools-3.5.0-2.el9 582 kB/s | 19 kB 00:00 2026-02-24T09:11:41.361 INFO:teuthology.orchestra.run.trial028.stdout:(181/183): util-linux-2.37.4-25.el9.x86_64.rpm 5.6 MB/s | 2.3 MB 00:00 2026-02-24T09:11:41.372 INFO:teuthology.orchestra.run.trial074.stdout:(154/183): python3-jaraco-text-4.0.0-2.el9.noar 814 kB/s | 26 kB 00:00 2026-02-24T09:11:41.386 INFO:teuthology.orchestra.run.trial028.stdout:(182/183): util-linux-core-2.37.4-25.el9.x86_64 1.4 MB/s | 458 kB 00:00 2026-02-24T09:11:41.387 INFO:teuthology.orchestra.run.trial028.stdout:(183/183): libmount-2.37.4-25.el9.x86_64.rpm 187 kB/s | 133 kB 00:00 2026-02-24T09:11:41.390 INFO:teuthology.orchestra.run.trial074.stdout:(155/183): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2026-02-24T09:11:41.393 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-24T09:11:41.393 INFO:teuthology.orchestra.run.trial028.stdout:Total 16 MB/s | 296 MB 00:18 2026-02-24T09:11:41.405 INFO:teuthology.orchestra.run.trial074.stdout:(156/183): python3-msgpack-1.0.3-2.el9.x86_64.r 2.5 MB/s | 86 kB 00:00 2026-02-24T09:11:41.424 INFO:teuthology.orchestra.run.trial074.stdout:(157/183): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2026-02-24T09:11:41.427 INFO:teuthology.orchestra.run.trial074.stdout:(158/183): python3-kubernetes-26.1.0-3.el9.noar 13 MB/s | 1.0 MB 00:00 2026-02-24T09:11:41.438 INFO:teuthology.orchestra.run.trial074.stdout:(159/183): python3-portend-3.1.0-2.el9.noarch.r 504 kB/s | 16 kB 00:00 2026-02-24T09:11:41.458 INFO:teuthology.orchestra.run.trial074.stdout:(160/183): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.6 MB/s | 90 kB 00:00 2026-02-24T09:11:41.461 INFO:teuthology.orchestra.run.trial074.stdout:(161/183): python3-pyperclip-1.8.2-2.el9.noarch 827 kB/s | 28 kB 00:00 2026-02-24T09:11:41.471 INFO:teuthology.orchestra.run.trial074.stdout:(162/183): python3-repoze-lru-0.7-16.el9.noarch 926 kB/s | 31 kB 00:00 2026-02-24T09:11:41.494 INFO:teuthology.orchestra.run.trial074.stdout:(163/183): python3-routes-2.5.1-5.el9.noarch.rp 5.2 MB/s | 188 kB 00:00 2026-02-24T09:11:41.496 INFO:teuthology.orchestra.run.trial074.stdout:(164/183): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2026-02-24T09:11:41.506 INFO:teuthology.orchestra.run.trial074.stdout:(165/183): python3-saml-1.16.0-1.el9.noarch.rpm 3.6 MB/s | 125 kB 00:00 2026-02-24T09:11:41.531 INFO:teuthology.orchestra.run.trial074.stdout:(166/183): python3-tempora-5.0.0-2.el9.noarch.r 962 kB/s | 36 kB 00:00 2026-02-24T09:11:41.532 INFO:teuthology.orchestra.run.trial074.stdout:(167/183): python3-typing-extensions-4.15.0-1.e 2.4 MB/s | 86 kB 00:00 2026-02-24T09:11:41.540 INFO:teuthology.orchestra.run.trial074.stdout:(168/183): python3-websocket-client-1.2.3-2.el9 2.6 MB/s | 90 kB 00:00 2026-02-24T09:11:41.564 INFO:teuthology.orchestra.run.trial074.stdout:(169/183): python3-xmlsec-1.3.13-1.el9.x86_64.r 1.4 MB/s | 48 kB 00:00 2026-02-24T09:11:41.566 INFO:teuthology.orchestra.run.trial074.stdout:(170/183): python3-xmltodict-0.12.0-15.el9.noar 654 kB/s | 22 kB 00:00 2026-02-24T09:11:41.573 INFO:teuthology.orchestra.run.trial074.stdout:(171/183): python3-zc-lockfile-2.0-10.el9.noarc 613 kB/s | 20 kB 00:00 2026-02-24T09:11:41.600 INFO:teuthology.orchestra.run.trial074.stdout:(172/183): re2-20211101-20.el9.x86_64.rpm 5.3 MB/s | 191 kB 00:00 2026-02-24T09:11:41.606 INFO:teuthology.orchestra.run.trial074.stdout:(173/183): yaml-cpp-0.6.3-5.el9.x86_64.rpm 3.6 MB/s | 122 kB 00:00 2026-02-24T09:11:41.640 INFO:teuthology.orchestra.run.trial074.stdout:(174/183): thrift-0.15.0-4.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2026-02-24T09:11:41.733 INFO:teuthology.orchestra.run.trial159.stdout: Preparing : 1/1 2026-02-24T09:11:41.737 INFO:teuthology.orchestra.run.trial159.stdout: Upgrading : libuuid-2.37.4-25.el9.x86_64 1/192 2026-02-24T09:11:41.739 INFO:teuthology.orchestra.run.trial159.stdout: Upgrading : libblkid-2.37.4-25.el9.x86_64 2/192 2026-02-24T09:11:41.744 INFO:teuthology.orchestra.run.trial074.stdout:(175/183): librbd1-20.3.0-5537.g5bc9a1ff.el9.x8 20 MB/s | 2.8 MB 00:00 2026-02-24T09:11:41.763 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: libblkid-2.37.4-25.el9.x86_64 2/192 2026-02-24T09:11:41.773 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 3/192 2026-02-24T09:11:41.779 INFO:teuthology.orchestra.run.trial159.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/192 2026-02-24T09:11:41.793 INFO:teuthology.orchestra.run.trial159.stdout: Installing : liboath-2.6.12-1.el9.x86_64 5/192 2026-02-24T09:11:41.795 INFO:teuthology.orchestra.run.trial074.stdout:(176/183): librados2-20.3.0-5537.g5bc9a1ff.el9. 18 MB/s | 3.5 MB 00:00 2026-02-24T09:11:41.809 INFO:teuthology.orchestra.run.trial159.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 6/192 2026-02-24T09:11:41.991 INFO:teuthology.orchestra.run.trial159.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/192 2026-02-24T09:11:41.994 INFO:teuthology.orchestra.run.trial159.stdout: Upgrading : librados2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 8/192 2026-02-24T09:11:42.035 INFO:teuthology.orchestra.run.trial074.stdout:(177/183): libblkid-2.37.4-25.el9.x86_64.rpm 266 kB/s | 105 kB 00:00 2026-02-24T09:11:42.061 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: librados2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 8/192 2026-02-24T09:11:42.063 INFO:teuthology.orchestra.run.trial159.stdout: Installing : libcephfs2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 9/192 2026-02-24T09:11:42.088 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: libcephfs2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 9/192 2026-02-24T09:11:42.092 INFO:teuthology.orchestra.run.trial159.stdout: Installing : libcephfs-daemon-2:20.3.0-5537.g5bc9a1ff.el9.x86 10/192 2026-02-24T09:11:42.093 INFO:teuthology.orchestra.run.trial159.stdout: Installing : libcephfs-proxy2-2:20.3.0-5537.g5bc9a1ff.el9.x86 11/192 2026-02-24T09:11:42.133 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5537.g5bc9a1ff.el9.x86 11/192 2026-02-24T09:11:42.137 INFO:teuthology.orchestra.run.trial074.stdout:(178/183): libfdisk-2.37.4-25.el9.x86_64.rpm 386 kB/s | 152 kB 00:00 2026-02-24T09:11:42.145 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-rados-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 12/192 2026-02-24T09:11:42.150 INFO:teuthology.orchestra.run.trial159.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 13/192 2026-02-24T09:11:42.155 INFO:teuthology.orchestra.run.trial159.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 14/192 2026-02-24T09:11:42.159 INFO:teuthology.orchestra.run.trial159.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 15/192 2026-02-24T09:11:42.162 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 16/192 2026-02-24T09:11:42.170 INFO:teuthology.orchestra.run.trial159.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 17/192 2026-02-24T09:11:42.196 INFO:teuthology.orchestra.run.trial074.stdout:(179/183): libsmartcols-2.37.4-25.el9.x86_64.rp 379 kB/s | 61 kB 00:00 2026-02-24T09:11:42.296 INFO:teuthology.orchestra.run.trial074.stdout:(180/183): libuuid-2.37.4-25.el9.x86_64.rpm 162 kB/s | 26 kB 00:00 2026-02-24T09:11:42.305 INFO:teuthology.orchestra.run.trial159.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/192 2026-02-24T09:11:42.308 INFO:teuthology.orchestra.run.trial159.stdout: Upgrading : librbd1-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 19/192 2026-02-24T09:11:42.421 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: librbd1-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 19/192 2026-02-24T09:11:42.433 INFO:teuthology.orchestra.run.trial074.stdout:(181/183): libmount-2.37.4-25.el9.x86_64.rpm 208 kB/s | 133 kB 00:00 2026-02-24T09:11:42.436 INFO:teuthology.orchestra.run.trial159.stdout: Installing : postgresql-13.23-1.el9.x86_64 20/192 2026-02-24T09:11:42.438 INFO:teuthology.orchestra.run.trial159.stdout: Installing : libcephsqlite-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 21/192 2026-02-24T09:11:42.472 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 21/192 2026-02-24T09:11:42.474 INFO:teuthology.orchestra.run.trial159.stdout: Installing : libradosstriper1-2:20.3.0-5537.g5bc9a1ff.el9.x86 22/192 2026-02-24T09:11:42.546 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5537.g5bc9a1ff.el9.x86 22/192 2026-02-24T09:11:42.558 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 23/192 2026-02-24T09:11:42.563 INFO:teuthology.orchestra.run.trial159.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 24/192 2026-02-24T09:11:42.568 INFO:teuthology.orchestra.run.trial159.stdout: Upgrading : libmount-2.37.4-25.el9.x86_64 25/192 2026-02-24T09:11:42.573 INFO:teuthology.orchestra.run.trial159.stdout: Upgrading : libsmartcols-2.37.4-25.el9.x86_64 26/192 2026-02-24T09:11:42.579 INFO:teuthology.orchestra.run.trial159.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 27/192 2026-02-24T09:11:42.612 INFO:teuthology.orchestra.run.trial074.stdout:(182/183): util-linux-core-2.37.4-25.el9.x86_64 1.4 MB/s | 458 kB 00:00 2026-02-24T09:11:42.618 INFO:teuthology.orchestra.run.trial159.stdout: Installing : re2-1:20211101-20.el9.x86_64 28/192 2026-02-24T09:11:42.653 INFO:teuthology.orchestra.run.trial159.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 29/192 2026-02-24T09:11:42.661 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 30/192 2026-02-24T09:11:42.671 INFO:teuthology.orchestra.run.trial159.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 31/192 2026-02-24T09:11:42.671 INFO:teuthology.orchestra.run.trial074.stdout:(183/183): util-linux-2.37.4-25.el9.x86_64.rpm 4.8 MB/s | 2.3 MB 00:00 2026-02-24T09:11:42.675 INFO:teuthology.orchestra.run.trial074.stdout:-------------------------------------------------------------------------------- 2026-02-24T09:11:42.675 INFO:teuthology.orchestra.run.trial074.stdout:Total 17 MB/s | 296 MB 00:17 2026-02-24T09:11:42.676 INFO:teuthology.orchestra.run.trial159.stdout: Installing : lua-5.4.4-4.el9.x86_64 32/192 2026-02-24T09:11:42.684 INFO:teuthology.orchestra.run.trial159.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 33/192 2026-02-24T09:11:42.721 INFO:teuthology.orchestra.run.trial159.stdout: Installing : unzip-6.0-59.el9.x86_64 34/192 2026-02-24T09:11:42.742 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 35/192 2026-02-24T09:11:42.752 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 36/192 2026-02-24T09:11:42.758 INFO:teuthology.orchestra.run.trial159.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 37/192 2026-02-24T09:11:42.766 INFO:teuthology.orchestra.run.trial159.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 38/192 2026-02-24T09:11:42.769 INFO:teuthology.orchestra.run.trial159.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 39/192 2026-02-24T09:11:42.772 INFO:teuthology.orchestra.run.trial159.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 40/192 2026-02-24T09:11:42.787 INFO:teuthology.orchestra.run.trial159.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 41/192 2026-02-24T09:11:42.837 INFO:teuthology.orchestra.run.trial159.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 42/192 2026-02-24T09:11:42.845 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-ceph-common-2:20.3.0-5537.g5bc9a1ff.el9. 43/192 2026-02-24T09:11:42.857 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-ceph-argparse-2:20.3.0-5537.g5bc9a1ff.el 44/192 2026-02-24T09:11:42.875 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-cephfs-2:20.3.0-5537.g5bc9a1ff.el9.x86_6 45/192 2026-02-24T09:11:42.886 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 46/192 2026-02-24T09:11:42.924 INFO:teuthology.orchestra.run.trial159.stdout: Installing : zip-3.0-35.el9.x86_64 47/192 2026-02-24T09:11:42.931 INFO:teuthology.orchestra.run.trial159.stdout: Installing : luarocks-3.9.2-5.el9.noarch 48/192 2026-02-24T09:11:42.936 INFO:teuthology.orchestra.run.trial159.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 49/192 2026-02-24T09:11:42.941 INFO:teuthology.orchestra.run.trial159.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 50/192 2026-02-24T09:11:42.950 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction check 2026-02-24T09:11:42.981 INFO:teuthology.orchestra.run.trial159.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 51/192 2026-02-24T09:11:43.056 INFO:teuthology.orchestra.run.trial028.stdout:Transaction check succeeded. 2026-02-24T09:11:43.056 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction test 2026-02-24T09:11:43.056 INFO:teuthology.orchestra.run.trial159.stdout: Installing : automake-1.16.2-8.el9.noarch 52/192 2026-02-24T09:11:43.076 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 53/192 2026-02-24T09:11:43.120 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-rsa-4.9-2.el9.noarch 54/192 2026-02-24T09:11:43.127 INFO:teuthology.orchestra.run.trial159.stdout: Upgrading : util-linux-core-2.37.4-25.el9.x86_64 55/192 2026-02-24T09:11:43.144 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: util-linux-core-2.37.4-25.el9.x86_64 55/192 2026-02-24T09:11:43.152 INFO:teuthology.orchestra.run.trial159.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/192 2026-02-24T09:11:43.173 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 57/192 2026-02-24T09:11:43.181 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-rbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 58/192 2026-02-24T09:11:43.191 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 59/192 2026-02-24T09:11:43.203 INFO:teuthology.orchestra.run.trial159.stdout: Installing : librados-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_6 60/192 2026-02-24T09:11:43.210 INFO:teuthology.orchestra.run.trial159.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 61/192 2026-02-24T09:11:43.242 INFO:teuthology.orchestra.run.trial159.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 62/192 2026-02-24T09:11:43.248 INFO:teuthology.orchestra.run.trial159.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 63/192 2026-02-24T09:11:43.393 INFO:teuthology.orchestra.run.trial159.stdout: Upgrading : libfdisk-2.37.4-25.el9.x86_64 64/192 2026-02-24T09:11:43.565 INFO:teuthology.orchestra.run.trial159.stdout: Upgrading : util-linux-2.37.4-25.el9.x86_64 65/192 2026-02-24T09:11:43.570 INFO:teuthology.orchestra.run.trial159.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 66/192 2026-02-24T09:11:44.125 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 66/192 2026-02-24T09:11:44.125 INFO:teuthology.orchestra.run.trial159.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-24T09:11:44.125 INFO:teuthology.orchestra.run.trial159.stdout: 2026-02-24T09:11:44.148 INFO:teuthology.orchestra.run.trial159.stdout: Installing : libuuid-devel-2.37.4-25.el9.x86_64 67/192 2026-02-24T09:11:44.158 INFO:teuthology.orchestra.run.trial159.stdout: Installing : thrift-0.15.0-4.el9.x86_64 68/192 2026-02-24T09:11:44.168 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 69/192 2026-02-24T09:11:44.197 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 70/192 2026-02-24T09:11:44.205 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 71/192 2026-02-24T09:11:44.207 INFO:teuthology.orchestra.run.trial074.stdout:Running transaction check 2026-02-24T09:11:44.215 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 72/192 2026-02-24T09:11:44.233 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 73/192 2026-02-24T09:11:44.242 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 74/192 2026-02-24T09:11:44.257 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 75/192 2026-02-24T09:11:44.268 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 76/192 2026-02-24T09:11:44.299 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 77/192 2026-02-24T09:11:44.315 INFO:teuthology.orchestra.run.trial074.stdout:Transaction check succeeded. 2026-02-24T09:11:44.315 INFO:teuthology.orchestra.run.trial074.stdout:Running transaction test 2026-02-24T09:11:44.317 INFO:teuthology.orchestra.run.trial028.stdout:Transaction test succeeded. 2026-02-24T09:11:44.317 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction 2026-02-24T09:11:44.318 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 78/192 2026-02-24T09:11:44.342 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 79/192 2026-02-24T09:11:44.351 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 80/192 2026-02-24T09:11:44.363 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 81/192 2026-02-24T09:11:44.424 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 82/192 2026-02-24T09:11:44.890 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 83/192 2026-02-24T09:11:44.909 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 84/192 2026-02-24T09:11:44.916 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 85/192 2026-02-24T09:11:44.926 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 86/192 2026-02-24T09:11:44.932 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 87/192 2026-02-24T09:11:44.940 INFO:teuthology.orchestra.run.trial159.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/192 2026-02-24T09:11:44.945 INFO:teuthology.orchestra.run.trial159.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 89/192 2026-02-24T09:11:44.948 INFO:teuthology.orchestra.run.trial159.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 90/192 2026-02-24T09:11:44.992 INFO:teuthology.orchestra.run.trial159.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/192 2026-02-24T09:11:45.061 INFO:teuthology.orchestra.run.trial159.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 92/192 2026-02-24T09:11:45.069 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/192 2026-02-24T09:11:45.075 INFO:teuthology.orchestra.run.trial159.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 94/192 2026-02-24T09:11:45.088 INFO:teuthology.orchestra.run.trial159.stdout: Installing : uuid-1.6.2-55.el9.x86_64 95/192 2026-02-24T09:11:45.099 INFO:teuthology.orchestra.run.trial159.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 96/192 2026-02-24T09:11:45.141 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 97/192 2026-02-24T09:11:45.152 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 98/192 2026-02-24T09:11:45.159 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 99/192 2026-02-24T09:11:45.169 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 100/192 2026-02-24T09:11:45.176 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 101/192 2026-02-24T09:11:45.187 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 102/192 2026-02-24T09:11:45.194 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 103/192 2026-02-24T09:11:45.237 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 104/192 2026-02-24T09:11:45.254 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 105/192 2026-02-24T09:11:45.265 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 106/192 2026-02-24T09:11:45.277 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 107/192 2026-02-24T09:11:45.328 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 108/192 2026-02-24T09:11:45.347 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 109/192 2026-02-24T09:11:45.576 INFO:teuthology.orchestra.run.trial074.stdout:Transaction test succeeded. 2026-02-24T09:11:45.577 INFO:teuthology.orchestra.run.trial074.stdout:Running transaction 2026-02-24T09:11:45.649 INFO:teuthology.orchestra.run.trial028.stdout: Preparing : 1/1 2026-02-24T09:11:45.651 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 110/192 2026-02-24T09:11:45.654 INFO:teuthology.orchestra.run.trial028.stdout: Upgrading : libuuid-2.37.4-25.el9.x86_64 1/192 2026-02-24T09:11:45.655 INFO:teuthology.orchestra.run.trial028.stdout: Upgrading : libblkid-2.37.4-25.el9.x86_64 2/192 2026-02-24T09:11:45.680 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libblkid-2.37.4-25.el9.x86_64 2/192 2026-02-24T09:11:45.690 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 111/192 2026-02-24T09:11:45.690 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 3/192 2026-02-24T09:11:45.697 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/192 2026-02-24T09:11:45.697 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 112/192 2026-02-24T09:11:45.709 INFO:teuthology.orchestra.run.trial028.stdout: Installing : liboath-2.6.12-1.el9.x86_64 5/192 2026-02-24T09:11:45.726 INFO:teuthology.orchestra.run.trial028.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 6/192 2026-02-24T09:11:45.770 INFO:teuthology.orchestra.run.trial159.stdout: Installing : openblas-0.3.29-1.el9.x86_64 113/192 2026-02-24T09:11:45.774 INFO:teuthology.orchestra.run.trial159.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 114/192 2026-02-24T09:11:45.801 INFO:teuthology.orchestra.run.trial159.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 115/192 2026-02-24T09:11:45.892 INFO:teuthology.orchestra.run.trial028.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/192 2026-02-24T09:11:45.895 INFO:teuthology.orchestra.run.trial028.stdout: Upgrading : librados2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 8/192 2026-02-24T09:11:45.965 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: librados2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 8/192 2026-02-24T09:11:45.968 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libcephfs2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 9/192 2026-02-24T09:11:45.993 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libcephfs2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 9/192 2026-02-24T09:11:45.997 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libcephfs-daemon-2:20.3.0-5537.g5bc9a1ff.el9.x86 10/192 2026-02-24T09:11:45.998 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libcephfs-proxy2-2:20.3.0-5537.g5bc9a1ff.el9.x86 11/192 2026-02-24T09:11:46.039 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5537.g5bc9a1ff.el9.x86 11/192 2026-02-24T09:11:46.051 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-rados-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 12/192 2026-02-24T09:11:46.056 INFO:teuthology.orchestra.run.trial028.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 13/192 2026-02-24T09:11:46.063 INFO:teuthology.orchestra.run.trial028.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 14/192 2026-02-24T09:11:46.067 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 15/192 2026-02-24T09:11:46.070 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 16/192 2026-02-24T09:11:46.078 INFO:teuthology.orchestra.run.trial028.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 17/192 2026-02-24T09:11:46.211 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/192 2026-02-24T09:11:46.214 INFO:teuthology.orchestra.run.trial028.stdout: Upgrading : librbd1-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 19/192 2026-02-24T09:11:46.268 INFO:teuthology.orchestra.run.trial159.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 116/192 2026-02-24T09:11:46.328 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: librbd1-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 19/192 2026-02-24T09:11:46.343 INFO:teuthology.orchestra.run.trial028.stdout: Installing : postgresql-13.23-1.el9.x86_64 20/192 2026-02-24T09:11:46.345 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libcephsqlite-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 21/192 2026-02-24T09:11:46.379 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 21/192 2026-02-24T09:11:46.381 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libradosstriper1-2:20.3.0-5537.g5bc9a1ff.el9.x86 22/192 2026-02-24T09:11:46.385 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 117/192 2026-02-24T09:11:46.454 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5537.g5bc9a1ff.el9.x86 22/192 2026-02-24T09:11:46.465 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 23/192 2026-02-24T09:11:46.470 INFO:teuthology.orchestra.run.trial028.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 24/192 2026-02-24T09:11:46.475 INFO:teuthology.orchestra.run.trial028.stdout: Upgrading : libmount-2.37.4-25.el9.x86_64 25/192 2026-02-24T09:11:46.480 INFO:teuthology.orchestra.run.trial028.stdout: Upgrading : libsmartcols-2.37.4-25.el9.x86_64 26/192 2026-02-24T09:11:46.486 INFO:teuthology.orchestra.run.trial028.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 27/192 2026-02-24T09:11:46.525 INFO:teuthology.orchestra.run.trial028.stdout: Installing : re2-1:20211101-20.el9.x86_64 28/192 2026-02-24T09:11:46.559 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 29/192 2026-02-24T09:11:46.567 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 30/192 2026-02-24T09:11:46.576 INFO:teuthology.orchestra.run.trial028.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 31/192 2026-02-24T09:11:46.580 INFO:teuthology.orchestra.run.trial028.stdout: Installing : lua-5.4.4-4.el9.x86_64 32/192 2026-02-24T09:11:46.588 INFO:teuthology.orchestra.run.trial028.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 33/192 2026-02-24T09:11:46.625 INFO:teuthology.orchestra.run.trial028.stdout: Installing : unzip-6.0-59.el9.x86_64 34/192 2026-02-24T09:11:46.646 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 35/192 2026-02-24T09:11:46.656 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 36/192 2026-02-24T09:11:46.662 INFO:teuthology.orchestra.run.trial028.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 37/192 2026-02-24T09:11:46.670 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 38/192 2026-02-24T09:11:46.673 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 39/192 2026-02-24T09:11:46.676 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 40/192 2026-02-24T09:11:46.691 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 41/192 2026-02-24T09:11:46.741 INFO:teuthology.orchestra.run.trial028.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 42/192 2026-02-24T09:11:46.749 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-ceph-common-2:20.3.0-5537.g5bc9a1ff.el9. 43/192 2026-02-24T09:11:46.761 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-ceph-argparse-2:20.3.0-5537.g5bc9a1ff.el 44/192 2026-02-24T09:11:46.779 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cephfs-2:20.3.0-5537.g5bc9a1ff.el9.x86_6 45/192 2026-02-24T09:11:46.790 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 46/192 2026-02-24T09:11:46.828 INFO:teuthology.orchestra.run.trial028.stdout: Installing : zip-3.0-35.el9.x86_64 47/192 2026-02-24T09:11:46.835 INFO:teuthology.orchestra.run.trial028.stdout: Installing : luarocks-3.9.2-5.el9.noarch 48/192 2026-02-24T09:11:46.840 INFO:teuthology.orchestra.run.trial028.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 49/192 2026-02-24T09:11:46.845 INFO:teuthology.orchestra.run.trial028.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 50/192 2026-02-24T09:11:46.885 INFO:teuthology.orchestra.run.trial028.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 51/192 2026-02-24T09:11:46.910 INFO:teuthology.orchestra.run.trial074.stdout: Preparing : 1/1 2026-02-24T09:11:46.915 INFO:teuthology.orchestra.run.trial074.stdout: Upgrading : libuuid-2.37.4-25.el9.x86_64 1/192 2026-02-24T09:11:46.917 INFO:teuthology.orchestra.run.trial074.stdout: Upgrading : libblkid-2.37.4-25.el9.x86_64 2/192 2026-02-24T09:11:46.940 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: libblkid-2.37.4-25.el9.x86_64 2/192 2026-02-24T09:11:46.951 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 3/192 2026-02-24T09:11:46.957 INFO:teuthology.orchestra.run.trial074.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/192 2026-02-24T09:11:46.961 INFO:teuthology.orchestra.run.trial028.stdout: Installing : automake-1.16.2-8.el9.noarch 52/192 2026-02-24T09:11:46.970 INFO:teuthology.orchestra.run.trial074.stdout: Installing : liboath-2.6.12-1.el9.x86_64 5/192 2026-02-24T09:11:46.982 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 53/192 2026-02-24T09:11:46.987 INFO:teuthology.orchestra.run.trial074.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 6/192 2026-02-24T09:11:47.025 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-rsa-4.9-2.el9.noarch 54/192 2026-02-24T09:11:47.032 INFO:teuthology.orchestra.run.trial028.stdout: Upgrading : util-linux-core-2.37.4-25.el9.x86_64 55/192 2026-02-24T09:11:47.049 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: util-linux-core-2.37.4-25.el9.x86_64 55/192 2026-02-24T09:11:47.057 INFO:teuthology.orchestra.run.trial028.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/192 2026-02-24T09:11:47.078 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 57/192 2026-02-24T09:11:47.086 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-rbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 58/192 2026-02-24T09:11:47.096 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 59/192 2026-02-24T09:11:47.108 INFO:teuthology.orchestra.run.trial028.stdout: Installing : librados-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_6 60/192 2026-02-24T09:11:47.115 INFO:teuthology.orchestra.run.trial028.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 61/192 2026-02-24T09:11:47.147 INFO:teuthology.orchestra.run.trial028.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 62/192 2026-02-24T09:11:47.153 INFO:teuthology.orchestra.run.trial028.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 63/192 2026-02-24T09:11:47.165 INFO:teuthology.orchestra.run.trial074.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/192 2026-02-24T09:11:47.168 INFO:teuthology.orchestra.run.trial074.stdout: Upgrading : librados2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 8/192 2026-02-24T09:11:47.233 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: librados2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 8/192 2026-02-24T09:11:47.236 INFO:teuthology.orchestra.run.trial074.stdout: Installing : libcephfs2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 9/192 2026-02-24T09:11:47.260 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: libcephfs2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 9/192 2026-02-24T09:11:47.263 INFO:teuthology.orchestra.run.trial074.stdout: Installing : libcephfs-daemon-2:20.3.0-5537.g5bc9a1ff.el9.x86 10/192 2026-02-24T09:11:47.265 INFO:teuthology.orchestra.run.trial074.stdout: Installing : libcephfs-proxy2-2:20.3.0-5537.g5bc9a1ff.el9.x86 11/192 2026-02-24T09:11:47.298 INFO:teuthology.orchestra.run.trial028.stdout: Upgrading : libfdisk-2.37.4-25.el9.x86_64 64/192 2026-02-24T09:11:47.305 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5537.g5bc9a1ff.el9.x86 11/192 2026-02-24T09:11:47.317 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-rados-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 12/192 2026-02-24T09:11:47.321 INFO:teuthology.orchestra.run.trial074.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 13/192 2026-02-24T09:11:47.327 INFO:teuthology.orchestra.run.trial074.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 14/192 2026-02-24T09:11:47.331 INFO:teuthology.orchestra.run.trial074.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 15/192 2026-02-24T09:11:47.335 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 16/192 2026-02-24T09:11:47.343 INFO:teuthology.orchestra.run.trial074.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 17/192 2026-02-24T09:11:47.354 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 118/192 2026-02-24T09:11:47.386 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 119/192 2026-02-24T09:11:47.389 INFO:teuthology.orchestra.run.trial159.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 120/192 2026-02-24T09:11:47.398 INFO:teuthology.orchestra.run.trial159.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 121/192 2026-02-24T09:11:47.470 INFO:teuthology.orchestra.run.trial028.stdout: Upgrading : util-linux-2.37.4-25.el9.x86_64 65/192 2026-02-24T09:11:47.475 INFO:teuthology.orchestra.run.trial028.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 66/192 2026-02-24T09:11:47.482 INFO:teuthology.orchestra.run.trial074.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/192 2026-02-24T09:11:47.485 INFO:teuthology.orchestra.run.trial074.stdout: Upgrading : librbd1-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 19/192 2026-02-24T09:11:47.598 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: librbd1-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 19/192 2026-02-24T09:11:47.613 INFO:teuthology.orchestra.run.trial074.stdout: Installing : postgresql-13.23-1.el9.x86_64 20/192 2026-02-24T09:11:47.615 INFO:teuthology.orchestra.run.trial074.stdout: Installing : libcephsqlite-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 21/192 2026-02-24T09:11:47.648 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 21/192 2026-02-24T09:11:47.651 INFO:teuthology.orchestra.run.trial074.stdout: Installing : libradosstriper1-2:20.3.0-5537.g5bc9a1ff.el9.x86 22/192 2026-02-24T09:11:47.702 INFO:teuthology.orchestra.run.trial159.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 122/192 2026-02-24T09:11:47.705 INFO:teuthology.orchestra.run.trial159.stdout: Installing : librgw2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 123/192 2026-02-24T09:11:47.722 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5537.g5bc9a1ff.el9.x86 22/192 2026-02-24T09:11:47.734 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 23/192 2026-02-24T09:11:47.739 INFO:teuthology.orchestra.run.trial074.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 24/192 2026-02-24T09:11:47.743 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: librgw2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 123/192 2026-02-24T09:11:47.744 INFO:teuthology.orchestra.run.trial074.stdout: Upgrading : libmount-2.37.4-25.el9.x86_64 25/192 2026-02-24T09:11:47.745 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-rgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 124/192 2026-02-24T09:11:47.749 INFO:teuthology.orchestra.run.trial074.stdout: Upgrading : libsmartcols-2.37.4-25.el9.x86_64 26/192 2026-02-24T09:11:47.755 INFO:teuthology.orchestra.run.trial074.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 27/192 2026-02-24T09:11:47.794 INFO:teuthology.orchestra.run.trial074.stdout: Installing : re2-1:20211101-20.el9.x86_64 28/192 2026-02-24T09:11:47.828 INFO:teuthology.orchestra.run.trial074.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 29/192 2026-02-24T09:11:47.837 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 30/192 2026-02-24T09:11:47.845 INFO:teuthology.orchestra.run.trial074.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 31/192 2026-02-24T09:11:47.850 INFO:teuthology.orchestra.run.trial074.stdout: Installing : lua-5.4.4-4.el9.x86_64 32/192 2026-02-24T09:11:47.858 INFO:teuthology.orchestra.run.trial074.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 33/192 2026-02-24T09:11:47.895 INFO:teuthology.orchestra.run.trial074.stdout: Installing : unzip-6.0-59.el9.x86_64 34/192 2026-02-24T09:11:47.916 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 35/192 2026-02-24T09:11:47.926 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 36/192 2026-02-24T09:11:47.932 INFO:teuthology.orchestra.run.trial074.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 37/192 2026-02-24T09:11:47.940 INFO:teuthology.orchestra.run.trial074.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 38/192 2026-02-24T09:11:47.943 INFO:teuthology.orchestra.run.trial074.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 39/192 2026-02-24T09:11:47.946 INFO:teuthology.orchestra.run.trial074.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 40/192 2026-02-24T09:11:47.961 INFO:teuthology.orchestra.run.trial074.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 41/192 2026-02-24T09:11:48.011 INFO:teuthology.orchestra.run.trial074.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 42/192 2026-02-24T09:11:48.019 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-ceph-common-2:20.3.0-5537.g5bc9a1ff.el9. 43/192 2026-02-24T09:11:48.031 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-ceph-argparse-2:20.3.0-5537.g5bc9a1ff.el 44/192 2026-02-24T09:11:48.047 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 66/192 2026-02-24T09:11:48.047 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-24T09:11:48.047 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:11:48.049 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-cephfs-2:20.3.0-5537.g5bc9a1ff.el9.x86_6 45/192 2026-02-24T09:11:48.059 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 46/192 2026-02-24T09:11:48.074 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libuuid-devel-2.37.4-25.el9.x86_64 67/192 2026-02-24T09:11:48.084 INFO:teuthology.orchestra.run.trial028.stdout: Installing : thrift-0.15.0-4.el9.x86_64 68/192 2026-02-24T09:11:48.090 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 69/192 2026-02-24T09:11:48.097 INFO:teuthology.orchestra.run.trial074.stdout: Installing : zip-3.0-35.el9.x86_64 47/192 2026-02-24T09:11:48.104 INFO:teuthology.orchestra.run.trial074.stdout: Installing : luarocks-3.9.2-5.el9.noarch 48/192 2026-02-24T09:11:48.110 INFO:teuthology.orchestra.run.trial074.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 49/192 2026-02-24T09:11:48.114 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 70/192 2026-02-24T09:11:48.115 INFO:teuthology.orchestra.run.trial074.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 50/192 2026-02-24T09:11:48.124 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 71/192 2026-02-24T09:11:48.133 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 72/192 2026-02-24T09:11:48.152 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 73/192 2026-02-24T09:11:48.155 INFO:teuthology.orchestra.run.trial074.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 51/192 2026-02-24T09:11:48.162 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 74/192 2026-02-24T09:11:48.176 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 75/192 2026-02-24T09:11:48.188 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 76/192 2026-02-24T09:11:48.220 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 77/192 2026-02-24T09:11:48.229 INFO:teuthology.orchestra.run.trial074.stdout: Installing : automake-1.16.2-8.el9.noarch 52/192 2026-02-24T09:11:48.238 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 78/192 2026-02-24T09:11:48.250 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 53/192 2026-02-24T09:11:48.264 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 79/192 2026-02-24T09:11:48.272 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 80/192 2026-02-24T09:11:48.285 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 81/192 2026-02-24T09:11:48.292 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-rsa-4.9-2.el9.noarch 54/192 2026-02-24T09:11:48.299 INFO:teuthology.orchestra.run.trial074.stdout: Upgrading : util-linux-core-2.37.4-25.el9.x86_64 55/192 2026-02-24T09:11:48.316 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: util-linux-core-2.37.4-25.el9.x86_64 55/192 2026-02-24T09:11:48.324 INFO:teuthology.orchestra.run.trial074.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/192 2026-02-24T09:11:48.344 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 57/192 2026-02-24T09:11:48.347 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 82/192 2026-02-24T09:11:48.353 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-rbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 58/192 2026-02-24T09:11:48.362 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 59/192 2026-02-24T09:11:48.374 INFO:teuthology.orchestra.run.trial074.stdout: Installing : librados-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_6 60/192 2026-02-24T09:11:48.381 INFO:teuthology.orchestra.run.trial074.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 61/192 2026-02-24T09:11:48.413 INFO:teuthology.orchestra.run.trial074.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 62/192 2026-02-24T09:11:48.419 INFO:teuthology.orchestra.run.trial074.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 63/192 2026-02-24T09:11:48.564 INFO:teuthology.orchestra.run.trial074.stdout: Upgrading : libfdisk-2.37.4-25.el9.x86_64 64/192 2026-02-24T09:11:48.736 INFO:teuthology.orchestra.run.trial074.stdout: Upgrading : util-linux-2.37.4-25.el9.x86_64 65/192 2026-02-24T09:11:48.741 INFO:teuthology.orchestra.run.trial074.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 66/192 2026-02-24T09:11:48.819 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 83/192 2026-02-24T09:11:48.837 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 84/192 2026-02-24T09:11:48.846 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 85/192 2026-02-24T09:11:48.856 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 86/192 2026-02-24T09:11:48.863 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 87/192 2026-02-24T09:11:48.871 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/192 2026-02-24T09:11:48.876 INFO:teuthology.orchestra.run.trial028.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 89/192 2026-02-24T09:11:48.879 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 90/192 2026-02-24T09:11:48.923 INFO:teuthology.orchestra.run.trial028.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/192 2026-02-24T09:11:48.949 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 125/192 2026-02-24T09:11:48.956 INFO:teuthology.orchestra.run.trial159.stdout: Installing : ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 125/192 2026-02-24T09:11:48.991 INFO:teuthology.orchestra.run.trial028.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 92/192 2026-02-24T09:11:48.993 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 125/192 2026-02-24T09:11:48.999 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/192 2026-02-24T09:11:49.005 INFO:teuthology.orchestra.run.trial028.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 94/192 2026-02-24T09:11:49.009 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 126/192 2026-02-24T09:11:49.018 INFO:teuthology.orchestra.run.trial028.stdout: Installing : uuid-1.6.2-55.el9.x86_64 95/192 2026-02-24T09:11:49.021 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-packaging-20.9-5.el9.noarch 127/192 2026-02-24T09:11:49.030 INFO:teuthology.orchestra.run.trial028.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 96/192 2026-02-24T09:11:49.042 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-ply-3.11-14.el9.noarch 128/192 2026-02-24T09:11:49.066 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 129/192 2026-02-24T09:11:49.071 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 97/192 2026-02-24T09:11:49.083 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 98/192 2026-02-24T09:11:49.089 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 99/192 2026-02-24T09:11:49.099 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 100/192 2026-02-24T09:11:49.106 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 101/192 2026-02-24T09:11:49.117 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 102/192 2026-02-24T09:11:49.124 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 103/192 2026-02-24T09:11:49.166 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 104/192 2026-02-24T09:11:49.183 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 130/192 2026-02-24T09:11:49.183 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 105/192 2026-02-24T09:11:49.194 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 106/192 2026-02-24T09:11:49.200 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 131/192 2026-02-24T09:11:49.206 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 107/192 2026-02-24T09:11:49.235 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 132/192 2026-02-24T09:11:49.257 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 108/192 2026-02-24T09:11:49.276 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 109/192 2026-02-24T09:11:49.281 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 133/192 2026-02-24T09:11:49.302 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 66/192 2026-02-24T09:11:49.302 INFO:teuthology.orchestra.run.trial074.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-24T09:11:49.302 INFO:teuthology.orchestra.run.trial074.stdout: 2026-02-24T09:11:49.329 INFO:teuthology.orchestra.run.trial074.stdout: Installing : libuuid-devel-2.37.4-25.el9.x86_64 67/192 2026-02-24T09:11:49.343 INFO:teuthology.orchestra.run.trial074.stdout: Installing : thrift-0.15.0-4.el9.x86_64 68/192 2026-02-24T09:11:49.348 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 69/192 2026-02-24T09:11:49.355 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 134/192 2026-02-24T09:11:49.366 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 135/192 2026-02-24T09:11:49.371 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 70/192 2026-02-24T09:11:49.373 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 136/192 2026-02-24T09:11:49.380 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 71/192 2026-02-24T09:11:49.380 INFO:teuthology.orchestra.run.trial159.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 137/192 2026-02-24T09:11:49.385 INFO:teuthology.orchestra.run.trial159.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 138/192 2026-02-24T09:11:49.387 INFO:teuthology.orchestra.run.trial159.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 139/192 2026-02-24T09:11:49.389 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 72/192 2026-02-24T09:11:49.407 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 73/192 2026-02-24T09:11:49.416 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 74/192 2026-02-24T09:11:49.423 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 139/192 2026-02-24T09:11:49.430 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 75/192 2026-02-24T09:11:49.441 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 76/192 2026-02-24T09:11:49.473 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 77/192 2026-02-24T09:11:49.491 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 78/192 2026-02-24T09:11:49.515 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 79/192 2026-02-24T09:11:49.524 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 80/192 2026-02-24T09:11:49.536 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 81/192 2026-02-24T09:11:49.580 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 110/192 2026-02-24T09:11:49.596 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 82/192 2026-02-24T09:11:49.620 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 111/192 2026-02-24T09:11:49.627 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 112/192 2026-02-24T09:11:49.701 INFO:teuthology.orchestra.run.trial028.stdout: Installing : openblas-0.3.29-1.el9.x86_64 113/192 2026-02-24T09:11:49.705 INFO:teuthology.orchestra.run.trial028.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 114/192 2026-02-24T09:11:49.710 INFO:teuthology.orchestra.run.trial159.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 140/192 2026-02-24T09:11:49.718 INFO:teuthology.orchestra.run.trial159.stdout: Installing : ceph-base-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 141/192 2026-02-24T09:11:49.732 INFO:teuthology.orchestra.run.trial028.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 115/192 2026-02-24T09:11:49.788 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: ceph-base-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 141/192 2026-02-24T09:11:49.788 INFO:teuthology.orchestra.run.trial159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-24T09:11:49.788 INFO:teuthology.orchestra.run.trial159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-24T09:11:49.789 INFO:teuthology.orchestra.run.trial159.stdout: 2026-02-24T09:11:49.795 INFO:teuthology.orchestra.run.trial159.stdout: Installing : ceph-selinux-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 142/192 2026-02-24T09:11:50.060 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 83/192 2026-02-24T09:11:50.079 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 84/192 2026-02-24T09:11:50.087 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 85/192 2026-02-24T09:11:50.096 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 86/192 2026-02-24T09:11:50.102 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 87/192 2026-02-24T09:11:50.111 INFO:teuthology.orchestra.run.trial074.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/192 2026-02-24T09:11:50.115 INFO:teuthology.orchestra.run.trial074.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 89/192 2026-02-24T09:11:50.118 INFO:teuthology.orchestra.run.trial074.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 90/192 2026-02-24T09:11:50.162 INFO:teuthology.orchestra.run.trial074.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/192 2026-02-24T09:11:50.203 INFO:teuthology.orchestra.run.trial028.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 116/192 2026-02-24T09:11:50.229 INFO:teuthology.orchestra.run.trial074.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 92/192 2026-02-24T09:11:50.238 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/192 2026-02-24T09:11:50.244 INFO:teuthology.orchestra.run.trial074.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 94/192 2026-02-24T09:11:50.257 INFO:teuthology.orchestra.run.trial074.stdout: Installing : uuid-1.6.2-55.el9.x86_64 95/192 2026-02-24T09:11:50.268 INFO:teuthology.orchestra.run.trial074.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 96/192 2026-02-24T09:11:50.309 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 97/192 2026-02-24T09:11:50.319 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 117/192 2026-02-24T09:11:50.320 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 98/192 2026-02-24T09:11:50.327 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 99/192 2026-02-24T09:11:50.337 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 100/192 2026-02-24T09:11:50.344 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 101/192 2026-02-24T09:11:50.356 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 102/192 2026-02-24T09:11:50.362 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 103/192 2026-02-24T09:11:50.404 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 104/192 2026-02-24T09:11:50.421 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 105/192 2026-02-24T09:11:50.431 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 106/192 2026-02-24T09:11:50.443 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 107/192 2026-02-24T09:11:50.494 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 108/192 2026-02-24T09:11:50.513 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 109/192 2026-02-24T09:11:50.815 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 110/192 2026-02-24T09:11:50.854 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 111/192 2026-02-24T09:11:50.862 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 112/192 2026-02-24T09:11:50.936 INFO:teuthology.orchestra.run.trial074.stdout: Installing : openblas-0.3.29-1.el9.x86_64 113/192 2026-02-24T09:11:50.939 INFO:teuthology.orchestra.run.trial074.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 114/192 2026-02-24T09:11:50.967 INFO:teuthology.orchestra.run.trial074.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 115/192 2026-02-24T09:11:51.294 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 118/192 2026-02-24T09:11:51.325 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 119/192 2026-02-24T09:11:51.329 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 120/192 2026-02-24T09:11:51.337 INFO:teuthology.orchestra.run.trial028.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 121/192 2026-02-24T09:11:51.431 INFO:teuthology.orchestra.run.trial074.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 116/192 2026-02-24T09:11:51.547 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 117/192 2026-02-24T09:11:51.637 INFO:teuthology.orchestra.run.trial028.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 122/192 2026-02-24T09:11:51.640 INFO:teuthology.orchestra.run.trial028.stdout: Installing : librgw2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 123/192 2026-02-24T09:11:51.679 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: librgw2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 123/192 2026-02-24T09:11:51.681 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-rgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 124/192 2026-02-24T09:11:52.508 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 118/192 2026-02-24T09:11:52.541 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 119/192 2026-02-24T09:11:52.545 INFO:teuthology.orchestra.run.trial074.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 120/192 2026-02-24T09:11:52.552 INFO:teuthology.orchestra.run.trial074.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 121/192 2026-02-24T09:11:52.860 INFO:teuthology.orchestra.run.trial074.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 122/192 2026-02-24T09:11:52.863 INFO:teuthology.orchestra.run.trial074.stdout: Installing : librgw2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 123/192 2026-02-24T09:11:52.865 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 125/192 2026-02-24T09:11:52.872 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 125/192 2026-02-24T09:11:52.906 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: librgw2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 123/192 2026-02-24T09:11:52.908 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-rgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 124/192 2026-02-24T09:11:52.909 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 125/192 2026-02-24T09:11:52.926 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 126/192 2026-02-24T09:11:52.937 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-packaging-20.9-5.el9.noarch 127/192 2026-02-24T09:11:52.959 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-ply-3.11-14.el9.noarch 128/192 2026-02-24T09:11:52.983 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 129/192 2026-02-24T09:11:53.101 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 130/192 2026-02-24T09:11:53.118 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 131/192 2026-02-24T09:11:53.153 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 132/192 2026-02-24T09:11:53.199 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 133/192 2026-02-24T09:11:53.273 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 134/192 2026-02-24T09:11:53.285 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 135/192 2026-02-24T09:11:53.292 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 136/192 2026-02-24T09:11:53.299 INFO:teuthology.orchestra.run.trial028.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 137/192 2026-02-24T09:11:53.303 INFO:teuthology.orchestra.run.trial028.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 138/192 2026-02-24T09:11:53.305 INFO:teuthology.orchestra.run.trial028.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 139/192 2026-02-24T09:11:53.342 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 139/192 2026-02-24T09:11:53.625 INFO:teuthology.orchestra.run.trial028.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 140/192 2026-02-24T09:11:53.633 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-base-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 141/192 2026-02-24T09:11:53.702 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-base-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 141/192 2026-02-24T09:11:53.702 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-24T09:11:53.702 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-24T09:11:53.703 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:11:53.709 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-selinux-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 142/192 2026-02-24T09:11:54.117 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 125/192 2026-02-24T09:11:54.123 INFO:teuthology.orchestra.run.trial074.stdout: Installing : ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 125/192 2026-02-24T09:11:54.158 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 125/192 2026-02-24T09:11:54.174 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 126/192 2026-02-24T09:11:54.186 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-packaging-20.9-5.el9.noarch 127/192 2026-02-24T09:11:54.207 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-ply-3.11-14.el9.noarch 128/192 2026-02-24T09:11:54.231 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 129/192 2026-02-24T09:11:54.346 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 130/192 2026-02-24T09:11:54.363 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 131/192 2026-02-24T09:11:54.399 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 132/192 2026-02-24T09:11:54.445 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 133/192 2026-02-24T09:11:54.519 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 134/192 2026-02-24T09:11:54.530 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 135/192 2026-02-24T09:11:54.537 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 136/192 2026-02-24T09:11:54.544 INFO:teuthology.orchestra.run.trial074.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 137/192 2026-02-24T09:11:54.549 INFO:teuthology.orchestra.run.trial074.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 138/192 2026-02-24T09:11:54.550 INFO:teuthology.orchestra.run.trial074.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 139/192 2026-02-24T09:11:54.586 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 139/192 2026-02-24T09:11:54.873 INFO:teuthology.orchestra.run.trial074.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 140/192 2026-02-24T09:11:54.881 INFO:teuthology.orchestra.run.trial074.stdout: Installing : ceph-base-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 141/192 2026-02-24T09:11:54.950 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: ceph-base-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 141/192 2026-02-24T09:11:54.950 INFO:teuthology.orchestra.run.trial074.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-24T09:11:54.951 INFO:teuthology.orchestra.run.trial074.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-24T09:11:54.951 INFO:teuthology.orchestra.run.trial074.stdout: 2026-02-24T09:11:54.957 INFO:teuthology.orchestra.run.trial074.stdout: Installing : ceph-selinux-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 142/192 2026-02-24T09:11:55.911 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 142/192 2026-02-24T09:11:55.911 INFO:teuthology.orchestra.run.trial159.stdout:skipping the directory /sys 2026-02-24T09:11:55.911 INFO:teuthology.orchestra.run.trial159.stdout:skipping the directory /proc 2026-02-24T09:11:55.911 INFO:teuthology.orchestra.run.trial159.stdout:skipping the directory /mnt 2026-02-24T09:11:55.911 INFO:teuthology.orchestra.run.trial159.stdout:skipping the directory /var/tmp 2026-02-24T09:11:55.911 INFO:teuthology.orchestra.run.trial159.stdout:skipping the directory /home 2026-02-24T09:11:55.911 INFO:teuthology.orchestra.run.trial159.stdout:skipping the directory /root 2026-02-24T09:11:55.911 INFO:teuthology.orchestra.run.trial159.stdout:skipping the directory /tmp 2026-02-24T09:11:55.912 INFO:teuthology.orchestra.run.trial159.stdout: 2026-02-24T09:11:56.025 INFO:teuthology.orchestra.run.trial159.stdout: Installing : ceph-mds-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 143/192 2026-02-24T09:11:56.073 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: ceph-mds-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 143/192 2026-02-24T09:11:56.073 INFO:teuthology.orchestra.run.trial159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:11:56.073 INFO:teuthology.orchestra.run.trial159.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-24T09:11:56.073 INFO:teuthology.orchestra.run.trial159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T09:11:56.073 INFO:teuthology.orchestra.run.trial159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T09:11:56.073 INFO:teuthology.orchestra.run.trial159.stdout: 2026-02-24T09:11:56.306 INFO:teuthology.orchestra.run.trial159.stdout: Installing : ceph-mon-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 144/192 2026-02-24T09:11:56.353 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: ceph-mon-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 144/192 2026-02-24T09:11:56.353 INFO:teuthology.orchestra.run.trial159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:11:56.354 INFO:teuthology.orchestra.run.trial159.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-24T09:11:56.354 INFO:teuthology.orchestra.run.trial159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T09:11:56.354 INFO:teuthology.orchestra.run.trial159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T09:11:56.354 INFO:teuthology.orchestra.run.trial159.stdout: 2026-02-24T09:11:56.364 INFO:teuthology.orchestra.run.trial159.stdout: Installing : mailcap-2.1.49-5.el9.noarch 145/192 2026-02-24T09:11:56.366 INFO:teuthology.orchestra.run.trial159.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 146/192 2026-02-24T09:11:56.403 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 147/192 2026-02-24T09:11:56.403 INFO:teuthology.orchestra.run.trial159.stdout:Creating group 'qat' with GID 992. 2026-02-24T09:11:56.403 INFO:teuthology.orchestra.run.trial159.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-24T09:11:56.403 INFO:teuthology.orchestra.run.trial159.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-24T09:11:56.403 INFO:teuthology.orchestra.run.trial159.stdout: 2026-02-24T09:11:56.417 INFO:teuthology.orchestra.run.trial159.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 147/192 2026-02-24T09:11:56.468 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 147/192 2026-02-24T09:11:56.468 INFO:teuthology.orchestra.run.trial159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-24T09:11:56.468 INFO:teuthology.orchestra.run.trial159.stdout: 2026-02-24T09:11:57.146 INFO:teuthology.orchestra.run.trial159.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 148/192 2026-02-24T09:11:57.946 INFO:teuthology.orchestra.run.trial159.stdout: Installing : ceph-osd-classic-2:20.3.0-5537.g5bc9a1ff.el9.x86 149/192 2026-02-24T09:11:58.036 INFO:teuthology.orchestra.run.trial159.stdout: Installing : ceph-osd-crimson-2:20.3.0-5537.g5bc9a1ff.el9.x86 150/192 2026-02-24T09:11:58.041 INFO:teuthology.orchestra.run.trial159.stdout: Installing : ceph-volume-2:20.3.0-5537.g5bc9a1ff.el9.noarch 151/192 2026-02-24T09:11:58.073 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: ceph-volume-2:20.3.0-5537.g5bc9a1ff.el9.noarch 151/192 2026-02-24T09:11:58.073 INFO:teuthology.orchestra.run.trial159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:11:58.073 INFO:teuthology.orchestra.run.trial159.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-24T09:11:58.073 INFO:teuthology.orchestra.run.trial159.stdout: 2026-02-24T09:11:58.088 INFO:teuthology.orchestra.run.trial159.stdout: Installing : ceph-osd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 152/192 2026-02-24T09:11:58.139 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: ceph-osd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 152/192 2026-02-24T09:11:58.139 INFO:teuthology.orchestra.run.trial159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:11:58.140 INFO:teuthology.orchestra.run.trial159.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-24T09:11:58.140 INFO:teuthology.orchestra.run.trial159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T09:11:58.140 INFO:teuthology.orchestra.run.trial159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T09:11:58.140 INFO:teuthology.orchestra.run.trial159.stdout: 2026-02-24T09:11:58.256 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noarch 153/192 2026-02-24T09:11:58.259 INFO:teuthology.orchestra.run.trial159.stdout: Installing : cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noarch 153/192 2026-02-24T09:11:58.272 INFO:teuthology.orchestra.run.trial159.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5537.g5bc9a1ff.e 154/192 2026-02-24T09:11:58.305 INFO:teuthology.orchestra.run.trial159.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5537.g5bc9a1ff. 155/192 2026-02-24T09:11:58.308 INFO:teuthology.orchestra.run.trial159.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noa 156/192 2026-02-24T09:11:59.814 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 142/192 2026-02-24T09:11:59.814 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /sys 2026-02-24T09:11:59.814 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /proc 2026-02-24T09:11:59.814 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /mnt 2026-02-24T09:11:59.814 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /var/tmp 2026-02-24T09:11:59.815 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /home 2026-02-24T09:11:59.815 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /root 2026-02-24T09:11:59.815 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /tmp 2026-02-24T09:11:59.815 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:11:59.927 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mds-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 143/192 2026-02-24T09:11:59.976 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mds-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 143/192 2026-02-24T09:11:59.977 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:11:59.977 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-24T09:11:59.977 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T09:11:59.977 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T09:11:59.977 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:12:00.186 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noa 156/192 2026-02-24T09:12:00.200 INFO:teuthology.orchestra.run.trial159.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5537.g5bc9a1ff.el9.n 157/192 2026-02-24T09:12:00.207 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mon-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 144/192 2026-02-24T09:12:00.254 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mon-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 144/192 2026-02-24T09:12:00.254 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:12:00.254 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-24T09:12:00.254 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T09:12:00.254 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T09:12:00.255 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:12:00.266 INFO:teuthology.orchestra.run.trial028.stdout: Installing : mailcap-2.1.49-5.el9.noarch 145/192 2026-02-24T09:12:00.268 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 146/192 2026-02-24T09:12:00.306 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 147/192 2026-02-24T09:12:00.306 INFO:teuthology.orchestra.run.trial028.stdout:Creating group 'qat' with GID 992. 2026-02-24T09:12:00.306 INFO:teuthology.orchestra.run.trial028.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-24T09:12:00.306 INFO:teuthology.orchestra.run.trial028.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-24T09:12:00.306 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:12:00.320 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 147/192 2026-02-24T09:12:00.372 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 147/192 2026-02-24T09:12:00.373 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-24T09:12:00.373 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:12:00.706 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5537.g5bc9a1ff.el9.n 157/192 2026-02-24T09:12:00.709 INFO:teuthology.orchestra.run.trial159.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5537.g5bc 158/192 2026-02-24T09:12:00.733 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5537.g5bc 158/192 2026-02-24T09:12:00.735 INFO:teuthology.orchestra.run.trial159.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5537.g5bc9a1ff.el9.n 159/192 2026-02-24T09:12:00.829 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5537.g5bc9a1ff.el9.n 159/192 2026-02-24T09:12:00.878 INFO:teuthology.orchestra.run.trial159.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5537.g5bc9a1ff.el 160/192 2026-02-24T09:12:00.881 INFO:teuthology.orchestra.run.trial159.stdout: Installing : ceph-mgr-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 161/192 2026-02-24T09:12:00.928 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 161/192 2026-02-24T09:12:00.928 INFO:teuthology.orchestra.run.trial159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:12:00.928 INFO:teuthology.orchestra.run.trial159.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-24T09:12:00.928 INFO:teuthology.orchestra.run.trial159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T09:12:00.928 INFO:teuthology.orchestra.run.trial159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T09:12:00.929 INFO:teuthology.orchestra.run.trial159.stdout: 2026-02-24T09:12:00.945 INFO:teuthology.orchestra.run.trial159.stdout: Installing : ceph-mgr-rook-2:20.3.0-5537.g5bc9a1ff.el9.noarch 162/192 2026-02-24T09:12:00.966 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5537.g5bc9a1ff.el9.noarch 162/192 2026-02-24T09:12:01.035 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 142/192 2026-02-24T09:12:01.036 INFO:teuthology.orchestra.run.trial074.stdout:skipping the directory /sys 2026-02-24T09:12:01.036 INFO:teuthology.orchestra.run.trial074.stdout:skipping the directory /proc 2026-02-24T09:12:01.036 INFO:teuthology.orchestra.run.trial074.stdout:skipping the directory /mnt 2026-02-24T09:12:01.036 INFO:teuthology.orchestra.run.trial074.stdout:skipping the directory /var/tmp 2026-02-24T09:12:01.036 INFO:teuthology.orchestra.run.trial074.stdout:skipping the directory /home 2026-02-24T09:12:01.037 INFO:teuthology.orchestra.run.trial074.stdout:skipping the directory /root 2026-02-24T09:12:01.037 INFO:teuthology.orchestra.run.trial074.stdout:skipping the directory /tmp 2026-02-24T09:12:01.037 INFO:teuthology.orchestra.run.trial074.stdout: 2026-02-24T09:12:01.041 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 148/192 2026-02-24T09:12:01.150 INFO:teuthology.orchestra.run.trial074.stdout: Installing : ceph-mds-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 143/192 2026-02-24T09:12:01.197 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: ceph-mds-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 143/192 2026-02-24T09:12:01.198 INFO:teuthology.orchestra.run.trial074.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:12:01.198 INFO:teuthology.orchestra.run.trial074.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-24T09:12:01.198 INFO:teuthology.orchestra.run.trial074.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T09:12:01.198 INFO:teuthology.orchestra.run.trial074.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T09:12:01.198 INFO:teuthology.orchestra.run.trial074.stdout: 2026-02-24T09:12:01.431 INFO:teuthology.orchestra.run.trial074.stdout: Installing : ceph-mon-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 144/192 2026-02-24T09:12:01.477 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: ceph-mon-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 144/192 2026-02-24T09:12:01.477 INFO:teuthology.orchestra.run.trial074.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:12:01.477 INFO:teuthology.orchestra.run.trial074.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-24T09:12:01.477 INFO:teuthology.orchestra.run.trial074.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T09:12:01.477 INFO:teuthology.orchestra.run.trial074.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T09:12:01.478 INFO:teuthology.orchestra.run.trial074.stdout: 2026-02-24T09:12:01.488 INFO:teuthology.orchestra.run.trial074.stdout: Installing : mailcap-2.1.49-5.el9.noarch 145/192 2026-02-24T09:12:01.490 INFO:teuthology.orchestra.run.trial074.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 146/192 2026-02-24T09:12:01.528 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 147/192 2026-02-24T09:12:01.528 INFO:teuthology.orchestra.run.trial074.stdout:Creating group 'qat' with GID 992. 2026-02-24T09:12:01.528 INFO:teuthology.orchestra.run.trial074.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-24T09:12:01.528 INFO:teuthology.orchestra.run.trial074.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-24T09:12:01.528 INFO:teuthology.orchestra.run.trial074.stdout: 2026-02-24T09:12:01.541 INFO:teuthology.orchestra.run.trial074.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 147/192 2026-02-24T09:12:01.579 INFO:teuthology.orchestra.run.trial159.stdout: Installing : ceph-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 163/192 2026-02-24T09:12:01.584 INFO:teuthology.orchestra.run.trial159.stdout: Installing : ceph-radosgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 164/192 2026-02-24T09:12:01.592 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 147/192 2026-02-24T09:12:01.592 INFO:teuthology.orchestra.run.trial074.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-24T09:12:01.592 INFO:teuthology.orchestra.run.trial074.stdout: 2026-02-24T09:12:01.632 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 164/192 2026-02-24T09:12:01.632 INFO:teuthology.orchestra.run.trial159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:12:01.632 INFO:teuthology.orchestra.run.trial159.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-24T09:12:01.632 INFO:teuthology.orchestra.run.trial159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T09:12:01.632 INFO:teuthology.orchestra.run.trial159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T09:12:01.633 INFO:teuthology.orchestra.run.trial159.stdout: 2026-02-24T09:12:01.645 INFO:teuthology.orchestra.run.trial159.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5537.g5bc9a 165/192 2026-02-24T09:12:01.689 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5537.g5bc9a 165/192 2026-02-24T09:12:01.689 INFO:teuthology.orchestra.run.trial159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:12:01.689 INFO:teuthology.orchestra.run.trial159.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-24T09:12:01.689 INFO:teuthology.orchestra.run.trial159.stdout: 2026-02-24T09:12:01.706 INFO:teuthology.orchestra.run.trial159.stdout: Installing : cephfs-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 166/192 2026-02-24T09:12:01.751 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 166/192 2026-02-24T09:12:01.751 INFO:teuthology.orchestra.run.trial159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:12:01.751 INFO:teuthology.orchestra.run.trial159.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-24T09:12:01.751 INFO:teuthology.orchestra.run.trial159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-24T09:12:01.751 INFO:teuthology.orchestra.run.trial159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-24T09:12:01.751 INFO:teuthology.orchestra.run.trial159.stdout: 2026-02-24T09:12:01.827 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-osd-classic-2:20.3.0-5537.g5bc9a1ff.el9.x86 149/192 2026-02-24T09:12:01.889 INFO:teuthology.orchestra.run.trial159.stdout: Installing : rbd-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 167/192 2026-02-24T09:12:01.918 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-osd-crimson-2:20.3.0-5537.g5bc9a1ff.el9.x86 150/192 2026-02-24T09:12:01.923 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-volume-2:20.3.0-5537.g5bc9a1ff.el9.noarch 151/192 2026-02-24T09:12:01.935 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 167/192 2026-02-24T09:12:01.935 INFO:teuthology.orchestra.run.trial159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:12:01.935 INFO:teuthology.orchestra.run.trial159.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-24T09:12:01.936 INFO:teuthology.orchestra.run.trial159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T09:12:01.936 INFO:teuthology.orchestra.run.trial159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T09:12:01.936 INFO:teuthology.orchestra.run.trial159.stdout: 2026-02-24T09:12:01.956 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-volume-2:20.3.0-5537.g5bc9a1ff.el9.noarch 151/192 2026-02-24T09:12:01.956 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:12:01.956 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-24T09:12:01.957 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:12:01.971 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-osd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 152/192 2026-02-24T09:12:02.024 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-osd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 152/192 2026-02-24T09:12:02.024 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:12:02.024 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-24T09:12:02.024 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T09:12:02.024 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T09:12:02.024 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:12:02.142 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noarch 153/192 2026-02-24T09:12:02.146 INFO:teuthology.orchestra.run.trial028.stdout: Installing : cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noarch 153/192 2026-02-24T09:12:02.159 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5537.g5bc9a1ff.e 154/192 2026-02-24T09:12:02.192 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5537.g5bc9a1ff. 155/192 2026-02-24T09:12:02.195 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noa 156/192 2026-02-24T09:12:02.271 INFO:teuthology.orchestra.run.trial074.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 148/192 2026-02-24T09:12:03.071 INFO:teuthology.orchestra.run.trial074.stdout: Installing : ceph-osd-classic-2:20.3.0-5537.g5bc9a1ff.el9.x86 149/192 2026-02-24T09:12:03.159 INFO:teuthology.orchestra.run.trial074.stdout: Installing : ceph-osd-crimson-2:20.3.0-5537.g5bc9a1ff.el9.x86 150/192 2026-02-24T09:12:03.165 INFO:teuthology.orchestra.run.trial074.stdout: Installing : ceph-volume-2:20.3.0-5537.g5bc9a1ff.el9.noarch 151/192 2026-02-24T09:12:03.197 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: ceph-volume-2:20.3.0-5537.g5bc9a1ff.el9.noarch 151/192 2026-02-24T09:12:03.197 INFO:teuthology.orchestra.run.trial074.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:12:03.197 INFO:teuthology.orchestra.run.trial074.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-24T09:12:03.197 INFO:teuthology.orchestra.run.trial074.stdout: 2026-02-24T09:12:03.211 INFO:teuthology.orchestra.run.trial074.stdout: Installing : ceph-osd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 152/192 2026-02-24T09:12:03.264 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: ceph-osd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 152/192 2026-02-24T09:12:03.265 INFO:teuthology.orchestra.run.trial074.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:12:03.265 INFO:teuthology.orchestra.run.trial074.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-24T09:12:03.265 INFO:teuthology.orchestra.run.trial074.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T09:12:03.265 INFO:teuthology.orchestra.run.trial074.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T09:12:03.265 INFO:teuthology.orchestra.run.trial074.stdout: 2026-02-24T09:12:03.382 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noarch 153/192 2026-02-24T09:12:03.386 INFO:teuthology.orchestra.run.trial074.stdout: Installing : cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noarch 153/192 2026-02-24T09:12:03.398 INFO:teuthology.orchestra.run.trial074.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5537.g5bc9a1ff.e 154/192 2026-02-24T09:12:03.431 INFO:teuthology.orchestra.run.trial074.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5537.g5bc9a1ff. 155/192 2026-02-24T09:12:03.434 INFO:teuthology.orchestra.run.trial074.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noa 156/192 2026-02-24T09:12:04.071 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noa 156/192 2026-02-24T09:12:04.085 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5537.g5bc9a1ff.el9.n 157/192 2026-02-24T09:12:04.584 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5537.g5bc9a1ff.el9.n 157/192 2026-02-24T09:12:04.587 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5537.g5bc 158/192 2026-02-24T09:12:04.613 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5537.g5bc 158/192 2026-02-24T09:12:04.615 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5537.g5bc9a1ff.el9.n 159/192 2026-02-24T09:12:04.707 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5537.g5bc9a1ff.el9.n 159/192 2026-02-24T09:12:04.755 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5537.g5bc9a1ff.el 160/192 2026-02-24T09:12:04.758 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 161/192 2026-02-24T09:12:04.807 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 161/192 2026-02-24T09:12:04.807 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:12:04.807 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-24T09:12:04.807 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T09:12:04.807 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T09:12:04.807 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:12:04.824 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-rook-2:20.3.0-5537.g5bc9a1ff.el9.noarch 162/192 2026-02-24T09:12:04.847 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5537.g5bc9a1ff.el9.noarch 162/192 2026-02-24T09:12:05.318 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noa 156/192 2026-02-24T09:12:05.333 INFO:teuthology.orchestra.run.trial074.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5537.g5bc9a1ff.el9.n 157/192 2026-02-24T09:12:05.448 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 163/192 2026-02-24T09:12:05.452 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-radosgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 164/192 2026-02-24T09:12:05.501 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 164/192 2026-02-24T09:12:05.501 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:12:05.501 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-24T09:12:05.501 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T09:12:05.501 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T09:12:05.501 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:12:05.511 INFO:teuthology.orchestra.run.trial159.stdout: Installing : ceph-test-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 168/192 2026-02-24T09:12:05.514 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5537.g5bc9a 165/192 2026-02-24T09:12:05.516 INFO:teuthology.orchestra.run.trial159.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 169/192 2026-02-24T09:12:05.560 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5537.g5bc9a 165/192 2026-02-24T09:12:05.560 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:12:05.560 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-24T09:12:05.561 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:12:05.577 INFO:teuthology.orchestra.run.trial028.stdout: Installing : cephfs-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 166/192 2026-02-24T09:12:05.622 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 166/192 2026-02-24T09:12:05.622 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:12:05.622 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-24T09:12:05.622 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-24T09:12:05.623 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-24T09:12:05.623 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:12:05.625 INFO:teuthology.orchestra.run.trial159.stdout: Installing : cephfs-shell-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 170/192 2026-02-24T09:12:05.645 INFO:teuthology.orchestra.run.trial159.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 171/192 2026-02-24T09:12:05.651 INFO:teuthology.orchestra.run.trial159.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 172/192 2026-02-24T09:12:05.665 INFO:teuthology.orchestra.run.trial159.stdout: Installing : libcephfs-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_ 173/192 2026-02-24T09:12:05.669 INFO:teuthology.orchestra.run.trial159.stdout: Installing : libtool-2.4.6-46.el9.x86_64 174/192 2026-02-24T09:12:05.758 INFO:teuthology.orchestra.run.trial028.stdout: Installing : rbd-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 167/192 2026-02-24T09:12:05.806 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 167/192 2026-02-24T09:12:05.806 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:12:05.806 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-24T09:12:05.806 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T09:12:05.806 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T09:12:05.806 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:12:05.840 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5537.g5bc9a1ff.el9.n 157/192 2026-02-24T09:12:05.842 INFO:teuthology.orchestra.run.trial074.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5537.g5bc 158/192 2026-02-24T09:12:05.867 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5537.g5bc 158/192 2026-02-24T09:12:05.868 INFO:teuthology.orchestra.run.trial074.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5537.g5bc9a1ff.el9.n 159/192 2026-02-24T09:12:05.876 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 175/192 2026-02-24T09:12:05.886 INFO:teuthology.orchestra.run.trial159.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 175/192 2026-02-24T09:12:05.926 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 175/192 2026-02-24T09:12:05.938 INFO:teuthology.orchestra.run.trial159.stdout: Installing : rbd-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 176/192 2026-02-24T09:12:05.943 INFO:teuthology.orchestra.run.trial159.stdout: Installing : rbd-nbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 177/192 2026-02-24T09:12:05.961 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5537.g5bc9a1ff.el9.n 159/192 2026-02-24T09:12:05.989 INFO:teuthology.orchestra.run.trial159.stdout: Installing : cephfs-top-2:20.3.0-5537.g5bc9a1ff.el9.noarch 178/192 2026-02-24T09:12:06.009 INFO:teuthology.orchestra.run.trial074.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5537.g5bc9a1ff.el 160/192 2026-02-24T09:12:06.012 INFO:teuthology.orchestra.run.trial074.stdout: Installing : ceph-mgr-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 161/192 2026-02-24T09:12:06.058 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 161/192 2026-02-24T09:12:06.058 INFO:teuthology.orchestra.run.trial074.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:12:06.058 INFO:teuthology.orchestra.run.trial074.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-24T09:12:06.058 INFO:teuthology.orchestra.run.trial074.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T09:12:06.059 INFO:teuthology.orchestra.run.trial074.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T09:12:06.059 INFO:teuthology.orchestra.run.trial074.stdout: 2026-02-24T09:12:06.076 INFO:teuthology.orchestra.run.trial074.stdout: Installing : ceph-mgr-rook-2:20.3.0-5537.g5bc9a1ff.el9.noarch 162/192 2026-02-24T09:12:06.097 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5537.g5bc9a1ff.el9.noarch 162/192 2026-02-24T09:12:06.710 INFO:teuthology.orchestra.run.trial074.stdout: Installing : ceph-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 163/192 2026-02-24T09:12:06.714 INFO:teuthology.orchestra.run.trial074.stdout: Installing : ceph-radosgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 164/192 2026-02-24T09:12:06.762 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 164/192 2026-02-24T09:12:06.763 INFO:teuthology.orchestra.run.trial074.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:12:06.763 INFO:teuthology.orchestra.run.trial074.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-24T09:12:06.763 INFO:teuthology.orchestra.run.trial074.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T09:12:06.763 INFO:teuthology.orchestra.run.trial074.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T09:12:06.763 INFO:teuthology.orchestra.run.trial074.stdout: 2026-02-24T09:12:06.776 INFO:teuthology.orchestra.run.trial074.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5537.g5bc9a 165/192 2026-02-24T09:12:06.822 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5537.g5bc9a 165/192 2026-02-24T09:12:06.822 INFO:teuthology.orchestra.run.trial074.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:12:06.822 INFO:teuthology.orchestra.run.trial074.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-24T09:12:06.822 INFO:teuthology.orchestra.run.trial074.stdout: 2026-02-24T09:12:06.839 INFO:teuthology.orchestra.run.trial074.stdout: Installing : cephfs-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 166/192 2026-02-24T09:12:06.845 INFO:teuthology.orchestra.run.trial159.stdout: Installing : ceph-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 179/192 2026-02-24T09:12:06.879 INFO:teuthology.orchestra.run.trial159.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 180/192 2026-02-24T09:12:06.884 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 166/192 2026-02-24T09:12:06.884 INFO:teuthology.orchestra.run.trial074.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:12:06.885 INFO:teuthology.orchestra.run.trial074.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-24T09:12:06.885 INFO:teuthology.orchestra.run.trial074.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-24T09:12:06.885 INFO:teuthology.orchestra.run.trial074.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-24T09:12:06.885 INFO:teuthology.orchestra.run.trial074.stdout: 2026-02-24T09:12:06.894 INFO:teuthology.orchestra.run.trial159.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 181/192 2026-02-24T09:12:06.936 INFO:teuthology.orchestra.run.trial159.stdout: Installing : flex-2.6.4-9.el9.x86_64 182/192 2026-02-24T09:12:06.949 INFO:teuthology.orchestra.run.trial159.stdout: Installing : bison-3.7.4-5.el9.x86_64 183/192 2026-02-24T09:12:06.964 INFO:teuthology.orchestra.run.trial159.stdout: Cleanup : util-linux-2.37.4-21.el9.x86_64 184/192 2026-02-24T09:12:06.970 INFO:teuthology.orchestra.run.trial159.stdout: Cleanup : util-linux-core-2.37.4-21.el9.x86_64 185/192 2026-02-24T09:12:06.972 INFO:teuthology.orchestra.run.trial159.stdout: Cleanup : libfdisk-2.37.4-21.el9.x86_64 186/192 2026-02-24T09:12:06.977 INFO:teuthology.orchestra.run.trial159.stdout: Cleanup : libmount-2.37.4-21.el9.x86_64 187/192 2026-02-24T09:12:06.977 INFO:teuthology.orchestra.run.trial159.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 188/192 2026-02-24T09:12:07.006 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 188/192 2026-02-24T09:12:07.006 INFO:teuthology.orchestra.run.trial159.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 189/192 2026-02-24T09:12:07.023 INFO:teuthology.orchestra.run.trial074.stdout: Installing : rbd-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 167/192 2026-02-24T09:12:07.033 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 189/192 2026-02-24T09:12:07.035 INFO:teuthology.orchestra.run.trial159.stdout: Cleanup : libblkid-2.37.4-21.el9.x86_64 190/192 2026-02-24T09:12:07.038 INFO:teuthology.orchestra.run.trial159.stdout: Cleanup : libuuid-2.37.4-21.el9.x86_64 191/192 2026-02-24T09:12:07.040 INFO:teuthology.orchestra.run.trial159.stdout: Cleanup : libsmartcols-2.37.4-21.el9.x86_64 192/192 2026-02-24T09:12:07.054 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5537.g5bc9a1ff.el9.x86 192/192 2026-02-24T09:12:07.070 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 167/192 2026-02-24T09:12:07.070 INFO:teuthology.orchestra.run.trial074.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:12:07.070 INFO:teuthology.orchestra.run.trial074.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-24T09:12:07.071 INFO:teuthology.orchestra.run.trial074.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T09:12:07.071 INFO:teuthology.orchestra.run.trial074.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T09:12:07.071 INFO:teuthology.orchestra.run.trial074.stdout: 2026-02-24T09:12:07.088 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5537.g5bc9a1ff.el9.x86 192/192 2026-02-24T09:12:07.252 INFO:teuthology.orchestra.run.trial159.stdout: Running scriptlet: libsmartcols-2.37.4-21.el9.x86_64 192/192 2026-02-24T09:12:07.252 INFO:teuthology.orchestra.run.trial159.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2026-02-24T09:12:07.252 INFO:teuthology.orchestra.run.trial159.stdout: 2026-02-24T09:12:08.245 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : ceph-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 1/192 2026-02-24T09:12:08.245 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : ceph-base-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2/192 2026-02-24T09:12:08.245 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 3/192 2026-02-24T09:12:08.245 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : ceph-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 4/192 2026-02-24T09:12:08.245 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5537.g5bc9a 5/192 2026-02-24T09:12:08.246 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : ceph-mds-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 6/192 2026-02-24T09:12:08.246 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : ceph-mgr-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 7/192 2026-02-24T09:12:08.246 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : ceph-mon-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 8/192 2026-02-24T09:12:08.246 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : ceph-osd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 9/192 2026-02-24T09:12:08.246 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : ceph-osd-classic-2:20.3.0-5537.g5bc9a1ff.el9.x86 10/192 2026-02-24T09:12:08.246 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5537.g5bc9a1ff.el9.x86 11/192 2026-02-24T09:12:08.246 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : ceph-radosgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 12/192 2026-02-24T09:12:08.246 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : ceph-selinux-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 13/192 2026-02-24T09:12:08.246 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : ceph-test-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 14/192 2026-02-24T09:12:08.246 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : cephfs-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 15/192 2026-02-24T09:12:08.246 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : cephfs-shell-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 16/192 2026-02-24T09:12:08.246 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : libcephfs-daemon-2:20.3.0-5537.g5bc9a1ff.el9.x86 17/192 2026-02-24T09:12:08.247 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : libcephfs-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_ 18/192 2026-02-24T09:12:08.247 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5537.g5bc9a1ff.el9.x86 19/192 2026-02-24T09:12:08.247 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : libcephfs2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 20/192 2026-02-24T09:12:08.247 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : libcephsqlite-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 21/192 2026-02-24T09:12:08.247 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : librados-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_6 22/192 2026-02-24T09:12:08.247 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : libradosstriper1-2:20.3.0-5537.g5bc9a1ff.el9.x86 23/192 2026-02-24T09:12:08.247 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : librgw2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 24/192 2026-02-24T09:12:08.247 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5537.g5bc9a1ff.el 25/192 2026-02-24T09:12:08.247 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-ceph-common-2:20.3.0-5537.g5bc9a1ff.el9. 26/192 2026-02-24T09:12:08.247 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-cephfs-2:20.3.0-5537.g5bc9a1ff.el9.x86_6 27/192 2026-02-24T09:12:08.247 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-rados-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 28/192 2026-02-24T09:12:08.247 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-rbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 29/192 2026-02-24T09:12:08.248 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-rgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 30/192 2026-02-24T09:12:08.248 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : rbd-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 31/192 2026-02-24T09:12:08.248 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : rbd-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 32/192 2026-02-24T09:12:08.248 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : rbd-nbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 33/192 2026-02-24T09:12:08.248 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5537.g5bc9a1ff. 34/192 2026-02-24T09:12:08.248 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noa 35/192 2026-02-24T09:12:08.261 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5537.g5bc9a1ff.el9.n 36/192 2026-02-24T09:12:08.261 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5537.g5bc 37/192 2026-02-24T09:12:08.261 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5537.g5bc9a1ff.el9.n 38/192 2026-02-24T09:12:08.261 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5537.g5bc9a1ff.el 39/192 2026-02-24T09:12:08.261 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5537.g5bc9a1ff.el9.noarch 40/192 2026-02-24T09:12:08.261 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5537.g5bc9a1ff.e 41/192 2026-02-24T09:12:08.261 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : ceph-volume-2:20.3.0-5537.g5bc9a1ff.el9.noarch 42/192 2026-02-24T09:12:08.261 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noarch 43/192 2026-02-24T09:12:08.262 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : cephfs-top-2:20.3.0-5537.g5bc9a1ff.el9.noarch 44/192 2026-02-24T09:12:08.262 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 45/192 2026-02-24T09:12:08.262 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 46/192 2026-02-24T09:12:08.262 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 47/192 2026-02-24T09:12:08.262 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 48/192 2026-02-24T09:12:08.262 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 49/192 2026-02-24T09:12:08.262 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 50/192 2026-02-24T09:12:08.262 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 51/192 2026-02-24T09:12:08.262 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 52/192 2026-02-24T09:12:08.262 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 53/192 2026-02-24T09:12:08.262 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 54/192 2026-02-24T09:12:08.262 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 55/192 2026-02-24T09:12:08.263 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 56/192 2026-02-24T09:12:08.263 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 57/192 2026-02-24T09:12:08.263 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-ply-3.11-14.el9.noarch 58/192 2026-02-24T09:12:08.263 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 59/192 2026-02-24T09:12:08.263 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 60/192 2026-02-24T09:12:08.263 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 61/192 2026-02-24T09:12:08.263 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 62/192 2026-02-24T09:12:08.263 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : unzip-6.0-59.el9.x86_64 63/192 2026-02-24T09:12:08.263 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : zip-3.0-35.el9.x86_64 64/192 2026-02-24T09:12:08.263 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : automake-1.16.2-8.el9.noarch 65/192 2026-02-24T09:12:08.263 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : bison-3.7.4-5.el9.x86_64 66/192 2026-02-24T09:12:08.263 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 67/192 2026-02-24T09:12:08.264 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 68/192 2026-02-24T09:12:08.264 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : flex-2.6.4-9.el9.x86_64 69/192 2026-02-24T09:12:08.264 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 70/192 2026-02-24T09:12:08.264 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 71/192 2026-02-24T09:12:08.264 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 72/192 2026-02-24T09:12:08.264 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 73/192 2026-02-24T09:12:08.264 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 74/192 2026-02-24T09:12:08.264 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 75/192 2026-02-24T09:12:08.264 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 76/192 2026-02-24T09:12:08.264 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 77/192 2026-02-24T09:12:08.265 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 78/192 2026-02-24T09:12:08.265 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 79/192 2026-02-24T09:12:08.265 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : libuuid-devel-2.37.4-25.el9.x86_64 80/192 2026-02-24T09:12:08.265 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 81/192 2026-02-24T09:12:08.265 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 82/192 2026-02-24T09:12:08.265 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 83/192 2026-02-24T09:12:08.265 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : lua-5.4.4-4.el9.x86_64 84/192 2026-02-24T09:12:08.265 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 85/192 2026-02-24T09:12:08.265 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 86/192 2026-02-24T09:12:08.265 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 87/192 2026-02-24T09:12:08.265 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 88/192 2026-02-24T09:12:08.265 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 89/192 2026-02-24T09:12:08.266 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 90/192 2026-02-24T09:12:08.266 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : postgresql-13.23-1.el9.x86_64 91/192 2026-02-24T09:12:08.266 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 92/192 2026-02-24T09:12:08.266 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 93/192 2026-02-24T09:12:08.266 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 94/192 2026-02-24T09:12:08.266 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 95/192 2026-02-24T09:12:08.266 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 96/192 2026-02-24T09:12:08.266 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 97/192 2026-02-24T09:12:08.266 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 98/192 2026-02-24T09:12:08.266 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 99/192 2026-02-24T09:12:08.266 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 100/192 2026-02-24T09:12:08.266 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 101/192 2026-02-24T09:12:08.267 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 102/192 2026-02-24T09:12:08.267 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 103/192 2026-02-24T09:12:08.267 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 104/192 2026-02-24T09:12:08.267 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 105/192 2026-02-24T09:12:08.267 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 106/192 2026-02-24T09:12:08.267 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 107/192 2026-02-24T09:12:08.267 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 108/192 2026-02-24T09:12:08.267 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 109/192 2026-02-24T09:12:08.267 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 110/192 2026-02-24T09:12:08.267 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 111/192 2026-02-24T09:12:08.267 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 112/192 2026-02-24T09:12:08.267 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 113/192 2026-02-24T09:12:08.268 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 114/192 2026-02-24T09:12:08.268 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 115/192 2026-02-24T09:12:08.268 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 116/192 2026-02-24T09:12:08.268 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 117/192 2026-02-24T09:12:08.268 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 118/192 2026-02-24T09:12:08.268 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 119/192 2026-02-24T09:12:08.268 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 120/192 2026-02-24T09:12:08.268 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 121/192 2026-02-24T09:12:08.268 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 122/192 2026-02-24T09:12:08.268 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 123/192 2026-02-24T09:12:08.268 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 124/192 2026-02-24T09:12:08.268 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 125/192 2026-02-24T09:12:08.268 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 126/192 2026-02-24T09:12:08.269 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 127/192 2026-02-24T09:12:08.269 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 128/192 2026-02-24T09:12:08.269 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 129/192 2026-02-24T09:12:08.269 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 130/192 2026-02-24T09:12:08.269 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 131/192 2026-02-24T09:12:08.269 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 132/192 2026-02-24T09:12:08.269 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 133/192 2026-02-24T09:12:08.269 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 134/192 2026-02-24T09:12:08.269 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 135/192 2026-02-24T09:12:08.269 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 136/192 2026-02-24T09:12:08.269 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 137/192 2026-02-24T09:12:08.269 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 138/192 2026-02-24T09:12:08.270 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 139/192 2026-02-24T09:12:08.270 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 140/192 2026-02-24T09:12:08.270 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 141/192 2026-02-24T09:12:08.270 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 142/192 2026-02-24T09:12:08.270 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 143/192 2026-02-24T09:12:08.270 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 144/192 2026-02-24T09:12:08.270 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 145/192 2026-02-24T09:12:08.270 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 146/192 2026-02-24T09:12:08.270 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 147/192 2026-02-24T09:12:08.270 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 148/192 2026-02-24T09:12:08.270 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 149/192 2026-02-24T09:12:08.270 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 150/192 2026-02-24T09:12:08.271 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 151/192 2026-02-24T09:12:08.271 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 152/192 2026-02-24T09:12:08.271 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 153/192 2026-02-24T09:12:08.271 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 154/192 2026-02-24T09:12:08.271 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 155/192 2026-02-24T09:12:08.271 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 156/192 2026-02-24T09:12:08.271 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 157/192 2026-02-24T09:12:08.271 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 158/192 2026-02-24T09:12:08.271 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 159/192 2026-02-24T09:12:08.271 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 160/192 2026-02-24T09:12:08.271 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 161/192 2026-02-24T09:12:08.272 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 162/192 2026-02-24T09:12:08.272 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 163/192 2026-02-24T09:12:08.272 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 164/192 2026-02-24T09:12:08.272 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 165/192 2026-02-24T09:12:08.272 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 166/192 2026-02-24T09:12:08.272 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 167/192 2026-02-24T09:12:08.272 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 168/192 2026-02-24T09:12:08.272 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 169/192 2026-02-24T09:12:08.272 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 170/192 2026-02-24T09:12:08.272 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 171/192 2026-02-24T09:12:08.272 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : re2-1:20211101-20.el9.x86_64 172/192 2026-02-24T09:12:08.273 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 173/192 2026-02-24T09:12:08.273 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 174/192 2026-02-24T09:12:08.273 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : librados2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 175/192 2026-02-24T09:12:08.273 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 176/192 2026-02-24T09:12:08.273 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : librbd1-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 177/192 2026-02-24T09:12:08.273 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 178/192 2026-02-24T09:12:08.273 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : libblkid-2.37.4-25.el9.x86_64 179/192 2026-02-24T09:12:08.273 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : libblkid-2.37.4-21.el9.x86_64 180/192 2026-02-24T09:12:08.273 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : libfdisk-2.37.4-25.el9.x86_64 181/192 2026-02-24T09:12:08.273 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : libfdisk-2.37.4-21.el9.x86_64 182/192 2026-02-24T09:12:08.273 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : libmount-2.37.4-25.el9.x86_64 183/192 2026-02-24T09:12:08.274 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : libmount-2.37.4-21.el9.x86_64 184/192 2026-02-24T09:12:08.274 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : libsmartcols-2.37.4-25.el9.x86_64 185/192 2026-02-24T09:12:08.274 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : libsmartcols-2.37.4-21.el9.x86_64 186/192 2026-02-24T09:12:08.274 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : libuuid-2.37.4-25.el9.x86_64 187/192 2026-02-24T09:12:08.274 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : libuuid-2.37.4-21.el9.x86_64 188/192 2026-02-24T09:12:08.274 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : util-linux-2.37.4-25.el9.x86_64 189/192 2026-02-24T09:12:08.274 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : util-linux-2.37.4-21.el9.x86_64 190/192 2026-02-24T09:12:08.274 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : util-linux-core-2.37.4-25.el9.x86_64 191/192 2026-02-24T09:12:08.359 INFO:teuthology.orchestra.run.trial159.stdout: Verifying : util-linux-core-2.37.4-21.el9.x86_64 192/192 2026-02-24T09:12:08.360 INFO:teuthology.orchestra.run.trial159.stdout: 2026-02-24T09:12:08.360 INFO:teuthology.orchestra.run.trial159.stdout:Upgraded: 2026-02-24T09:12:08.360 INFO:teuthology.orchestra.run.trial159.stdout: libblkid-2.37.4-25.el9.x86_64 2026-02-24T09:12:08.360 INFO:teuthology.orchestra.run.trial159.stdout: libfdisk-2.37.4-25.el9.x86_64 2026-02-24T09:12:08.360 INFO:teuthology.orchestra.run.trial159.stdout: libmount-2.37.4-25.el9.x86_64 2026-02-24T09:12:08.360 INFO:teuthology.orchestra.run.trial159.stdout: librados2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.360 INFO:teuthology.orchestra.run.trial159.stdout: librbd1-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.360 INFO:teuthology.orchestra.run.trial159.stdout: libsmartcols-2.37.4-25.el9.x86_64 2026-02-24T09:12:08.361 INFO:teuthology.orchestra.run.trial159.stdout: libuuid-2.37.4-25.el9.x86_64 2026-02-24T09:12:08.361 INFO:teuthology.orchestra.run.trial159.stdout: util-linux-2.37.4-25.el9.x86_64 2026-02-24T09:12:08.361 INFO:teuthology.orchestra.run.trial159.stdout: util-linux-core-2.37.4-25.el9.x86_64 2026-02-24T09:12:08.361 INFO:teuthology.orchestra.run.trial159.stdout:Installed: 2026-02-24T09:12:08.361 INFO:teuthology.orchestra.run.trial159.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-24T09:12:08.361 INFO:teuthology.orchestra.run.trial159.stdout: automake-1.16.2-8.el9.noarch 2026-02-24T09:12:08.361 INFO:teuthology.orchestra.run.trial159.stdout: bison-3.7.4-5.el9.x86_64 2026-02-24T09:12:08.361 INFO:teuthology.orchestra.run.trial159.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-24T09:12:08.361 INFO:teuthology.orchestra.run.trial159.stdout: ceph-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.361 INFO:teuthology.orchestra.run.trial159.stdout: ceph-base-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.361 INFO:teuthology.orchestra.run.trial159.stdout: ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.361 INFO:teuthology.orchestra.run.trial159.stdout: ceph-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.362 INFO:teuthology.orchestra.run.trial159.stdout: ceph-grafana-dashboards-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:12:08.362 INFO:teuthology.orchestra.run.trial159.stdout: ceph-immutable-object-cache-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.362 INFO:teuthology.orchestra.run.trial159.stdout: ceph-mds-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.362 INFO:teuthology.orchestra.run.trial159.stdout: ceph-mgr-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.362 INFO:teuthology.orchestra.run.trial159.stdout: ceph-mgr-cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:12:08.362 INFO:teuthology.orchestra.run.trial159.stdout: ceph-mgr-dashboard-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:12:08.362 INFO:teuthology.orchestra.run.trial159.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:12:08.362 INFO:teuthology.orchestra.run.trial159.stdout: ceph-mgr-k8sevents-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:12:08.362 INFO:teuthology.orchestra.run.trial159.stdout: ceph-mgr-modules-core-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:12:08.362 INFO:teuthology.orchestra.run.trial159.stdout: ceph-mgr-rook-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:12:08.362 INFO:teuthology.orchestra.run.trial159.stdout: ceph-mon-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.362 INFO:teuthology.orchestra.run.trial159.stdout: ceph-osd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.363 INFO:teuthology.orchestra.run.trial159.stdout: ceph-osd-classic-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.363 INFO:teuthology.orchestra.run.trial159.stdout: ceph-osd-crimson-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.363 INFO:teuthology.orchestra.run.trial159.stdout: ceph-prometheus-alerts-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:12:08.363 INFO:teuthology.orchestra.run.trial159.stdout: ceph-radosgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.363 INFO:teuthology.orchestra.run.trial159.stdout: ceph-selinux-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.363 INFO:teuthology.orchestra.run.trial159.stdout: ceph-test-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.363 INFO:teuthology.orchestra.run.trial159.stdout: ceph-volume-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:12:08.363 INFO:teuthology.orchestra.run.trial159.stdout: cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:12:08.363 INFO:teuthology.orchestra.run.trial159.stdout: cephfs-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.363 INFO:teuthology.orchestra.run.trial159.stdout: cephfs-shell-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.363 INFO:teuthology.orchestra.run.trial159.stdout: cephfs-top-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:12:08.363 INFO:teuthology.orchestra.run.trial159.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-24T09:12:08.364 INFO:teuthology.orchestra.run.trial159.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-24T09:12:08.364 INFO:teuthology.orchestra.run.trial159.stdout: flex-2.6.4-9.el9.x86_64 2026-02-24T09:12:08.364 INFO:teuthology.orchestra.run.trial159.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-24T09:12:08.364 INFO:teuthology.orchestra.run.trial159.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-24T09:12:08.364 INFO:teuthology.orchestra.run.trial159.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-24T09:12:08.364 INFO:teuthology.orchestra.run.trial159.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-24T09:12:08.364 INFO:teuthology.orchestra.run.trial159.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-24T09:12:08.364 INFO:teuthology.orchestra.run.trial159.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-24T09:12:08.364 INFO:teuthology.orchestra.run.trial159.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-24T09:12:08.364 INFO:teuthology.orchestra.run.trial159.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-24T09:12:08.364 INFO:teuthology.orchestra.run.trial159.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-24T09:12:08.365 INFO:teuthology.orchestra.run.trial159.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-24T09:12:08.365 INFO:teuthology.orchestra.run.trial159.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-24T09:12:08.365 INFO:teuthology.orchestra.run.trial159.stdout: libcephfs-daemon-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.365 INFO:teuthology.orchestra.run.trial159.stdout: libcephfs-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.365 INFO:teuthology.orchestra.run.trial159.stdout: libcephfs-proxy2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.365 INFO:teuthology.orchestra.run.trial159.stdout: libcephfs2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.365 INFO:teuthology.orchestra.run.trial159.stdout: libcephsqlite-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.365 INFO:teuthology.orchestra.run.trial159.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-24T09:12:08.365 INFO:teuthology.orchestra.run.trial159.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-24T09:12:08.365 INFO:teuthology.orchestra.run.trial159.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-24T09:12:08.366 INFO:teuthology.orchestra.run.trial159.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-24T09:12:08.366 INFO:teuthology.orchestra.run.trial159.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-24T09:12:08.366 INFO:teuthology.orchestra.run.trial159.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-24T09:12:08.366 INFO:teuthology.orchestra.run.trial159.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-24T09:12:08.366 INFO:teuthology.orchestra.run.trial159.stdout: librados-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.366 INFO:teuthology.orchestra.run.trial159.stdout: libradosstriper1-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.366 INFO:teuthology.orchestra.run.trial159.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-24T09:12:08.366 INFO:teuthology.orchestra.run.trial159.stdout: librgw2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.366 INFO:teuthology.orchestra.run.trial159.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T09:12:08.366 INFO:teuthology.orchestra.run.trial159.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-24T09:12:08.366 INFO:teuthology.orchestra.run.trial159.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-24T09:12:08.366 INFO:teuthology.orchestra.run.trial159.stdout: libuuid-devel-2.37.4-25.el9.x86_64 2026-02-24T09:12:08.367 INFO:teuthology.orchestra.run.trial159.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-24T09:12:08.367 INFO:teuthology.orchestra.run.trial159.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-24T09:12:08.367 INFO:teuthology.orchestra.run.trial159.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-24T09:12:08.367 INFO:teuthology.orchestra.run.trial159.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-24T09:12:08.367 INFO:teuthology.orchestra.run.trial159.stdout: lua-5.4.4-4.el9.x86_64 2026-02-24T09:12:08.367 INFO:teuthology.orchestra.run.trial159.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-24T09:12:08.367 INFO:teuthology.orchestra.run.trial159.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-24T09:12:08.367 INFO:teuthology.orchestra.run.trial159.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-24T09:12:08.367 INFO:teuthology.orchestra.run.trial159.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-24T09:12:08.367 INFO:teuthology.orchestra.run.trial159.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-24T09:12:08.367 INFO:teuthology.orchestra.run.trial159.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-24T09:12:08.367 INFO:teuthology.orchestra.run.trial159.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-24T09:12:08.368 INFO:teuthology.orchestra.run.trial159.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-24T09:12:08.368 INFO:teuthology.orchestra.run.trial159.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-24T09:12:08.368 INFO:teuthology.orchestra.run.trial159.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-24T09:12:08.368 INFO:teuthology.orchestra.run.trial159.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-24T09:12:08.368 INFO:teuthology.orchestra.run.trial159.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-24T09:12:08.368 INFO:teuthology.orchestra.run.trial159.stdout: postgresql-13.23-1.el9.x86_64 2026-02-24T09:12:08.368 INFO:teuthology.orchestra.run.trial159.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-24T09:12:08.368 INFO:teuthology.orchestra.run.trial159.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-24T09:12:08.368 INFO:teuthology.orchestra.run.trial159.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-24T09:12:08.368 INFO:teuthology.orchestra.run.trial159.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-24T09:12:08.368 INFO:teuthology.orchestra.run.trial159.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-24T09:12:08.368 INFO:teuthology.orchestra.run.trial159.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-24T09:12:08.368 INFO:teuthology.orchestra.run.trial159.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-24T09:12:08.369 INFO:teuthology.orchestra.run.trial159.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-24T09:12:08.369 INFO:teuthology.orchestra.run.trial159.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-24T09:12:08.369 INFO:teuthology.orchestra.run.trial159.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-24T09:12:08.369 INFO:teuthology.orchestra.run.trial159.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-24T09:12:08.369 INFO:teuthology.orchestra.run.trial159.stdout: python3-ceph-argparse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.369 INFO:teuthology.orchestra.run.trial159.stdout: python3-ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.369 INFO:teuthology.orchestra.run.trial159.stdout: python3-cephfs-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.369 INFO:teuthology.orchestra.run.trial159.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-24T09:12:08.369 INFO:teuthology.orchestra.run.trial159.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-24T09:12:08.369 INFO:teuthology.orchestra.run.trial159.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-24T09:12:08.369 INFO:teuthology.orchestra.run.trial159.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-24T09:12:08.369 INFO:teuthology.orchestra.run.trial159.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-24T09:12:08.370 INFO:teuthology.orchestra.run.trial159.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-24T09:12:08.370 INFO:teuthology.orchestra.run.trial159.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-24T09:12:08.370 INFO:teuthology.orchestra.run.trial159.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-24T09:12:08.370 INFO:teuthology.orchestra.run.trial159.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-24T09:12:08.370 INFO:teuthology.orchestra.run.trial159.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-24T09:12:08.370 INFO:teuthology.orchestra.run.trial159.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-24T09:12:08.370 INFO:teuthology.orchestra.run.trial159.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-24T09:12:08.370 INFO:teuthology.orchestra.run.trial159.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-24T09:12:08.370 INFO:teuthology.orchestra.run.trial159.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-24T09:12:08.370 INFO:teuthology.orchestra.run.trial159.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-24T09:12:08.370 INFO:teuthology.orchestra.run.trial159.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-24T09:12:08.370 INFO:teuthology.orchestra.run.trial159.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-24T09:12:08.370 INFO:teuthology.orchestra.run.trial159.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-24T09:12:08.371 INFO:teuthology.orchestra.run.trial159.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-24T09:12:08.371 INFO:teuthology.orchestra.run.trial159.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-24T09:12:08.371 INFO:teuthology.orchestra.run.trial159.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-24T09:12:08.371 INFO:teuthology.orchestra.run.trial159.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-24T09:12:08.371 INFO:teuthology.orchestra.run.trial159.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T09:12:08.371 INFO:teuthology.orchestra.run.trial159.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-24T09:12:08.371 INFO:teuthology.orchestra.run.trial159.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-24T09:12:08.371 INFO:teuthology.orchestra.run.trial159.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-24T09:12:08.371 INFO:teuthology.orchestra.run.trial159.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-24T09:12:08.371 INFO:teuthology.orchestra.run.trial159.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-24T09:12:08.371 INFO:teuthology.orchestra.run.trial159.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-24T09:12:08.371 INFO:teuthology.orchestra.run.trial159.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-24T09:12:08.372 INFO:teuthology.orchestra.run.trial159.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-24T09:12:08.372 INFO:teuthology.orchestra.run.trial159.stdout: python3-ply-3.11-14.el9.noarch 2026-02-24T09:12:08.372 INFO:teuthology.orchestra.run.trial159.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-24T09:12:08.372 INFO:teuthology.orchestra.run.trial159.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-24T09:12:08.372 INFO:teuthology.orchestra.run.trial159.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-24T09:12:08.372 INFO:teuthology.orchestra.run.trial159.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-24T09:12:08.372 INFO:teuthology.orchestra.run.trial159.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-24T09:12:08.372 INFO:teuthology.orchestra.run.trial159.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-24T09:12:08.372 INFO:teuthology.orchestra.run.trial159.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-24T09:12:08.372 INFO:teuthology.orchestra.run.trial159.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-24T09:12:08.372 INFO:teuthology.orchestra.run.trial159.stdout: python3-rados-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.373 INFO:teuthology.orchestra.run.trial159.stdout: python3-rbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.373 INFO:teuthology.orchestra.run.trial159.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-24T09:12:08.373 INFO:teuthology.orchestra.run.trial159.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-24T09:12:08.373 INFO:teuthology.orchestra.run.trial159.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-24T09:12:08.373 INFO:teuthology.orchestra.run.trial159.stdout: python3-rgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.373 INFO:teuthology.orchestra.run.trial159.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-24T09:12:08.373 INFO:teuthology.orchestra.run.trial159.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-24T09:12:08.373 INFO:teuthology.orchestra.run.trial159.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-24T09:12:08.373 INFO:teuthology.orchestra.run.trial159.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-24T09:12:08.373 INFO:teuthology.orchestra.run.trial159.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-24T09:12:08.373 INFO:teuthology.orchestra.run.trial159.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-24T09:12:08.374 INFO:teuthology.orchestra.run.trial159.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-24T09:12:08.374 INFO:teuthology.orchestra.run.trial159.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-24T09:12:08.374 INFO:teuthology.orchestra.run.trial159.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-24T09:12:08.374 INFO:teuthology.orchestra.run.trial159.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-24T09:12:08.374 INFO:teuthology.orchestra.run.trial159.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-24T09:12:08.374 INFO:teuthology.orchestra.run.trial159.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-24T09:12:08.374 INFO:teuthology.orchestra.run.trial159.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-24T09:12:08.374 INFO:teuthology.orchestra.run.trial159.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-24T09:12:08.374 INFO:teuthology.orchestra.run.trial159.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-24T09:12:08.374 INFO:teuthology.orchestra.run.trial159.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-24T09:12:08.374 INFO:teuthology.orchestra.run.trial159.stdout: rbd-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.375 INFO:teuthology.orchestra.run.trial159.stdout: rbd-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.375 INFO:teuthology.orchestra.run.trial159.stdout: rbd-nbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:08.375 INFO:teuthology.orchestra.run.trial159.stdout: re2-1:20211101-20.el9.x86_64 2026-02-24T09:12:08.375 INFO:teuthology.orchestra.run.trial159.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-24T09:12:08.375 INFO:teuthology.orchestra.run.trial159.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-24T09:12:08.375 INFO:teuthology.orchestra.run.trial159.stdout: unzip-6.0-59.el9.x86_64 2026-02-24T09:12:08.375 INFO:teuthology.orchestra.run.trial159.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-24T09:12:08.375 INFO:teuthology.orchestra.run.trial159.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-24T09:12:08.375 INFO:teuthology.orchestra.run.trial159.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-24T09:12:08.375 INFO:teuthology.orchestra.run.trial159.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-24T09:12:08.375 INFO:teuthology.orchestra.run.trial159.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-24T09:12:08.375 INFO:teuthology.orchestra.run.trial159.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-24T09:12:08.375 INFO:teuthology.orchestra.run.trial159.stdout: zip-3.0-35.el9.x86_64 2026-02-24T09:12:08.376 INFO:teuthology.orchestra.run.trial159.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-24T09:12:08.376 INFO:teuthology.orchestra.run.trial159.stdout: 2026-02-24T09:12:08.376 INFO:teuthology.orchestra.run.trial159.stdout:Complete! 2026-02-24T09:12:08.607 DEBUG:teuthology.parallel:result is None 2026-02-24T09:12:09.318 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-test-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 168/192 2026-02-24T09:12:09.323 INFO:teuthology.orchestra.run.trial028.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 169/192 2026-02-24T09:12:09.432 INFO:teuthology.orchestra.run.trial028.stdout: Installing : cephfs-shell-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 170/192 2026-02-24T09:12:09.451 INFO:teuthology.orchestra.run.trial028.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 171/192 2026-02-24T09:12:09.458 INFO:teuthology.orchestra.run.trial028.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 172/192 2026-02-24T09:12:09.472 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libcephfs-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_ 173/192 2026-02-24T09:12:09.475 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libtool-2.4.6-46.el9.x86_64 174/192 2026-02-24T09:12:09.680 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 175/192 2026-02-24T09:12:09.691 INFO:teuthology.orchestra.run.trial028.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 175/192 2026-02-24T09:12:09.730 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 175/192 2026-02-24T09:12:09.742 INFO:teuthology.orchestra.run.trial028.stdout: Installing : rbd-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 176/192 2026-02-24T09:12:09.748 INFO:teuthology.orchestra.run.trial028.stdout: Installing : rbd-nbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 177/192 2026-02-24T09:12:09.794 INFO:teuthology.orchestra.run.trial028.stdout: Installing : cephfs-top-2:20.3.0-5537.g5bc9a1ff.el9.noarch 178/192 2026-02-24T09:12:10.654 INFO:teuthology.orchestra.run.trial074.stdout: Installing : ceph-test-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 168/192 2026-02-24T09:12:10.660 INFO:teuthology.orchestra.run.trial074.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 169/192 2026-02-24T09:12:10.665 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 179/192 2026-02-24T09:12:10.700 INFO:teuthology.orchestra.run.trial028.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 180/192 2026-02-24T09:12:10.715 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 181/192 2026-02-24T09:12:10.757 INFO:teuthology.orchestra.run.trial028.stdout: Installing : flex-2.6.4-9.el9.x86_64 182/192 2026-02-24T09:12:10.767 INFO:teuthology.orchestra.run.trial074.stdout: Installing : cephfs-shell-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 170/192 2026-02-24T09:12:10.770 INFO:teuthology.orchestra.run.trial028.stdout: Installing : bison-3.7.4-5.el9.x86_64 183/192 2026-02-24T09:12:10.785 INFO:teuthology.orchestra.run.trial028.stdout: Cleanup : util-linux-2.37.4-21.el9.x86_64 184/192 2026-02-24T09:12:10.787 INFO:teuthology.orchestra.run.trial074.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 171/192 2026-02-24T09:12:10.791 INFO:teuthology.orchestra.run.trial028.stdout: Cleanup : util-linux-core-2.37.4-21.el9.x86_64 185/192 2026-02-24T09:12:10.793 INFO:teuthology.orchestra.run.trial028.stdout: Cleanup : libfdisk-2.37.4-21.el9.x86_64 186/192 2026-02-24T09:12:10.794 INFO:teuthology.orchestra.run.trial074.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 172/192 2026-02-24T09:12:10.798 INFO:teuthology.orchestra.run.trial028.stdout: Cleanup : libmount-2.37.4-21.el9.x86_64 187/192 2026-02-24T09:12:10.798 INFO:teuthology.orchestra.run.trial028.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 188/192 2026-02-24T09:12:10.808 INFO:teuthology.orchestra.run.trial074.stdout: Installing : libcephfs-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_ 173/192 2026-02-24T09:12:10.811 INFO:teuthology.orchestra.run.trial074.stdout: Installing : libtool-2.4.6-46.el9.x86_64 174/192 2026-02-24T09:12:10.828 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 188/192 2026-02-24T09:12:10.828 INFO:teuthology.orchestra.run.trial028.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 189/192 2026-02-24T09:12:10.855 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 189/192 2026-02-24T09:12:10.858 INFO:teuthology.orchestra.run.trial028.stdout: Cleanup : libblkid-2.37.4-21.el9.x86_64 190/192 2026-02-24T09:12:10.860 INFO:teuthology.orchestra.run.trial028.stdout: Cleanup : libuuid-2.37.4-21.el9.x86_64 191/192 2026-02-24T09:12:10.862 INFO:teuthology.orchestra.run.trial028.stdout: Cleanup : libsmartcols-2.37.4-21.el9.x86_64 192/192 2026-02-24T09:12:10.878 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5537.g5bc9a1ff.el9.x86 192/192 2026-02-24T09:12:10.913 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5537.g5bc9a1ff.el9.x86 192/192 2026-02-24T09:12:11.015 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 175/192 2026-02-24T09:12:11.026 INFO:teuthology.orchestra.run.trial074.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 175/192 2026-02-24T09:12:11.064 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 175/192 2026-02-24T09:12:11.076 INFO:teuthology.orchestra.run.trial074.stdout: Installing : rbd-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 176/192 2026-02-24T09:12:11.078 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libsmartcols-2.37.4-21.el9.x86_64 192/192 2026-02-24T09:12:11.078 INFO:teuthology.orchestra.run.trial028.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2026-02-24T09:12:11.078 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:12:11.082 INFO:teuthology.orchestra.run.trial074.stdout: Installing : rbd-nbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 177/192 2026-02-24T09:12:11.128 INFO:teuthology.orchestra.run.trial074.stdout: Installing : cephfs-top-2:20.3.0-5537.g5bc9a1ff.el9.noarch 178/192 2026-02-24T09:12:11.997 INFO:teuthology.orchestra.run.trial074.stdout: Installing : ceph-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 179/192 2026-02-24T09:12:12.032 INFO:teuthology.orchestra.run.trial074.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 180/192 2026-02-24T09:12:12.047 INFO:teuthology.orchestra.run.trial074.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 181/192 2026-02-24T09:12:12.089 INFO:teuthology.orchestra.run.trial074.stdout: Installing : flex-2.6.4-9.el9.x86_64 182/192 2026-02-24T09:12:12.102 INFO:teuthology.orchestra.run.trial074.stdout: Installing : bison-3.7.4-5.el9.x86_64 183/192 2026-02-24T09:12:12.116 INFO:teuthology.orchestra.run.trial074.stdout: Cleanup : util-linux-2.37.4-21.el9.x86_64 184/192 2026-02-24T09:12:12.124 INFO:teuthology.orchestra.run.trial074.stdout: Cleanup : util-linux-core-2.37.4-21.el9.x86_64 185/192 2026-02-24T09:12:12.131 INFO:teuthology.orchestra.run.trial074.stdout: Cleanup : libfdisk-2.37.4-21.el9.x86_64 186/192 2026-02-24T09:12:12.131 INFO:teuthology.orchestra.run.trial074.stdout: Cleanup : libmount-2.37.4-21.el9.x86_64 187/192 2026-02-24T09:12:12.131 INFO:teuthology.orchestra.run.trial074.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 188/192 2026-02-24T09:12:12.133 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 1/192 2026-02-24T09:12:12.133 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-base-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2/192 2026-02-24T09:12:12.133 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 3/192 2026-02-24T09:12:12.134 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 4/192 2026-02-24T09:12:12.134 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5537.g5bc9a 5/192 2026-02-24T09:12:12.134 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mds-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 6/192 2026-02-24T09:12:12.134 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 7/192 2026-02-24T09:12:12.134 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mon-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 8/192 2026-02-24T09:12:12.134 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-osd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 9/192 2026-02-24T09:12:12.134 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-osd-classic-2:20.3.0-5537.g5bc9a1ff.el9.x86 10/192 2026-02-24T09:12:12.134 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5537.g5bc9a1ff.el9.x86 11/192 2026-02-24T09:12:12.134 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-radosgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 12/192 2026-02-24T09:12:12.134 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-selinux-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 13/192 2026-02-24T09:12:12.134 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-test-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 14/192 2026-02-24T09:12:12.134 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : cephfs-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 15/192 2026-02-24T09:12:12.135 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : cephfs-shell-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 16/192 2026-02-24T09:12:12.135 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libcephfs-daemon-2:20.3.0-5537.g5bc9a1ff.el9.x86 17/192 2026-02-24T09:12:12.135 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libcephfs-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_ 18/192 2026-02-24T09:12:12.135 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5537.g5bc9a1ff.el9.x86 19/192 2026-02-24T09:12:12.135 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libcephfs2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 20/192 2026-02-24T09:12:12.135 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libcephsqlite-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 21/192 2026-02-24T09:12:12.135 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librados-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_6 22/192 2026-02-24T09:12:12.135 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libradosstriper1-2:20.3.0-5537.g5bc9a1ff.el9.x86 23/192 2026-02-24T09:12:12.135 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librgw2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 24/192 2026-02-24T09:12:12.135 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5537.g5bc9a1ff.el 25/192 2026-02-24T09:12:12.135 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-ceph-common-2:20.3.0-5537.g5bc9a1ff.el9. 26/192 2026-02-24T09:12:12.136 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cephfs-2:20.3.0-5537.g5bc9a1ff.el9.x86_6 27/192 2026-02-24T09:12:12.136 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-rados-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 28/192 2026-02-24T09:12:12.136 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-rbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 29/192 2026-02-24T09:12:12.136 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-rgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 30/192 2026-02-24T09:12:12.136 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : rbd-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 31/192 2026-02-24T09:12:12.136 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : rbd-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 32/192 2026-02-24T09:12:12.136 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : rbd-nbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 33/192 2026-02-24T09:12:12.136 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5537.g5bc9a1ff. 34/192 2026-02-24T09:12:12.136 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noa 35/192 2026-02-24T09:12:12.136 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5537.g5bc9a1ff.el9.n 36/192 2026-02-24T09:12:12.136 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5537.g5bc 37/192 2026-02-24T09:12:12.136 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5537.g5bc9a1ff.el9.n 38/192 2026-02-24T09:12:12.136 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5537.g5bc9a1ff.el 39/192 2026-02-24T09:12:12.137 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5537.g5bc9a1ff.el9.noarch 40/192 2026-02-24T09:12:12.137 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5537.g5bc9a1ff.e 41/192 2026-02-24T09:12:12.137 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-volume-2:20.3.0-5537.g5bc9a1ff.el9.noarch 42/192 2026-02-24T09:12:12.137 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noarch 43/192 2026-02-24T09:12:12.137 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : cephfs-top-2:20.3.0-5537.g5bc9a1ff.el9.noarch 44/192 2026-02-24T09:12:12.137 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 45/192 2026-02-24T09:12:12.137 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 46/192 2026-02-24T09:12:12.137 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 47/192 2026-02-24T09:12:12.137 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 48/192 2026-02-24T09:12:12.137 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 49/192 2026-02-24T09:12:12.137 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 50/192 2026-02-24T09:12:12.138 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 51/192 2026-02-24T09:12:12.138 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 52/192 2026-02-24T09:12:12.138 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 53/192 2026-02-24T09:12:12.138 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 54/192 2026-02-24T09:12:12.138 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 55/192 2026-02-24T09:12:12.138 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 56/192 2026-02-24T09:12:12.138 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 57/192 2026-02-24T09:12:12.138 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-ply-3.11-14.el9.noarch 58/192 2026-02-24T09:12:12.138 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 59/192 2026-02-24T09:12:12.138 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 60/192 2026-02-24T09:12:12.138 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 61/192 2026-02-24T09:12:12.138 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 62/192 2026-02-24T09:12:12.139 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : unzip-6.0-59.el9.x86_64 63/192 2026-02-24T09:12:12.139 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : zip-3.0-35.el9.x86_64 64/192 2026-02-24T09:12:12.139 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : automake-1.16.2-8.el9.noarch 65/192 2026-02-24T09:12:12.139 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : bison-3.7.4-5.el9.x86_64 66/192 2026-02-24T09:12:12.139 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 67/192 2026-02-24T09:12:12.139 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 68/192 2026-02-24T09:12:12.139 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : flex-2.6.4-9.el9.x86_64 69/192 2026-02-24T09:12:12.139 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 70/192 2026-02-24T09:12:12.139 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 71/192 2026-02-24T09:12:12.139 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 72/192 2026-02-24T09:12:12.139 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 73/192 2026-02-24T09:12:12.139 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 74/192 2026-02-24T09:12:12.139 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 75/192 2026-02-24T09:12:12.140 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 76/192 2026-02-24T09:12:12.140 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 77/192 2026-02-24T09:12:12.140 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 78/192 2026-02-24T09:12:12.140 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 79/192 2026-02-24T09:12:12.140 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libuuid-devel-2.37.4-25.el9.x86_64 80/192 2026-02-24T09:12:12.140 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 81/192 2026-02-24T09:12:12.140 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 82/192 2026-02-24T09:12:12.140 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 83/192 2026-02-24T09:12:12.140 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : lua-5.4.4-4.el9.x86_64 84/192 2026-02-24T09:12:12.140 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 85/192 2026-02-24T09:12:12.140 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 86/192 2026-02-24T09:12:12.140 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 87/192 2026-02-24T09:12:12.141 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 88/192 2026-02-24T09:12:12.141 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 89/192 2026-02-24T09:12:12.141 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 90/192 2026-02-24T09:12:12.141 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : postgresql-13.23-1.el9.x86_64 91/192 2026-02-24T09:12:12.141 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 92/192 2026-02-24T09:12:12.141 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 93/192 2026-02-24T09:12:12.141 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 94/192 2026-02-24T09:12:12.141 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 95/192 2026-02-24T09:12:12.141 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 96/192 2026-02-24T09:12:12.141 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 97/192 2026-02-24T09:12:12.141 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 98/192 2026-02-24T09:12:12.141 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 99/192 2026-02-24T09:12:12.141 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 100/192 2026-02-24T09:12:12.142 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 101/192 2026-02-24T09:12:12.142 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 102/192 2026-02-24T09:12:12.142 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 103/192 2026-02-24T09:12:12.142 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 104/192 2026-02-24T09:12:12.142 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 105/192 2026-02-24T09:12:12.142 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 106/192 2026-02-24T09:12:12.142 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 107/192 2026-02-24T09:12:12.142 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 108/192 2026-02-24T09:12:12.142 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 109/192 2026-02-24T09:12:12.142 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 110/192 2026-02-24T09:12:12.143 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 111/192 2026-02-24T09:12:12.143 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 112/192 2026-02-24T09:12:12.143 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 113/192 2026-02-24T09:12:12.143 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 114/192 2026-02-24T09:12:12.143 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 115/192 2026-02-24T09:12:12.143 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 116/192 2026-02-24T09:12:12.143 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 117/192 2026-02-24T09:12:12.143 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 118/192 2026-02-24T09:12:12.143 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 119/192 2026-02-24T09:12:12.143 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 120/192 2026-02-24T09:12:12.143 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 121/192 2026-02-24T09:12:12.143 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 122/192 2026-02-24T09:12:12.143 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 123/192 2026-02-24T09:12:12.144 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 124/192 2026-02-24T09:12:12.144 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 125/192 2026-02-24T09:12:12.144 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 126/192 2026-02-24T09:12:12.144 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 127/192 2026-02-24T09:12:12.144 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 128/192 2026-02-24T09:12:12.144 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 129/192 2026-02-24T09:12:12.144 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 130/192 2026-02-24T09:12:12.144 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 131/192 2026-02-24T09:12:12.144 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 132/192 2026-02-24T09:12:12.144 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 133/192 2026-02-24T09:12:12.144 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 134/192 2026-02-24T09:12:12.144 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 135/192 2026-02-24T09:12:12.144 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 136/192 2026-02-24T09:12:12.145 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 137/192 2026-02-24T09:12:12.145 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 138/192 2026-02-24T09:12:12.145 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 139/192 2026-02-24T09:12:12.145 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 140/192 2026-02-24T09:12:12.145 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 141/192 2026-02-24T09:12:12.145 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 142/192 2026-02-24T09:12:12.145 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 143/192 2026-02-24T09:12:12.145 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 144/192 2026-02-24T09:12:12.145 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 145/192 2026-02-24T09:12:12.145 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 146/192 2026-02-24T09:12:12.145 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 147/192 2026-02-24T09:12:12.145 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 148/192 2026-02-24T09:12:12.145 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 149/192 2026-02-24T09:12:12.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 150/192 2026-02-24T09:12:12.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 151/192 2026-02-24T09:12:12.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 152/192 2026-02-24T09:12:12.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 153/192 2026-02-24T09:12:12.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 154/192 2026-02-24T09:12:12.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 155/192 2026-02-24T09:12:12.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 156/192 2026-02-24T09:12:12.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 157/192 2026-02-24T09:12:12.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 158/192 2026-02-24T09:12:12.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 159/192 2026-02-24T09:12:12.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 160/192 2026-02-24T09:12:12.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 161/192 2026-02-24T09:12:12.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 162/192 2026-02-24T09:12:12.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 163/192 2026-02-24T09:12:12.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 164/192 2026-02-24T09:12:12.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 165/192 2026-02-24T09:12:12.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 166/192 2026-02-24T09:12:12.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 167/192 2026-02-24T09:12:12.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 168/192 2026-02-24T09:12:12.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 169/192 2026-02-24T09:12:12.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 170/192 2026-02-24T09:12:12.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 171/192 2026-02-24T09:12:12.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : re2-1:20211101-20.el9.x86_64 172/192 2026-02-24T09:12:12.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 173/192 2026-02-24T09:12:12.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 174/192 2026-02-24T09:12:12.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librados2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 175/192 2026-02-24T09:12:12.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 176/192 2026-02-24T09:12:12.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librbd1-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 177/192 2026-02-24T09:12:12.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 178/192 2026-02-24T09:12:12.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libblkid-2.37.4-25.el9.x86_64 179/192 2026-02-24T09:12:12.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libblkid-2.37.4-21.el9.x86_64 180/192 2026-02-24T09:12:12.147 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libfdisk-2.37.4-25.el9.x86_64 181/192 2026-02-24T09:12:12.147 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libfdisk-2.37.4-21.el9.x86_64 182/192 2026-02-24T09:12:12.147 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libmount-2.37.4-25.el9.x86_64 183/192 2026-02-24T09:12:12.147 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libmount-2.37.4-21.el9.x86_64 184/192 2026-02-24T09:12:12.147 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libsmartcols-2.37.4-25.el9.x86_64 185/192 2026-02-24T09:12:12.147 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libsmartcols-2.37.4-21.el9.x86_64 186/192 2026-02-24T09:12:12.147 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libuuid-2.37.4-25.el9.x86_64 187/192 2026-02-24T09:12:12.147 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libuuid-2.37.4-21.el9.x86_64 188/192 2026-02-24T09:12:12.147 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : util-linux-2.37.4-25.el9.x86_64 189/192 2026-02-24T09:12:12.147 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : util-linux-2.37.4-21.el9.x86_64 190/192 2026-02-24T09:12:12.147 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : util-linux-core-2.37.4-25.el9.x86_64 191/192 2026-02-24T09:12:12.158 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 188/192 2026-02-24T09:12:12.158 INFO:teuthology.orchestra.run.trial074.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 189/192 2026-02-24T09:12:12.185 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 189/192 2026-02-24T09:12:12.187 INFO:teuthology.orchestra.run.trial074.stdout: Cleanup : libblkid-2.37.4-21.el9.x86_64 190/192 2026-02-24T09:12:12.190 INFO:teuthology.orchestra.run.trial074.stdout: Cleanup : libuuid-2.37.4-21.el9.x86_64 191/192 2026-02-24T09:12:12.191 INFO:teuthology.orchestra.run.trial074.stdout: Cleanup : libsmartcols-2.37.4-21.el9.x86_64 192/192 2026-02-24T09:12:12.206 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5537.g5bc9a1ff.el9.x86 192/192 2026-02-24T09:12:12.234 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : util-linux-core-2.37.4-21.el9.x86_64 192/192 2026-02-24T09:12:12.234 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:12:12.234 INFO:teuthology.orchestra.run.trial028.stdout:Upgraded: 2026-02-24T09:12:12.234 INFO:teuthology.orchestra.run.trial028.stdout: libblkid-2.37.4-25.el9.x86_64 2026-02-24T09:12:12.234 INFO:teuthology.orchestra.run.trial028.stdout: libfdisk-2.37.4-25.el9.x86_64 2026-02-24T09:12:12.235 INFO:teuthology.orchestra.run.trial028.stdout: libmount-2.37.4-25.el9.x86_64 2026-02-24T09:12:12.235 INFO:teuthology.orchestra.run.trial028.stdout: librados2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.235 INFO:teuthology.orchestra.run.trial028.stdout: librbd1-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.235 INFO:teuthology.orchestra.run.trial028.stdout: libsmartcols-2.37.4-25.el9.x86_64 2026-02-24T09:12:12.235 INFO:teuthology.orchestra.run.trial028.stdout: libuuid-2.37.4-25.el9.x86_64 2026-02-24T09:12:12.235 INFO:teuthology.orchestra.run.trial028.stdout: util-linux-2.37.4-25.el9.x86_64 2026-02-24T09:12:12.235 INFO:teuthology.orchestra.run.trial028.stdout: util-linux-core-2.37.4-25.el9.x86_64 2026-02-24T09:12:12.235 INFO:teuthology.orchestra.run.trial028.stdout:Installed: 2026-02-24T09:12:12.235 INFO:teuthology.orchestra.run.trial028.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-24T09:12:12.235 INFO:teuthology.orchestra.run.trial028.stdout: automake-1.16.2-8.el9.noarch 2026-02-24T09:12:12.235 INFO:teuthology.orchestra.run.trial028.stdout: bison-3.7.4-5.el9.x86_64 2026-02-24T09:12:12.236 INFO:teuthology.orchestra.run.trial028.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-24T09:12:12.236 INFO:teuthology.orchestra.run.trial028.stdout: ceph-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.236 INFO:teuthology.orchestra.run.trial028.stdout: ceph-base-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.236 INFO:teuthology.orchestra.run.trial028.stdout: ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.236 INFO:teuthology.orchestra.run.trial028.stdout: ceph-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.236 INFO:teuthology.orchestra.run.trial028.stdout: ceph-grafana-dashboards-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:12:12.236 INFO:teuthology.orchestra.run.trial028.stdout: ceph-immutable-object-cache-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.236 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mds-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.236 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.236 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:12:12.236 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-dashboard-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:12:12.236 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:12:12.236 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-k8sevents-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:12:12.237 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-modules-core-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:12:12.237 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-rook-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:12:12.237 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mon-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.237 INFO:teuthology.orchestra.run.trial028.stdout: ceph-osd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.237 INFO:teuthology.orchestra.run.trial028.stdout: ceph-osd-classic-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.237 INFO:teuthology.orchestra.run.trial028.stdout: ceph-osd-crimson-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.237 INFO:teuthology.orchestra.run.trial028.stdout: ceph-prometheus-alerts-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:12:12.237 INFO:teuthology.orchestra.run.trial028.stdout: ceph-radosgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.237 INFO:teuthology.orchestra.run.trial028.stdout: ceph-selinux-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.237 INFO:teuthology.orchestra.run.trial028.stdout: ceph-test-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.237 INFO:teuthology.orchestra.run.trial028.stdout: ceph-volume-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:12:12.237 INFO:teuthology.orchestra.run.trial028.stdout: cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:12:12.238 INFO:teuthology.orchestra.run.trial028.stdout: cephfs-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.238 INFO:teuthology.orchestra.run.trial028.stdout: cephfs-shell-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.238 INFO:teuthology.orchestra.run.trial028.stdout: cephfs-top-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:12:12.238 INFO:teuthology.orchestra.run.trial028.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-24T09:12:12.238 INFO:teuthology.orchestra.run.trial028.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-24T09:12:12.238 INFO:teuthology.orchestra.run.trial028.stdout: flex-2.6.4-9.el9.x86_64 2026-02-24T09:12:12.238 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-24T09:12:12.238 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-24T09:12:12.238 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-24T09:12:12.238 INFO:teuthology.orchestra.run.trial028.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-24T09:12:12.238 INFO:teuthology.orchestra.run.trial028.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-24T09:12:12.238 INFO:teuthology.orchestra.run.trial028.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-24T09:12:12.238 INFO:teuthology.orchestra.run.trial028.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-24T09:12:12.239 INFO:teuthology.orchestra.run.trial028.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-24T09:12:12.239 INFO:teuthology.orchestra.run.trial028.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-24T09:12:12.239 INFO:teuthology.orchestra.run.trial028.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-24T09:12:12.239 INFO:teuthology.orchestra.run.trial028.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-24T09:12:12.239 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs-daemon-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.239 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.239 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs-proxy2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.239 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.239 INFO:teuthology.orchestra.run.trial028.stdout: libcephsqlite-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.239 INFO:teuthology.orchestra.run.trial028.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-24T09:12:12.239 INFO:teuthology.orchestra.run.trial028.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-24T09:12:12.239 INFO:teuthology.orchestra.run.trial028.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-24T09:12:12.239 INFO:teuthology.orchestra.run.trial028.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-24T09:12:12.240 INFO:teuthology.orchestra.run.trial028.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-24T09:12:12.240 INFO:teuthology.orchestra.run.trial028.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-24T09:12:12.240 INFO:teuthology.orchestra.run.trial028.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-24T09:12:12.240 INFO:teuthology.orchestra.run.trial028.stdout: librados-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.240 INFO:teuthology.orchestra.run.trial028.stdout: libradosstriper1-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.240 INFO:teuthology.orchestra.run.trial028.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-24T09:12:12.240 INFO:teuthology.orchestra.run.trial028.stdout: librgw2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.240 INFO:teuthology.orchestra.run.trial028.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T09:12:12.240 INFO:teuthology.orchestra.run.trial028.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-24T09:12:12.240 INFO:teuthology.orchestra.run.trial028.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-24T09:12:12.240 INFO:teuthology.orchestra.run.trial028.stdout: libuuid-devel-2.37.4-25.el9.x86_64 2026-02-24T09:12:12.240 INFO:teuthology.orchestra.run.trial028.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-24T09:12:12.240 INFO:teuthology.orchestra.run.trial028.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-24T09:12:12.241 INFO:teuthology.orchestra.run.trial028.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-24T09:12:12.241 INFO:teuthology.orchestra.run.trial028.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-24T09:12:12.241 INFO:teuthology.orchestra.run.trial028.stdout: lua-5.4.4-4.el9.x86_64 2026-02-24T09:12:12.241 INFO:teuthology.orchestra.run.trial028.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-24T09:12:12.241 INFO:teuthology.orchestra.run.trial028.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-24T09:12:12.241 INFO:teuthology.orchestra.run.trial028.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-24T09:12:12.241 INFO:teuthology.orchestra.run.trial028.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-24T09:12:12.241 INFO:teuthology.orchestra.run.trial028.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-24T09:12:12.241 INFO:teuthology.orchestra.run.trial028.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-24T09:12:12.241 INFO:teuthology.orchestra.run.trial028.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-24T09:12:12.241 INFO:teuthology.orchestra.run.trial028.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-24T09:12:12.241 INFO:teuthology.orchestra.run.trial028.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-24T09:12:12.241 INFO:teuthology.orchestra.run.trial028.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-24T09:12:12.242 INFO:teuthology.orchestra.run.trial028.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-24T09:12:12.242 INFO:teuthology.orchestra.run.trial028.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-24T09:12:12.242 INFO:teuthology.orchestra.run.trial028.stdout: postgresql-13.23-1.el9.x86_64 2026-02-24T09:12:12.242 INFO:teuthology.orchestra.run.trial028.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-24T09:12:12.242 INFO:teuthology.orchestra.run.trial028.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-24T09:12:12.242 INFO:teuthology.orchestra.run.trial028.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-24T09:12:12.242 INFO:teuthology.orchestra.run.trial028.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-24T09:12:12.242 INFO:teuthology.orchestra.run.trial028.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-24T09:12:12.242 INFO:teuthology.orchestra.run.trial028.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-24T09:12:12.242 INFO:teuthology.orchestra.run.trial028.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-24T09:12:12.242 INFO:teuthology.orchestra.run.trial028.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-24T09:12:12.242 INFO:teuthology.orchestra.run.trial028.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-24T09:12:12.242 INFO:teuthology.orchestra.run.trial028.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-24T09:12:12.243 INFO:teuthology.orchestra.run.trial028.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-24T09:12:12.243 INFO:teuthology.orchestra.run.trial028.stdout: python3-ceph-argparse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.243 INFO:teuthology.orchestra.run.trial028.stdout: python3-ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.243 INFO:teuthology.orchestra.run.trial028.stdout: python3-cephfs-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.243 INFO:teuthology.orchestra.run.trial028.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-24T09:12:12.243 INFO:teuthology.orchestra.run.trial028.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-24T09:12:12.243 INFO:teuthology.orchestra.run.trial028.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-24T09:12:12.243 INFO:teuthology.orchestra.run.trial028.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-24T09:12:12.243 INFO:teuthology.orchestra.run.trial028.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-24T09:12:12.243 INFO:teuthology.orchestra.run.trial028.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-24T09:12:12.243 INFO:teuthology.orchestra.run.trial028.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-24T09:12:12.243 INFO:teuthology.orchestra.run.trial028.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-24T09:12:12.244 INFO:teuthology.orchestra.run.trial028.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-24T09:12:12.244 INFO:teuthology.orchestra.run.trial028.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-24T09:12:12.244 INFO:teuthology.orchestra.run.trial028.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-24T09:12:12.244 INFO:teuthology.orchestra.run.trial028.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-24T09:12:12.244 INFO:teuthology.orchestra.run.trial028.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-24T09:12:12.244 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-24T09:12:12.244 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-24T09:12:12.244 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-24T09:12:12.244 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-24T09:12:12.244 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-24T09:12:12.244 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-24T09:12:12.244 INFO:teuthology.orchestra.run.trial028.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-24T09:12:12.244 INFO:teuthology.orchestra.run.trial028.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-24T09:12:12.245 INFO:teuthology.orchestra.run.trial028.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-24T09:12:12.245 INFO:teuthology.orchestra.run.trial028.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T09:12:12.245 INFO:teuthology.orchestra.run.trial028.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-24T09:12:12.245 INFO:teuthology.orchestra.run.trial028.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-24T09:12:12.245 INFO:teuthology.orchestra.run.trial028.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-24T09:12:12.245 INFO:teuthology.orchestra.run.trial028.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-24T09:12:12.245 INFO:teuthology.orchestra.run.trial028.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-24T09:12:12.246 INFO:teuthology.orchestra.run.trial028.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-24T09:12:12.246 INFO:teuthology.orchestra.run.trial028.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-24T09:12:12.246 INFO:teuthology.orchestra.run.trial028.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-24T09:12:12.246 INFO:teuthology.orchestra.run.trial028.stdout: python3-ply-3.11-14.el9.noarch 2026-02-24T09:12:12.246 INFO:teuthology.orchestra.run.trial028.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-24T09:12:12.246 INFO:teuthology.orchestra.run.trial028.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-24T09:12:12.247 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-24T09:12:12.247 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-24T09:12:12.247 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-24T09:12:12.247 INFO:teuthology.orchestra.run.trial028.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-24T09:12:12.247 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-24T09:12:12.247 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-24T09:12:12.248 INFO:teuthology.orchestra.run.trial028.stdout: python3-rados-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.248 INFO:teuthology.orchestra.run.trial028.stdout: python3-rbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.248 INFO:teuthology.orchestra.run.trial028.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-24T09:12:12.248 INFO:teuthology.orchestra.run.trial028.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-24T09:12:12.248 INFO:teuthology.orchestra.run.trial028.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-24T09:12:12.248 INFO:teuthology.orchestra.run.trial028.stdout: python3-rgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.248 INFO:teuthology.orchestra.run.trial028.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-24T09:12:12.248 INFO:teuthology.orchestra.run.trial028.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-24T09:12:12.249 INFO:teuthology.orchestra.run.trial028.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-24T09:12:12.249 INFO:teuthology.orchestra.run.trial028.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-24T09:12:12.249 INFO:teuthology.orchestra.run.trial028.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-24T09:12:12.249 INFO:teuthology.orchestra.run.trial028.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-24T09:12:12.249 INFO:teuthology.orchestra.run.trial028.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-24T09:12:12.249 INFO:teuthology.orchestra.run.trial028.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-24T09:12:12.249 INFO:teuthology.orchestra.run.trial028.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-24T09:12:12.249 INFO:teuthology.orchestra.run.trial028.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-24T09:12:12.249 INFO:teuthology.orchestra.run.trial028.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-24T09:12:12.250 INFO:teuthology.orchestra.run.trial028.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-24T09:12:12.250 INFO:teuthology.orchestra.run.trial028.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-24T09:12:12.250 INFO:teuthology.orchestra.run.trial028.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-24T09:12:12.250 INFO:teuthology.orchestra.run.trial028.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-24T09:12:12.250 INFO:teuthology.orchestra.run.trial028.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-24T09:12:12.250 INFO:teuthology.orchestra.run.trial028.stdout: rbd-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.250 INFO:teuthology.orchestra.run.trial028.stdout: rbd-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.251 INFO:teuthology.orchestra.run.trial028.stdout: rbd-nbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:12.251 INFO:teuthology.orchestra.run.trial028.stdout: re2-1:20211101-20.el9.x86_64 2026-02-24T09:12:12.251 INFO:teuthology.orchestra.run.trial028.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-24T09:12:12.251 INFO:teuthology.orchestra.run.trial028.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-24T09:12:12.251 INFO:teuthology.orchestra.run.trial028.stdout: unzip-6.0-59.el9.x86_64 2026-02-24T09:12:12.251 INFO:teuthology.orchestra.run.trial028.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-24T09:12:12.251 INFO:teuthology.orchestra.run.trial028.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-24T09:12:12.251 INFO:teuthology.orchestra.run.trial028.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-24T09:12:12.251 INFO:teuthology.orchestra.run.trial028.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-24T09:12:12.251 INFO:teuthology.orchestra.run.trial028.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-24T09:12:12.251 INFO:teuthology.orchestra.run.trial028.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-24T09:12:12.251 INFO:teuthology.orchestra.run.trial028.stdout: zip-3.0-35.el9.x86_64 2026-02-24T09:12:12.252 INFO:teuthology.orchestra.run.trial028.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-24T09:12:12.252 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:12:12.252 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-24T09:12:12.252 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5537.g5bc9a1ff.el9.x86 192/192 2026-02-24T09:12:12.403 INFO:teuthology.orchestra.run.trial074.stdout: Running scriptlet: libsmartcols-2.37.4-21.el9.x86_64 192/192 2026-02-24T09:12:12.403 INFO:teuthology.orchestra.run.trial074.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2026-02-24T09:12:12.404 INFO:teuthology.orchestra.run.trial074.stdout: 2026-02-24T09:12:12.479 DEBUG:teuthology.parallel:result is None 2026-02-24T09:12:13.379 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : ceph-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 1/192 2026-02-24T09:12:13.379 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : ceph-base-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2/192 2026-02-24T09:12:13.379 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 3/192 2026-02-24T09:12:13.380 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : ceph-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 4/192 2026-02-24T09:12:13.380 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5537.g5bc9a 5/192 2026-02-24T09:12:13.380 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : ceph-mds-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 6/192 2026-02-24T09:12:13.380 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : ceph-mgr-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 7/192 2026-02-24T09:12:13.380 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : ceph-mon-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 8/192 2026-02-24T09:12:13.380 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : ceph-osd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 9/192 2026-02-24T09:12:13.380 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : ceph-osd-classic-2:20.3.0-5537.g5bc9a1ff.el9.x86 10/192 2026-02-24T09:12:13.380 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5537.g5bc9a1ff.el9.x86 11/192 2026-02-24T09:12:13.380 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : ceph-radosgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 12/192 2026-02-24T09:12:13.380 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : ceph-selinux-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 13/192 2026-02-24T09:12:13.380 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : ceph-test-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 14/192 2026-02-24T09:12:13.380 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : cephfs-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 15/192 2026-02-24T09:12:13.380 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : cephfs-shell-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 16/192 2026-02-24T09:12:13.380 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : libcephfs-daemon-2:20.3.0-5537.g5bc9a1ff.el9.x86 17/192 2026-02-24T09:12:13.380 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : libcephfs-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_ 18/192 2026-02-24T09:12:13.380 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5537.g5bc9a1ff.el9.x86 19/192 2026-02-24T09:12:13.380 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : libcephfs2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 20/192 2026-02-24T09:12:13.380 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : libcephsqlite-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 21/192 2026-02-24T09:12:13.380 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : librados-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_6 22/192 2026-02-24T09:12:13.380 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : libradosstriper1-2:20.3.0-5537.g5bc9a1ff.el9.x86 23/192 2026-02-24T09:12:13.380 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : librgw2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 24/192 2026-02-24T09:12:13.380 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5537.g5bc9a1ff.el 25/192 2026-02-24T09:12:13.380 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-ceph-common-2:20.3.0-5537.g5bc9a1ff.el9. 26/192 2026-02-24T09:12:13.380 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-cephfs-2:20.3.0-5537.g5bc9a1ff.el9.x86_6 27/192 2026-02-24T09:12:13.380 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-rados-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 28/192 2026-02-24T09:12:13.380 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-rbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 29/192 2026-02-24T09:12:13.380 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-rgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 30/192 2026-02-24T09:12:13.380 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : rbd-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 31/192 2026-02-24T09:12:13.380 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : rbd-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 32/192 2026-02-24T09:12:13.380 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : rbd-nbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 33/192 2026-02-24T09:12:13.380 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5537.g5bc9a1ff. 34/192 2026-02-24T09:12:13.380 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noa 35/192 2026-02-24T09:12:13.380 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5537.g5bc9a1ff.el9.n 36/192 2026-02-24T09:12:13.385 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5537.g5bc 37/192 2026-02-24T09:12:13.385 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5537.g5bc9a1ff.el9.n 38/192 2026-02-24T09:12:13.385 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5537.g5bc9a1ff.el 39/192 2026-02-24T09:12:13.385 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5537.g5bc9a1ff.el9.noarch 40/192 2026-02-24T09:12:13.385 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5537.g5bc9a1ff.e 41/192 2026-02-24T09:12:13.385 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : ceph-volume-2:20.3.0-5537.g5bc9a1ff.el9.noarch 42/192 2026-02-24T09:12:13.385 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noarch 43/192 2026-02-24T09:12:13.385 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : cephfs-top-2:20.3.0-5537.g5bc9a1ff.el9.noarch 44/192 2026-02-24T09:12:13.385 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 45/192 2026-02-24T09:12:13.385 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 46/192 2026-02-24T09:12:13.385 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 47/192 2026-02-24T09:12:13.385 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 48/192 2026-02-24T09:12:13.385 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 49/192 2026-02-24T09:12:13.385 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 50/192 2026-02-24T09:12:13.385 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 51/192 2026-02-24T09:12:13.385 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 52/192 2026-02-24T09:12:13.385 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 53/192 2026-02-24T09:12:13.385 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 54/192 2026-02-24T09:12:13.385 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 55/192 2026-02-24T09:12:13.385 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 56/192 2026-02-24T09:12:13.385 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 57/192 2026-02-24T09:12:13.385 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-ply-3.11-14.el9.noarch 58/192 2026-02-24T09:12:13.385 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 59/192 2026-02-24T09:12:13.385 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 60/192 2026-02-24T09:12:13.385 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 61/192 2026-02-24T09:12:13.385 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 62/192 2026-02-24T09:12:13.385 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : unzip-6.0-59.el9.x86_64 63/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : zip-3.0-35.el9.x86_64 64/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : automake-1.16.2-8.el9.noarch 65/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : bison-3.7.4-5.el9.x86_64 66/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 67/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 68/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : flex-2.6.4-9.el9.x86_64 69/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 70/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 71/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 72/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 73/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 74/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 75/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 76/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 77/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 78/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 79/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : libuuid-devel-2.37.4-25.el9.x86_64 80/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 81/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 82/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 83/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : lua-5.4.4-4.el9.x86_64 84/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 85/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 86/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 87/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 88/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 89/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 90/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : postgresql-13.23-1.el9.x86_64 91/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 92/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 93/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 94/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 95/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 96/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 97/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 98/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 99/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 100/192 2026-02-24T09:12:13.386 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 101/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 102/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 103/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 104/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 105/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 106/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 107/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 108/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 109/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 110/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 111/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 112/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 113/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 114/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 115/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 116/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 117/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 118/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 119/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 120/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 121/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 122/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 123/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 124/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 125/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 126/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 127/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 128/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 129/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 130/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 131/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 132/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 133/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 134/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 135/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 136/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 137/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 138/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 139/192 2026-02-24T09:12:13.387 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 140/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 141/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 142/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 143/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 144/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 145/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 146/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 147/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 148/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 149/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 150/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 151/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 152/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 153/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 154/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 155/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 156/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 157/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 158/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 159/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 160/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 161/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 162/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 163/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 164/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 165/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 166/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 167/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 168/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 169/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 170/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 171/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : re2-1:20211101-20.el9.x86_64 172/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 173/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 174/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : librados2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 175/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 176/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : librbd1-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 177/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 178/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : libblkid-2.37.4-25.el9.x86_64 179/192 2026-02-24T09:12:13.388 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : libblkid-2.37.4-21.el9.x86_64 180/192 2026-02-24T09:12:13.389 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : libfdisk-2.37.4-25.el9.x86_64 181/192 2026-02-24T09:12:13.389 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : libfdisk-2.37.4-21.el9.x86_64 182/192 2026-02-24T09:12:13.389 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : libmount-2.37.4-25.el9.x86_64 183/192 2026-02-24T09:12:13.389 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : libmount-2.37.4-21.el9.x86_64 184/192 2026-02-24T09:12:13.389 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : libsmartcols-2.37.4-25.el9.x86_64 185/192 2026-02-24T09:12:13.389 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : libsmartcols-2.37.4-21.el9.x86_64 186/192 2026-02-24T09:12:13.389 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : libuuid-2.37.4-25.el9.x86_64 187/192 2026-02-24T09:12:13.389 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : libuuid-2.37.4-21.el9.x86_64 188/192 2026-02-24T09:12:13.389 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : util-linux-2.37.4-25.el9.x86_64 189/192 2026-02-24T09:12:13.389 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : util-linux-2.37.4-21.el9.x86_64 190/192 2026-02-24T09:12:13.389 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : util-linux-core-2.37.4-25.el9.x86_64 191/192 2026-02-24T09:12:13.497 INFO:teuthology.orchestra.run.trial074.stdout: Verifying : util-linux-core-2.37.4-21.el9.x86_64 192/192 2026-02-24T09:12:13.497 INFO:teuthology.orchestra.run.trial074.stdout: 2026-02-24T09:12:13.497 INFO:teuthology.orchestra.run.trial074.stdout:Upgraded: 2026-02-24T09:12:13.497 INFO:teuthology.orchestra.run.trial074.stdout: libblkid-2.37.4-25.el9.x86_64 2026-02-24T09:12:13.498 INFO:teuthology.orchestra.run.trial074.stdout: libfdisk-2.37.4-25.el9.x86_64 2026-02-24T09:12:13.498 INFO:teuthology.orchestra.run.trial074.stdout: libmount-2.37.4-25.el9.x86_64 2026-02-24T09:12:13.498 INFO:teuthology.orchestra.run.trial074.stdout: librados2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.498 INFO:teuthology.orchestra.run.trial074.stdout: librbd1-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.498 INFO:teuthology.orchestra.run.trial074.stdout: libsmartcols-2.37.4-25.el9.x86_64 2026-02-24T09:12:13.498 INFO:teuthology.orchestra.run.trial074.stdout: libuuid-2.37.4-25.el9.x86_64 2026-02-24T09:12:13.498 INFO:teuthology.orchestra.run.trial074.stdout: util-linux-2.37.4-25.el9.x86_64 2026-02-24T09:12:13.498 INFO:teuthology.orchestra.run.trial074.stdout: util-linux-core-2.37.4-25.el9.x86_64 2026-02-24T09:12:13.498 INFO:teuthology.orchestra.run.trial074.stdout:Installed: 2026-02-24T09:12:13.498 INFO:teuthology.orchestra.run.trial074.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-24T09:12:13.498 INFO:teuthology.orchestra.run.trial074.stdout: automake-1.16.2-8.el9.noarch 2026-02-24T09:12:13.498 INFO:teuthology.orchestra.run.trial074.stdout: bison-3.7.4-5.el9.x86_64 2026-02-24T09:12:13.499 INFO:teuthology.orchestra.run.trial074.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-24T09:12:13.499 INFO:teuthology.orchestra.run.trial074.stdout: ceph-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.499 INFO:teuthology.orchestra.run.trial074.stdout: ceph-base-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.499 INFO:teuthology.orchestra.run.trial074.stdout: ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.499 INFO:teuthology.orchestra.run.trial074.stdout: ceph-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.499 INFO:teuthology.orchestra.run.trial074.stdout: ceph-grafana-dashboards-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:12:13.499 INFO:teuthology.orchestra.run.trial074.stdout: ceph-immutable-object-cache-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.499 INFO:teuthology.orchestra.run.trial074.stdout: ceph-mds-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.499 INFO:teuthology.orchestra.run.trial074.stdout: ceph-mgr-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.499 INFO:teuthology.orchestra.run.trial074.stdout: ceph-mgr-cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:12:13.499 INFO:teuthology.orchestra.run.trial074.stdout: ceph-mgr-dashboard-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:12:13.499 INFO:teuthology.orchestra.run.trial074.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:12:13.500 INFO:teuthology.orchestra.run.trial074.stdout: ceph-mgr-k8sevents-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:12:13.500 INFO:teuthology.orchestra.run.trial074.stdout: ceph-mgr-modules-core-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:12:13.500 INFO:teuthology.orchestra.run.trial074.stdout: ceph-mgr-rook-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:12:13.500 INFO:teuthology.orchestra.run.trial074.stdout: ceph-mon-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.500 INFO:teuthology.orchestra.run.trial074.stdout: ceph-osd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.500 INFO:teuthology.orchestra.run.trial074.stdout: ceph-osd-classic-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.500 INFO:teuthology.orchestra.run.trial074.stdout: ceph-osd-crimson-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.500 INFO:teuthology.orchestra.run.trial074.stdout: ceph-prometheus-alerts-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:12:13.500 INFO:teuthology.orchestra.run.trial074.stdout: ceph-radosgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.500 INFO:teuthology.orchestra.run.trial074.stdout: ceph-selinux-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.500 INFO:teuthology.orchestra.run.trial074.stdout: ceph-test-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.500 INFO:teuthology.orchestra.run.trial074.stdout: ceph-volume-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:12:13.501 INFO:teuthology.orchestra.run.trial074.stdout: cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:12:13.501 INFO:teuthology.orchestra.run.trial074.stdout: cephfs-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.501 INFO:teuthology.orchestra.run.trial074.stdout: cephfs-shell-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.501 INFO:teuthology.orchestra.run.trial074.stdout: cephfs-top-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:12:13.501 INFO:teuthology.orchestra.run.trial074.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-24T09:12:13.501 INFO:teuthology.orchestra.run.trial074.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-24T09:12:13.501 INFO:teuthology.orchestra.run.trial074.stdout: flex-2.6.4-9.el9.x86_64 2026-02-24T09:12:13.501 INFO:teuthology.orchestra.run.trial074.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-24T09:12:13.501 INFO:teuthology.orchestra.run.trial074.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-24T09:12:13.501 INFO:teuthology.orchestra.run.trial074.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-24T09:12:13.501 INFO:teuthology.orchestra.run.trial074.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-24T09:12:13.501 INFO:teuthology.orchestra.run.trial074.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-24T09:12:13.501 INFO:teuthology.orchestra.run.trial074.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-24T09:12:13.502 INFO:teuthology.orchestra.run.trial074.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-24T09:12:13.502 INFO:teuthology.orchestra.run.trial074.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-24T09:12:13.502 INFO:teuthology.orchestra.run.trial074.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-24T09:12:13.502 INFO:teuthology.orchestra.run.trial074.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-24T09:12:13.502 INFO:teuthology.orchestra.run.trial074.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-24T09:12:13.502 INFO:teuthology.orchestra.run.trial074.stdout: libcephfs-daemon-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.502 INFO:teuthology.orchestra.run.trial074.stdout: libcephfs-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.502 INFO:teuthology.orchestra.run.trial074.stdout: libcephfs-proxy2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.502 INFO:teuthology.orchestra.run.trial074.stdout: libcephfs2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.502 INFO:teuthology.orchestra.run.trial074.stdout: libcephsqlite-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.502 INFO:teuthology.orchestra.run.trial074.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-24T09:12:13.502 INFO:teuthology.orchestra.run.trial074.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-24T09:12:13.502 INFO:teuthology.orchestra.run.trial074.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-24T09:12:13.503 INFO:teuthology.orchestra.run.trial074.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-24T09:12:13.503 INFO:teuthology.orchestra.run.trial074.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-24T09:12:13.503 INFO:teuthology.orchestra.run.trial074.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-24T09:12:13.503 INFO:teuthology.orchestra.run.trial074.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-24T09:12:13.503 INFO:teuthology.orchestra.run.trial074.stdout: librados-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.503 INFO:teuthology.orchestra.run.trial074.stdout: libradosstriper1-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.503 INFO:teuthology.orchestra.run.trial074.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-24T09:12:13.503 INFO:teuthology.orchestra.run.trial074.stdout: librgw2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.503 INFO:teuthology.orchestra.run.trial074.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T09:12:13.503 INFO:teuthology.orchestra.run.trial074.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-24T09:12:13.503 INFO:teuthology.orchestra.run.trial074.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-24T09:12:13.503 INFO:teuthology.orchestra.run.trial074.stdout: libuuid-devel-2.37.4-25.el9.x86_64 2026-02-24T09:12:13.503 INFO:teuthology.orchestra.run.trial074.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-24T09:12:13.504 INFO:teuthology.orchestra.run.trial074.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-24T09:12:13.504 INFO:teuthology.orchestra.run.trial074.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-24T09:12:13.504 INFO:teuthology.orchestra.run.trial074.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-24T09:12:13.504 INFO:teuthology.orchestra.run.trial074.stdout: lua-5.4.4-4.el9.x86_64 2026-02-24T09:12:13.504 INFO:teuthology.orchestra.run.trial074.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-24T09:12:13.504 INFO:teuthology.orchestra.run.trial074.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-24T09:12:13.504 INFO:teuthology.orchestra.run.trial074.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-24T09:12:13.504 INFO:teuthology.orchestra.run.trial074.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-24T09:12:13.504 INFO:teuthology.orchestra.run.trial074.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-24T09:12:13.504 INFO:teuthology.orchestra.run.trial074.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-24T09:12:13.504 INFO:teuthology.orchestra.run.trial074.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-24T09:12:13.504 INFO:teuthology.orchestra.run.trial074.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-24T09:12:13.504 INFO:teuthology.orchestra.run.trial074.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-24T09:12:13.505 INFO:teuthology.orchestra.run.trial074.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-24T09:12:13.505 INFO:teuthology.orchestra.run.trial074.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-24T09:12:13.505 INFO:teuthology.orchestra.run.trial074.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-24T09:12:13.505 INFO:teuthology.orchestra.run.trial074.stdout: postgresql-13.23-1.el9.x86_64 2026-02-24T09:12:13.505 INFO:teuthology.orchestra.run.trial074.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-24T09:12:13.505 INFO:teuthology.orchestra.run.trial074.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-24T09:12:13.505 INFO:teuthology.orchestra.run.trial074.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-24T09:12:13.505 INFO:teuthology.orchestra.run.trial074.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-24T09:12:13.505 INFO:teuthology.orchestra.run.trial074.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-24T09:12:13.505 INFO:teuthology.orchestra.run.trial074.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-24T09:12:13.505 INFO:teuthology.orchestra.run.trial074.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-24T09:12:13.505 INFO:teuthology.orchestra.run.trial074.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-24T09:12:13.505 INFO:teuthology.orchestra.run.trial074.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-24T09:12:13.506 INFO:teuthology.orchestra.run.trial074.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-24T09:12:13.506 INFO:teuthology.orchestra.run.trial074.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-24T09:12:13.506 INFO:teuthology.orchestra.run.trial074.stdout: python3-ceph-argparse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.506 INFO:teuthology.orchestra.run.trial074.stdout: python3-ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.506 INFO:teuthology.orchestra.run.trial074.stdout: python3-cephfs-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.506 INFO:teuthology.orchestra.run.trial074.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-24T09:12:13.506 INFO:teuthology.orchestra.run.trial074.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-24T09:12:13.506 INFO:teuthology.orchestra.run.trial074.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-24T09:12:13.506 INFO:teuthology.orchestra.run.trial074.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-24T09:12:13.506 INFO:teuthology.orchestra.run.trial074.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-24T09:12:13.506 INFO:teuthology.orchestra.run.trial074.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-24T09:12:13.506 INFO:teuthology.orchestra.run.trial074.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-24T09:12:13.506 INFO:teuthology.orchestra.run.trial074.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-24T09:12:13.507 INFO:teuthology.orchestra.run.trial074.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-24T09:12:13.507 INFO:teuthology.orchestra.run.trial074.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-24T09:12:13.507 INFO:teuthology.orchestra.run.trial074.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-24T09:12:13.507 INFO:teuthology.orchestra.run.trial074.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-24T09:12:13.507 INFO:teuthology.orchestra.run.trial074.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-24T09:12:13.507 INFO:teuthology.orchestra.run.trial074.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-24T09:12:13.507 INFO:teuthology.orchestra.run.trial074.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-24T09:12:13.507 INFO:teuthology.orchestra.run.trial074.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-24T09:12:13.507 INFO:teuthology.orchestra.run.trial074.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-24T09:12:13.507 INFO:teuthology.orchestra.run.trial074.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-24T09:12:13.507 INFO:teuthology.orchestra.run.trial074.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-24T09:12:13.507 INFO:teuthology.orchestra.run.trial074.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-24T09:12:13.508 INFO:teuthology.orchestra.run.trial074.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-24T09:12:13.508 INFO:teuthology.orchestra.run.trial074.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-24T09:12:13.508 INFO:teuthology.orchestra.run.trial074.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T09:12:13.508 INFO:teuthology.orchestra.run.trial074.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-24T09:12:13.508 INFO:teuthology.orchestra.run.trial074.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-24T09:12:13.508 INFO:teuthology.orchestra.run.trial074.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-24T09:12:13.508 INFO:teuthology.orchestra.run.trial074.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-24T09:12:13.508 INFO:teuthology.orchestra.run.trial074.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-24T09:12:13.508 INFO:teuthology.orchestra.run.trial074.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-24T09:12:13.508 INFO:teuthology.orchestra.run.trial074.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-24T09:12:13.508 INFO:teuthology.orchestra.run.trial074.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-24T09:12:13.508 INFO:teuthology.orchestra.run.trial074.stdout: python3-ply-3.11-14.el9.noarch 2026-02-24T09:12:13.508 INFO:teuthology.orchestra.run.trial074.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-24T09:12:13.509 INFO:teuthology.orchestra.run.trial074.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-24T09:12:13.509 INFO:teuthology.orchestra.run.trial074.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-24T09:12:13.509 INFO:teuthology.orchestra.run.trial074.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-24T09:12:13.509 INFO:teuthology.orchestra.run.trial074.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-24T09:12:13.509 INFO:teuthology.orchestra.run.trial074.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-24T09:12:13.509 INFO:teuthology.orchestra.run.trial074.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-24T09:12:13.509 INFO:teuthology.orchestra.run.trial074.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-24T09:12:13.509 INFO:teuthology.orchestra.run.trial074.stdout: python3-rados-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.509 INFO:teuthology.orchestra.run.trial074.stdout: python3-rbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.509 INFO:teuthology.orchestra.run.trial074.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-24T09:12:13.509 INFO:teuthology.orchestra.run.trial074.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-24T09:12:13.509 INFO:teuthology.orchestra.run.trial074.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-24T09:12:13.509 INFO:teuthology.orchestra.run.trial074.stdout: python3-rgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.510 INFO:teuthology.orchestra.run.trial074.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-24T09:12:13.510 INFO:teuthology.orchestra.run.trial074.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-24T09:12:13.510 INFO:teuthology.orchestra.run.trial074.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-24T09:12:13.510 INFO:teuthology.orchestra.run.trial074.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-24T09:12:13.510 INFO:teuthology.orchestra.run.trial074.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-24T09:12:13.510 INFO:teuthology.orchestra.run.trial074.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-24T09:12:13.510 INFO:teuthology.orchestra.run.trial074.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-24T09:12:13.510 INFO:teuthology.orchestra.run.trial074.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-24T09:12:13.510 INFO:teuthology.orchestra.run.trial074.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-24T09:12:13.510 INFO:teuthology.orchestra.run.trial074.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-24T09:12:13.510 INFO:teuthology.orchestra.run.trial074.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-24T09:12:13.510 INFO:teuthology.orchestra.run.trial074.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-24T09:12:13.510 INFO:teuthology.orchestra.run.trial074.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-24T09:12:13.510 INFO:teuthology.orchestra.run.trial074.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-24T09:12:13.511 INFO:teuthology.orchestra.run.trial074.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-24T09:12:13.511 INFO:teuthology.orchestra.run.trial074.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-24T09:12:13.511 INFO:teuthology.orchestra.run.trial074.stdout: rbd-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.511 INFO:teuthology.orchestra.run.trial074.stdout: rbd-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.511 INFO:teuthology.orchestra.run.trial074.stdout: rbd-nbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:12:13.511 INFO:teuthology.orchestra.run.trial074.stdout: re2-1:20211101-20.el9.x86_64 2026-02-24T09:12:13.511 INFO:teuthology.orchestra.run.trial074.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-24T09:12:13.511 INFO:teuthology.orchestra.run.trial074.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-24T09:12:13.511 INFO:teuthology.orchestra.run.trial074.stdout: unzip-6.0-59.el9.x86_64 2026-02-24T09:12:13.511 INFO:teuthology.orchestra.run.trial074.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-24T09:12:13.511 INFO:teuthology.orchestra.run.trial074.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-24T09:12:13.511 INFO:teuthology.orchestra.run.trial074.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-24T09:12:13.511 INFO:teuthology.orchestra.run.trial074.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-24T09:12:13.512 INFO:teuthology.orchestra.run.trial074.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-24T09:12:13.512 INFO:teuthology.orchestra.run.trial074.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-24T09:12:13.512 INFO:teuthology.orchestra.run.trial074.stdout: zip-3.0-35.el9.x86_64 2026-02-24T09:12:13.512 INFO:teuthology.orchestra.run.trial074.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-24T09:12:13.512 INFO:teuthology.orchestra.run.trial074.stdout: 2026-02-24T09:12:13.512 INFO:teuthology.orchestra.run.trial074.stdout:Complete! 2026-02-24T09:12:13.735 DEBUG:teuthology.parallel:result is None 2026-02-24T09:12:13.736 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5bc9a1ffc19df681248ece8c3c8c7191a571745b 2026-02-24T09:12:13.861 DEBUG:teuthology.orchestra.run.trial028:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-24T09:12:13.906 INFO:teuthology.orchestra.run.trial028.stdout:20.3.0-5537.g5bc9a1ff.el9 2026-02-24T09:12:13.906 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5537.g5bc9a1ff.el9 2026-02-24T09:12:13.906 INFO:teuthology.task.install:The correct ceph version 20.3.0-5537.g5bc9a1ff is installed. 2026-02-24T09:12:13.909 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5bc9a1ffc19df681248ece8c3c8c7191a571745b 2026-02-24T09:12:14.058 DEBUG:teuthology.orchestra.run.trial074:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-24T09:12:14.101 INFO:teuthology.orchestra.run.trial074.stdout:20.3.0-5537.g5bc9a1ff.el9 2026-02-24T09:12:14.101 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5537.g5bc9a1ff.el9 2026-02-24T09:12:14.101 INFO:teuthology.task.install:The correct ceph version 20.3.0-5537.g5bc9a1ff is installed. 2026-02-24T09:12:14.103 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5bc9a1ffc19df681248ece8c3c8c7191a571745b 2026-02-24T09:12:14.260 DEBUG:teuthology.orchestra.run.trial159:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-24T09:12:14.304 INFO:teuthology.orchestra.run.trial159.stdout:20.3.0-5537.g5bc9a1ff.el9 2026-02-24T09:12:14.304 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5537.g5bc9a1ff.el9 2026-02-24T09:12:14.304 INFO:teuthology.task.install:The correct ceph version 20.3.0-5537.g5bc9a1ff is installed. 2026-02-24T09:12:14.306 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-24T09:12:14.307 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-24T09:12:14.307 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-24T09:12:14.365 DEBUG:teuthology.orchestra.run.trial074:> set -ex 2026-02-24T09:12:14.366 DEBUG:teuthology.orchestra.run.trial074:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-24T09:12:14.423 DEBUG:teuthology.orchestra.run.trial159:> set -ex 2026-02-24T09:12:14.424 DEBUG:teuthology.orchestra.run.trial159:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-24T09:12:14.480 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-24T09:12:14.481 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-24T09:12:14.481 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/usr/bin/daemon-helper 2026-02-24T09:12:14.538 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-24T09:12:14.632 DEBUG:teuthology.orchestra.run.trial074:> set -ex 2026-02-24T09:12:14.632 DEBUG:teuthology.orchestra.run.trial074:> sudo dd of=/usr/bin/daemon-helper 2026-02-24T09:12:14.687 DEBUG:teuthology.orchestra.run.trial074:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-24T09:12:14.782 DEBUG:teuthology.orchestra.run.trial159:> set -ex 2026-02-24T09:12:14.783 DEBUG:teuthology.orchestra.run.trial159:> sudo dd of=/usr/bin/daemon-helper 2026-02-24T09:12:14.841 DEBUG:teuthology.orchestra.run.trial159:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-24T09:12:14.937 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-24T09:12:14.937 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-24T09:12:14.938 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-24T09:12:14.992 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-24T09:12:15.089 DEBUG:teuthology.orchestra.run.trial074:> set -ex 2026-02-24T09:12:15.089 DEBUG:teuthology.orchestra.run.trial074:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-24T09:12:15.147 DEBUG:teuthology.orchestra.run.trial074:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-24T09:12:15.242 DEBUG:teuthology.orchestra.run.trial159:> set -ex 2026-02-24T09:12:15.243 DEBUG:teuthology.orchestra.run.trial159:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-24T09:12:15.299 DEBUG:teuthology.orchestra.run.trial159:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-24T09:12:15.395 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-24T09:12:15.395 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-24T09:12:15.395 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/usr/bin/stdin-killer 2026-02-24T09:12:15.452 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-24T09:12:15.547 DEBUG:teuthology.orchestra.run.trial074:> set -ex 2026-02-24T09:12:15.547 DEBUG:teuthology.orchestra.run.trial074:> sudo dd of=/usr/bin/stdin-killer 2026-02-24T09:12:15.603 DEBUG:teuthology.orchestra.run.trial074:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-24T09:12:15.700 DEBUG:teuthology.orchestra.run.trial159:> set -ex 2026-02-24T09:12:15.700 DEBUG:teuthology.orchestra.run.trial159:> sudo dd of=/usr/bin/stdin-killer 2026-02-24T09:12:15.756 DEBUG:teuthology.orchestra.run.trial159:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-24T09:12:15.853 INFO:teuthology.run_tasks:Running task cephadm... 2026-02-24T09:12:16.017 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['disabled'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds use global snaprealm seq for subvol': False, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True, 'mgr/snap_schedule/log_level': 'debug', 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'client_fscrypt_dummy_encryption': True}, 'mds': {'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.2}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'is offline because no MDS', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'BLUESTORE_SLOW_OP_ALERT', 'slow operation indications in BlueStore', 'experiencing slow operations in BlueStore', 'MGR_MODULE_ERROR', 'OSD_DOWN', 'osd.* is down', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'osds down', 'osd.* is down', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'pg .* is stuck inactive', 'pg .* is .*degraded'], 'mgr-modules': ['snap_schedule'], 'sha1': '5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2026-02-24T09:12:16.017 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b 2026-02-24T09:12:16.019 INFO:tasks.cephadm:Cluster fsid is e9ad50af-1160-11f1-800e-d404e6e7d460 2026-02-24T09:12:16.019 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-02-24T09:12:16.019 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '10.20.193.28', 'mon.b': '10.20.193.74', 'mon.c': '10.20.193.159'} 2026-02-24T09:12:16.019 INFO:tasks.cephadm:First mon is mon.a on trial028 2026-02-24T09:12:16.019 INFO:tasks.cephadm:First mgr is x 2026-02-24T09:12:16.019 INFO:tasks.cephadm:Normalizing hostnames... 2026-02-24T09:12:16.019 DEBUG:teuthology.orchestra.run.trial028:> sudo hostname $(hostname -s) 2026-02-24T09:12:16.076 DEBUG:teuthology.orchestra.run.trial074:> sudo hostname $(hostname -s) 2026-02-24T09:12:16.135 DEBUG:teuthology.orchestra.run.trial159:> sudo hostname $(hostname -s) 2026-02-24T09:12:16.192 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-02-24T09:12:16.193 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5bc9a1ffc19df681248ece8c3c8c7191a571745b 2026-02-24T09:12:16.361 INFO:tasks.cephadm:builder_project result: [{'url': 'https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/flavors/default/', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/flavors/default/', 'ref': 'wip-vshankar-testing-20260223.155722', 'sha1': '5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'distro': 'centos', 'distro_version': '9', 'distro_codename': None, 'modified': '2026-02-24 04:18:34.321058', 'status': 'ready', 'flavor': 'default', 'project': 'ceph', 'archs': ['x86_64', 'source'], 'extra': {'version': '20.3.0-5537-g5bc9a1ff', 'package_manager_version': '20.3.0-5537.g5bc9a1ff', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/3216/', 'root_build_cause': '', 'node_name': '10.20.192.26+soko16', 'job_name': 'ceph-dev-pipeline'}}] 2026-02-24T09:12:16.516 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-vshankar-testing-20260223.155722, sha1 5bc9a1ffc19df681248ece8c3c8c7191a571745b from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=5bc9a1ffc19df681248ece8c3c8c7191a571745b 2026-02-24T09:12:16.518 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/x86_64/flavors/default/cephadm 2026-02-24T09:12:16.518 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/x86_64/flavors/default/cephadm 2026-02-24T09:12:16.518 DEBUG:teuthology.orchestra.run.trial028:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-24T09:12:16.808 INFO:teuthology.orchestra.run.trial028.stdout:-rw-r--r--. 1 ubuntu ubuntu 1076303 Feb 24 09:12 /home/ubuntu/cephtest/cephadm 2026-02-24T09:12:16.809 DEBUG:teuthology.orchestra.run.trial074:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-24T09:12:17.125 INFO:teuthology.orchestra.run.trial074.stdout:-rw-r--r--. 1 ubuntu ubuntu 1076303 Feb 24 09:12 /home/ubuntu/cephtest/cephadm 2026-02-24T09:12:17.125 DEBUG:teuthology.orchestra.run.trial159:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-24T09:12:17.429 INFO:teuthology.orchestra.run.trial159.stdout:-rw-r--r--. 1 ubuntu ubuntu 1076303 Feb 24 09:12 /home/ubuntu/cephtest/cephadm 2026-02-24T09:12:17.430 DEBUG:teuthology.orchestra.run.trial028:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-24T09:12:17.470 DEBUG:teuthology.orchestra.run.trial074:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-24T09:12:17.510 DEBUG:teuthology.orchestra.run.trial159:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-24T09:12:17.576 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b on all hosts... 2026-02-24T09:12:17.576 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b pull 2026-02-24T09:12:17.580 DEBUG:teuthology.orchestra.run.trial074:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b pull 2026-02-24T09:12:17.584 DEBUG:teuthology.orchestra.run.trial159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b pull 2026-02-24T09:12:17.939 INFO:teuthology.orchestra.run.trial028.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b... 2026-02-24T09:12:17.942 INFO:teuthology.orchestra.run.trial074.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b... 2026-02-24T09:12:17.946 INFO:teuthology.orchestra.run.trial159.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b... 2026-02-24T09:12:29.254 INFO:teuthology.orchestra.run.trial159.stdout:{ 2026-02-24T09:12:29.254 INFO:teuthology.orchestra.run.trial159.stdout: "ceph_version": "ceph version 20.3.0-5537-g5bc9a1ff (5bc9a1ffc19df681248ece8c3c8c7191a571745b) tentacle (dev)", 2026-02-24T09:12:29.254 INFO:teuthology.orchestra.run.trial159.stdout: "image_id": "5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212", 2026-02-24T09:12:29.255 INFO:teuthology.orchestra.run.trial159.stdout: "repo_digests": [ 2026-02-24T09:12:29.255 INFO:teuthology.orchestra.run.trial159.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b" 2026-02-24T09:12:29.255 INFO:teuthology.orchestra.run.trial159.stdout: ] 2026-02-24T09:12:29.255 INFO:teuthology.orchestra.run.trial159.stdout:} 2026-02-24T09:12:29.292 INFO:teuthology.orchestra.run.trial074.stdout:{ 2026-02-24T09:12:29.292 INFO:teuthology.orchestra.run.trial074.stdout: "ceph_version": "ceph version 20.3.0-5537-g5bc9a1ff (5bc9a1ffc19df681248ece8c3c8c7191a571745b) tentacle (dev)", 2026-02-24T09:12:29.292 INFO:teuthology.orchestra.run.trial074.stdout: "image_id": "5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212", 2026-02-24T09:12:29.292 INFO:teuthology.orchestra.run.trial074.stdout: "repo_digests": [ 2026-02-24T09:12:29.292 INFO:teuthology.orchestra.run.trial074.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b" 2026-02-24T09:12:29.293 INFO:teuthology.orchestra.run.trial074.stdout: ] 2026-02-24T09:12:29.293 INFO:teuthology.orchestra.run.trial074.stdout:} 2026-02-24T09:12:29.430 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-24T09:12:29.430 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version": "ceph version 20.3.0-5537-g5bc9a1ff (5bc9a1ffc19df681248ece8c3c8c7191a571745b) tentacle (dev)", 2026-02-24T09:12:29.430 INFO:teuthology.orchestra.run.trial028.stdout: "image_id": "5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212", 2026-02-24T09:12:29.430 INFO:teuthology.orchestra.run.trial028.stdout: "repo_digests": [ 2026-02-24T09:12:29.431 INFO:teuthology.orchestra.run.trial028.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b" 2026-02-24T09:12:29.431 INFO:teuthology.orchestra.run.trial028.stdout: ] 2026-02-24T09:12:29.431 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-24T09:12:29.454 DEBUG:teuthology.orchestra.run.trial028:> sudo mkdir -p /etc/ceph 2026-02-24T09:12:29.634 DEBUG:teuthology.orchestra.run.trial074:> sudo mkdir -p /etc/ceph 2026-02-24T09:12:29.693 DEBUG:teuthology.orchestra.run.trial159:> sudo mkdir -p /etc/ceph 2026-02-24T09:12:29.754 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod 777 /etc/ceph 2026-02-24T09:12:29.810 DEBUG:teuthology.orchestra.run.trial074:> sudo chmod 777 /etc/ceph 2026-02-24T09:12:29.867 DEBUG:teuthology.orchestra.run.trial159:> sudo chmod 777 /etc/ceph 2026-02-24T09:12:29.924 INFO:tasks.cephadm:Writing seed config... 2026-02-24T09:12:29.926 INFO:tasks.cephadm: override: [client] client_fscrypt_dummy_encryption = True 2026-02-24T09:12:29.926 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2026-02-24T09:12:29.926 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.2 2026-02-24T09:12:29.926 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2026-02-24T09:12:29.926 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-02-24T09:12:29.927 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-02-24T09:12:29.927 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-02-24T09:12:29.927 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-02-24T09:12:29.927 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-02-24T09:12:29.927 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2026-02-24T09:12:29.927 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2026-02-24T09:12:29.927 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2026-02-24T09:12:29.927 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2026-02-24T09:12:29.927 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2026-02-24T09:12:29.927 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2026-02-24T09:12:29.927 INFO:tasks.cephadm: override: [osd] debug ms = 1 2026-02-24T09:12:29.927 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-02-24T09:12:29.928 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2026-02-24T09:12:29.928 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2026-02-24T09:12:29.928 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2026-02-24T09:12:29.928 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2026-02-24T09:12:29.928 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2026-02-24T09:12:29.928 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2026-02-24T09:12:29.928 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2026-02-24T09:12:29.928 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2026-02-24T09:12:29.929 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-24T09:12:29.929 DEBUG:teuthology.orchestra.run.trial028:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-02-24T09:12:29.969 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = e9ad50af-1160-11f1-800e-d404e6e7d460 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd mclock skip benchmark = true osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client_fscrypt_dummy_encryption = True [mds] mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.2 2026-02-24T09:12:29.969 DEBUG:teuthology.orchestra.run.trial028:mon.a> sudo journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mon.a.service 2026-02-24T09:12:30.012 DEBUG:teuthology.orchestra.run.trial028:mgr.x> sudo journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mgr.x.service 2026-02-24T09:12:30.058 INFO:tasks.cephadm:Bootstrapping... 2026-02-24T09:12:30.058 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b -v bootstrap --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 10.20.193.28 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-02-24T09:12:30.251 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-24T09:12:30.251 INFO:teuthology.orchestra.run.trial028.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', '-v', 'bootstrap', '--fsid', 'e9ad50af-1160-11f1-800e-d404e6e7d460', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '10.20.193.28', '--skip-admin-label'] 2026-02-24T09:12:30.252 INFO:teuthology.orchestra.run.trial028.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-02-24T09:12:30.252 INFO:teuthology.orchestra.run.trial028.stdout:Verifying podman|docker is present... 2026-02-24T09:12:30.283 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stdout 5.8.0 2026-02-24T09:12:30.283 INFO:teuthology.orchestra.run.trial028.stdout:Verifying lvm2 is present... 2026-02-24T09:12:30.283 INFO:teuthology.orchestra.run.trial028.stdout:Verifying time synchronization is in place... 2026-02-24T09:12:30.295 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-24T09:12:30.295 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-24T09:12:30.306 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-24T09:12:30.306 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout inactive 2026-02-24T09:12:30.317 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout enabled 2026-02-24T09:12:30.328 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout active 2026-02-24T09:12:30.328 INFO:teuthology.orchestra.run.trial028.stdout:Unit chronyd.service is enabled and running 2026-02-24T09:12:30.328 INFO:teuthology.orchestra.run.trial028.stdout:Repeating the final host check... 2026-02-24T09:12:30.361 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stdout 5.8.0 2026-02-24T09:12:30.361 INFO:teuthology.orchestra.run.trial028.stdout:podman (/bin/podman) version 5.8.0 is present 2026-02-24T09:12:30.361 INFO:teuthology.orchestra.run.trial028.stdout:systemctl is present 2026-02-24T09:12:30.361 INFO:teuthology.orchestra.run.trial028.stdout:lvcreate is present 2026-02-24T09:12:30.372 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-24T09:12:30.372 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-24T09:12:30.383 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-24T09:12:30.383 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout inactive 2026-02-24T09:12:30.394 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout enabled 2026-02-24T09:12:30.405 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout active 2026-02-24T09:12:30.405 INFO:teuthology.orchestra.run.trial028.stdout:Unit chronyd.service is enabled and running 2026-02-24T09:12:30.405 INFO:teuthology.orchestra.run.trial028.stdout:Host looks OK 2026-02-24T09:12:30.405 INFO:teuthology.orchestra.run.trial028.stdout:Cluster fsid: e9ad50af-1160-11f1-800e-d404e6e7d460 2026-02-24T09:12:30.406 INFO:teuthology.orchestra.run.trial028.stdout:Acquiring lock 140715469219008 on /run/cephadm/e9ad50af-1160-11f1-800e-d404e6e7d460.lock 2026-02-24T09:12:30.406 INFO:teuthology.orchestra.run.trial028.stdout:Lock 140715469219008 acquired on /run/cephadm/e9ad50af-1160-11f1-800e-d404e6e7d460.lock 2026-02-24T09:12:30.406 INFO:teuthology.orchestra.run.trial028.stdout:Verifying IP 10.20.193.28 port 3300 ... 2026-02-24T09:12:30.406 INFO:teuthology.orchestra.run.trial028.stdout:Verifying IP 10.20.193.28 port 6789 ... 2026-02-24T09:12:30.407 INFO:teuthology.orchestra.run.trial028.stdout:Base mon IP(s) is [10.20.193.28:3300, 10.20.193.28:6789], mon addrv is [v2:10.20.193.28:3300,v1:10.20.193.28:6789] 2026-02-24T09:12:30.411 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout default via 10.20.192.1 dev enp1s0f0np0 proto dhcp src 10.20.193.28 metric 100 2026-02-24T09:12:30.411 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout 10.20.192.0/20 dev enp1s0f0np0 proto kernel scope link src 10.20.193.28 metric 100 2026-02-24T09:12:30.417 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-02-24T09:12:30.417 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout fe80::/64 dev enp1s0f0np0 proto kernel metric 256 pref medium 2026-02-24T09:12:30.422 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-02-24T09:12:30.422 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-02-24T09:12:30.422 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-24T09:12:30.422 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout 2: enp1s0f0np0: mtu 1500 state UP qlen 1000 2026-02-24T09:12:30.423 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout inet6 fe80::925a:8ff:fe77:630c/64 scope link proto kernel_ll 2026-02-24T09:12:30.423 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-24T09:12:30.423 INFO:teuthology.orchestra.run.trial028.stdout:Mon IP `10.20.193.28` is in CIDR network `10.20.192.0/20` 2026-02-24T09:12:30.423 INFO:teuthology.orchestra.run.trial028.stdout:Mon IP `10.20.193.28` is in CIDR network `10.20.192.0/20` 2026-02-24T09:12:30.424 INFO:teuthology.orchestra.run.trial028.stdout:Inferred mon public CIDR from local network configuration ['10.20.192.0/20', '10.20.192.0/20'] 2026-02-24T09:12:30.424 INFO:teuthology.orchestra.run.trial028.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-02-24T09:12:30.424 INFO:teuthology.orchestra.run.trial028.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b... 2026-02-24T09:12:30.713 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stdout 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 2026-02-24T09:12:30.713 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b... 2026-02-24T09:12:30.713 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stderr Getting image source signatures 2026-02-24T09:12:30.714 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stderr Copying blob sha256:3d82da28ef36b49476ffeec0ce0e397991e48c7457931968a65f282d08a3b761 2026-02-24T09:12:30.714 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stderr Copying blob sha256:8e380faede39ebd4286247457b408d979ab568aafd8389c42ec304b8cfba4e92 2026-02-24T09:12:30.714 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stderr Copying config sha256:5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 2026-02-24T09:12:30.714 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stderr Writing manifest to image destination 2026-02-24T09:12:30.945 INFO:teuthology.orchestra.run.trial028.stdout:ceph: stdout ceph version 20.3.0-5537-g5bc9a1ff (5bc9a1ffc19df681248ece8c3c8c7191a571745b) tentacle (dev) 2026-02-24T09:12:30.945 INFO:teuthology.orchestra.run.trial028.stdout:Ceph version: ceph version 20.3.0-5537-g5bc9a1ff (5bc9a1ffc19df681248ece8c3c8c7191a571745b) tentacle (dev) 2026-02-24T09:12:30.945 INFO:teuthology.orchestra.run.trial028.stdout:Extracting ceph user uid/gid from container image... 2026-02-24T09:12:31.281 INFO:teuthology.orchestra.run.trial028.stdout:stat: stdout 167 167 2026-02-24T09:12:31.281 INFO:teuthology.orchestra.run.trial028.stdout:Creating initial keys... 2026-02-24T09:12:31.689 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph-authtool: stdout AQB/a51piahGIxAAJ0sJvCniYSp77ndHqyWngA== 2026-02-24T09:12:31.911 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph-authtool: stdout AQB/a51pxoxiMBAAaThBMeHSZkXjALUnrCDbYw== 2026-02-24T09:12:32.144 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph-authtool: stdout AQCAa51pGYKLAhAA2osWqzZGENorycQZIepM/A== 2026-02-24T09:12:32.145 INFO:teuthology.orchestra.run.trial028.stdout:Creating initial monmap... 2026-02-24T09:12:32.378 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-24T09:12:32.378 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = tentacle 2026-02-24T09:12:32.378 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to e9ad50af-1160-11f1-800e-d404e6e7d460 2026-02-24T09:12:32.378 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-24T09:12:32.378 INFO:teuthology.orchestra.run.trial028.stdout:monmaptool for a [v2:10.20.193.28:3300,v1:10.20.193.28:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-24T09:12:32.379 INFO:teuthology.orchestra.run.trial028.stdout:setting min_mon_release = tentacle 2026-02-24T09:12:32.379 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/monmaptool: set fsid to e9ad50af-1160-11f1-800e-d404e6e7d460 2026-02-24T09:12:32.379 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-24T09:12:32.379 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:12:32.379 INFO:teuthology.orchestra.run.trial028.stdout:Creating mon... 2026-02-24T09:12:32.555 INFO:teuthology.orchestra.run.trial028.stdout:create mon.a on 2026-02-24T09:12:32.778 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2026-02-24T09:12:33.035 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-02-24T09:12:33.232 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-e9ad50af-1160-11f1-800e-d404e6e7d460.target → /etc/systemd/system/ceph-e9ad50af-1160-11f1-800e-d404e6e7d460.target. 2026-02-24T09:12:33.232 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-e9ad50af-1160-11f1-800e-d404e6e7d460.target → /etc/systemd/system/ceph-e9ad50af-1160-11f1-800e-d404e6e7d460.target. 2026-02-24T09:12:33.455 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mon.a 2026-02-24T09:12:33.455 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Failed to reset failed state of unit ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mon.a.service: Unit ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mon.a.service not loaded. 2026-02-24T09:12:33.678 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-e9ad50af-1160-11f1-800e-d404e6e7d460.target.wants/ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mon.a.service → /etc/systemd/system/ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@.service. 2026-02-24T09:12:33.947 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-24T09:12:33.947 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout disabled 2026-02-24T09:12:33.958 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-24T09:12:33.959 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout inactive 2026-02-24T09:12:33.959 INFO:teuthology.orchestra.run.trial028.stdout:firewalld.service is not enabled 2026-02-24T09:12:33.959 INFO:teuthology.orchestra.run.trial028.stdout:Not possible to enable service . firewalld.service is not available 2026-02-24T09:12:33.959 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for mon to start... 2026-02-24T09:12:33.959 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for mon... 2026-02-24T09:12:34.003 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:33 trial028 ceph-mon[40023]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-24T09:12:34.246 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout cluster: 2026-02-24T09:12:34.246 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout id: e9ad50af-1160-11f1-800e-d404e6e7d460 2026-02-24T09:12:34.246 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-24T09:12:34.246 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-24T09:12:34.246 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout services: 2026-02-24T09:12:34.246 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.207745s) [leader: a] 2026-02-24T09:12:34.246 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-24T09:12:34.246 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-24T09:12:34.246 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-24T09:12:34.247 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout data: 2026-02-24T09:12:34.247 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-24T09:12:34.247 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-24T09:12:34.247 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-24T09:12:34.247 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout pgs: 2026-02-24T09:12:34.247 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-24T09:12:34.247 INFO:teuthology.orchestra.run.trial028.stdout:mon is available 2026-02-24T09:12:34.247 INFO:teuthology.orchestra.run.trial028.stdout:Assimilating anything we can from ceph.conf... 2026-02-24T09:12:34.554 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-24T09:12:34.554 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout [global] 2026-02-24T09:12:34.554 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout fsid = e9ad50af-1160-11f1-800e-d404e6e7d460 2026-02-24T09:12:34.554 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-24T09:12:34.554 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.28:3300,v1:10.20.193.28:6789] 2026-02-24T09:12:34.554 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-24T09:12:34.554 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-24T09:12:34.554 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-24T09:12:34.554 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-24T09:12:34.555 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-24T09:12:34.555 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-24T09:12:34.555 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-24T09:12:34.555 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-24T09:12:34.555 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout [osd] 2026-02-24T09:12:34.555 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2026-02-24T09:12:34.555 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2026-02-24T09:12:34.555 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2026-02-24T09:12:34.555 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-24T09:12:34.555 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-24T09:12:34.555 INFO:teuthology.orchestra.run.trial028.stdout:Generating new minimal ceph.conf... 2026-02-24T09:12:34.823 INFO:teuthology.orchestra.run.trial028.stdout:Restarting the monitor... 2026-02-24T09:12:35.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:34 trial028 systemd[1]: Stopping Ceph mon.a for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:12:35.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:34 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mon-a[40019]: 2026-02-24T09:12:34.959+0000 7f4f75b15640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T09:12:35.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:34 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mon-a[40019]: 2026-02-24T09:12:34.959+0000 7f4f75b15640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-24T09:12:35.438 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 podman[40256]: 2026-02-24 09:12:35.113047493 +0000 UTC m=+0.175950623 container died b27b18b8d030a5259fbf2de84ac571a99ffce3f7348c352231c33e569f049529 (image=quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mon-a, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, io.buildah.version=1.41.3, org.label-schema.build-date=20260223, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-vshankar-testing-20260223.155722) 2026-02-24T09:12:35.438 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 podman[40256]: 2026-02-24 09:12:35.169666138 +0000 UTC m=+0.232569268 container remove b27b18b8d030a5259fbf2de84ac571a99ffce3f7348c352231c33e569f049529 (image=quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mon-a, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, CEPH_REF=wip-vshankar-testing-20260223.155722, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-24T09:12:35.438 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 bash[40256]: ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mon-a 2026-02-24T09:12:35.438 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 systemd[1]: ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mon.a.service: Deactivated successfully. 2026-02-24T09:12:35.439 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 systemd[1]: Stopped Ceph mon.a for e9ad50af-1160-11f1-800e-d404e6e7d460. 2026-02-24T09:12:35.439 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 systemd[1]: Starting Ceph mon.a for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:12:35.493 INFO:teuthology.orchestra.run.trial028.stdout:Setting public_network to 10.20.192.0/20 in global config section 2026-02-24T09:12:35.723 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 podman[40352]: 2026-02-24 09:12:35.437448761 +0000 UTC m=+0.027603838 container create 5f849c008983b80901a9d75f7a61a450549a419961602227903edf7b0e6c16ed (image=quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mon-a, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-vshankar-testing-20260223.155722, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, OSD_FLAVOR=default) 2026-02-24T09:12:35.723 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 podman[40352]: 2026-02-24 09:12:35.479654483 +0000 UTC m=+0.069809560 container init 5f849c008983b80901a9d75f7a61a450549a419961602227903edf7b0e6c16ed (image=quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mon-a, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, CEPH_REF=wip-vshankar-testing-20260223.155722, ceph=True, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-24T09:12:35.723 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 podman[40352]: 2026-02-24 09:12:35.485288855 +0000 UTC m=+0.075443932 container start 5f849c008983b80901a9d75f7a61a450549a419961602227903edf7b0e6c16ed (image=quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mon-a, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, org.label-schema.build-date=20260223, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-vshankar-testing-20260223.155722, ceph=True, OSD_FLAVOR=default) 2026-02-24T09:12:35.723 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 bash[40352]: 5f849c008983b80901a9d75f7a61a450549a419961602227903edf7b0e6c16ed 2026-02-24T09:12:35.723 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 podman[40352]: 2026-02-24 09:12:35.427340401 +0000 UTC m=+0.017495488 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b 2026-02-24T09:12:35.723 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 systemd[1]: Started Ceph mon.a for e9ad50af-1160-11f1-800e-d404e6e7d460. 2026-02-24T09:12:35.723 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: set uid:gid to 167:167 (ceph:ceph) 2026-02-24T09:12:35.723 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: ceph version 20.3.0-5537-g5bc9a1ff (5bc9a1ffc19df681248ece8c3c8c7191a571745b) tentacle (dev - RelWithDebInfo), process ceph-mon, pid 2 2026-02-24T09:12:35.723 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: pidfile_write: ignore empty --pid-file 2026-02-24T09:12:35.723 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: load: jerasure load: lrc 2026-02-24T09:12:35.723 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: RocksDB version: 7.9.2 2026-02-24T09:12:35.723 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Git sha 0 2026-02-24T09:12:35.723 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Compile date 2026-02-24 03:46:44 2026-02-24T09:12:35.723 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: DB SUMMARY 2026-02-24T09:12:35.723 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: DB Session ID: HVJHZKM4MSOPNV1VVZ8N 2026-02-24T09:12:35.723 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: CURRENT file: CURRENT 2026-02-24T09:12:35.723 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: IDENTITY file: IDENTITY 2026-02-24T09:12:35.723 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-02-24T09:12:35.723 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2026-02-24T09:12:35.723 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 83839 ; 2026-02-24T09:12:35.723 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.error_if_exists: 0 2026-02-24T09:12:35.723 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.create_if_missing: 0 2026-02-24T09:12:35.723 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.paranoid_checks: 1 2026-02-24T09:12:35.723 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.env: 0xed6d60 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.fs: PosixFileSystem 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.info_log: 0x3b64a220 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.max_file_opening_threads: 16 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.statistics: (nil) 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.use_fsync: 0 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.max_log_file_size: 0 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.keep_log_file_num: 1000 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.recycle_log_file_num: 0 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.allow_fallocate: 1 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.allow_mmap_reads: 0 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.allow_mmap_writes: 0 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.use_direct_reads: 0 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.create_missing_column_families: 0 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.db_log_dir: 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.wal_dir: 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.advise_random_on_open: 1 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.db_write_buffer_size: 0 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.write_buffer_manager: 0x3b646140 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.rate_limiter: (nil) 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.wal_recovery_mode: 2 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.enable_thread_tracking: 0 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.enable_pipelined_write: 0 2026-02-24T09:12:35.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.unordered_write: 0 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.row_cache: None 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.wal_filter: None 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.allow_ingest_behind: 0 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.two_write_queues: 0 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.manual_wal_flush: 0 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.wal_compression: 0 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.atomic_flush: 0 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.log_readahead_size: 0 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.best_efforts_recovery: 0 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.allow_data_in_errors: 0 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.db_host_id: __hostname__ 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.max_background_jobs: 2 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.max_background_compactions: -1 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.max_subcompactions: 1 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.max_total_wal_size: 0 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.max_open_files: -1 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.bytes_per_sync: 0 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.compaction_readahead_size: 0 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.max_background_flushes: -1 2026-02-24T09:12:35.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Compression algorithms supported: 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: kZSTD supported: 0 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: kXpressCompression supported: 0 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: kBZip2Compression supported: 0 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: kLZ4Compression supported: 1 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: kZlibCompression supported: 1 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: kLZ4HCCompression supported: 1 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: kSnappyCompression supported: 1 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.merge_operator: 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.compaction_filter: None 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.compaction_filter_factory: None 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.sst_partitioner_factory: None 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x3b5f8aa0) 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout: cache_index_and_filter_blocks: 1 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout: pin_top_level_index_and_filter: 1 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout: index_type: 0 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout: data_block_index_type: 0 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout: index_shortening: 1 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout: checksum: 4 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout: no_block_cache: 0 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout: block_cache: 0x3b625870 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout: block_cache_name: BinnedLRUCache 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout: block_cache_options: 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout: capacity : 536870912 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout: num_shard_bits : 4 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout: strict_capacity_limit : 0 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout: high_pri_pool_ratio: 0.000 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout: block_cache_compressed: (nil) 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout: persistent_cache: (nil) 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout: block_size: 4096 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout: block_size_deviation: 10 2026-02-24T09:12:35.726 INFO:journalctl@ceph.mon.a.trial028.stdout: block_restart_interval: 16 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout: index_block_restart_interval: 1 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout: metadata_block_size: 4096 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout: partition_filters: 0 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout: use_delta_encoding: 1 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout: filter_policy: bloomfilter 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout: whole_key_filtering: 1 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout: verify_compression: 0 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout: read_amp_bytes_per_bit: 0 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout: format_version: 5 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout: enable_index_compression: 1 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout: block_align: 0 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout: max_auto_readahead_size: 262144 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout: prepopulate_block_cache: 0 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout: initial_auto_readahead_size: 8192 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout: num_file_reads_for_auto_readahead: 2 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.write_buffer_size: 33554432 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.max_write_buffer_number: 2 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.compression: NoCompression 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.bottommost_compression: Disabled 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.prefix_extractor: nullptr 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.num_levels: 7 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.compression_opts.level: 32767 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.compression_opts.strategy: 0 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.compression_opts.enabled: false 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-24T09:12:35.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-24T09:12:35.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-24T09:12:35.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-24T09:12:35.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.target_file_size_base: 67108864 2026-02-24T09:12:35.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-24T09:12:35.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-24T09:12:35.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-24T09:12:35.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-24T09:12:35.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-24T09:12:35.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-24T09:12:35.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-24T09:12:35.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-24T09:12:35.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-24T09:12:35.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-24T09:12:35.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-24T09:12:35.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-24T09:12:35.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-24T09:12:35.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-24T09:12:35.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.arena_block_size: 1048576 2026-02-24T09:12:35.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-24T09:12:35.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-24T09:12:35.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.disable_auto_compactions: 0 2026-02-24T09:12:35.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-24T09:12:35.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-24T09:12:35.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-24T09:12:35.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-24T09:12:35.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-24T09:12:35.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-24T09:12:35.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-24T09:12:35.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-24T09:12:35.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-24T09:12:35.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-24T09:12:35.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-24T09:12:35.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.inplace_update_support: 0 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.bloom_locality: 0 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.max_successive_merges: 0 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.paranoid_file_checks: 0 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.force_consistency_checks: 1 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.report_bg_io_stats: 0 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.ttl: 2592000 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.enable_blob_files: false 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.min_blob_size: 0 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.blob_file_size: 268435456 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.blob_file_starting_level: 0 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 16688a55-911c-4613-8a78-bb2e7c58093f 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771924355516498, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771924355517760, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 80382, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 255, "table_properties": {"data_size": 78558, "index_size": 209, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 11388, "raw_average_key_size": 50, "raw_value_size": 72145, "raw_average_value_size": 319, "num_data_blocks": 9, "num_entries": 226, "num_filter_entries": 226, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771924355, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "16688a55-911c-4613-8a78-bb2e7c58093f", "db_session_id": "HVJHZKM4MSOPNV1VVZ8N", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771924355517878, "job": 1, "event": "recovery_finished"} 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x3b668e00 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: DB pointer 0x3b67a000 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout: ** DB Stats ** 2026-02-24T09:12:35.729 INFO:journalctl@ceph.mon.a.trial028.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: ** Compaction Stats [default] ** 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: L0 2/0 80.37 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 90.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: Sum 2/0 80.37 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 90.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 90.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: ** Compaction Stats [default] ** 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 90.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: Cumulative compaction: 0.00 GB write, 14.87 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: Interval compaction: 0.00 GB write, 14.87 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: Block cache BinnedLRUCache@0x3b625870#2 capacity: 512.00 MB usage: 1.17 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.5e-05 secs_since: 0 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.41 KB,7.7486e-05%) Misc(1,0.00 KB,0%) 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: starting mon.a rank 0 at public addrs [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] at bind addrs [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid e9ad50af-1160-11f1-800e-d404e6e7d460 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: mon.a@-1(???) e1 preinit fsid e9ad50af-1160-11f1-800e-d404e6e7d460 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: mon.a@-1(???).mds e1 new map 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: mon.a@-1(???).mds e1 print_map 2026-02-24T09:12:35.730 INFO:journalctl@ceph.mon.a.trial028.stdout: e1 2026-02-24T09:12:35.731 INFO:journalctl@ceph.mon.a.trial028.stdout: btime 2026-02-24T09:12:33:966558+0000 2026-02-24T09:12:35.731 INFO:journalctl@ceph.mon.a.trial028.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-24T09:12:35.731 INFO:journalctl@ceph.mon.a.trial028.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-24T09:12:35.731 INFO:journalctl@ceph.mon.a.trial028.stdout: legacy client fscid: -1 2026-02-24T09:12:35.731 INFO:journalctl@ceph.mon.a.trial028.stdout: 2026-02-24T09:12:35.731 INFO:journalctl@ceph.mon.a.trial028.stdout: No filesystems configured 2026-02-24T09:12:35.731 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-24T09:12:35.731 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-24T09:12:35.731 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-24T09:12:35.731 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-24T09:12:35.731 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-02-24T09:12:35.731 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: mon.a@-1(???).mgr e0 loading version 1 2026-02-24T09:12:35.731 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: mon.a@-1(???).mgr e1 active server: (0) 2026-02-24T09:12:35.731 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: mon.a@-1(???).mgr e1 mkfs or daemon transitioned to available, loading commands 2026-02-24T09:12:35.731 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-24T09:12:35.731 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: monmap epoch 1 2026-02-24T09:12:35.731 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: fsid e9ad50af-1160-11f1-800e-d404e6e7d460 2026-02-24T09:12:35.731 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: last_changed 2026-02-24T09:12:32.280273+0000 2026-02-24T09:12:35.731 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: created 2026-02-24T09:12:32.280273+0000 2026-02-24T09:12:35.731 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: min_mon_release 20 (tentacle) 2026-02-24T09:12:35.731 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: election_strategy: 1 2026-02-24T09:12:35.731 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-24T09:12:35.731 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: fsmap 2026-02-24T09:12:35.731 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: osdmap e1: 0 total, 0 up, 0 in 2026-02-24T09:12:35.731 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:35 trial028 ceph-mon[40371]: mgrmap e1: no daemons active 2026-02-24T09:12:35.784 INFO:teuthology.orchestra.run.trial028.stdout:Wrote config to /etc/ceph/ceph.conf 2026-02-24T09:12:35.784 INFO:teuthology.orchestra.run.trial028.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-02-24T09:12:35.784 INFO:teuthology.orchestra.run.trial028.stdout:Creating mgr... 2026-02-24T09:12:35.785 INFO:teuthology.orchestra.run.trial028.stdout:Verifying port 0.0.0.0:9283 ... 2026-02-24T09:12:35.785 INFO:teuthology.orchestra.run.trial028.stdout:Verifying port 0.0.0.0:8765 ... 2026-02-24T09:12:36.013 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mgr.x 2026-02-24T09:12:36.013 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Failed to reset failed state of unit ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mgr.x.service: Unit ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mgr.x.service not loaded. 2026-02-24T09:12:36.203 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-e9ad50af-1160-11f1-800e-d404e6e7d460.target.wants/ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mgr.x.service → /etc/systemd/system/ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@.service. 2026-02-24T09:12:36.360 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:36 trial028 systemd[1]: Starting Ceph mgr.x for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:12:36.473 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-24T09:12:36.473 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout disabled 2026-02-24T09:12:36.484 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-24T09:12:36.485 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout inactive 2026-02-24T09:12:36.485 INFO:teuthology.orchestra.run.trial028.stdout:firewalld.service is not enabled 2026-02-24T09:12:36.485 INFO:teuthology.orchestra.run.trial028.stdout:Not possible to enable service . firewalld.service is not available 2026-02-24T09:12:36.499 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-24T09:12:36.499 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout disabled 2026-02-24T09:12:36.510 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-24T09:12:36.510 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout inactive 2026-02-24T09:12:36.510 INFO:teuthology.orchestra.run.trial028.stdout:firewalld.service is not enabled 2026-02-24T09:12:36.511 INFO:teuthology.orchestra.run.trial028.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2026-02-24T09:12:36.511 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for mgr to start... 2026-02-24T09:12:36.511 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for mgr... 2026-02-24T09:12:36.714 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:36 trial028 podman[40593]: 2026-02-24 09:12:36.399434777 +0000 UTC m=+0.029539283 container create 1e11c7f0ee80d9bb78c3420d3585d2bda75a38b70d9e53944ff83c5d3980bdb6 (image=quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, CEPH_REF=wip-vshankar-testing-20260223.155722, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2026-02-24T09:12:36.714 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:36 trial028 podman[40593]: 2026-02-24 09:12:36.441003856 +0000 UTC m=+0.071108362 container init 1e11c7f0ee80d9bb78c3420d3585d2bda75a38b70d9e53944ff83c5d3980bdb6 (image=quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.license=GPLv2, org.label-schema.build-date=20260223, org.label-schema.vendor=CentOS, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, io.buildah.version=1.41.3, OSD_FLAVOR=default) 2026-02-24T09:12:36.714 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:36 trial028 podman[40593]: 2026-02-24 09:12:36.445757803 +0000 UTC m=+0.075862309 container start 1e11c7f0ee80d9bb78c3420d3585d2bda75a38b70d9e53944ff83c5d3980bdb6 (image=quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x, OSD_FLAVOR=default, org.label-schema.build-date=20260223, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, CEPH_REF=wip-vshankar-testing-20260223.155722, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, ceph=True, io.buildah.version=1.41.3) 2026-02-24T09:12:36.714 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:36 trial028 bash[40593]: 1e11c7f0ee80d9bb78c3420d3585d2bda75a38b70d9e53944ff83c5d3980bdb6 2026-02-24T09:12:36.714 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:36 trial028 podman[40593]: 2026-02-24 09:12:36.388311341 +0000 UTC m=+0.018415847 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b 2026-02-24T09:12:36.714 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:36 trial028 systemd[1]: Started Ceph mgr.x for e9ad50af-1160-11f1-800e-d404e6e7d460. 2026-02-24T09:12:36.714 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:36 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/385528263' entity='client.admin' 2026-02-24T09:12:36.837 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-24T09:12:36.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout { 2026-02-24T09:12:36.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "fsid": "e9ad50af-1160-11f1-800e-d404e6e7d460", 2026-02-24T09:12:36.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "health": { 2026-02-24T09:12:36.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-24T09:12:36.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-24T09:12:36.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-24T09:12:36.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:12:36.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-24T09:12:36.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-24T09:12:36.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 0 2026-02-24T09:12:36.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-24T09:12:36.839 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-24T09:12:36.839 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "a" 2026-02-24T09:12:36.839 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-24T09:12:36.839 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum_age": 1, 2026-02-24T09:12:36.839 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-24T09:12:36.839 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T09:12:36.843 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-24T09:12:36.843 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-24T09:12:36.843 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:12:36.843 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-24T09:12:36.843 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T09:12:36.844 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-24T09:12:36.844 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-24T09:12:36.844 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-24T09:12:36.844 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-24T09:12:36.844 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-24T09:12:36.844 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-24T09:12:36.844 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:12:36.844 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-24T09:12:36.844 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-24T09:12:36.844 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-24T09:12:36.844 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-24T09:12:36.845 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-24T09:12:36.845 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-24T09:12:36.845 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-24T09:12:36.845 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-24T09:12:36.845 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-24T09:12:36.845 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:12:36.845 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-24T09:12:36.845 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T09:12:36.845 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "btime": "2026-02-24T09:12:33:966558+0000", 2026-02-24T09:12:36.845 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-24T09:12:36.845 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-24T09:12:36.845 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:12:36.846 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-24T09:12:36.846 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-24T09:12:36.846 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-24T09:12:36.846 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-24T09:12:36.846 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-24T09:12:36.846 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-24T09:12:36.846 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-24T09:12:36.846 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T09:12:36.846 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:12:36.846 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-24T09:12:36.846 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T09:12:36.846 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "modified": "2026-02-24T09:12:33.967020+0000", 2026-02-24T09:12:36.846 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T09:12:36.847 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:12:36.847 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-24T09:12:36.847 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout } 2026-02-24T09:12:36.847 INFO:teuthology.orchestra.run.trial028.stdout:mgr not available, waiting (1/15)... 2026-02-24T09:12:38.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:37 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/418202499' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-24T09:12:38.111 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:37 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-24T09:12:38.111 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:37 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-24T09:12:38.111 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:37 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: from numpy import show_config as show_numpy_config 2026-02-24T09:12:39.118 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-24T09:12:39.118 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout { 2026-02-24T09:12:39.118 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "fsid": "e9ad50af-1160-11f1-800e-d404e6e7d460", 2026-02-24T09:12:39.118 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "health": { 2026-02-24T09:12:39.118 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-24T09:12:39.118 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-24T09:12:39.118 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-24T09:12:39.118 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:12:39.118 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-24T09:12:39.118 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 0 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "a" 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "btime": "2026-02-24T09:12:33:966558+0000", 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:12:39.119 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-24T09:12:39.120 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T09:12:39.120 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "modified": "2026-02-24T09:12:33.967020+0000", 2026-02-24T09:12:39.120 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T09:12:39.120 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:12:39.120 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-24T09:12:39.120 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout } 2026-02-24T09:12:39.120 INFO:teuthology.orchestra.run.trial028.stdout:mgr not available, waiting (2/15)... 2026-02-24T09:12:39.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:39 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/212197453' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-24T09:12:40.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:40 trial028 ceph-mon[40371]: Activating manager daemon x 2026-02-24T09:12:40.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:40 trial028 ceph-mon[40371]: mgrmap e2: x(active, starting, since 0.00377167s) 2026-02-24T09:12:40.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:40 trial028 ceph-mon[40371]: from='mgr.14100 10.20.193.28:0/1302844385' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-24T09:12:40.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:40 trial028 ceph-mon[40371]: from='mgr.14100 10.20.193.28:0/1302844385' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-24T09:12:40.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:40 trial028 ceph-mon[40371]: from='mgr.14100 10.20.193.28:0/1302844385' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-24T09:12:40.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:40 trial028 ceph-mon[40371]: from='mgr.14100 10.20.193.28:0/1302844385' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:12:40.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:40 trial028 ceph-mon[40371]: from='mgr.14100 10.20.193.28:0/1302844385' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-24T09:12:40.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:40 trial028 ceph-mon[40371]: Manager daemon x is now available 2026-02-24T09:12:40.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:40 trial028 ceph-mon[40371]: from='mgr.14100 10.20.193.28:0/1302844385' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-24T09:12:40.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:40 trial028 ceph-mon[40371]: from='mgr.14100 10.20.193.28:0/1302844385' entity='mgr.x' 2026-02-24T09:12:40.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:40 trial028 ceph-mon[40371]: from='mgr.14100 10.20.193.28:0/1302844385' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-24T09:12:40.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:40 trial028 ceph-mon[40371]: from='mgr.14100 10.20.193.28:0/1302844385' entity='mgr.x' 2026-02-24T09:12:40.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:40 trial028 ceph-mon[40371]: from='mgr.14100 10.20.193.28:0/1302844385' entity='mgr.x' 2026-02-24T09:12:41.402 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-24T09:12:41.402 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout { 2026-02-24T09:12:41.402 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "fsid": "e9ad50af-1160-11f1-800e-d404e6e7d460", 2026-02-24T09:12:41.402 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "health": { 2026-02-24T09:12:41.402 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-24T09:12:41.402 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-24T09:12:41.402 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-24T09:12:41.402 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:12:41.402 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-24T09:12:41.402 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-24T09:12:41.402 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 0 2026-02-24T09:12:41.402 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-24T09:12:41.402 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-24T09:12:41.402 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "a" 2026-02-24T09:12:41.402 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-24T09:12:41.402 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2026-02-24T09:12:41.402 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-24T09:12:41.402 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T09:12:41.402 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-24T09:12:41.402 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-24T09:12:41.402 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:12:41.402 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-24T09:12:41.402 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T09:12:41.402 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-24T09:12:41.402 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-24T09:12:41.403 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-24T09:12:41.403 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-24T09:12:41.403 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-24T09:12:41.403 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-24T09:12:41.403 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:12:41.403 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-24T09:12:41.404 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-24T09:12:41.404 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-24T09:12:41.404 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-24T09:12:41.404 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-24T09:12:41.404 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-24T09:12:41.404 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-24T09:12:41.404 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-24T09:12:41.404 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-24T09:12:41.404 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:12:41.404 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-24T09:12:41.404 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T09:12:41.404 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "btime": "2026-02-24T09:12:33:966558+0000", 2026-02-24T09:12:41.404 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-24T09:12:41.404 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-24T09:12:41.404 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:12:41.404 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-24T09:12:41.404 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-24T09:12:41.404 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-24T09:12:41.404 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-24T09:12:41.404 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-24T09:12:41.404 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-24T09:12:41.404 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-24T09:12:41.404 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T09:12:41.404 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:12:41.404 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-24T09:12:41.404 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T09:12:41.404 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "modified": "2026-02-24T09:12:33.967020+0000", 2026-02-24T09:12:41.404 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T09:12:41.404 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:12:41.404 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-24T09:12:41.404 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout } 2026-02-24T09:12:41.404 INFO:teuthology.orchestra.run.trial028.stdout:mgr is available 2026-02-24T09:12:41.772 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-24T09:12:41.772 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout [global] 2026-02-24T09:12:41.772 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout fsid = e9ad50af-1160-11f1-800e-d404e6e7d460 2026-02-24T09:12:41.772 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-24T09:12:41.772 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.28:3300,v1:10.20.193.28:6789] 2026-02-24T09:12:41.773 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-24T09:12:41.773 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-24T09:12:41.773 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-24T09:12:41.773 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-24T09:12:41.773 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-24T09:12:41.773 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-24T09:12:41.773 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-24T09:12:41.773 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-24T09:12:41.773 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout [osd] 2026-02-24T09:12:41.774 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2026-02-24T09:12:41.774 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2026-02-24T09:12:41.774 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2026-02-24T09:12:41.774 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-24T09:12:41.774 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-24T09:12:41.774 INFO:teuthology.orchestra.run.trial028.stdout:Enabling cephadm module... 2026-02-24T09:12:42.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:42 trial028 ceph-mon[40371]: mgrmap e3: x(active, since 1.00819s) 2026-02-24T09:12:42.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:42 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/1308706664' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-24T09:12:42.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:42 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/4116564554' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2026-02-24T09:12:42.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:42 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/3122617329' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2026-02-24T09:12:42.611 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:42 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: ignoring --setuser ceph since I am not root 2026-02-24T09:12:42.612 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:42 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: ignoring --setgroup ceph since I am not root 2026-02-24T09:12:42.824 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout { 2026-02-24T09:12:42.825 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 4, 2026-02-24T09:12:42.825 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-24T09:12:42.825 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "active_name": "x", 2026-02-24T09:12:42.825 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-24T09:12:42.825 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout } 2026-02-24T09:12:42.825 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for the mgr to restart... 2026-02-24T09:12:42.825 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for mgr epoch 4... 2026-02-24T09:12:43.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:43 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/3122617329' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-24T09:12:43.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:43 trial028 ceph-mon[40371]: mgrmap e4: x(active, since 2s) 2026-02-24T09:12:43.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:43 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/466764892' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-24T09:12:44.110 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:43 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-24T09:12:44.111 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:43 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-24T09:12:44.111 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:43 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: from numpy import show_config as show_numpy_config 2026-02-24T09:12:46.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:46 trial028 ceph-mon[40371]: Active manager daemon x restarted 2026-02-24T09:12:46.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:46 trial028 ceph-mon[40371]: Activating manager daemon x 2026-02-24T09:12:46.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:46 trial028 ceph-mon[40371]: osdmap e2: 0 total, 0 up, 0 in 2026-02-24T09:12:46.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:46 trial028 ceph-mon[40371]: mgrmap e5: x(active, starting, since 0.00340912s) 2026-02-24T09:12:46.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:46 trial028 ceph-mon[40371]: from='mgr.14118 10.20.193.28:0/3587796343' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:12:46.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:46 trial028 ceph-mon[40371]: from='mgr.14118 10.20.193.28:0/3587796343' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-24T09:12:46.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:46 trial028 ceph-mon[40371]: from='mgr.14118 10.20.193.28:0/3587796343' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-24T09:12:46.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:46 trial028 ceph-mon[40371]: from='mgr.14118 10.20.193.28:0/3587796343' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-24T09:12:46.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:46 trial028 ceph-mon[40371]: from='mgr.14118 10.20.193.28:0/3587796343' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-24T09:12:46.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:46 trial028 ceph-mon[40371]: Manager daemon x is now available 2026-02-24T09:12:47.260 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout { 2026-02-24T09:12:47.260 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 6, 2026-02-24T09:12:47.260 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-24T09:12:47.260 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout } 2026-02-24T09:12:47.261 INFO:teuthology.orchestra.run.trial028.stdout:mgr epoch 4 is available 2026-02-24T09:12:47.261 INFO:teuthology.orchestra.run.trial028.stdout:Verifying orchestrator module is enabled... 2026-02-24T09:12:47.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:47 trial028 ceph-mon[40371]: from='mgr.14118 10.20.193.28:0/3587796343' entity='mgr.x' 2026-02-24T09:12:47.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:47 trial028 ceph-mon[40371]: from='mgr.14118 10.20.193.28:0/3587796343' entity='mgr.x' 2026-02-24T09:12:47.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:47 trial028 ceph-mon[40371]: Found migration_current of "None". Setting to last migration. 2026-02-24T09:12:47.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:47 trial028 ceph-mon[40371]: from='mgr.14118 10.20.193.28:0/3587796343' entity='mgr.x' 2026-02-24T09:12:47.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:47 trial028 ceph-mon[40371]: from='mgr.14118 10.20.193.28:0/3587796343' entity='mgr.x' 2026-02-24T09:12:47.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:47 trial028 ceph-mon[40371]: from='mgr.14118 10.20.193.28:0/3587796343' entity='mgr.x' 2026-02-24T09:12:47.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:47 trial028 ceph-mon[40371]: from='mgr.14118 10.20.193.28:0/3587796343' entity='mgr.x' 2026-02-24T09:12:47.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:47 trial028 ceph-mon[40371]: from='mgr.14118 10.20.193.28:0/3587796343' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:12:47.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:47 trial028 ceph-mon[40371]: from='mgr.14118 10.20.193.28:0/3587796343' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:12:47.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:47 trial028 ceph-mon[40371]: from='mgr.14118 10.20.193.28:0/3587796343' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-24T09:12:47.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:47 trial028 ceph-mon[40371]: from='mgr.14118 10.20.193.28:0/3587796343' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-24T09:12:47.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:47 trial028 ceph-mon[40371]: from='mgr.14118 10.20.193.28:0/3587796343' entity='mgr.x' 2026-02-24T09:12:47.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:47 trial028 ceph-mon[40371]: from='mgr.14118 10.20.193.28:0/3587796343' entity='mgr.x' 2026-02-24T09:12:47.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:47 trial028 ceph-mon[40371]: [24/Feb/2026:09:12:46] ENGINE Bus STARTING 2026-02-24T09:12:47.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:47 trial028 ceph-mon[40371]: [24/Feb/2026:09:12:47] ENGINE Serving on https://10.20.193.28:7150 2026-02-24T09:12:47.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:47 trial028 ceph-mon[40371]: [24/Feb/2026:09:12:47] ENGINE Client ('10.20.193.28', 41050) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-24T09:12:47.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:47 trial028 ceph-mon[40371]: [24/Feb/2026:09:12:47] ENGINE Serving on http://10.20.193.28:8765 2026-02-24T09:12:47.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:47 trial028 ceph-mon[40371]: [24/Feb/2026:09:12:47] ENGINE Bus STARTED 2026-02-24T09:12:47.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:47 trial028 ceph-mon[40371]: from='mgr.14118 10.20.193.28:0/3587796343' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:12:47.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:47 trial028 ceph-mon[40371]: mgrmap e6: x(active, since 1.00561s) 2026-02-24T09:12:47.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:47 trial028 ceph-mon[40371]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-24T09:12:47.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:47 trial028 ceph-mon[40371]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-24T09:12:48.548 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2026-02-24T09:12:48.549 INFO:teuthology.orchestra.run.trial028.stdout:Setting orchestrator backend to cephadm... 2026-02-24T09:12:48.847 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:48 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/3752791124' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2026-02-24T09:12:49.275 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout value unchanged 2026-02-24T09:12:49.275 INFO:teuthology.orchestra.run.trial028.stdout:Generating ssh key... 2026-02-24T09:12:49.751 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:49 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/3752791124' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2026-02-24T09:12:49.751 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:49 trial028 ceph-mon[40371]: mgrmap e7: x(active, since 2s) 2026-02-24T09:12:49.751 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:49 trial028 ceph-mon[40371]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:12:49.752 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:49 trial028 ceph-mon[40371]: from='mgr.14118 10.20.193.28:0/3587796343' entity='mgr.x' 2026-02-24T09:12:49.752 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:49 trial028 ceph-mon[40371]: from='mgr.14118 10.20.193.28:0/3587796343' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:12:49.752 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:49 trial028 ceph-mon[40371]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:12:49.752 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:49 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: Generating public/private ed25519 key pair. 2026-02-24T09:12:49.752 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:49 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: Your identification has been saved in /tmp/tmp6j6x2kqn/key 2026-02-24T09:12:49.752 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:49 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: Your public key has been saved in /tmp/tmp6j6x2kqn/key.pub 2026-02-24T09:12:49.753 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:49 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: The key fingerprint is: 2026-02-24T09:12:49.753 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:49 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: SHA256:G6Sodq3ntMB5h+b+pYolwy+viFHtrKKXkDt9mS8NpoE ceph-e9ad50af-1160-11f1-800e-d404e6e7d460 2026-02-24T09:12:49.753 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:49 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: The key's randomart image is: 2026-02-24T09:12:49.753 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:49 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: +--[ED25519 256]--+ 2026-02-24T09:12:49.753 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:49 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: | | 2026-02-24T09:12:49.753 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:49 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: | | 2026-02-24T09:12:49.753 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:49 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: | . | 2026-02-24T09:12:49.753 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:49 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: | . . o | 2026-02-24T09:12:49.753 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:49 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: | o. o . S | 2026-02-24T09:12:49.753 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:49 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: |E..*oo . o | 2026-02-24T09:12:49.753 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:49 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: |.+o=@=B o . | 2026-02-24T09:12:49.754 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:49 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: |++=+*&oo o | 2026-02-24T09:12:49.754 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:49 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: |++o.+XXoo | 2026-02-24T09:12:49.754 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:49 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: +----[SHA256]-----+ 2026-02-24T09:12:50.068 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOb7njVwPwk3N4ip0Gqc3qKxUsyjZ3qitWW3o+nVOkuj ceph-e9ad50af-1160-11f1-800e-d404e6e7d460 2026-02-24T09:12:50.069 INFO:teuthology.orchestra.run.trial028.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-02-24T09:12:50.069 INFO:teuthology.orchestra.run.trial028.stdout:Adding key to root@localhost authorized_keys... 2026-02-24T09:12:50.070 INFO:teuthology.orchestra.run.trial028.stdout:Adding host trial028... 2026-02-24T09:12:50.690 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:50 trial028 ceph-mon[40371]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:12:50.691 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:50 trial028 ceph-mon[40371]: Generating ssh key... 2026-02-24T09:12:50.691 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:50 trial028 ceph-mon[40371]: from='mgr.14118 10.20.193.28:0/3587796343' entity='mgr.x' 2026-02-24T09:12:50.691 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:50 trial028 ceph-mon[40371]: from='mgr.14118 10.20.193.28:0/3587796343' entity='mgr.x' 2026-02-24T09:12:50.691 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:50 trial028 ceph-mon[40371]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:12:50.691 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:50 trial028 ceph-mon[40371]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial028", "addr": "10.20.193.28", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:12:51.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:51 trial028 ceph-mon[40371]: Deploying cephadm binary to trial028 2026-02-24T09:12:52.624 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout Added host 'trial028' with addr '10.20.193.28' 2026-02-24T09:12:52.624 INFO:teuthology.orchestra.run.trial028.stdout:Deploying unmanaged mon service... 2026-02-24T09:12:53.020 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-02-24T09:12:53.020 INFO:teuthology.orchestra.run.trial028.stdout:Deploying unmanaged mgr service... 2026-02-24T09:12:53.388 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-02-24T09:12:53.742 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:53 trial028 ceph-mon[40371]: from='mgr.14118 10.20.193.28:0/3587796343' entity='mgr.x' 2026-02-24T09:12:53.742 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:53 trial028 ceph-mon[40371]: Added host trial028 2026-02-24T09:12:53.742 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:53 trial028 ceph-mon[40371]: from='mgr.14118 10.20.193.28:0/3587796343' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:12:53.742 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:53 trial028 ceph-mon[40371]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:12:53.743 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:53 trial028 ceph-mon[40371]: Saving service mon spec with placement count:5 2026-02-24T09:12:53.743 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:53 trial028 ceph-mon[40371]: from='mgr.14118 10.20.193.28:0/3587796343' entity='mgr.x' 2026-02-24T09:12:53.743 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:53 trial028 ceph-mon[40371]: from='mgr.14118 10.20.193.28:0/3587796343' entity='mgr.x' 2026-02-24T09:12:53.743 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:53 trial028 ceph-mon[40371]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:12:53.743 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:53 trial028 ceph-mon[40371]: Saving service mgr spec with placement count:2 2026-02-24T09:12:53.743 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:53 trial028 ceph-mon[40371]: from='mgr.14118 10.20.193.28:0/3587796343' entity='mgr.x' 2026-02-24T09:12:54.141 INFO:teuthology.orchestra.run.trial028.stdout:Enabling the dashboard module... 2026-02-24T09:12:54.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:54 trial028 ceph-mon[40371]: from='mgr.14118 10.20.193.28:0/3587796343' entity='mgr.x' 2026-02-24T09:12:54.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:54 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/439348911' entity='client.admin' 2026-02-24T09:12:54.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:54 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/926392921' entity='client.admin' 2026-02-24T09:12:54.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:54 trial028 ceph-mon[40371]: from='mgr.14118 10.20.193.28:0/3587796343' entity='mgr.x' 2026-02-24T09:12:54.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:54 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/1617028619' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2026-02-24T09:12:55.438 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:55 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: ignoring --setuser ceph since I am not root 2026-02-24T09:12:55.438 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:55 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: ignoring --setgroup ceph since I am not root 2026-02-24T09:12:55.666 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout { 2026-02-24T09:12:55.666 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 8, 2026-02-24T09:12:55.666 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-24T09:12:55.666 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "active_name": "x", 2026-02-24T09:12:55.666 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-24T09:12:55.666 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout } 2026-02-24T09:12:55.666 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for the mgr to restart... 2026-02-24T09:12:55.666 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for mgr epoch 8... 2026-02-24T09:12:56.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:56 trial028 ceph-mon[40371]: from='mgr.14118 10.20.193.28:0/3587796343' entity='mgr.x' 2026-02-24T09:12:56.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:56 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/1617028619' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2026-02-24T09:12:56.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:56 trial028 ceph-mon[40371]: mgrmap e8: x(active, since 8s) 2026-02-24T09:12:56.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:56 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/897876985' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-24T09:12:56.860 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:56 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-24T09:12:56.860 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:56 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-24T09:12:56.860 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:12:56 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: from numpy import show_config as show_numpy_config 2026-02-24T09:12:59.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:59 trial028 ceph-mon[40371]: Active manager daemon x restarted 2026-02-24T09:12:59.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:59 trial028 ceph-mon[40371]: Activating manager daemon x 2026-02-24T09:12:59.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:59 trial028 ceph-mon[40371]: osdmap e3: 0 total, 0 up, 0 in 2026-02-24T09:12:59.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:59 trial028 ceph-mon[40371]: mgrmap e9: x(active, starting, since 0.0030997s) 2026-02-24T09:12:59.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:59 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:12:59.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:59 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-24T09:12:59.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:59 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-24T09:12:59.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:59 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-24T09:12:59.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:59 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-24T09:12:59.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:12:59 trial028 ceph-mon[40371]: Manager daemon x is now available 2026-02-24T09:13:00.114 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout { 2026-02-24T09:13:00.114 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 10, 2026-02-24T09:13:00.114 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-24T09:13:00.114 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout } 2026-02-24T09:13:00.114 INFO:teuthology.orchestra.run.trial028.stdout:mgr epoch 8 is available 2026-02-24T09:13:00.114 INFO:teuthology.orchestra.run.trial028.stdout:Using certmgr to generate dashboard self-signed certificate... 2026-02-24T09:13:00.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:00 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:13:00.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:00 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-24T09:13:00.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:00 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-24T09:13:00.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:00 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:00.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:00 trial028 ceph-mon[40371]: mgrmap e10: x(active, since 1.0068s) 2026-02-24T09:13:00.753 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIFHzCCAwegAwIBAgIUW31wAZ9a0stAGWXoSHsN0q1MLo4wDQYJKoZIhvcNAQEL\nBQAwPDE6MDgGA1UEAwwxY2VwaGFkbS1yb290LWU5YWQ1MGFmLTExNjAtMTFmMS04\nMDBlLWQ0MDRlNmU3ZDQ2MDAeFw0yNjAyMjQwOTEzMDBaFw0yOTAyMjMwOTEzMDBa\nMBcxFTATBgNVBAMMDDEwLjIwLjE5My4yODCCAiIwDQYJKoZIhvcNAQEBBQADggIP\nADCCAgoCggIBAOqLOTCMPumXtsi7UxVOfsnb8Yg7wyMAg1pwqeVHZs7xGHpqbHaa\nZNN+NZsSaxPTcjlOvyOEYkHzKN3dzwtOVszSGl54y4JdbQEk0vd0kWCFmIW7jg7A\njs50ITwwGqTOnstS2ITLcQQHjaW8wPQ5SXN9nHcXEJzUuHMSvrpTo1kVlyAvZjYl\niRo1ZhszIFEuSqXSyWPB4K7tmpSPVBcK1rDjqNQILz1bXa+v3UCAFfi4a6SjTnTx\n/mqewLZXy5r2DjfiSpXuL2R02sRtVNz+ErNEdUJnoYhGAdBL1o3Qk09Yqw5qoNCY\n9pe/6QYgiD/Z5ZsdefYCtB0eL8CiBa1gHV4QSUhWxobq10Lb4nMcFZRjQAp/Wc21\nVvEhYrmIG0IrYI7I+u6LxuMyef/1njf60kYOO6qv2KbMPFoWkxEKum56nrJigyam\nQ56DLEGxaNjKlh7TZhuwDSoM39+j5+6QUPc/9CAjNsFNiBMQaWr8FV+fZk2Ryqoy\n9VQu/u+08TdrWc3x78/TlufoX3Wi/EnwBPuLqQuJDd0sxvVm6E5qYoYMC/PwMbXr\nkZPDlR2sJwjtV8o8qmcxsueVUQueZ3I4eNCvNdT5ri07E/xZ0WY4YIRVI5fFIseI\nQfngnZD4L/b8RwG+2VN+ZwSCubhCiVKlYFxJliZSbDDPl32312KfE0Y1AgMBAAGj\nPjA8MCwGA1UdEQQlMCOCCHRyaWFsMDI4ghFkYXNoYm9hcmRfc2VydmVyc4cEChTB\nHDAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQCFgxeDQT+Wk0EuXoI6\nt1oFwQlOF9ASDh0p2QlEJD6GxoJk2O20KC8oRkjIG7asgIxpO5bpUV73Yz/bBdEl\nGWbwBPZBatS/HMtlCNQ+3DQEDm7k3qmdI6br4HzERlHuqm2rbQUwtIPuYVhL0ZkN\n50NLmxOZGLCV5ENu4joxj9pr6AWkco/U6Q2zYhI2nhZf1j+Dg8BG3LqbhqsKipjw\nocN7bBH1FZVb0emlN1cZafBoTeselgSYXgTzVq8SGxK3+mdBgonxzzviWG58OUmV\nRhsb6/TjhRphniUqL0nU/0rI7jIKhbTBMpMpIjw1ORTBDCoKv/gJSkOtiQ7I3TO9\nq55JA6Sij46IsWoPYWYpyMEWkBdylgN7XR79vfY6Sm32B7DAh0PQQ9oU2xQfBewS\nG92dRlCY05QFlmT55xi1f+xumJxS/R07L/FTxI7rS9lHba1W9P+O5HLXCTzvwB7a\n51NKCPWGXjOsyceJ0RPOMtU+vCHMEjlf4KhQaaEDZrp5rBajSX95XJr2MORg1HGS\nVGveXExkyHflDverSZiM7Rew3oHaiZD7UQJA2Ggvx7F6+hayW7BTTmbmOn49xBaR\nbCpzOLs0cXt2uPs6ZLJaZdLFvJjaYHOJYos4T4cHibdEI3TYPSaaFgycIuFQsgVQ\nFVMpZvbp+7K2s0A7cU5arLbygA==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKAIBAAKCAgEA6os5MIw+6Ze2yLtTFU5+ydvxiDvDIwCDWnCp5UdmzvEYemps\ndppk0341mxJrE9NyOU6/I4RiQfMo3d3PC05WzNIaXnjLgl1tASTS93SRYIWYhbuO\nDsCOznQhPDAapM6ey1LYhMtxBAeNpbzA9DlJc32cdxcQnNS4cxK+ulOjWRWXIC9m\nNiWJGjVmGzMgUS5KpdLJY8Hgru2alI9UFwrWsOOo1AgvPVtdr6/dQIAV+LhrpKNO\ndPH+ap7AtlfLmvYON+JKle4vZHTaxG1U3P4Ss0R1QmehiEYB0EvWjdCTT1irDmqg\n0Jj2l7/pBiCIP9nlmx159gK0HR4vwKIFrWAdXhBJSFbGhurXQtvicxwVlGNACn9Z\nzbVW8SFiuYgbQitgjsj67ovG4zJ5//WeN/rSRg47qq/Ypsw8WhaTEQq6bnqesmKD\nJqZDnoMsQbFo2MqWHtNmG7ANKgzf36Pn7pBQ9z/0ICM2wU2IExBpavwVX59mTZHK\nqjL1VC7+77TxN2tZzfHvz9OW5+hfdaL8SfAE+4upC4kN3SzG9WboTmpihgwL8/Ax\nteuRk8OVHawnCO1XyjyqZzGy55VRC55ncjh40K811PmuLTsT/FnRZjhghFUjl8Ui\nx4hB+eCdkPgv9vxHAb7ZU35nBIK5uEKJUqVgXEmWJlJsMM+XfbfXYp8TRjUCAwEA\nAQKCAgBxbS8VKV3rffFplh4R+cobOQDPz4cJUGA1xrKDLUqs3a/m07zshrIoDatC\n+V9LUUC2Mj0Boi4aksu6sGBGqXYUy67w7R4OR7xFh1d3UKpVsYYXdqK2w6zMbyD7\niI/6D+p/jeskHXbkafq4olX2RhYdgiu+9CqWjdE95VzTo0sl8+kIKaQWn4R0Zkqg\n8NK6L9bt5sh6M/LC5imRmtch5Z36Ib8t+19NHvhp1HT9knQNurJkBo4UxEszqN6t\n0DupD0HFCOzlITFONazuvakCzuSgSYUjvhZCXwjVgTebkbkL8GeZKzvmZXMr5CV/\nTxBVQL1njJPEw33zbvvM/w4b0JWiUOA16oYmdngsMLPRGDT9VDhl2InTTir/CbKR\n3ilg4QxGtaGN6t1xP3hSTZu2+Nndgrh2qibCh5GWU+Ym5lAa7EU4eymygYLxmd0N\nCQROYJzxF5NyZw5pCf8qJOWIR/R1PxfGQ3jr9msQaBhGmZOTFtIzkD7SEV9WWTX0\nAhT0+gcpLGufdCzs+MPE+wYnepnbtaXcdhp75NCGh0bhZ+qHDNkS0n6TC+hXYIq4\nIARtsKz7IBB+LzGAOAdDAo8kXc5/10xUHc/oMN6B2LHgFHtTSz8RWRYh/NVVxjF9\nRT7cqgwg/TGh12oQPr2ZrWcX1vtPXMmRSmsCxYW3ipftvkge6QKCAQEA9cm1Ca39\nnA/X2vL2ZrxL2jOzjlxUqKIlAeHzcyoGxoXvfLn61ZO4XL5MvFlDIMTRSpOw3SuI\ngzNNYM7Tx5Es0ZXPAFinvDLPyJWOsCPiKI/4eyohqzV/g/kcvjKOOexz/lIsben6\nj9wXSUn4Xzo11LA4oglBL9ZGhBTVBWsb40L11ULx+gvfMLCvGXwNP8DGnJR7yJNS\njDzV9qX5gpp1w3cpqp697HaOMnHgHkGR0DmtBBlTDOkP+k3/vrahLh66ssBm6/Dd\nQsJDFe8eaLw3Aw4SGjh5YZESekYZyJ4GNe9oGtKLJEmsFXoNc94SgpzlGUoExT0n\nWWmaAZeJqo0OfwKCAQEA9Enrg8tbw2Sco6jUP9MC1cziYRa1GIuHcdyZbMfBS4Oy\nbO6dxDolKEUYg0n98TH2WcvLmZtsdEOHme2zjs3w/3nmHEfBEsNi5CYchoRPXK2o\nbreK2xvenQ+AdBSdFRs+EgRi6/UDfLCxptc3JjdZ+jowo0sTfSQQQ5qpr05Zkq96\nZzzmo7J5WVnJ9JiPx/RJvq9aVEz4Qc5pwC4Zyiu+vaKzqLPtdbuaX/ZwTkJnhAhK\ngnn97w+qpsKpk0M7t4l8aD1xdgx8RoR1iTBZTbMywhBhVcDHk5gFZwaubZ5Mp3LL\nweQfdvN97lMAMReKRKFUEWst6OgLaXpXDWg2/Rp5SwKCAQApSa3op1qf2aV3+TJd\nBap0SBUUh/wMq9gtncgog1nKBXu6Zv902zCwG6OGTDRTj9xce7zNGl//MiIAbh3z\nOzbdKh4wv7PFkH+JAV6LxitahvzFq8kmGoGGKNWkOZfcsRS3FxSxjglyGxWqUQuw\n63VZehS5W3ag04za6SjzlQ+FOJ1VKr69MztV0YhIbqdHG1oBuYuloOHP/vQuT6k/\nQDUiFaVhLPNYgn3WiXyNeJRG9zlSI/Loi0oM0QdyAPnIZo8UMe/YGIkCiuF8EMP5\n8gwHrlhqISx6sET7V0VDhxAiBUpmnxGSkfGfVfZmjVpsqHBvtBhjDafLhErDk7Ij\nfTh/AoIBAQDLOge1L+OaLMRnHpfctPXh2b3m2VY1Ija+0a/NoGy9HsW7+9LCIUEy\nPDFFX7PkCRWR5Invsy5JlrhjpS1AuzEnyEhX9JW5v1Qwy0fl3IKNbmb2HLlmyMus\ny+2oJFH98hj0MjP9amrJO9G/I8HciCXRlsFJx7Zh4DOrmipaDgtUjal941tYiayM\nWbc6RgUvappDCWxTP2k0jbzKRU/tMfFPn+Bok68Tx8uI0+LgKDwnyiH6Y/SOAfGN\nI9qhCUjPyo/1xE/0zjRBEgcZ52AT1OWALtJa3bLqpYixCgzoYs4Qa9744YgPlEeK\nkgBR1uyPZcsjZo/d99Uunbl4DN/aNkD7AoIBAAFQhWB4LxcgHMaWtepIFfRg8Zcd\nzZ6E0EkkMRhNTCEV4LmM2338ExLvOfCzlnSA6cCwkpD+ePfskTEa0PEINDfPe/Wc\nYauASj4NJVRjUsuBo46T+nbUktLB61E9NUyLlE0RxN6wx2LKGqonOeFs0ajt8bZt\no7QNQBnDR65khBOXvlJQByy9bN9C6HDZ7PIxmOaKAfEkBT7DzRGluq6Jc6jRBuLu\njRmTdgrMx+WGIj/0W9eb5XNDKBzS0Rlu2JRReA6I7+y//ThEiakTQFtpGAdm238v\nW6CHXizfO9LOHawLvYlFbVcQvJY/OL0yUtdoGGuE+xw2xosyn3IEem1M2rM=\n-----END RSA PRIVATE KEY-----\n"} 2026-02-24T09:13:01.144 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout SSL certificate updated 2026-02-24T09:13:01.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:01 trial028 ceph-mon[40371]: [24/Feb/2026:09:12:59] ENGINE Bus STARTING 2026-02-24T09:13:01.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:01 trial028 ceph-mon[40371]: [24/Feb/2026:09:12:59] ENGINE Serving on http://10.20.193.28:8765 2026-02-24T09:13:01.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:01 trial028 ceph-mon[40371]: [24/Feb/2026:09:12:59] ENGINE Serving on https://10.20.193.28:7150 2026-02-24T09:13:01.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:01 trial028 ceph-mon[40371]: [24/Feb/2026:09:12:59] ENGINE Bus STARTED 2026-02-24T09:13:01.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:01 trial028 ceph-mon[40371]: [24/Feb/2026:09:12:59] ENGINE Client ('10.20.193.28', 42172) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-24T09:13:01.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:01 trial028 ceph-mon[40371]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-24T09:13:01.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:01 trial028 ceph-mon[40371]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-24T09:13:01.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:01 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:01.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:01 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:01.532 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2026-02-24T09:13:01.532 INFO:teuthology.orchestra.run.trial028.stdout:Creating initial admin user... 2026-02-24T09:13:02.160 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$lJIUlCPeD/EAZTkZI0.LcOLBztLU9MwIWyJEcN7Mr8crom7sMvhtq", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1771924382, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2026-02-24T09:13:02.160 INFO:teuthology.orchestra.run.trial028.stdout:Fetching dashboard port number... 2026-02-24T09:13:02.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:02 trial028 ceph-mon[40371]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:13:02.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:02 trial028 ceph-mon[40371]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:13:02.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:02 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:02.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:02 trial028 ceph-mon[40371]: mgrmap e11: x(active, since 2s) 2026-02-24T09:13:02.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:02 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:02.507 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 8443 2026-02-24T09:13:02.524 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-24T09:13:02.524 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout disabled 2026-02-24T09:13:02.534 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-24T09:13:02.534 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout inactive 2026-02-24T09:13:02.534 INFO:teuthology.orchestra.run.trial028.stdout:firewalld.service is not enabled 2026-02-24T09:13:02.534 INFO:teuthology.orchestra.run.trial028.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2026-02-24T09:13:02.536 INFO:teuthology.orchestra.run.trial028.stdout:Ceph Dashboard is now available at: 2026-02-24T09:13:02.536 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:13:02.536 INFO:teuthology.orchestra.run.trial028.stdout: URL: https://trial028:8443/ 2026-02-24T09:13:02.536 INFO:teuthology.orchestra.run.trial028.stdout: User: admin 2026-02-24T09:13:02.537 INFO:teuthology.orchestra.run.trial028.stdout: Password: rcygjvf6nv 2026-02-24T09:13:02.537 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:13:02.537 INFO:teuthology.orchestra.run.trial028.stdout:Saving cluster configuration to /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config directory 2026-02-24T09:13:02.943 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-02-24T09:13:02.943 INFO:teuthology.orchestra.run.trial028.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-02-24T09:13:02.943 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:13:02.943 INFO:teuthology.orchestra.run.trial028.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-02-24T09:13:02.943 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:13:02.943 INFO:teuthology.orchestra.run.trial028.stdout:Or, if you are only running a single cluster on this host: 2026-02-24T09:13:02.944 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:13:02.944 INFO:teuthology.orchestra.run.trial028.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-02-24T09:13:02.944 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:13:02.944 INFO:teuthology.orchestra.run.trial028.stdout:Please consider enabling telemetry to help improve Ceph: 2026-02-24T09:13:02.944 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:13:02.944 INFO:teuthology.orchestra.run.trial028.stdout: ceph telemetry on 2026-02-24T09:13:02.944 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:13:02.944 INFO:teuthology.orchestra.run.trial028.stdout:For more information see: 2026-02-24T09:13:02.944 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:13:02.944 INFO:teuthology.orchestra.run.trial028.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-02-24T09:13:02.944 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:13:02.944 INFO:teuthology.orchestra.run.trial028.stdout:Bootstrap complete. 2026-02-24T09:13:02.958 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout static 2026-02-24T09:13:02.968 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 3 from systemctl is-active logrotate 2026-02-24T09:13:02.968 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout inactive 2026-02-24T09:13:02.968 INFO:teuthology.orchestra.run.trial028.stdout:Enabling the logrotate.timer service to perform daily log rotation. 2026-02-24T09:13:03.187 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:03 trial028 ceph-mon[40371]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:13:03.187 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:03 trial028 ceph-mon[40371]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:13:03.188 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:03 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/1372781091' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2026-02-24T09:13:03.188 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:03 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/2426334993' entity='client.admin' 2026-02-24T09:13:03.211 INFO:tasks.cephadm:Fetching config... 2026-02-24T09:13:03.211 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-24T09:13:03.211 DEBUG:teuthology.orchestra.run.trial028:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-02-24T09:13:03.252 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-02-24T09:13:03.252 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-24T09:13:03.252 DEBUG:teuthology.orchestra.run.trial028:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-02-24T09:13:03.331 INFO:tasks.cephadm:Fetching mon keyring... 2026-02-24T09:13:03.331 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-24T09:13:03.331 DEBUG:teuthology.orchestra.run.trial028:> sudo dd if=/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/keyring of=/dev/stdout 2026-02-24T09:13:03.429 INFO:tasks.cephadm:Fetching pub ssh key... 2026-02-24T09:13:03.430 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-24T09:13:03.430 DEBUG:teuthology.orchestra.run.trial028:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-02-24T09:13:03.510 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-02-24T09:13:03.510 DEBUG:teuthology.orchestra.run.trial028:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOb7njVwPwk3N4ip0Gqc3qKxUsyjZ3qitWW3o+nVOkuj ceph-e9ad50af-1160-11f1-800e-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-24T09:13:03.625 INFO:teuthology.orchestra.run.trial028.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOb7njVwPwk3N4ip0Gqc3qKxUsyjZ3qitWW3o+nVOkuj ceph-e9ad50af-1160-11f1-800e-d404e6e7d460 2026-02-24T09:13:03.647 DEBUG:teuthology.orchestra.run.trial074:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOb7njVwPwk3N4ip0Gqc3qKxUsyjZ3qitWW3o+nVOkuj ceph-e9ad50af-1160-11f1-800e-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-24T09:13:03.724 INFO:teuthology.orchestra.run.trial074.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOb7njVwPwk3N4ip0Gqc3qKxUsyjZ3qitWW3o+nVOkuj ceph-e9ad50af-1160-11f1-800e-d404e6e7d460 2026-02-24T09:13:03.747 DEBUG:teuthology.orchestra.run.trial159:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOb7njVwPwk3N4ip0Gqc3qKxUsyjZ3qitWW3o+nVOkuj ceph-e9ad50af-1160-11f1-800e-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-24T09:13:03.825 INFO:teuthology.orchestra.run.trial159.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOb7njVwPwk3N4ip0Gqc3qKxUsyjZ3qitWW3o+nVOkuj ceph-e9ad50af-1160-11f1-800e-d404e6e7d460 2026-02-24T09:13:03.847 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-02-24T09:13:04.033 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:04.492 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-02-24T09:13:04.492 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-02-24T09:13:04.678 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:05.096 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial074 2026-02-24T09:13:05.097 DEBUG:teuthology.orchestra.run.trial074:> set -ex 2026-02-24T09:13:05.097 DEBUG:teuthology.orchestra.run.trial074:> dd of=/etc/ceph/ceph.conf 2026-02-24T09:13:05.135 DEBUG:teuthology.orchestra.run.trial074:> set -ex 2026-02-24T09:13:05.135 DEBUG:teuthology.orchestra.run.trial074:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-24T09:13:05.213 INFO:tasks.cephadm:Adding host trial074 to orchestrator... 2026-02-24T09:13:05.213 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph orch host add trial074 2026-02-24T09:13:05.401 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:05.531 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:05 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/3143583370' entity='client.admin' 2026-02-24T09:13:05.531 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:05 trial028 ceph-mon[40371]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:13:05.531 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:05 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:07.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:06 trial028 ceph-mon[40371]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial074", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:13:07.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:06 trial028 ceph-mon[40371]: mgrmap e12: x(active, since 6s) 2026-02-24T09:13:07.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:06 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:07.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:06 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:07.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:06 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial028", "name": "osd_memory_target"} : dispatch 2026-02-24T09:13:07.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:06 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:07.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:06 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:13:07.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:06 trial028 ceph-mon[40371]: Updating trial028:/etc/ceph/ceph.conf 2026-02-24T09:13:07.689 INFO:teuthology.orchestra.run.trial028.stdout:Added host 'trial074' with addr '10.20.193.74' 2026-02-24T09:13:07.797 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-24T09:13:07.984 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:08.296 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:07 trial028 ceph-mon[40371]: Deploying cephadm binary to trial074 2026-02-24T09:13:08.296 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:07 trial028 ceph-mon[40371]: Updating trial028:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config/ceph.conf 2026-02-24T09:13:08.296 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:07 trial028 ceph-mon[40371]: Updating trial028:/etc/ceph/ceph.client.admin.keyring 2026-02-24T09:13:08.296 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:07 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:08.296 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:07 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:08.297 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:07 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:08.297 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:07 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:08.297 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:07 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:13:08.297 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:13:08.297 INFO:teuthology.orchestra.run.trial028.stdout:[{"addr": "10.20.193.28", "hostname": "trial028", "labels": [], "status": ""}, {"addr": "10.20.193.74", "hostname": "trial074", "labels": [], "status": ""}] 2026-02-24T09:13:08.393 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial159 2026-02-24T09:13:08.394 DEBUG:teuthology.orchestra.run.trial159:> set -ex 2026-02-24T09:13:08.394 DEBUG:teuthology.orchestra.run.trial159:> dd of=/etc/ceph/ceph.conf 2026-02-24T09:13:08.434 DEBUG:teuthology.orchestra.run.trial159:> set -ex 2026-02-24T09:13:08.434 DEBUG:teuthology.orchestra.run.trial159:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-24T09:13:08.511 INFO:tasks.cephadm:Adding host trial159 to orchestrator... 2026-02-24T09:13:08.512 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph orch host add trial159 2026-02-24T09:13:08.698 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:09.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:09 trial028 ceph-mon[40371]: Updating trial028:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-24T09:13:09.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:09 trial028 ceph-mon[40371]: Added host trial074 2026-02-24T09:13:09.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:09 trial028 ceph-mon[40371]: Certificate for "cephadm-signed_agent_cert (trial028)" is still valid for 1824 days. 2026-02-24T09:13:09.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:09 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:09.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:09 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:10.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:10 trial028 ceph-mon[40371]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:13:10.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:10 trial028 ceph-mon[40371]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial159", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:13:10.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:10 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:11.042 INFO:teuthology.orchestra.run.trial028.stdout:Added host 'trial159' with addr '10.20.193.159' 2026-02-24T09:13:11.148 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-24T09:13:11.334 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:11.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:11 trial028 ceph-mon[40371]: Deploying cephadm binary to trial159 2026-02-24T09:13:11.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:11 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:11.630 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:13:11.630 INFO:teuthology.orchestra.run.trial028.stdout:[{"addr": "10.20.193.28", "hostname": "trial028", "labels": [], "status": ""}, {"addr": "10.20.193.74", "hostname": "trial074", "labels": [], "status": ""}, {"addr": "10.20.193.159", "hostname": "trial159", "labels": [], "status": ""}] 2026-02-24T09:13:11.726 INFO:tasks.cephadm:Setting crush tunables to default 2026-02-24T09:13:11.726 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd crush tunables default 2026-02-24T09:13:11.911 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:12.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:12 trial028 ceph-mon[40371]: Added host trial159 2026-02-24T09:13:12.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:12 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:12.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:12 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:12.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:12 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:12.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:12 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:12.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:12 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial074", "name": "osd_memory_target"} : dispatch 2026-02-24T09:13:12.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:12 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:12.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:12 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:13:12.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:12 trial028 ceph-mon[40371]: Updating trial074:/etc/ceph/ceph.conf 2026-02-24T09:13:13.168 INFO:teuthology.orchestra.run.trial028.stderr:adjusted tunables profile to default 2026-02-24T09:13:13.308 INFO:tasks.cephadm:Adding mon.a on trial028 2026-02-24T09:13:13.308 INFO:tasks.cephadm:Adding mon.b on trial074 2026-02-24T09:13:13.309 INFO:tasks.cephadm:Adding mon.c on trial159 2026-02-24T09:13:13.309 DEBUG:teuthology.orchestra.run.trial159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph orch apply mon '3;trial028:10.20.193.28=a;trial074:10.20.193.74=b;trial159:10.20.193.159=c' 2026-02-24T09:13:13.493 INFO:teuthology.orchestra.run.trial159.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-24T09:13:13.493 INFO:teuthology.orchestra.run.trial159.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-24T09:13:13.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:13 trial028 ceph-mon[40371]: Updating trial074:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config/ceph.conf 2026-02-24T09:13:13.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:13 trial028 ceph-mon[40371]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:13:13.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:13 trial028 ceph-mon[40371]: Updating trial074:/etc/ceph/ceph.client.admin.keyring 2026-02-24T09:13:13.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:13 trial028 ceph-mon[40371]: Updating trial074:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-24T09:13:13.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:13 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/80548962' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2026-02-24T09:13:13.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:13 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:13.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:13 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:13.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:13 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:13.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:13 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:13:13.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:13 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:13.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:13 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:13.809 INFO:teuthology.orchestra.run.trial159.stdout:Scheduled mon update... 2026-02-24T09:13:13.911 DEBUG:teuthology.orchestra.run.trial074:mon.b> sudo journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mon.b.service 2026-02-24T09:13:13.915 DEBUG:teuthology.orchestra.run.trial159:mon.c> sudo journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mon.c.service 2026-02-24T09:13:13.920 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-24T09:13:13.920 DEBUG:teuthology.orchestra.run.trial159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph mon dump -f json 2026-02-24T09:13:14.145 INFO:teuthology.orchestra.run.trial159.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-24T09:13:14.145 INFO:teuthology.orchestra.run.trial159.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-24T09:13:14.494 INFO:teuthology.orchestra.run.trial159.stdout: 2026-02-24T09:13:14.495 INFO:teuthology.orchestra.run.trial159.stdout:{"epoch":1,"fsid":"e9ad50af-1160-11f1-800e-d404e6e7d460","modified":"2026-02-24T09:12:32.280273Z","created":"2026-02-24T09:12:32.280273Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:3300","nonce":0},{"type":"v1","addr":"10.20.193.28:6789","nonce":0}]},"addr":"10.20.193.28:6789/0","public_addr":"10.20.193.28:6789/0","priority":0,"weight":0,"time_added":"2026-02-24T09:12:32:280292+0000","crush_location":[]}],"quorum":[0]} 2026-02-24T09:13:14.495 INFO:teuthology.orchestra.run.trial159.stderr:dumped monmap epoch 1 2026-02-24T09:13:14.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:14 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/80548962' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-24T09:13:14.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:14 trial028 ceph-mon[40371]: osdmap e4: 0 total, 0 up, 0 in 2026-02-24T09:13:14.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:14 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:15.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:15 trial028 ceph-mon[40371]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;trial028:10.20.193.28=a;trial074:10.20.193.74=b;trial159:10.20.193.159=c", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:13:15.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:15 trial028 ceph-mon[40371]: Saving service mon spec with placement trial028:10.20.193.28=a;trial074:10.20.193.74=b;trial159:10.20.193.159=c;count:3 2026-02-24T09:13:15.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:15 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:15.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:15 trial028 ceph-mon[40371]: from='client.? 10.20.193.159:0/125537425' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-24T09:13:15.637 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-24T09:13:15.638 DEBUG:teuthology.orchestra.run.trial159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph mon dump -f json 2026-02-24T09:13:15.823 INFO:teuthology.orchestra.run.trial159.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-24T09:13:15.823 INFO:teuthology.orchestra.run.trial159.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-24T09:13:16.166 INFO:teuthology.orchestra.run.trial159.stdout: 2026-02-24T09:13:16.167 INFO:teuthology.orchestra.run.trial159.stdout:{"epoch":1,"fsid":"e9ad50af-1160-11f1-800e-d404e6e7d460","modified":"2026-02-24T09:12:32.280273Z","created":"2026-02-24T09:12:32.280273Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:3300","nonce":0},{"type":"v1","addr":"10.20.193.28:6789","nonce":0}]},"addr":"10.20.193.28:6789/0","public_addr":"10.20.193.28:6789/0","priority":0,"weight":0,"time_added":"2026-02-24T09:12:32:280292+0000","crush_location":[]}],"quorum":[0]} 2026-02-24T09:13:16.167 INFO:teuthology.orchestra.run.trial159.stderr:dumped monmap epoch 1 2026-02-24T09:13:17.265 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-24T09:13:17.266 DEBUG:teuthology.orchestra.run.trial159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph mon dump -f json 2026-02-24T09:13:17.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:17 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:17.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:17 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:17.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:17 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:17.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:17 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:17.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:17 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial159", "name": "osd_memory_target"} : dispatch 2026-02-24T09:13:17.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:17 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:17.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:17 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:13:17.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:17 trial028 ceph-mon[40371]: Updating trial159:/etc/ceph/ceph.conf 2026-02-24T09:13:17.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:17 trial028 ceph-mon[40371]: from='client.? 10.20.193.159:0/3553548936' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-24T09:13:17.452 INFO:teuthology.orchestra.run.trial159.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config/ceph.conf 2026-02-24T09:13:17.802 INFO:teuthology.orchestra.run.trial159.stdout: 2026-02-24T09:13:17.802 INFO:teuthology.orchestra.run.trial159.stdout:{"epoch":1,"fsid":"e9ad50af-1160-11f1-800e-d404e6e7d460","modified":"2026-02-24T09:12:32.280273Z","created":"2026-02-24T09:12:32.280273Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:3300","nonce":0},{"type":"v1","addr":"10.20.193.28:6789","nonce":0}]},"addr":"10.20.193.28:6789/0","public_addr":"10.20.193.28:6789/0","priority":0,"weight":0,"time_added":"2026-02-24T09:12:32:280292+0000","crush_location":[]}],"quorum":[0]} 2026-02-24T09:13:17.802 INFO:teuthology.orchestra.run.trial159.stderr:dumped monmap epoch 1 2026-02-24T09:13:18.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:18 trial028 ceph-mon[40371]: Updating trial159:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config/ceph.conf 2026-02-24T09:13:18.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:18 trial028 ceph-mon[40371]: Updating trial159:/etc/ceph/ceph.client.admin.keyring 2026-02-24T09:13:18.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:18 trial028 ceph-mon[40371]: Updating trial159:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-24T09:13:18.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:18 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:18.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:18 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:18.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:18 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:18.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:18 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-24T09:13:18.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:18 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:18.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:18 trial028 ceph-mon[40371]: Deploying daemon mon.c on trial159 2026-02-24T09:13:18.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:18 trial028 ceph-mon[40371]: from='client.? 10.20.193.159:0/2207750116' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-24T09:13:18.946 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-24T09:13:18.947 DEBUG:teuthology.orchestra.run.trial159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph mon dump -f json 2026-02-24T09:13:19.232 INFO:teuthology.orchestra.run.trial159.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.c/config 2026-02-24T09:13:19.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:19 trial159 ceph-mon[44242]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2026-02-24T09:13:24.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:24 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:13:24.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:24 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:13:24.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:24 trial159 ceph-mon[44242]: mon.a calling monitor election 2026-02-24T09:13:24.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:24 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:13:24.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:24 trial159 ceph-mon[44242]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:13:24.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:24 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:13:24.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:24 trial159 ceph-mon[44242]: mon.c calling monitor election 2026-02-24T09:13:24.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:24 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:13:24.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:24 trial159 ceph-mon[44242]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:13:24.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:24 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:13:24.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:24 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:13:24.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:24 trial159 ceph-mon[44242]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-24T09:13:24.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:24 trial159 ceph-mon[44242]: monmap epoch 2 2026-02-24T09:13:24.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:24 trial159 ceph-mon[44242]: fsid e9ad50af-1160-11f1-800e-d404e6e7d460 2026-02-24T09:13:24.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:24 trial159 ceph-mon[44242]: last_changed 2026-02-24T09:13:19.405576+0000 2026-02-24T09:13:24.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:24 trial159 ceph-mon[44242]: created 2026-02-24T09:12:32.280273+0000 2026-02-24T09:13:24.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:24 trial159 ceph-mon[44242]: min_mon_release 20 (tentacle) 2026-02-24T09:13:24.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:24 trial159 ceph-mon[44242]: election_strategy: 1 2026-02-24T09:13:24.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:24 trial159 ceph-mon[44242]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-24T09:13:24.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:24 trial159 ceph-mon[44242]: 1: [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] mon.c 2026-02-24T09:13:24.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:24 trial159 ceph-mon[44242]: fsmap 2026-02-24T09:13:24.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:24 trial159 ceph-mon[44242]: osdmap e4: 0 total, 0 up, 0 in 2026-02-24T09:13:24.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:24 trial159 ceph-mon[44242]: mgrmap e12: x(active, since 25s) 2026-02-24T09:13:24.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:24 trial159 ceph-mon[44242]: overall HEALTH_OK 2026-02-24T09:13:24.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:24 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:24.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:24 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:13:24.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:24 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:13:24.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:24 trial028 ceph-mon[40371]: mon.a calling monitor election 2026-02-24T09:13:24.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:24 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:13:24.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:24 trial028 ceph-mon[40371]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:13:24.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:24 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:13:24.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:24 trial028 ceph-mon[40371]: mon.c calling monitor election 2026-02-24T09:13:24.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:24 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:13:24.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:24 trial028 ceph-mon[40371]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:13:24.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:24 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:13:24.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:24 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:13:24.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:24 trial028 ceph-mon[40371]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-24T09:13:24.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:24 trial028 ceph-mon[40371]: monmap epoch 2 2026-02-24T09:13:24.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:24 trial028 ceph-mon[40371]: fsid e9ad50af-1160-11f1-800e-d404e6e7d460 2026-02-24T09:13:24.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:24 trial028 ceph-mon[40371]: last_changed 2026-02-24T09:13:19.405576+0000 2026-02-24T09:13:24.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:24 trial028 ceph-mon[40371]: created 2026-02-24T09:12:32.280273+0000 2026-02-24T09:13:24.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:24 trial028 ceph-mon[40371]: min_mon_release 20 (tentacle) 2026-02-24T09:13:24.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:24 trial028 ceph-mon[40371]: election_strategy: 1 2026-02-24T09:13:24.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:24 trial028 ceph-mon[40371]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-24T09:13:24.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:24 trial028 ceph-mon[40371]: 1: [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] mon.c 2026-02-24T09:13:24.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:24 trial028 ceph-mon[40371]: fsmap 2026-02-24T09:13:24.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:24 trial028 ceph-mon[40371]: osdmap e4: 0 total, 0 up, 0 in 2026-02-24T09:13:24.863 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:24 trial028 ceph-mon[40371]: mgrmap e12: x(active, since 25s) 2026-02-24T09:13:24.863 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:24 trial028 ceph-mon[40371]: overall HEALTH_OK 2026-02-24T09:13:24.863 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:24 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:25.579 INFO:teuthology.orchestra.run.trial159.stdout: 2026-02-24T09:13:25.579 INFO:teuthology.orchestra.run.trial159.stdout:{"epoch":2,"fsid":"e9ad50af-1160-11f1-800e-d404e6e7d460","modified":"2026-02-24T09:13:19.405576Z","created":"2026-02-24T09:12:32.280273Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:3300","nonce":0},{"type":"v1","addr":"10.20.193.28:6789","nonce":0}]},"addr":"10.20.193.28:6789/0","public_addr":"10.20.193.28:6789/0","priority":0,"weight":0,"time_added":"2026-02-24T09:12:32:280292+0000","crush_location":[]},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:3300","nonce":0},{"type":"v1","addr":"10.20.193.159:6789","nonce":0}]},"addr":"10.20.193.159:6789/0","public_addr":"10.20.193.159:6789/0","priority":0,"weight":0,"time_added":"2026-02-24T09:13:19:405575+0000","crush_location":[]}],"quorum":[0,1]} 2026-02-24T09:13:25.580 INFO:teuthology.orchestra.run.trial159.stderr:dumped monmap epoch 2 2026-02-24T09:13:25.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:25 trial159 ceph-mon[44242]: Deploying daemon mon.b on trial074 2026-02-24T09:13:25.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:25 trial159 ceph-mon[44242]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:13:25.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:25 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:13:25.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:25 trial028 ceph-mon[40371]: Deploying daemon mon.b on trial074 2026-02-24T09:13:25.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:25 trial028 ceph-mon[40371]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:13:25.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:25 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:13:26.680 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-24T09:13:26.680 DEBUG:teuthology.orchestra.run.trial159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph mon dump -f json 2026-02-24T09:13:26.732 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:26 trial159 ceph-mon[44242]: from='client.? 10.20.193.159:0/1517505922' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-24T09:13:26.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:26 trial028 ceph-mon[40371]: from='client.? 10.20.193.159:0/1517505922' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-24T09:13:26.867 INFO:teuthology.orchestra.run.trial159.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.c/config 2026-02-24T09:13:26.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:26 trial074 ceph-mon[44412]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2026-02-24T09:13:32.004 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:31 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:13:32.004 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:31 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:13:32.004 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:31 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:13:32.004 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:31 trial074 ceph-mon[44412]: mon.a calling monitor election 2026-02-24T09:13:32.005 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:31 trial074 ceph-mon[44412]: mon.c calling monitor election 2026-02-24T09:13:32.005 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:31 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:13:32.005 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:31 trial074 ceph-mon[44412]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:13:32.005 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:31 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:13:32.005 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:31 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:13:32.005 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:31 trial074 ceph-mon[44412]: mon.b calling monitor election 2026-02-24T09:13:32.005 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:31 trial074 ceph-mon[44412]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:13:32.005 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:31 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:13:32.006 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:31 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:13:32.006 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:31 trial074 ceph-mon[44412]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:13:32.006 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:31 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:13:32.006 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:31 trial074 ceph-mon[44412]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-24T09:13:32.006 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:31 trial074 ceph-mon[44412]: monmap epoch 3 2026-02-24T09:13:32.006 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:31 trial074 ceph-mon[44412]: fsid e9ad50af-1160-11f1-800e-d404e6e7d460 2026-02-24T09:13:32.006 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:31 trial074 ceph-mon[44412]: last_changed 2026-02-24T09:13:26.635774+0000 2026-02-24T09:13:32.006 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:31 trial074 ceph-mon[44412]: created 2026-02-24T09:12:32.280273+0000 2026-02-24T09:13:32.007 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:31 trial074 ceph-mon[44412]: min_mon_release 20 (tentacle) 2026-02-24T09:13:32.007 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:31 trial074 ceph-mon[44412]: election_strategy: 1 2026-02-24T09:13:32.007 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:31 trial074 ceph-mon[44412]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-24T09:13:32.007 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:31 trial074 ceph-mon[44412]: 1: [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] mon.c 2026-02-24T09:13:32.007 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:31 trial074 ceph-mon[44412]: 2: [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] mon.b 2026-02-24T09:13:32.007 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:31 trial074 ceph-mon[44412]: fsmap 2026-02-24T09:13:32.007 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:31 trial074 ceph-mon[44412]: osdmap e4: 0 total, 0 up, 0 in 2026-02-24T09:13:32.007 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:31 trial074 ceph-mon[44412]: mgrmap e12: x(active, since 32s) 2026-02-24T09:13:32.008 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:31 trial074 ceph-mon[44412]: overall HEALTH_OK 2026-02-24T09:13:32.008 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:31 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:32.010 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:31 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:13:32.010 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:31 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:13:32.010 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:31 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:13:32.010 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:31 trial159 ceph-mon[44242]: mon.a calling monitor election 2026-02-24T09:13:32.010 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:31 trial159 ceph-mon[44242]: mon.c calling monitor election 2026-02-24T09:13:32.010 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:31 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:13:32.010 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:31 trial159 ceph-mon[44242]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:13:32.010 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:31 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:13:32.010 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:31 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:13:32.011 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:31 trial159 ceph-mon[44242]: mon.b calling monitor election 2026-02-24T09:13:32.011 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:31 trial159 ceph-mon[44242]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:13:32.011 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:31 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:13:32.011 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:31 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:13:32.011 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:31 trial159 ceph-mon[44242]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:13:32.011 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:31 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:13:32.011 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:31 trial159 ceph-mon[44242]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-24T09:13:32.011 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:31 trial159 ceph-mon[44242]: monmap epoch 3 2026-02-24T09:13:32.011 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:31 trial159 ceph-mon[44242]: fsid e9ad50af-1160-11f1-800e-d404e6e7d460 2026-02-24T09:13:32.011 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:31 trial159 ceph-mon[44242]: last_changed 2026-02-24T09:13:26.635774+0000 2026-02-24T09:13:32.011 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:31 trial159 ceph-mon[44242]: created 2026-02-24T09:12:32.280273+0000 2026-02-24T09:13:32.012 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:31 trial159 ceph-mon[44242]: min_mon_release 20 (tentacle) 2026-02-24T09:13:32.012 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:31 trial159 ceph-mon[44242]: election_strategy: 1 2026-02-24T09:13:32.012 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:31 trial159 ceph-mon[44242]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-24T09:13:32.012 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:31 trial159 ceph-mon[44242]: 1: [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] mon.c 2026-02-24T09:13:32.012 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:31 trial159 ceph-mon[44242]: 2: [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] mon.b 2026-02-24T09:13:32.012 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:31 trial159 ceph-mon[44242]: fsmap 2026-02-24T09:13:32.012 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:31 trial159 ceph-mon[44242]: osdmap e4: 0 total, 0 up, 0 in 2026-02-24T09:13:32.012 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:31 trial159 ceph-mon[44242]: mgrmap e12: x(active, since 32s) 2026-02-24T09:13:32.012 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:31 trial159 ceph-mon[44242]: overall HEALTH_OK 2026-02-24T09:13:32.012 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:31 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:32.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:31 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:13:32.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:31 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:13:32.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:31 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:13:32.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:31 trial028 ceph-mon[40371]: mon.a calling monitor election 2026-02-24T09:13:32.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:31 trial028 ceph-mon[40371]: mon.c calling monitor election 2026-02-24T09:13:32.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:31 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:13:32.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:31 trial028 ceph-mon[40371]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:13:32.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:31 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:13:32.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:31 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:13:32.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:31 trial028 ceph-mon[40371]: mon.b calling monitor election 2026-02-24T09:13:32.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:31 trial028 ceph-mon[40371]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:13:32.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:31 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:13:32.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:31 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:13:32.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:31 trial028 ceph-mon[40371]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:13:32.112 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:31 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:13:32.112 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:31 trial028 ceph-mon[40371]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-24T09:13:32.112 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:31 trial028 ceph-mon[40371]: monmap epoch 3 2026-02-24T09:13:32.112 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:31 trial028 ceph-mon[40371]: fsid e9ad50af-1160-11f1-800e-d404e6e7d460 2026-02-24T09:13:32.112 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:31 trial028 ceph-mon[40371]: last_changed 2026-02-24T09:13:26.635774+0000 2026-02-24T09:13:32.112 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:31 trial028 ceph-mon[40371]: created 2026-02-24T09:12:32.280273+0000 2026-02-24T09:13:32.112 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:31 trial028 ceph-mon[40371]: min_mon_release 20 (tentacle) 2026-02-24T09:13:32.112 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:31 trial028 ceph-mon[40371]: election_strategy: 1 2026-02-24T09:13:32.112 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:31 trial028 ceph-mon[40371]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-24T09:13:32.112 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:31 trial028 ceph-mon[40371]: 1: [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] mon.c 2026-02-24T09:13:32.112 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:31 trial028 ceph-mon[40371]: 2: [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] mon.b 2026-02-24T09:13:32.112 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:31 trial028 ceph-mon[40371]: fsmap 2026-02-24T09:13:32.112 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:31 trial028 ceph-mon[40371]: osdmap e4: 0 total, 0 up, 0 in 2026-02-24T09:13:32.113 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:31 trial028 ceph-mon[40371]: mgrmap e12: x(active, since 32s) 2026-02-24T09:13:32.113 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:31 trial028 ceph-mon[40371]: overall HEALTH_OK 2026-02-24T09:13:32.113 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:31 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:33.217 INFO:teuthology.orchestra.run.trial159.stdout: 2026-02-24T09:13:33.217 INFO:teuthology.orchestra.run.trial159.stdout:{"epoch":3,"fsid":"e9ad50af-1160-11f1-800e-d404e6e7d460","modified":"2026-02-24T09:13:26.635774Z","created":"2026-02-24T09:12:32.280273Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:3300","nonce":0},{"type":"v1","addr":"10.20.193.28:6789","nonce":0}]},"addr":"10.20.193.28:6789/0","public_addr":"10.20.193.28:6789/0","priority":0,"weight":0,"time_added":"2026-02-24T09:12:32:280292+0000","crush_location":[]},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:3300","nonce":0},{"type":"v1","addr":"10.20.193.159:6789","nonce":0}]},"addr":"10.20.193.159:6789/0","public_addr":"10.20.193.159:6789/0","priority":0,"weight":0,"time_added":"2026-02-24T09:13:19:405575+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:3300","nonce":0},{"type":"v1","addr":"10.20.193.74:6789","nonce":0}]},"addr":"10.20.193.74:6789/0","public_addr":"10.20.193.74:6789/0","priority":0,"weight":0,"time_added":"2026-02-24T09:13:26:635772+0000","crush_location":[]}],"quorum":[0,1,2]} 2026-02-24T09:13:33.217 INFO:teuthology.orchestra.run.trial159.stderr:dumped monmap epoch 3 2026-02-24T09:13:33.352 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-02-24T09:13:33.352 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config generate-minimal-conf 2026-02-24T09:13:33.404 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:33 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:33.404 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:33 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:33.404 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:33 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:33.404 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:33 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:33.404 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:33 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:33.404 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:33 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:13:33.405 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:33 trial028 ceph-mon[40371]: Updating trial028:/etc/ceph/ceph.conf 2026-02-24T09:13:33.405 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:33 trial028 ceph-mon[40371]: Updating trial074:/etc/ceph/ceph.conf 2026-02-24T09:13:33.405 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:33 trial028 ceph-mon[40371]: Updating trial159:/etc/ceph/ceph.conf 2026-02-24T09:13:33.405 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:33 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:13:33.405 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:33 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:33.405 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:33 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:33.405 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:33 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:33.405 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:33 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:33.405 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:33 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:33.406 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:33 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:33.406 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:33 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:33.406 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:33 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-24T09:13:33.406 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:33 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-24T09:13:33.406 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:33 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:33.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:33 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:33.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:33 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:33.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:33 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:33.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:33 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:33.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:33 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:33.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:33 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:13:33.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:33 trial159 ceph-mon[44242]: Updating trial028:/etc/ceph/ceph.conf 2026-02-24T09:13:33.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:33 trial159 ceph-mon[44242]: Updating trial074:/etc/ceph/ceph.conf 2026-02-24T09:13:33.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:33 trial159 ceph-mon[44242]: Updating trial159:/etc/ceph/ceph.conf 2026-02-24T09:13:33.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:33 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:13:33.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:33 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:33.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:33 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:33.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:33 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:33.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:33 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:33.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:33 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:33.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:33 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:33.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:33 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:33.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:33 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-24T09:13:33.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:33 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-24T09:13:33.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:33 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:33.540 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:33.622 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:33 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:33.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:33 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:33.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:33 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:33.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:33 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:33.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:33 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:33.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:33 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:13:33.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:33 trial074 ceph-mon[44412]: Updating trial028:/etc/ceph/ceph.conf 2026-02-24T09:13:33.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:33 trial074 ceph-mon[44412]: Updating trial074:/etc/ceph/ceph.conf 2026-02-24T09:13:33.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:33 trial074 ceph-mon[44412]: Updating trial159:/etc/ceph/ceph.conf 2026-02-24T09:13:33.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:33 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:13:33.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:33 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:33.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:33 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:33.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:33 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:33.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:33 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:33.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:33 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:33.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:33 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:33.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:33 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:33.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:33 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-24T09:13:33.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:33 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-24T09:13:33.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:33 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:33.670 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:13:33 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: 2026-02-24T09:13:33.635+0000 7f2546496640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-24T09:13:33.839 INFO:teuthology.orchestra.run.trial028.stdout:# minimal ceph.conf for e9ad50af-1160-11f1-800e-d404e6e7d460 2026-02-24T09:13:33.840 INFO:teuthology.orchestra.run.trial028.stdout:[global] 2026-02-24T09:13:33.840 INFO:teuthology.orchestra.run.trial028.stdout: fsid = e9ad50af-1160-11f1-800e-d404e6e7d460 2026-02-24T09:13:33.840 INFO:teuthology.orchestra.run.trial028.stdout: mon_host = [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] 2026-02-24T09:13:33.941 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-02-24T09:13:33.941 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-24T09:13:33.942 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/etc/ceph/ceph.conf 2026-02-24T09:13:34.002 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-24T09:13:34.002 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-24T09:13:34.097 DEBUG:teuthology.orchestra.run.trial074:> set -ex 2026-02-24T09:13:34.097 DEBUG:teuthology.orchestra.run.trial074:> sudo dd of=/etc/ceph/ceph.conf 2026-02-24T09:13:34.157 DEBUG:teuthology.orchestra.run.trial074:> set -ex 2026-02-24T09:13:34.157 DEBUG:teuthology.orchestra.run.trial074:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-24T09:13:34.252 DEBUG:teuthology.orchestra.run.trial159:> set -ex 2026-02-24T09:13:34.252 DEBUG:teuthology.orchestra.run.trial159:> sudo dd of=/etc/ceph/ceph.conf 2026-02-24T09:13:34.310 DEBUG:teuthology.orchestra.run.trial159:> set -ex 2026-02-24T09:13:34.310 DEBUG:teuthology.orchestra.run.trial159:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-24T09:13:34.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:34 trial028 ceph-mon[40371]: Updating trial074:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config/ceph.conf 2026-02-24T09:13:34.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:34 trial028 ceph-mon[40371]: Updating trial159:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config/ceph.conf 2026-02-24T09:13:34.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:34 trial028 ceph-mon[40371]: Updating trial028:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config/ceph.conf 2026-02-24T09:13:34.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:34 trial028 ceph-mon[40371]: Reconfiguring mon.a (unknown last config time)... 2026-02-24T09:13:34.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:34 trial028 ceph-mon[40371]: Reconfiguring daemon mon.a on trial028 2026-02-24T09:13:34.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:34 trial028 ceph-mon[40371]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:13:34.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:34 trial028 ceph-mon[40371]: from='client.? 10.20.193.159:0/3573110339' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-24T09:13:34.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:34 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:34.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:34 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:34.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:34 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-24T09:13:34.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:34 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-24T09:13:34.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:34 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:34.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:34 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:34.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:34 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:34.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:34 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-24T09:13:34.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:34 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-24T09:13:34.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:34 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:34.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:34 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/1804762765' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:34.399 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:34 trial159 ceph-mon[44242]: Updating trial074:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config/ceph.conf 2026-02-24T09:13:34.399 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:34 trial159 ceph-mon[44242]: Updating trial159:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config/ceph.conf 2026-02-24T09:13:34.399 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:34 trial159 ceph-mon[44242]: Updating trial028:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config/ceph.conf 2026-02-24T09:13:34.400 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:34 trial159 ceph-mon[44242]: Reconfiguring mon.a (unknown last config time)... 2026-02-24T09:13:34.400 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:34 trial159 ceph-mon[44242]: Reconfiguring daemon mon.a on trial028 2026-02-24T09:13:34.400 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:34 trial159 ceph-mon[44242]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:13:34.400 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:34 trial159 ceph-mon[44242]: from='client.? 10.20.193.159:0/3573110339' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-24T09:13:34.400 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:34 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:34.400 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:34 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:34.400 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:34 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-24T09:13:34.400 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:34 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-24T09:13:34.400 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:34 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:34.400 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:34 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:34.400 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:34 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:34.400 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:34 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-24T09:13:34.401 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:34 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-24T09:13:34.401 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:34 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:34.401 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:34 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/1804762765' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:34.407 INFO:tasks.cephadm:enabling module snap_schedule 2026-02-24T09:13:34.407 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2026-02-24T09:13:34.592 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:34.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:34 trial074 ceph-mon[44412]: Updating trial074:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config/ceph.conf 2026-02-24T09:13:34.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:34 trial074 ceph-mon[44412]: Updating trial159:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config/ceph.conf 2026-02-24T09:13:34.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:34 trial074 ceph-mon[44412]: Updating trial028:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config/ceph.conf 2026-02-24T09:13:34.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:34 trial074 ceph-mon[44412]: Reconfiguring mon.a (unknown last config time)... 2026-02-24T09:13:34.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:34 trial074 ceph-mon[44412]: Reconfiguring daemon mon.a on trial028 2026-02-24T09:13:34.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:34 trial074 ceph-mon[44412]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:13:34.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:34 trial074 ceph-mon[44412]: from='client.? 10.20.193.159:0/3573110339' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-24T09:13:34.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:34 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:34.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:34 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:34.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:34 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-24T09:13:34.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:34 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-24T09:13:34.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:34 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:34.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:34 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:34.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:34 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:34.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:34 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-24T09:13:34.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:34 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-24T09:13:34.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:34 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:34.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:34 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/1804762765' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:35.428 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:35 trial028 ceph-mon[40371]: Reconfiguring mon.b (monmap changed)... 2026-02-24T09:13:35.428 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:35 trial028 ceph-mon[40371]: Reconfiguring daemon mon.b on trial074 2026-02-24T09:13:35.428 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:35 trial028 ceph-mon[40371]: Reconfiguring mon.c (monmap changed)... 2026-02-24T09:13:35.428 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:35 trial028 ceph-mon[40371]: Reconfiguring daemon mon.c on trial159 2026-02-24T09:13:35.428 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:35 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:35.428 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:35 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:35.428 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:35 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:13:35.428 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:35 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:35.428 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:35 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:13:35.428 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:35 trial028 ceph-mon[40371]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:35.428 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:35 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/4094239186' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2026-02-24T09:13:35.471 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:35 trial074 ceph-mon[44412]: Reconfiguring mon.b (monmap changed)... 2026-02-24T09:13:35.472 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:35 trial074 ceph-mon[44412]: Reconfiguring daemon mon.b on trial074 2026-02-24T09:13:35.472 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:35 trial074 ceph-mon[44412]: Reconfiguring mon.c (monmap changed)... 2026-02-24T09:13:35.472 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:35 trial074 ceph-mon[44412]: Reconfiguring daemon mon.c on trial159 2026-02-24T09:13:35.472 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:35 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:35.472 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:35 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:35.472 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:35 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:13:35.472 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:35 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:35.472 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:35 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:13:35.472 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:35 trial074 ceph-mon[44412]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:35.472 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:35 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/4094239186' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2026-02-24T09:13:35.472 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:35 trial159 ceph-mon[44242]: Reconfiguring mon.b (monmap changed)... 2026-02-24T09:13:35.472 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:35 trial159 ceph-mon[44242]: Reconfiguring daemon mon.b on trial074 2026-02-24T09:13:35.473 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:35 trial159 ceph-mon[44242]: Reconfiguring mon.c (monmap changed)... 2026-02-24T09:13:35.473 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:35 trial159 ceph-mon[44242]: Reconfiguring daemon mon.c on trial159 2026-02-24T09:13:35.473 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:35 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:35.473 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:35 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:35.473 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:35 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:13:35.473 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:35 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:35.473 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:35 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:13:35.473 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:35 trial159 ceph-mon[44242]: from='mgr.14152 10.20.193.28:0/4121456344' entity='mgr.x' 2026-02-24T09:13:35.473 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:35 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/4094239186' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2026-02-24T09:13:35.491 INFO:tasks.cephadm:Adding mgr.x on trial028 2026-02-24T09:13:35.491 INFO:tasks.cephadm:Adding mgr.y on trial074 2026-02-24T09:13:35.492 INFO:tasks.cephadm:Adding mgr.z on trial159 2026-02-24T09:13:35.492 DEBUG:teuthology.orchestra.run.trial159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph orch apply mgr '3;trial028=x;trial074=y;trial159=z' 2026-02-24T09:13:35.676 INFO:teuthology.orchestra.run.trial159.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.c/config 2026-02-24T09:13:35.860 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:13:35 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: ignoring --setuser ceph since I am not root 2026-02-24T09:13:35.860 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:13:35 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: ignoring --setgroup ceph since I am not root 2026-02-24T09:13:36.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:36 trial159 ceph-mon[44242]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:13:36.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:36 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/4094239186' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2026-02-24T09:13:36.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:36 trial159 ceph-mon[44242]: mgrmap e13: x(active, since 36s) 2026-02-24T09:13:36.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:36 trial028 ceph-mon[40371]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:13:36.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:36 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/4094239186' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2026-02-24T09:13:36.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:36 trial028 ceph-mon[40371]: mgrmap e13: x(active, since 36s) 2026-02-24T09:13:36.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:36 trial074 ceph-mon[44412]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:13:36.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:36 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/4094239186' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2026-02-24T09:13:36.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:36 trial074 ceph-mon[44412]: mgrmap e13: x(active, since 36s) 2026-02-24T09:13:37.110 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:13:36 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-24T09:13:37.110 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:13:36 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-24T09:13:37.110 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:13:36 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: from numpy import show_config as show_numpy_config 2026-02-24T09:13:39.553 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:39 trial028 ceph-mon[40371]: Active manager daemon x restarted 2026-02-24T09:13:39.553 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:39 trial028 ceph-mon[40371]: Activating manager daemon x 2026-02-24T09:13:39.553 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:39 trial028 ceph-mon[40371]: osdmap e5: 0 total, 0 up, 0 in 2026-02-24T09:13:39.553 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:39 trial028 ceph-mon[40371]: mgrmap e14: x(active, starting, since 0.00435814s) 2026-02-24T09:13:39.554 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:39 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:13:39.554 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:39 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:13:39.554 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:39 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:13:39.554 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:39 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-24T09:13:39.554 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:39 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-24T09:13:39.554 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:39 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-24T09:13:39.554 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:39 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-24T09:13:39.554 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:39 trial028 ceph-mon[40371]: Manager daemon x is now available 2026-02-24T09:13:39.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:39 trial074 ceph-mon[44412]: Active manager daemon x restarted 2026-02-24T09:13:39.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:39 trial074 ceph-mon[44412]: Activating manager daemon x 2026-02-24T09:13:39.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:39 trial074 ceph-mon[44412]: osdmap e5: 0 total, 0 up, 0 in 2026-02-24T09:13:39.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:39 trial074 ceph-mon[44412]: mgrmap e14: x(active, starting, since 0.00435814s) 2026-02-24T09:13:39.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:39 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:13:39.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:39 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:13:39.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:39 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:13:39.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:39 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-24T09:13:39.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:39 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-24T09:13:39.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:39 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-24T09:13:39.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:39 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-24T09:13:39.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:39 trial074 ceph-mon[44412]: Manager daemon x is now available 2026-02-24T09:13:39.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:39 trial159 ceph-mon[44242]: Active manager daemon x restarted 2026-02-24T09:13:39.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:39 trial159 ceph-mon[44242]: Activating manager daemon x 2026-02-24T09:13:39.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:39 trial159 ceph-mon[44242]: osdmap e5: 0 total, 0 up, 0 in 2026-02-24T09:13:39.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:39 trial159 ceph-mon[44242]: mgrmap e14: x(active, starting, since 0.00435814s) 2026-02-24T09:13:39.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:39 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:13:39.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:39 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:13:39.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:39 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:13:39.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:39 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-24T09:13:39.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:39 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-24T09:13:39.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:39 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-24T09:13:39.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:39 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-24T09:13:39.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:39 trial159 ceph-mon[44242]: Manager daemon x is now available 2026-02-24T09:13:40.258 INFO:teuthology.orchestra.run.trial159.stdout:Scheduled mgr update... 2026-02-24T09:13:40.362 DEBUG:teuthology.orchestra.run.trial074:mgr.y> sudo journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mgr.y.service 2026-02-24T09:13:40.366 DEBUG:teuthology.orchestra.run.trial159:mgr.z> sudo journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mgr.z.service 2026-02-24T09:13:40.370 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2026-02-24T09:13:40.371 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config set client client_mount_timeout 600 2026-02-24T09:13:40.375 INFO:tasks.cephadm:setting config [client] debug_client = 20 2026-02-24T09:13:40.375 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config set client debug_client 20 2026-02-24T09:13:40.422 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2026-02-24T09:13:40.422 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config set client debug_ms 1 2026-02-24T09:13:40.468 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2026-02-24T09:13:40.468 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config set client rados_mon_op_timeout 900 2026-02-24T09:13:40.513 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2026-02-24T09:13:40.513 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config set client rados_osd_op_timeout 900 2026-02-24T09:13:40.529 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:13:40.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-24T09:13:40.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-24T09:13:40.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:40.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:40.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:40.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:40.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:40.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:40.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:40 trial159 ceph-mon[44242]: mgrmap e15: x(active, since 1.00849s) 2026-02-24T09:13:40.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:40.561 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2026-02-24T09:13:40.561 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config set mds debug_mds 20 2026-02-24T09:13:40.563 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:13:40.563 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-24T09:13:40.564 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-24T09:13:40.564 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:40.564 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:40.564 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:40.564 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:40.564 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:40.564 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:40.564 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:40 trial028 ceph-mon[40371]: mgrmap e15: x(active, since 1.00849s) 2026-02-24T09:13:40.564 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:40.566 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2026-02-24T09:13:40.566 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config set mds debug_mds_balancer 20 2026-02-24T09:13:40.568 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:40.614 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2026-02-24T09:13:40.614 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config set mds debug_ms 2 2026-02-24T09:13:40.615 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:40.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:13:40.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-24T09:13:40.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-24T09:13:40.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:40.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:40.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:40.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:40.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:40.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:40.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:40 trial074 ceph-mon[44412]: mgrmap e15: x(active, since 1.00849s) 2026-02-24T09:13:40.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:40.661 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2026-02-24T09:13:40.661 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config set mds mds_bal_fragment_size_max 10000 2026-02-24T09:13:40.679 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:40.685 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2026-02-24T09:13:40.685 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config set mds mds_bal_merge_size 5 2026-02-24T09:13:40.730 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2026-02-24T09:13:40.730 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config set mds mds_bal_split_bits 3 2026-02-24T09:13:40.778 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2026-02-24T09:13:40.778 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config set mds mds_bal_split_size 100 2026-02-24T09:13:40.779 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:40.802 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:40.805 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2026-02-24T09:13:40.805 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config set mds mds_debug_frag True 2026-02-24T09:13:40.900 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2026-02-24T09:13:40.900 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config set mds mds_debug_scatterstat True 2026-02-24T09:13:40.901 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:40.955 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2026-02-24T09:13:40.956 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config set mds mds_op_complaint_time 180 2026-02-24T09:13:41.015 INFO:tasks.cephadm:setting config [mds] mds_use_global_snaprealm_seq_for_subvol = False 2026-02-24T09:13:41.015 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config set mds mds_use_global_snaprealm_seq_for_subvol False 2026-02-24T09:13:41.067 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2026-02-24T09:13:41.067 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config set mds mds_verify_scatter True 2026-02-24T09:13:41.077 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:41.081 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2026-02-24T09:13:41.081 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config set mds osd_op_complaint_time 180 2026-02-24T09:13:41.100 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:41.108 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2026-02-24T09:13:41.109 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config set mds rados_mon_op_timeout 900 2026-02-24T09:13:41.119 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:41.157 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2026-02-24T09:13:41.157 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config set mds rados_osd_op_timeout 900 2026-02-24T09:13:41.205 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2026-02-24T09:13:41.206 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config set mgr client_mount_timeout 30 2026-02-24T09:13:41.243 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:41.244 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:41.322 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2026-02-24T09:13:41.322 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config set mgr debug_cephsqlite 20 2026-02-24T09:13:41.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.251+0000 7fb9267fc640 1 -- 10.20.193.28:0/2277138499 <== mon.1 v2:10.20.193.159:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v12)=0 v12) ==== 109+0+0 (secure 0 0 0) 0x7fb92c0183b0 con 0x7fb938155400 2026-02-24T09:13:41.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.256+0000 7fb907fff640 1 -- 10.20.193.28:0/2277138499 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb90803f8b0 msgr2=0x7fb90805fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:41.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.256+0000 7fb907fff640 1 --2- 10.20.193.28:0/2277138499 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb90803f8b0 0x7fb90805fd60 secure :-1 s=READY pgs=11 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb934003470 tx=0x7fb934003b60 comp rx=0 tx=0).stop 2026-02-24T09:13:41.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.256+0000 7fb907fff640 1 -- 10.20.193.28:0/2277138499 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb938155400 msgr2=0x7fb9380ffde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:41.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.256+0000 7fb907fff640 1 --2- 10.20.193.28:0/2277138499 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb938155400 0x7fb9380ffde0 secure :-1 s=READY pgs=7 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb92c00d6a0 tx=0x7fb92c00db70 comp rx=0 tx=0).stop 2026-02-24T09:13:41.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.256+0000 7fb907fff640 1 -- 10.20.193.28:0/2277138499 shutdown_connections 2026-02-24T09:13:41.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.256+0000 7fb907fff640 1 --2- 10.20.193.28:0/2277138499 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb90803f8b0 0x7fb90805fd60 unknown :-1 s=CLOSED pgs=11 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.256+0000 7fb907fff640 1 --2- 10.20.193.28:0/2277138499 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb938155400 0x7fb9380ffde0 unknown :-1 s=CLOSED pgs=7 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.256+0000 7fb907fff640 1 --2- 10.20.193.28:0/2277138499 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb938134880 0x7fb9381758b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.256+0000 7fb907fff640 1 --2- 10.20.193.28:0/2277138499 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb938113e80 0x7fb938154cc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.256+0000 7fb907fff640 1 -- 10.20.193.28:0/2277138499 >> 10.20.193.28:0/2277138499 conn(0x7fb938064690 msgr2=0x7fb9380f66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:41.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.256+0000 7fb907fff640 1 -- 10.20.193.28:0/2277138499 shutdown_connections 2026-02-24T09:13:41.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.257+0000 7fb907fff640 1 -- 10.20.193.28:0/2277138499 wait complete. 2026-02-24T09:13:41.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.288+0000 7fbdb6ffd640 1 -- 10.20.193.28:0/13977240 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fbda8002e40 con 0x7fbde4155790 2026-02-24T09:13:41.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.301+0000 7fbde17fa640 1 -- 10.20.193.28:0/13977240 <== mon.0 v2:10.20.193.28:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v13)=0 v13) ==== 123+0+0 (secure 0 0 0) 0x7fbdd001a070 con 0x7fbde4155790 2026-02-24T09:13:41.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.302+0000 7fbde17fa640 1 -- 10.20.193.28:0/13977240 <== mon.0 v2:10.20.193.28:3300/0 9 ==== config(26 keys) ==== 1081+0+0 (secure 0 0 0) 0x7fbdd0026bc0 con 0x7fbde4155790 2026-02-24T09:13:41.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.304+0000 7fbdb6ffd640 1 -- 10.20.193.28:0/13977240 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fbdc403f7e0 msgr2=0x7fbdc405fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:41.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.304+0000 7fbdb6ffd640 1 --2- 10.20.193.28:0/13977240 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fbdc403f7e0 0x7fbdc405fc90 secure :-1 s=READY pgs=12 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdd4004740 tx=0x7fbdd4009310 comp rx=0 tx=0).stop 2026-02-24T09:13:41.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.304+0000 7fbdb6ffd640 1 -- 10.20.193.28:0/13977240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbde4155790 msgr2=0x7fbde41621b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:41.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.304+0000 7fbdb6ffd640 1 --2- 10.20.193.28:0/13977240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbde4155790 0x7fbde41621b0 secure :-1 s=READY pgs=127 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdd00051f0 tx=0x7fbdd000c4c0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.305+0000 7fbdb6ffd640 1 -- 10.20.193.28:0/13977240 shutdown_connections 2026-02-24T09:13:41.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.305+0000 7fbdb6ffd640 1 --2- 10.20.193.28:0/13977240 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fbdc403f7e0 0x7fbdc405fc90 unknown :-1 s=CLOSED pgs=12 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.305+0000 7fbdb6ffd640 1 --2- 10.20.193.28:0/13977240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbde4155790 0x7fbde41621b0 unknown :-1 s=CLOSED pgs=127 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.305+0000 7fbdb6ffd640 1 --2- 10.20.193.28:0/13977240 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fbde4134bf0 0x7fbde4134660 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.305+0000 7fbdb6ffd640 1 --2- 10.20.193.28:0/13977240 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fbde405e7c0 0x7fbde4161950 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.305+0000 7fbdb6ffd640 1 -- 10.20.193.28:0/13977240 >> 10.20.193.28:0/13977240 conn(0x7fbde405b550 msgr2=0x7fbde4158510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:41.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.305+0000 7fbdb6ffd640 1 -- 10.20.193.28:0/13977240 shutdown_connections 2026-02-24T09:13:41.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.305+0000 7fbdb6ffd640 1 -- 10.20.193.28:0/13977240 wait complete. 2026-02-24T09:13:41.354 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:41 trial028 ceph-mon[40371]: [24/Feb/2026:09:13:39] ENGINE Bus STARTING 2026-02-24T09:13:41.354 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:41 trial028 ceph-mon[40371]: [24/Feb/2026:09:13:39] ENGINE Serving on http://10.20.193.28:8765 2026-02-24T09:13:41.354 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:41 trial028 ceph-mon[40371]: [24/Feb/2026:09:13:39] ENGINE Serving on https://10.20.193.28:7150 2026-02-24T09:13:41.354 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:41 trial028 ceph-mon[40371]: [24/Feb/2026:09:13:39] ENGINE Bus STARTED 2026-02-24T09:13:41.354 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:41 trial028 ceph-mon[40371]: [24/Feb/2026:09:13:39] ENGINE Client ('10.20.193.28', 37022) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-24T09:13:41.354 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:41 trial028 ceph-mon[40371]: from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial028=x;trial074=y;trial159=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:13:41.354 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:41 trial028 ceph-mon[40371]: Saving service mgr spec with placement trial028=x;trial074=y;trial159=z;count:3 2026-02-24T09:13:41.355 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:41 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:41.355 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:41 trial028 ceph-mon[40371]: from='client.? ' entity='client.admin' 2026-02-24T09:13:41.355 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:41 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:41.355 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:41 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial074", "name": "osd_memory_target"} : dispatch 2026-02-24T09:13:41.355 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:41 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:41.355 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:41 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:41.355 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:41 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial159", "name": "osd_memory_target"} : dispatch 2026-02-24T09:13:41.355 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:41 trial028 ceph-mon[40371]: from='client.? ' entity='client.admin' 2026-02-24T09:13:41.355 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:41 trial028 ceph-mon[40371]: from='client.? ' entity='client.admin' 2026-02-24T09:13:41.365 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2026-02-24T09:13:41.365 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config set mgr debug_client 20 2026-02-24T09:13:41.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.301+0000 7f67dffff640 1 -- 10.20.193.28:0/1022106726 <== mon.2 v2:10.20.193.74:3300/0 8 ==== config(26 keys) ==== 1081+0+0 (secure 0 0 0) 0x7f67e0010d60 con 0x7f67e805de20 2026-02-24T09:13:41.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.366+0000 7f67ed0ea640 1 -- 10.20.193.28:0/1022106726 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f67b4002fc0 con 0x7f67e805de20 2026-02-24T09:13:41.370 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2026-02-24T09:13:41.370 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config set mgr debug_mgr 20 2026-02-24T09:13:41.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.370+0000 7f67dffff640 1 -- 10.20.193.28:0/1022106726 <== mon.2 v2:10.20.193.74:3300/0 9 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v14)=0 v14) ==== 108+0+0 (secure 0 0 0) 0x7f67e0017350 con 0x7f67e805de20 2026-02-24T09:13:41.396 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:41.404 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2026-02-24T09:13:41.405 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config set mgr debug_ms 1 2026-02-24T09:13:41.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.398+0000 7f67ed0ea640 1 -- 10.20.193.28:0/1022106726 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f67b8041af0 msgr2=0x7f67b8061fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:41.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.398+0000 7f67ed0ea640 1 --2- 10.20.193.28:0/1022106726 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f67b8041af0 0x7f67b8061fa0 secure :-1 s=READY pgs=13 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f67d80023d0 tx=0x7f67d8002e80 comp rx=0 tx=0).stop 2026-02-24T09:13:41.429 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2026-02-24T09:13:41.429 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2026-02-24T09:13:41.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.398+0000 7f67ed0ea640 1 -- 10.20.193.28:0/1022106726 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f67e805de20 msgr2=0x7f67e81ddac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:41.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.398+0000 7f67ed0ea640 1 --2- 10.20.193.28:0/1022106726 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f67e805de20 0x7f67e81ddac0 secure :-1 s=READY pgs=10 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f67e0006c10 tx=0x7f67e0003cf0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.398+0000 7f67ed0ea640 1 -- 10.20.193.28:0/1022106726 shutdown_connections 2026-02-24T09:13:41.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.398+0000 7f67ed0ea640 1 --2- 10.20.193.28:0/1022106726 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f67b8041af0 0x7f67b8061fa0 unknown :-1 s=CLOSED pgs=13 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.398+0000 7f67ed0ea640 1 --2- 10.20.193.28:0/1022106726 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f67e805fc00 0x7f67e821e7b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.398+0000 7f67ed0ea640 1 --2- 10.20.193.28:0/1022106726 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f67e805f7a0 0x7f67e81fe050 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.398+0000 7f67ed0ea640 1 --2- 10.20.193.28:0/1022106726 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f67e805de20 0x7f67e81ddac0 unknown :-1 s=CLOSED pgs=10 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.398+0000 7f67ed0ea640 1 -- 10.20.193.28:0/1022106726 >> 10.20.193.28:0/1022106726 conn(0x7f67e805b580 msgr2=0x7f67e80663b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:41.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.398+0000 7f67ed0ea640 1 -- 10.20.193.28:0/1022106726 shutdown_connections 2026-02-24T09:13:41.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.398+0000 7f67ed0ea640 1 -- 10.20.193.28:0/1022106726 wait complete. 2026-02-24T09:13:41.502 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2026-02-24T09:13:41.502 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2026-02-24T09:13:41.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.461+0000 7f80f8c0d640 1 -- 10.20.193.28:0/3996203401 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f80f4114650 msgr2=0x7f80f4134a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:41.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.461+0000 7f80f8c0d640 1 --2- 10.20.193.28:0/3996203401 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f80f4114650 0x7f80f4134a30 secure :-1 s=READY pgs=10 gs=1 cs=0 l=1 c_cookie=11319667686752017773 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80e4009950 tx=0x7f80e402f190 comp rx=0 tx=0).stop 2026-02-24T09:13:41.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.462+0000 7f80f8c0d640 1 -- 10.20.193.28:0/3996203401 shutdown_connections 2026-02-24T09:13:41.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.462+0000 7f80f8c0d640 1 --2- 10.20.193.28:0/3996203401 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f80f4155970 0x7f80f4175df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.462+0000 7f80f8c0d640 1 --2- 10.20.193.28:0/3996203401 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f80f4134f70 0x7f80f4155350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.462+0000 7f80f8c0d640 1 --2- 10.20.193.28:0/3996203401 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f80f4114650 0x7f80f4134a30 unknown :-1 s=CLOSED pgs=10 gs=1 cs=0 l=1 c_cookie=11319667686752017773 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.462+0000 7f80f8c0d640 1 -- 10.20.193.28:0/3996203401 >> 10.20.193.28:0/3996203401 conn(0x7f80f405b580 msgr2=0x7f80f405b980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:41.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.462+0000 7f80f8c0d640 1 -- 10.20.193.28:0/3996203401 shutdown_connections 2026-02-24T09:13:41.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.463+0000 7f80f8c0d640 1 -- 10.20.193.28:0/3996203401 wait complete. 2026-02-24T09:13:41.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.464+0000 7f80f8c0d640 1 Processor -- start 2026-02-24T09:13:41.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.464+0000 7f80f8c0d640 1 -- start start 2026-02-24T09:13:41.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.464+0000 7f80f8c0d640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f80f4114650 0x7f80f4155350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:41.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.464+0000 7f80f8c0d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f80f4134f70 0x7f80f4175dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:41.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.464+0000 7f80f8c0d640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f80f4155970 0x7f80f40fd4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:41.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.464+0000 7f80f8c0d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f80f40fdc30 con 0x7f80f4134f70 2026-02-24T09:13:41.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.464+0000 7f80f8c0d640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f80f40fdda0 con 0x7f80f4155970 2026-02-24T09:13:41.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.464+0000 7f80f8c0d640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f80f40fe3f0 con 0x7f80f4114650 2026-02-24T09:13:41.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.465+0000 7f80f2d76640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f80f4155970 0x7f80f40fd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:41.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.465+0000 7f80f2d76640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f80f4155970 0x7f80f40fd4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:56666/0 (socket says 10.20.193.28:56666) 2026-02-24T09:13:41.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.465+0000 7f80f2d76640 1 -- 10.20.193.28:0/3846182005 learned_addr learned my addr 10.20.193.28:0/3846182005 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:13:41.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.465+0000 7f80f2d76640 1 -- 10.20.193.28:0/3846182005 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f80f4114650 msgr2=0x7f80f4155350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-24T09:13:41.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.465+0000 7f80f2d76640 1 --2- 10.20.193.28:0/3846182005 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f80f4114650 0x7f80f4155350 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.465+0000 7f80f2d76640 1 -- 10.20.193.28:0/3846182005 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f80f4134f70 msgr2=0x7f80f4175dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:41.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.465+0000 7f80f2d76640 1 --2- 10.20.193.28:0/3846182005 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f80f4134f70 0x7f80f4175dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.465+0000 7f80f2d76640 1 -- 10.20.193.28:0/3846182005 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e4009570 con 0x7f80f4155970 2026-02-24T09:13:41.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.466+0000 7f80f2d76640 1 --2- 10.20.193.28:0/3846182005 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f80f4155970 0x7f80f40fd4a0 secure :-1 s=READY pgs=11 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80ec006e90 tx=0x7f80ec00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:41.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.468+0000 7f80db7fe640 1 -- 10.20.193.28:0/3846182005 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f80ec005500 con 0x7f80f4155970 2026-02-24T09:13:41.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.468+0000 7f80db7fe640 1 -- 10.20.193.28:0/3846182005 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(26 keys) ==== 1081+0+0 (secure 0 0 0) 0x7f80ec005dd0 con 0x7f80f4155970 2026-02-24T09:13:41.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.468+0000 7f80db7fe640 1 -- 10.20.193.28:0/3846182005 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f80ec003a00 con 0x7f80f4155970 2026-02-24T09:13:41.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.468+0000 7f80f8c0d640 1 -- 10.20.193.28:0/3846182005 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80f40fe6a0 con 0x7f80f4155970 2026-02-24T09:13:41.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.468+0000 7f80f8c0d640 1 -- 10.20.193.28:0/3846182005 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80f40feb20 con 0x7f80f4155970 2026-02-24T09:13:41.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.469+0000 7f80f8c0d640 1 -- 10.20.193.28:0/3846182005 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80f4055c40 con 0x7f80f4155970 2026-02-24T09:13:41.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.477+0000 7f80db7fe640 1 -- 10.20.193.28:0/3846182005 <== mon.2 v2:10.20.193.74:3300/0 4 ==== mgrmap(e 15) ==== 52738+0+0 (secure 0 0 0) 0x7f80ec003b90 con 0x7f80f4155970 2026-02-24T09:13:41.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.478+0000 7f80db7fe640 1 --2- 10.20.193.28:0/3846182005 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f80c403f860 0x7f80c405fd10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:41.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.478+0000 7f80db7fe640 1 -- 10.20.193.28:0/3846182005 <== mon.2 v2:10.20.193.74:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7f80ec054b70 con 0x7f80f4155970 2026-02-24T09:13:41.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.478+0000 7f80f2575640 1 --2- 10.20.193.28:0/3846182005 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f80c403f860 0x7f80c405fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:41.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.479+0000 7f80f2575640 1 --2- 10.20.193.28:0/3846182005 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f80c403f860 0x7f80c405fd10 secure :-1 s=READY pgs=14 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80e402f6a0 tx=0x7f80e40047a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:41.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.483+0000 7f80db7fe640 1 -- 10.20.193.28:0/3846182005 <== mon.2 v2:10.20.193.74:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f80ec006130 con 0x7f80f4155970 2026-02-24T09:13:41.516 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:41.516 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:41.516 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:41.522 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/log_level = debug 2026-02-24T09:13:41.523 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config set mgr mgr/snap_schedule/log_level debug 2026-02-24T09:13:41.574 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2026-02-24T09:13:41.574 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config set mgr mon_warn_on_pool_no_app False 2026-02-24T09:13:41.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:41 trial074 ceph-mon[44412]: [24/Feb/2026:09:13:39] ENGINE Bus STARTING 2026-02-24T09:13:41.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:41 trial074 ceph-mon[44412]: [24/Feb/2026:09:13:39] ENGINE Serving on http://10.20.193.28:8765 2026-02-24T09:13:41.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:41 trial074 ceph-mon[44412]: [24/Feb/2026:09:13:39] ENGINE Serving on https://10.20.193.28:7150 2026-02-24T09:13:41.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:41 trial074 ceph-mon[44412]: [24/Feb/2026:09:13:39] ENGINE Bus STARTED 2026-02-24T09:13:41.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:41 trial074 ceph-mon[44412]: [24/Feb/2026:09:13:39] ENGINE Client ('10.20.193.28', 37022) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-24T09:13:41.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:41 trial074 ceph-mon[44412]: from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial028=x;trial074=y;trial159=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:13:41.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:41 trial074 ceph-mon[44412]: Saving service mgr spec with placement trial028=x;trial074=y;trial159=z;count:3 2026-02-24T09:13:41.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:41 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:41.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:41 trial074 ceph-mon[44412]: from='client.? ' entity='client.admin' 2026-02-24T09:13:41.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:41 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:41.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:41 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial074", "name": "osd_memory_target"} : dispatch 2026-02-24T09:13:41.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:41 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:41.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:41 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:41.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:41 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial159", "name": "osd_memory_target"} : dispatch 2026-02-24T09:13:41.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:41 trial074 ceph-mon[44412]: from='client.? ' entity='client.admin' 2026-02-24T09:13:41.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:41 trial074 ceph-mon[44412]: from='client.? ' entity='client.admin' 2026-02-24T09:13:41.633 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2026-02-24T09:13:41.633 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config set mon mon_op_complaint_time 120 2026-02-24T09:13:41.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.624+0000 7f80f8c0d640 1 -- 10.20.193.28:0/3846182005 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f80f4055e00 con 0x7f80f4155970 2026-02-24T09:13:41.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.627+0000 7f80db7fe640 1 -- 10.20.193.28:0/3846182005 <== mon.2 v2:10.20.193.74:3300/0 7 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f80ec056e90 con 0x7f80f4155970 2026-02-24T09:13:41.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.628+0000 7f80db7fe640 1 -- 10.20.193.28:0/3846182005 <== mon.2 v2:10.20.193.74:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v15)=0 v15) ==== 123+0+0 (secure 0 0 0) 0x7f80ec01e030 con 0x7f80f4155970 2026-02-24T09:13:41.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.631+0000 7f80f8c0d640 1 -- 10.20.193.28:0/3846182005 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f80c403f860 msgr2=0x7f80c405fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:41.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.631+0000 7f80f8c0d640 1 --2- 10.20.193.28:0/3846182005 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f80c403f860 0x7f80c405fd10 secure :-1 s=READY pgs=14 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80e402f6a0 tx=0x7f80e40047a0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.631+0000 7f80f8c0d640 1 -- 10.20.193.28:0/3846182005 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f80f4155970 msgr2=0x7f80f40fd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:41.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.631+0000 7f80f8c0d640 1 --2- 10.20.193.28:0/3846182005 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f80f4155970 0x7f80f40fd4a0 secure :-1 s=READY pgs=11 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80ec006e90 tx=0x7f80ec00edf0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.632+0000 7f80f8c0d640 1 -- 10.20.193.28:0/3846182005 shutdown_connections 2026-02-24T09:13:41.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.632+0000 7f80f8c0d640 1 --2- 10.20.193.28:0/3846182005 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f80c403f860 0x7f80c405fd10 unknown :-1 s=CLOSED pgs=14 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.632+0000 7f80f8c0d640 1 --2- 10.20.193.28:0/3846182005 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f80f4155970 0x7f80f40fd4a0 unknown :-1 s=CLOSED pgs=11 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.632+0000 7f80f8c0d640 1 --2- 10.20.193.28:0/3846182005 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f80f4134f70 0x7f80f4175dd0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.632+0000 7f80f8c0d640 1 --2- 10.20.193.28:0/3846182005 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f80f4114650 0x7f80f4155350 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.632+0000 7f80f8c0d640 1 -- 10.20.193.28:0/3846182005 >> 10.20.193.28:0/3846182005 conn(0x7f80f405b580 msgr2=0x7f80f4113a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:41.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.632+0000 7f80f8c0d640 1 -- 10.20.193.28:0/3846182005 shutdown_connections 2026-02-24T09:13:41.643 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2026-02-24T09:13:41.644 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config set osd osd_op_complaint_time 180 2026-02-24T09:13:41.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.632+0000 7f80f8c0d640 1 -- 10.20.193.28:0/3846182005 wait complete. 2026-02-24T09:13:41.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.649+0000 7fa8b2719640 1 -- 10.20.193.28:0/2120905731 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa8a40c41c0 msgr2=0x7fa8a40c45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:41.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.649+0000 7fa8b2719640 1 --2- 10.20.193.28:0/2120905731 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa8a40c41c0 0x7fa8a40c45b0 secure :-1 s=READY pgs=11 gs=1 cs=0 l=1 c_cookie=14661225205187072995 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8ac04db70 tx=0x7fa8ac07ebc0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.650+0000 7fa8b2719640 1 -- 10.20.193.28:0/2120905731 shutdown_connections 2026-02-24T09:13:41.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.650+0000 7fa8b2719640 1 --2- 10.20.193.28:0/2120905731 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa8a40c5d00 0x7fa8a4126690 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.650+0000 7fa8b2719640 1 --2- 10.20.193.28:0/2120905731 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa8a40c5350 0x7fa8a40c57c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.650+0000 7fa8b2719640 1 --2- 10.20.193.28:0/2120905731 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa8a40c41c0 0x7fa8a40c45b0 unknown :-1 s=CLOSED pgs=11 gs=1 cs=0 l=1 c_cookie=14661225205187072995 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.650+0000 7fa8b2719640 1 -- 10.20.193.28:0/2120905731 >> 10.20.193.28:0/2120905731 conn(0x7fa8a40a1490 msgr2=0x7fa8a40c18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:41.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.650+0000 7fa8b2719640 1 -- 10.20.193.28:0/2120905731 shutdown_connections 2026-02-24T09:13:41.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.650+0000 7fa8b2719640 1 -- 10.20.193.28:0/2120905731 wait complete. 2026-02-24T09:13:41.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.651+0000 7fa8b2719640 1 Processor -- start 2026-02-24T09:13:41.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.652+0000 7fa8b2719640 1 -- start start 2026-02-24T09:13:41.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.652+0000 7fa8b2719640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa8a40c41c0 0x7fa8a40ad2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:41.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.652+0000 7fa8b2719640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa8a40c5350 0x7fa8a4126690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:41.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.652+0000 7fa8b1490640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa8a40c41c0 0x7fa8a40ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:41.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.652+0000 7fa8b1490640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa8a40c41c0 0x7fa8a40ad2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:33154/0 (socket says 10.20.193.28:33154) 2026-02-24T09:13:41.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.652+0000 7fa8b1490640 1 -- 10.20.193.28:0/1372398738 learned_addr learned my addr 10.20.193.28:0/1372398738 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:13:41.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.652+0000 7fa8b2719640 1 --2- 10.20.193.28:0/1372398738 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa8a40c5d00 0x7fa8a40adb10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:41.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.652+0000 7fa8b2719640 1 -- 10.20.193.28:0/1372398738 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a40ae700 con 0x7fa8a40c5d00 2026-02-24T09:13:41.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.652+0000 7fa8b2719640 1 -- 10.20.193.28:0/1372398738 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a40ae870 con 0x7fa8a40c5350 2026-02-24T09:13:41.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.652+0000 7fa8b2719640 1 -- 10.20.193.28:0/1372398738 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a40aea30 con 0x7fa8a40c41c0 2026-02-24T09:13:41.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.653+0000 7fa8ab7fe640 1 --2- 10.20.193.28:0/1372398738 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa8a40c5350 0x7fa8a4126690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:41.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.653+0000 7fa8abfff640 1 --2- 10.20.193.28:0/1372398738 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa8a40c5d00 0x7fa8a40adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:41.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.653+0000 7fa8b1490640 1 -- 10.20.193.28:0/1372398738 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa8a40c5350 msgr2=0x7fa8a4126690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:41.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.653+0000 7fa8b1490640 1 --2- 10.20.193.28:0/1372398738 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa8a40c5350 0x7fa8a4126690 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.653+0000 7fa8b1490640 1 -- 10.20.193.28:0/1372398738 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa8a40c5d00 msgr2=0x7fa8a40adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:41.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.653+0000 7fa8b1490640 1 --2- 10.20.193.28:0/1372398738 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa8a40c5d00 0x7fa8a40adb10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.653+0000 7fa8b1490640 1 -- 10.20.193.28:0/1372398738 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8ac04bf50 con 0x7fa8a40c41c0 2026-02-24T09:13:41.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.654+0000 7fa8ab7fe640 1 --2- 10.20.193.28:0/1372398738 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa8a40c5350 0x7fa8a4126690 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:13:41.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.654+0000 7fa8b1490640 1 --2- 10.20.193.28:0/1372398738 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa8a40c41c0 0x7fa8a40ad2b0 secure :-1 s=READY pgs=12 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8ac052150 tx=0x7fa8ac055cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:41.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.654+0000 7fa8a97fa640 1 -- 10.20.193.28:0/1372398738 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa8ac04d210 con 0x7fa8a40c41c0 2026-02-24T09:13:41.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.654+0000 7fa8a97fa640 1 -- 10.20.193.28:0/1372398738 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fa8ac04d830 con 0x7fa8a40c41c0 2026-02-24T09:13:41.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.655+0000 7fa8a97fa640 1 -- 10.20.193.28:0/1372398738 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa8ac08acf0 con 0x7fa8a40c41c0 2026-02-24T09:13:41.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.655+0000 7fa8b2719640 1 -- 10.20.193.28:0/1372398738 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8a40aecb0 con 0x7fa8a40c41c0 2026-02-24T09:13:41.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.655+0000 7fa8b2719640 1 -- 10.20.193.28:0/1372398738 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8a40af130 con 0x7fa8a40c41c0 2026-02-24T09:13:41.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.656+0000 7fa886ffd640 1 -- 10.20.193.28:0/1372398738 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8a4129f60 con 0x7fa8a40c41c0 2026-02-24T09:13:41.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.656+0000 7fa8a97fa640 1 -- 10.20.193.28:0/1372398738 <== mon.1 v2:10.20.193.159:3300/0 4 ==== mgrmap(e 15) ==== 52738+0+0 (secure 0 0 0) 0x7fa8ac08a420 con 0x7fa8a40c41c0 2026-02-24T09:13:41.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.657+0000 7fa8a97fa640 1 --2- 10.20.193.28:0/1372398738 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa88c03f8b0 0x7fa88c05fd60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:41.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.657+0000 7fa8a97fa640 1 -- 10.20.193.28:0/1372398738 <== mon.1 v2:10.20.193.159:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7fa8ac0c81d0 con 0x7fa8a40c41c0 2026-02-24T09:13:41.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.658+0000 7fa8ab7fe640 1 --2- 10.20.193.28:0/1372398738 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa88c03f8b0 0x7fa88c05fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:41.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.660+0000 7fa8a97fa640 1 -- 10.20.193.28:0/1372398738 <== mon.1 v2:10.20.193.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fa8ac0897d0 con 0x7fa8a40c41c0 2026-02-24T09:13:41.667 DEBUG:tasks.cephadm:set 31 configs 2026-02-24T09:13:41.667 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e9ad50af-1160-11f1-800e-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='trial028') 2026-02-24T09:13:41.667 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e9ad50af-1160-11f1-800e-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='trial028') 2026-02-24T09:13:41.668 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e9ad50af-1160-11f1-800e-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='trial028') 2026-02-24T09:13:41.668 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e9ad50af-1160-11f1-800e-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='trial028') 2026-02-24T09:13:41.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.665+0000 7fa8ab7fe640 1 --2- 10.20.193.28:0/1372398738 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa88c03f8b0 0x7fa88c05fd60 secure :-1 s=READY pgs=15 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa89c004740 tx=0x7fa89c0073d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:41.673 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:41.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.659+0000 7f8eeffff640 1 -- 10.20.193.28:0/3347624096 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ef01148c0 msgr2=0x7f8ef0114d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:41.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.659+0000 7f8eeffff640 1 --2- 10.20.193.28:0/3347624096 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ef01148c0 0x7f8ef0114d30 secure :-1 s=READY pgs=128 gs=1 cs=0 l=1 c_cookie=12273869692000119062 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ed8009950 tx=0x7f8ed802f1b0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.689+0000 7f8eeffff640 1 -- 10.20.193.28:0/3347624096 shutdown_connections 2026-02-24T09:13:41.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.689+0000 7f8eeffff640 1 --2- 10.20.193.28:0/3347624096 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8ef0115270 0x7f8ef0175be0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.689+0000 7f8eeffff640 1 --2- 10.20.193.28:0/3347624096 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ef01148c0 0x7f8ef0114d30 unknown :-1 s=CLOSED pgs=128 gs=1 cs=0 l=1 c_cookie=12273869692000119062 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.689+0000 7f8eeffff640 1 --2- 10.20.193.28:0/3347624096 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8ef0113870 0x7f8ef0113c60 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.689+0000 7f8eeffff640 1 -- 10.20.193.28:0/3347624096 >> 10.20.193.28:0/3347624096 conn(0x7f8ef00646d0 msgr2=0x7f8ef0064ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:41.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.689+0000 7f8eeffff640 1 -- 10.20.193.28:0/3347624096 shutdown_connections 2026-02-24T09:13:41.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.689+0000 7f8eeffff640 1 -- 10.20.193.28:0/3347624096 wait complete. 2026-02-24T09:13:41.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.690+0000 7f8eeffff640 1 Processor -- start 2026-02-24T09:13:41.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.690+0000 7f8eeffff640 1 -- start start 2026-02-24T09:13:41.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.691+0000 7f8eeffff640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8ef0113870 0x7f8ef00feb10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:41.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.691+0000 7f8eeffff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8ef01148c0 0x7f8ef0175be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:41.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.691+0000 7f8eeffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ef0115270 0x7f8ef00ff370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:41.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.692+0000 7f8eeffff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef00fff60 con 0x7f8ef0115270 2026-02-24T09:13:41.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.692+0000 7f8eeffff640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef01000d0 con 0x7f8ef01148c0 2026-02-24T09:13:41.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.692+0000 7f8eeffff640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef0100290 con 0x7f8ef0113870 2026-02-24T09:13:41.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.692+0000 7f8eee7fc640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8ef01148c0 0x7f8ef0175be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:41.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.692+0000 7f8eeeffd640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8ef0113870 0x7f8ef00feb10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:41.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.692+0000 7f8eeeffd640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8ef0113870 0x7f8ef00feb10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:33158/0 (socket says 10.20.193.28:33158) 2026-02-24T09:13:41.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.692+0000 7f8eeeffd640 1 -- 10.20.193.28:0/2388656606 learned_addr learned my addr 10.20.193.28:0/2388656606 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:13:41.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.692+0000 7f8eef7fe640 1 --2- 10.20.193.28:0/2388656606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ef0115270 0x7f8ef00ff370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:41.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.692+0000 7f8eeeffd640 1 -- 10.20.193.28:0/2388656606 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8ef01148c0 msgr2=0x7f8ef0175be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:41.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.692+0000 7f8eeeffd640 1 --2- 10.20.193.28:0/2388656606 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8ef01148c0 0x7f8ef0175be0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.692+0000 7f8eeeffd640 1 -- 10.20.193.28:0/2388656606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ef0115270 msgr2=0x7f8ef00ff370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:41.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.692+0000 7f8eee7fc640 1 --2- 10.20.193.28:0/2388656606 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8ef01148c0 0x7f8ef0175be0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:13:41.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.693+0000 7f8eeeffd640 1 --2- 10.20.193.28:0/2388656606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ef0115270 0x7f8ef00ff370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.693+0000 7f8eeeffd640 1 -- 10.20.193.28:0/2388656606 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ed8009570 con 0x7f8ef0113870 2026-02-24T09:13:41.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.693+0000 7f8eeeffd640 1 --2- 10.20.193.28:0/2388656606 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8ef0113870 0x7f8ef00feb10 secure :-1 s=READY pgs=13 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ee400b520 tx=0x7f8ee400b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:41.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.693+0000 7f8ef48fe640 1 -- 10.20.193.28:0/2388656606 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8ee40044a0 con 0x7f8ef0113870 2026-02-24T09:13:41.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.693+0000 7f8eeffff640 1 -- 10.20.193.28:0/2388656606 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ef0100570 con 0x7f8ef0113870 2026-02-24T09:13:41.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.693+0000 7f8ef48fe640 1 -- 10.20.193.28:0/2388656606 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8ee4002c00 con 0x7f8ef0113870 2026-02-24T09:13:41.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.693+0000 7f8ef48fe640 1 -- 10.20.193.28:0/2388656606 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8ee400fce0 con 0x7f8ef0113870 2026-02-24T09:13:41.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.694+0000 7f8eeffff640 1 -- 10.20.193.28:0/2388656606 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ef0100b10 con 0x7f8ef0113870 2026-02-24T09:13:41.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.695+0000 7f8ef48fe640 1 -- 10.20.193.28:0/2388656606 <== mon.1 v2:10.20.193.159:3300/0 4 ==== mgrmap(e 15) ==== 52738+0+0 (secure 0 0 0) 0x7f8ee4018400 con 0x7f8ef0113870 2026-02-24T09:13:41.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.696+0000 7f8ece7fc640 1 -- 10.20.193.28:0/2388656606 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ef0179b80 con 0x7f8ef0113870 2026-02-24T09:13:41.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.696+0000 7f8ef48fe640 1 --2- 10.20.193.28:0/2388656606 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8ec403f860 0x7f8ec405fd10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:41.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.696+0000 7f8ef48fe640 1 -- 10.20.193.28:0/2388656606 <== mon.1 v2:10.20.193.159:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7f8ee4002d70 con 0x7f8ef0113870 2026-02-24T09:13:41.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.696+0000 7f8eee7fc640 1 --2- 10.20.193.28:0/2388656606 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8ec403f860 0x7f8ec405fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:41.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.697+0000 7f8eee7fc640 1 --2- 10.20.193.28:0/2388656606 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8ec403f860 0x7f8ec405fd10 secure :-1 s=READY pgs=16 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ed80098a0 tx=0x7f8ed8031040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:41.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.699+0000 7f8ef48fe640 1 -- 10.20.193.28:0/2388656606 <== mon.1 v2:10.20.193.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f8ee4017740 con 0x7f8ef0113870 2026-02-24T09:13:41.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:41 trial159 ceph-mon[44242]: [24/Feb/2026:09:13:39] ENGINE Bus STARTING 2026-02-24T09:13:41.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:41 trial159 ceph-mon[44242]: [24/Feb/2026:09:13:39] ENGINE Serving on http://10.20.193.28:8765 2026-02-24T09:13:41.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:41 trial159 ceph-mon[44242]: [24/Feb/2026:09:13:39] ENGINE Serving on https://10.20.193.28:7150 2026-02-24T09:13:41.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:41 trial159 ceph-mon[44242]: [24/Feb/2026:09:13:39] ENGINE Bus STARTED 2026-02-24T09:13:41.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:41 trial159 ceph-mon[44242]: [24/Feb/2026:09:13:39] ENGINE Client ('10.20.193.28', 37022) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-24T09:13:41.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:41 trial159 ceph-mon[44242]: from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial028=x;trial074=y;trial159=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:13:41.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:41 trial159 ceph-mon[44242]: Saving service mgr spec with placement trial028=x;trial074=y;trial159=z;count:3 2026-02-24T09:13:41.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:41 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:41.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:41 trial159 ceph-mon[44242]: from='client.? ' entity='client.admin' 2026-02-24T09:13:41.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:41 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:41.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:41 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial074", "name": "osd_memory_target"} : dispatch 2026-02-24T09:13:41.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:41 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:41.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:41 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:41.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:41 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial159", "name": "osd_memory_target"} : dispatch 2026-02-24T09:13:41.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:41 trial159 ceph-mon[44242]: from='client.? ' entity='client.admin' 2026-02-24T09:13:41.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:41 trial159 ceph-mon[44242]: from='client.? ' entity='client.admin' 2026-02-24T09:13:41.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.780+0000 7f86689f3640 1 -- 10.20.193.28:0/62426730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8660114b90 msgr2=0x7f8660115000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:41.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.780+0000 7f86689f3640 1 --2- 10.20.193.28:0/62426730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8660114b90 0x7f8660115000 secure :-1 s=READY pgs=129 gs=1 cs=0 l=1 c_cookie=17404407049977367012 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8658009950 tx=0x7f865802f1b0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.780+0000 7f86689f3640 1 -- 10.20.193.28:0/62426730 shutdown_connections 2026-02-24T09:13:41.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.780+0000 7f86689f3640 1 --2- 10.20.193.28:0/62426730 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8660115540 0x7f86601159c0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.780+0000 7f86689f3640 1 --2- 10.20.193.28:0/62426730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8660114b90 0x7f8660115000 unknown :-1 s=CLOSED pgs=129 gs=1 cs=0 l=1 c_cookie=17404407049977367012 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.780+0000 7f86689f3640 1 --2- 10.20.193.28:0/62426730 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f866005e570 0x7f8660114650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.780+0000 7f86689f3640 1 -- 10.20.193.28:0/62426730 >> 10.20.193.28:0/62426730 conn(0x7f866005b580 msgr2=0x7f866005b980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:41.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.780+0000 7f86689f3640 1 -- 10.20.193.28:0/62426730 shutdown_connections 2026-02-24T09:13:41.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.780+0000 7f86689f3640 1 -- 10.20.193.28:0/62426730 wait complete. 2026-02-24T09:13:41.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.781+0000 7f86689f3640 1 Processor -- start 2026-02-24T09:13:41.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.781+0000 7f86689f3640 1 -- start start 2026-02-24T09:13:41.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.782+0000 7f86689f3640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f866005e570 0x7f86601b4e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:41.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.782+0000 7f86689f3640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8660114b90 0x7f86601b5450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:41.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.782+0000 7f86689f3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8660115540 0x7f86601b6050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:41.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.782+0000 7f86689f3640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f86601b6790 con 0x7f8660115540 2026-02-24T09:13:41.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.782+0000 7f86689f3640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f86601b6900 con 0x7f866005e570 2026-02-24T09:13:41.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.782+0000 7f86689f3640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f86601b6ac0 con 0x7f8660114b90 2026-02-24T09:13:41.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.782+0000 7f8666768640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f866005e570 0x7f86601b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:41.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.782+0000 7f8666768640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f866005e570 0x7f86601b4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:56726/0 (socket says 10.20.193.28:56726) 2026-02-24T09:13:41.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.782+0000 7f8666768640 1 -- 10.20.193.28:0/1936172154 learned_addr learned my addr 10.20.193.28:0/1936172154 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:13:41.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.782+0000 7f8665f67640 1 --2- 10.20.193.28:0/1936172154 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8660114b90 0x7f86601b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:41.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.782+0000 7f8666f69640 1 --2- 10.20.193.28:0/1936172154 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8660115540 0x7f86601b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:41.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.782+0000 7f8666768640 1 -- 10.20.193.28:0/1936172154 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8660114b90 msgr2=0x7f86601b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:41.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.782+0000 7f8666768640 1 --2- 10.20.193.28:0/1936172154 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8660114b90 0x7f86601b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.782+0000 7f8666768640 1 -- 10.20.193.28:0/1936172154 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8660115540 msgr2=0x7f86601b6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:41.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.782+0000 7f8666768640 1 --2- 10.20.193.28:0/1936172154 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8660115540 0x7f86601b6050 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.782+0000 7f8666768640 1 -- 10.20.193.28:0/1936172154 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8658009570 con 0x7f866005e570 2026-02-24T09:13:41.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.782+0000 7f8666f69640 1 --2- 10.20.193.28:0/1936172154 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8660115540 0x7f86601b6050 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:13:41.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.783+0000 7f8666768640 1 --2- 10.20.193.28:0/1936172154 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f866005e570 0x7f86601b4e00 secure :-1 s=READY pgs=12 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f865c00a560 tx=0x7f865c00fe60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:41.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.784+0000 7f864b7fe640 1 -- 10.20.193.28:0/1936172154 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f865c00dd70 con 0x7f866005e570 2026-02-24T09:13:41.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.784+0000 7f864b7fe640 1 -- 10.20.193.28:0/1936172154 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f865c005df0 con 0x7f866005e570 2026-02-24T09:13:41.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.784+0000 7f864b7fe640 1 -- 10.20.193.28:0/1936172154 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f865c0116b0 con 0x7f866005e570 2026-02-24T09:13:41.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.784+0000 7f86689f3640 1 -- 10.20.193.28:0/1936172154 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86601b6da0 con 0x7f866005e570 2026-02-24T09:13:41.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.784+0000 7f86689f3640 1 -- 10.20.193.28:0/1936172154 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86602172e0 con 0x7f866005e570 2026-02-24T09:13:41.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.786+0000 7f864b7fe640 1 -- 10.20.193.28:0/1936172154 <== mon.2 v2:10.20.193.74:3300/0 4 ==== mgrmap(e 15) ==== 52738+0+0 (secure 0 0 0) 0x7f865c005850 con 0x7f866005e570 2026-02-24T09:13:41.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.786+0000 7f864b7fe640 1 --2- 10.20.193.28:0/1936172154 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f863403f7e0 0x7f863405fc90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:41.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.786+0000 7f864b7fe640 1 -- 10.20.193.28:0/1936172154 <== mon.2 v2:10.20.193.74:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7f865c015070 con 0x7f866005e570 2026-02-24T09:13:41.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.787+0000 7f8665f67640 1 --2- 10.20.193.28:0/1936172154 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f863403f7e0 0x7f863405fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:41.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.788+0000 7f8665f67640 1 --2- 10.20.193.28:0/1936172154 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f863403f7e0 0x7f863405fc90 secure :-1 s=READY pgs=17 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86580098a0 tx=0x7f8658002f40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:41.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.792+0000 7f86689f3640 1 -- 10.20.193.28:0/1936172154 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8660119c10 con 0x7f866005e570 2026-02-24T09:13:41.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.799+0000 7f864b7fe640 1 -- 10.20.193.28:0/1936172154 <== mon.2 v2:10.20.193.74:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f865c019430 con 0x7f866005e570 2026-02-24T09:13:41.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.824+0000 7f8ece7fc640 1 -- 10.20.193.28:0/2388656606 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f8ef0113c60 con 0x7f8ef0113870 2026-02-24T09:13:41.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.830+0000 7f8ef48fe640 1 -- 10.20.193.28:0/2388656606 <== mon.1 v2:10.20.193.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v17)=0 v17) ==== 106+0+0 (secure 0 0 0) 0x7f8ee4013030 con 0x7f8ef0113870 2026-02-24T09:13:41.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.834+0000 7f8ece7fc640 1 -- 10.20.193.28:0/2388656606 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8ec403f860 msgr2=0x7f8ec405fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:41.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.834+0000 7f8ece7fc640 1 --2- 10.20.193.28:0/2388656606 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8ec403f860 0x7f8ec405fd10 secure :-1 s=READY pgs=16 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ed80098a0 tx=0x7f8ed8031040 comp rx=0 tx=0).stop 2026-02-24T09:13:41.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.834+0000 7f8ece7fc640 1 -- 10.20.193.28:0/2388656606 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8ef0113870 msgr2=0x7f8ef00feb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:41.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.834+0000 7f8ece7fc640 1 --2- 10.20.193.28:0/2388656606 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8ef0113870 0x7f8ef00feb10 secure :-1 s=READY pgs=13 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ee400b520 tx=0x7f8ee400b9f0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.834+0000 7f8ece7fc640 1 -- 10.20.193.28:0/2388656606 shutdown_connections 2026-02-24T09:13:41.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.834+0000 7f8ece7fc640 1 --2- 10.20.193.28:0/2388656606 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8ec403f860 0x7f8ec405fd10 unknown :-1 s=CLOSED pgs=16 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.834+0000 7f8ece7fc640 1 --2- 10.20.193.28:0/2388656606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ef0115270 0x7f8ef00ff370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.834+0000 7f8ece7fc640 1 --2- 10.20.193.28:0/2388656606 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8ef01148c0 0x7f8ef0175be0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.834+0000 7f8ece7fc640 1 --2- 10.20.193.28:0/2388656606 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8ef0113870 0x7f8ef00feb10 unknown :-1 s=CLOSED pgs=13 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.834+0000 7f8ece7fc640 1 -- 10.20.193.28:0/2388656606 >> 10.20.193.28:0/2388656606 conn(0x7f8ef00646d0 msgr2=0x7f8ef00f5130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:41.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.835+0000 7f8ece7fc640 1 -- 10.20.193.28:0/2388656606 shutdown_connections 2026-02-24T09:13:41.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.835+0000 7f8ece7fc640 1 -- 10.20.193.28:0/2388656606 wait complete. 2026-02-24T09:13:41.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.821+0000 7fa886ffd640 1 -- 10.20.193.28:0/1372398738 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7fa8a40008d0 con 0x7fa8a40c41c0 2026-02-24T09:13:41.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.827+0000 7fa8a97fa640 1 -- 10.20.193.28:0/1372398738 <== mon.1 v2:10.20.193.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v16)=0 v16) ==== 116+0+0 (secure 0 0 0) 0x7fa8ac080cc0 con 0x7fa8a40c41c0 2026-02-24T09:13:41.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.829+0000 7fa886ffd640 1 -- 10.20.193.28:0/1372398738 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa88c03f8b0 msgr2=0x7fa88c05fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:41.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.829+0000 7fa886ffd640 1 --2- 10.20.193.28:0/1372398738 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa88c03f8b0 0x7fa88c05fd60 secure :-1 s=READY pgs=15 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa89c004740 tx=0x7fa89c0073d0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.830+0000 7fa886ffd640 1 -- 10.20.193.28:0/1372398738 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa8a40c41c0 msgr2=0x7fa8a40ad2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:41.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.830+0000 7fa886ffd640 1 --2- 10.20.193.28:0/1372398738 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa8a40c41c0 0x7fa8a40ad2b0 secure :-1 s=READY pgs=12 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8ac052150 tx=0x7fa8ac055cd0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.830+0000 7fa886ffd640 1 -- 10.20.193.28:0/1372398738 shutdown_connections 2026-02-24T09:13:41.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.830+0000 7fa886ffd640 1 --2- 10.20.193.28:0/1372398738 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa88c03f8b0 0x7fa88c05fd60 unknown :-1 s=CLOSED pgs=15 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.830+0000 7fa886ffd640 1 --2- 10.20.193.28:0/1372398738 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa8a40c5d00 0x7fa8a40adb10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.830+0000 7fa886ffd640 1 --2- 10.20.193.28:0/1372398738 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa8a40c5350 0x7fa8a4126690 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.830+0000 7fa886ffd640 1 --2- 10.20.193.28:0/1372398738 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa8a40c41c0 0x7fa8a40ad2b0 unknown :-1 s=CLOSED pgs=12 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.830+0000 7fa886ffd640 1 -- 10.20.193.28:0/1372398738 >> 10.20.193.28:0/1372398738 conn(0x7fa8a40a1490 msgr2=0x7fa8a40a33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:41.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.830+0000 7fa886ffd640 1 -- 10.20.193.28:0/1372398738 shutdown_connections 2026-02-24T09:13:41.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.830+0000 7fa886ffd640 1 -- 10.20.193.28:0/1372398738 wait complete. 2026-02-24T09:13:41.921 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:41.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.934+0000 7f6a54ebe640 1 -- 10.20.193.28:0/1254208113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6a480c5cc0 msgr2=0x7f6a48126650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:41.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.934+0000 7f6a54ebe640 1 --2- 10.20.193.28:0/1254208113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6a480c5cc0 0x7f6a48126650 secure :-1 s=READY pgs=130 gs=1 cs=0 l=1 c_cookie=1407051133856145264 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6a44008520 tx=0x7f6a44030e80 comp rx=0 tx=0).stop 2026-02-24T09:13:41.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.934+0000 7f6a54ebe640 1 -- 10.20.193.28:0/1254208113 shutdown_connections 2026-02-24T09:13:41.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.934+0000 7f6a54ebe640 1 --2- 10.20.193.28:0/1254208113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6a480c5cc0 0x7f6a48126650 unknown :-1 s=CLOSED pgs=130 gs=1 cs=0 l=1 c_cookie=1407051133856145264 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.934+0000 7f6a54ebe640 1 --2- 10.20.193.28:0/1254208113 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f6a480c5310 0x7f6a480c5780 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.934+0000 7f6a54ebe640 1 --2- 10.20.193.28:0/1254208113 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f6a480c4180 0x7f6a480c4570 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.934+0000 7f6a54ebe640 1 -- 10.20.193.28:0/1254208113 >> 10.20.193.28:0/1254208113 conn(0x7f6a480a1470 msgr2=0x7f6a480c1880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:41.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.934+0000 7f6a54ebe640 1 -- 10.20.193.28:0/1254208113 shutdown_connections 2026-02-24T09:13:41.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.934+0000 7f6a54ebe640 1 -- 10.20.193.28:0/1254208113 wait complete. 2026-02-24T09:13:41.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.936+0000 7f6a54ebe640 1 Processor -- start 2026-02-24T09:13:41.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.936+0000 7f6a54ebe640 1 -- start start 2026-02-24T09:13:41.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.936+0000 7f6a54ebe640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f6a480c4180 0x7f6a480ad3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:41.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.937+0000 7f6a54ebe640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f6a480c5310 0x7f6a48126650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:41.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.937+0000 7f6a54ebe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6a480c5cc0 0x7f6a480adc50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:41.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.937+0000 7f6a4f7fe640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f6a480c4180 0x7f6a480ad3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:41.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.937+0000 7f6a54ebe640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6a480ae840 con 0x7f6a480c5cc0 2026-02-24T09:13:41.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.937+0000 7f6a54ebe640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f6a480ae9b0 con 0x7f6a480c4180 2026-02-24T09:13:41.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.937+0000 7f6a4f7fe640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f6a480c4180 0x7f6a480ad3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:56746/0 (socket says 10.20.193.28:56746) 2026-02-24T09:13:41.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.937+0000 7f6a4f7fe640 1 -- 10.20.193.28:0/3746317724 learned_addr learned my addr 10.20.193.28:0/3746317724 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:13:41.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.937+0000 7f6a54ebe640 1 -- 10.20.193.28:0/3746317724 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6a480aeb70 con 0x7f6a480c5310 2026-02-24T09:13:41.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.937+0000 7f6a4effd640 1 --2- 10.20.193.28:0/3746317724 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f6a480c5310 0x7f6a48126650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:41.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.937+0000 7f6a4ffff640 1 --2- 10.20.193.28:0/3746317724 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6a480c5cc0 0x7f6a480adc50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:41.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.938+0000 7f6a4f7fe640 1 -- 10.20.193.28:0/3746317724 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f6a480c5310 msgr2=0x7f6a48126650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:41.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.938+0000 7f6a4f7fe640 1 --2- 10.20.193.28:0/3746317724 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f6a480c5310 0x7f6a48126650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.938+0000 7f6a4f7fe640 1 -- 10.20.193.28:0/3746317724 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6a480c5cc0 msgr2=0x7f6a480adc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:41.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.938+0000 7f6a4f7fe640 1 --2- 10.20.193.28:0/3746317724 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6a480c5cc0 0x7f6a480adc50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:41.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.938+0000 7f6a4f7fe640 1 -- 10.20.193.28:0/3746317724 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a440081c0 con 0x7f6a480c4180 2026-02-24T09:13:41.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.938+0000 7f6a4effd640 1 --2- 10.20.193.28:0/3746317724 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f6a480c5310 0x7f6a48126650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:13:41.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.938+0000 7f6a4f7fe640 1 --2- 10.20.193.28:0/3746317724 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f6a480c4180 0x7f6a480ad3f0 secure :-1 s=READY pgs=13 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6a3c00e9c0 tx=0x7f6a3c00ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:41.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.938+0000 7f6a4cff9640 1 -- 10.20.193.28:0/3746317724 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6a3c00cd70 con 0x7f6a480c4180 2026-02-24T09:13:41.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.939+0000 7f6a54ebe640 1 -- 10.20.193.28:0/3746317724 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a480aee50 con 0x7f6a480c4180 2026-02-24T09:13:41.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.939+0000 7f6a4cff9640 1 -- 10.20.193.28:0/3746317724 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6a3c004d10 con 0x7f6a480c4180 2026-02-24T09:13:41.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.939+0000 7f6a4cff9640 1 -- 10.20.193.28:0/3746317724 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6a3c0106b0 con 0x7f6a480c4180 2026-02-24T09:13:41.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.939+0000 7f6a54ebe640 1 -- 10.20.193.28:0/3746317724 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a480af320 con 0x7f6a480c4180 2026-02-24T09:13:41.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.940+0000 7f6a2a7fc640 1 -- 10.20.193.28:0/3746317724 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a10005300 con 0x7f6a480c4180 2026-02-24T09:13:41.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.941+0000 7f6a4cff9640 1 -- 10.20.193.28:0/3746317724 <== mon.2 v2:10.20.193.74:3300/0 4 ==== mgrmap(e 15) ==== 52738+0+0 (secure 0 0 0) 0x7f6a3c004770 con 0x7f6a480c4180 2026-02-24T09:13:41.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.941+0000 7f6a4cff9640 1 --2- 10.20.193.28:0/3746317724 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f6a2403f8b0 0x7f6a2405fd60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:41.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.942+0000 7f6a4cff9640 1 -- 10.20.193.28:0/3746317724 <== mon.2 v2:10.20.193.74:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7f6a3c014070 con 0x7f6a480c4180 2026-02-24T09:13:41.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.942+0000 7f6a4effd640 1 --2- 10.20.193.28:0/3746317724 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f6a2403f8b0 0x7f6a2405fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:41.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.943+0000 7f6a4cff9640 1 -- 10.20.193.28:0/3746317724 <== mon.2 v2:10.20.193.74:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f6a3c004410 con 0x7f6a480c4180 2026-02-24T09:13:41.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:41.944+0000 7f6a4effd640 1 --2- 10.20.193.28:0/3746317724 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f6a2403f8b0 0x7f6a2405fd60 secure :-1 s=READY pgs=18 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6a40004740 tx=0x7f6a4000b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:41.979 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:42.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.019+0000 7f6a4cff9640 1 -- 10.20.193.28:0/3746317724 <== mon.2 v2:10.20.193.74:3300/0 7 ==== mgrmap(e 16) ==== 52887+0+0 (secure 0 0 0) 0x7f6a3c052e60 con 0x7f6a480c4180 2026-02-24T09:13:42.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.019+0000 7f864b7fe640 1 -- 10.20.193.28:0/1936172154 <== mon.2 v2:10.20.193.74:3300/0 7 ==== mgrmap(e 16) ==== 52887+0+0 (secure 0 0 0) 0x7f865c01cd00 con 0x7f866005e570 2026-02-24T09:13:42.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.048+0000 7f86689f3640 1 -- 10.20.193.28:0/1936172154 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f8660055c40 con 0x7f866005e570 2026-02-24T09:13:42.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.051+0000 7f864b7fe640 1 -- 10.20.193.28:0/1936172154 <== mon.2 v2:10.20.193.74:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v18)=0 v18) ==== 117+0+0 (secure 0 0 0) 0x7f865c01b920 con 0x7f866005e570 2026-02-24T09:13:42.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.053+0000 7f86689f3640 1 -- 10.20.193.28:0/1936172154 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f863403f7e0 msgr2=0x7f863405fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.053+0000 7f86689f3640 1 --2- 10.20.193.28:0/1936172154 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f863403f7e0 0x7f863405fc90 secure :-1 s=READY pgs=17 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86580098a0 tx=0x7f8658002f40 comp rx=0 tx=0).stop 2026-02-24T09:13:42.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.053+0000 7f86689f3640 1 -- 10.20.193.28:0/1936172154 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f866005e570 msgr2=0x7f86601b4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.053+0000 7f86689f3640 1 --2- 10.20.193.28:0/1936172154 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f866005e570 0x7f86601b4e00 secure :-1 s=READY pgs=12 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f865c00a560 tx=0x7f865c00fe60 comp rx=0 tx=0).stop 2026-02-24T09:13:42.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.053+0000 7f86689f3640 1 -- 10.20.193.28:0/1936172154 shutdown_connections 2026-02-24T09:13:42.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.053+0000 7f86689f3640 1 --2- 10.20.193.28:0/1936172154 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f863403f7e0 0x7f863405fc90 unknown :-1 s=CLOSED pgs=17 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.053+0000 7f86689f3640 1 --2- 10.20.193.28:0/1936172154 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8660115540 0x7f86601b6050 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.053+0000 7f86689f3640 1 --2- 10.20.193.28:0/1936172154 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8660114b90 0x7f86601b5450 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.053+0000 7f86689f3640 1 --2- 10.20.193.28:0/1936172154 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f866005e570 0x7f86601b4e00 unknown :-1 s=CLOSED pgs=12 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.053+0000 7f86689f3640 1 -- 10.20.193.28:0/1936172154 >> 10.20.193.28:0/1936172154 conn(0x7f866005b580 msgr2=0x7f86601ab5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:42.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.053+0000 7f86689f3640 1 -- 10.20.193.28:0/1936172154 shutdown_connections 2026-02-24T09:13:42.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.054+0000 7f86689f3640 1 -- 10.20.193.28:0/1936172154 wait complete. 2026-02-24T09:13:42.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.102+0000 7f6a2a7fc640 1 -- 10.20.193.28:0/3746317724 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f6a100055b0 con 0x7f6a480c4180 2026-02-24T09:13:42.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.108+0000 7f6a4cff9640 1 -- 10.20.193.28:0/3746317724 <== mon.2 v2:10.20.193.74:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v19)=0 v19) ==== 127+0+0 (secure 0 0 0) 0x7f6a3c004030 con 0x7f6a480c4180 2026-02-24T09:13:42.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.111+0000 7f6a2a7fc640 1 -- 10.20.193.28:0/3746317724 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f6a2403f8b0 msgr2=0x7f6a2405fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.111+0000 7f6a2a7fc640 1 --2- 10.20.193.28:0/3746317724 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f6a2403f8b0 0x7f6a2405fd60 secure :-1 s=READY pgs=18 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6a40004740 tx=0x7f6a4000b410 comp rx=0 tx=0).stop 2026-02-24T09:13:42.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.111+0000 7f6a2a7fc640 1 -- 10.20.193.28:0/3746317724 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f6a480c4180 msgr2=0x7f6a480ad3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.111+0000 7f6a2a7fc640 1 --2- 10.20.193.28:0/3746317724 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f6a480c4180 0x7f6a480ad3f0 secure :-1 s=READY pgs=13 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6a3c00e9c0 tx=0x7f6a3c00ee90 comp rx=0 tx=0).stop 2026-02-24T09:13:42.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.112+0000 7f6a2a7fc640 1 -- 10.20.193.28:0/3746317724 shutdown_connections 2026-02-24T09:13:42.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.112+0000 7f6a2a7fc640 1 --2- 10.20.193.28:0/3746317724 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f6a2403f8b0 0x7f6a2405fd60 unknown :-1 s=CLOSED pgs=18 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.112+0000 7f6a2a7fc640 1 --2- 10.20.193.28:0/3746317724 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6a480c5cc0 0x7f6a480adc50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.112+0000 7f6a2a7fc640 1 --2- 10.20.193.28:0/3746317724 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f6a480c5310 0x7f6a48126650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.112+0000 7f6a2a7fc640 1 --2- 10.20.193.28:0/3746317724 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f6a480c4180 0x7f6a480ad3f0 unknown :-1 s=CLOSED pgs=13 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.112+0000 7f6a2a7fc640 1 -- 10.20.193.28:0/3746317724 >> 10.20.193.28:0/3746317724 conn(0x7f6a480a1470 msgr2=0x7f6a480a3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:42.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.112+0000 7f6a2a7fc640 1 -- 10.20.193.28:0/3746317724 shutdown_connections 2026-02-24T09:13:42.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.112+0000 7f6a2a7fc640 1 -- 10.20.193.28:0/3746317724 wait complete. 2026-02-24T09:13:42.133 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:42.140 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:42.141 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e9ad50af-1160-11f1-800e-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='trial028') 2026-02-24T09:13:42.199 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:42.207 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:42.229 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:42.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.269+0000 7f52a5fab640 1 -- 10.20.193.28:0/1838878965 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f52a005e890 msgr2=0x7f52a0134660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.269+0000 7f52a5fab640 1 --2- 10.20.193.28:0/1838878965 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f52a005e890 0x7f52a0134660 secure :-1 s=READY pgs=14 gs=2 cs=0 l=1 c_cookie=1833615271385460097 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5290009950 tx=0x7f5290030300 comp rx=0 tx=0).stop 2026-02-24T09:13:42.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.284+0000 7f52a5fab640 1 -- 10.20.193.28:0/1838878965 shutdown_connections 2026-02-24T09:13:42.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.284+0000 7f52a5fab640 1 --2- 10.20.193.28:0/1838878965 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52a0155860 0x7f52a0175d10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.284+0000 7f52a5fab640 1 --2- 10.20.193.28:0/1838878965 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f52a0134ca0 0x7f52a0155120 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.284+0000 7f52a5fab640 1 --2- 10.20.193.28:0/1838878965 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f52a005e890 0x7f52a0134660 unknown :-1 s=CLOSED pgs=14 gs=2 cs=0 l=1 c_cookie=1833615271385460097 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.284+0000 7f52a5fab640 1 -- 10.20.193.28:0/1838878965 >> 10.20.193.28:0/1838878965 conn(0x7f52a005b480 msgr2=0x7f52a005b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:42.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.284+0000 7f52a5fab640 1 -- 10.20.193.28:0/1838878965 shutdown_connections 2026-02-24T09:13:42.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.284+0000 7f52a5fab640 1 -- 10.20.193.28:0/1838878965 wait complete. 2026-02-24T09:13:42.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.285+0000 7f52a5fab640 1 Processor -- start 2026-02-24T09:13:42.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.286+0000 7f52a5fab640 1 -- start start 2026-02-24T09:13:42.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.286+0000 7f52a5fab640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52a005e890 0x7f52a0140d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.286+0000 7f52a5fab640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f52a0134ca0 0x7f52a0134660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.286+0000 7f52a5fab640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f52a0155860 0x7f52a0141560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.286+0000 7f52a5fab640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f52a0142150 con 0x7f52a005e890 2026-02-24T09:13:42.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.286+0000 7f52a5fab640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f52a01422c0 con 0x7f52a0155860 2026-02-24T09:13:42.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.286+0000 7f52a5fab640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f52a0142480 con 0x7f52a0134ca0 2026-02-24T09:13:42.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.287+0000 7f52a57aa640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f52a0155860 0x7f52a0141560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:42.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.287+0000 7f52a57aa640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f52a0155860 0x7f52a0141560 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:56768/0 (socket says 10.20.193.28:56768) 2026-02-24T09:13:42.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.287+0000 7f52a57aa640 1 -- 10.20.193.28:0/2982915687 learned_addr learned my addr 10.20.193.28:0/2982915687 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:13:42.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.287+0000 7f5297fff640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f52a0134ca0 0x7f52a0134660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:42.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.287+0000 7f52a57aa640 1 -- 10.20.193.28:0/2982915687 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f52a0134ca0 msgr2=0x7f52a0134660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.287+0000 7f52a57aa640 1 --2- 10.20.193.28:0/2982915687 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f52a0134ca0 0x7f52a0134660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.287+0000 7f52a57aa640 1 -- 10.20.193.28:0/2982915687 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52a005e890 msgr2=0x7f52a0140d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.287+0000 7f52a57aa640 1 --2- 10.20.193.28:0/2982915687 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52a005e890 0x7f52a0140d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.287+0000 7f52a57aa640 1 -- 10.20.193.28:0/2982915687 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5290009570 con 0x7f52a0155860 2026-02-24T09:13:42.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.287+0000 7f5297fff640 1 --2- 10.20.193.28:0/2982915687 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f52a0134ca0 0x7f52a0134660 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:13:42.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.291+0000 7f52a57aa640 1 --2- 10.20.193.28:0/2982915687 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f52a0155860 0x7f52a0141560 secure :-1 s=READY pgs=14 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f529c00c750 tx=0x7f529c00cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:42.297 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e9ad50af-1160-11f1-800e-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='trial028') 2026-02-24T09:13:42.297 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e9ad50af-1160-11f1-800e-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='trial028') 2026-02-24T09:13:42.298 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:42.302 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:42.305 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:42.316 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:42.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.315+0000 7f5295ffb640 1 -- 10.20.193.28:0/2982915687 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f529c005500 con 0x7f52a0155860 2026-02-24T09:13:42.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.315+0000 7f5295ffb640 1 -- 10.20.193.28:0/2982915687 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f529c003c40 con 0x7f52a0155860 2026-02-24T09:13:42.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.315+0000 7f5295ffb640 1 -- 10.20.193.28:0/2982915687 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f529c005500 con 0x7f52a0155860 2026-02-24T09:13:42.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.316+0000 7f52a5fab640 1 -- 10.20.193.28:0/2982915687 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52a0142760 con 0x7f52a0155860 2026-02-24T09:13:42.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.316+0000 7f52a5fab640 1 -- 10.20.193.28:0/2982915687 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52a0142be0 con 0x7f52a0155860 2026-02-24T09:13:42.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.317+0000 7f52a5fab640 1 -- 10.20.193.28:0/2982915687 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5268005300 con 0x7f52a0155860 2026-02-24T09:13:42.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.337+0000 7f5295ffb640 1 -- 10.20.193.28:0/2982915687 <== mon.2 v2:10.20.193.74:3300/0 4 ==== mgrmap(e 16) ==== 52887+0+0 (secure 0 0 0) 0x7f529c01d070 con 0x7f52a0155860 2026-02-24T09:13:42.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.339+0000 7f5295ffb640 1 --2- 10.20.193.28:0/2982915687 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f527c03fa80 0x7f527c05ff30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.342+0000 7f4bd89a7640 1 -- 10.20.193.28:0/2123068255 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f4bcc0b89a0 msgr2=0x7f4bcc119330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.342+0000 7f4bd89a7640 1 --2- 10.20.193.28:0/2123068255 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f4bcc0b89a0 0x7f4bcc119330 secure :-1 s=READY pgs=15 gs=2 cs=0 l=1 c_cookie=13243595404641277536 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4bc400aa30 tx=0x7f4bc4030290 comp rx=0 tx=0).stop 2026-02-24T09:13:42.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.343+0000 7f4bd89a7640 1 -- 10.20.193.28:0/2123068255 shutdown_connections 2026-02-24T09:13:42.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.343+0000 7f4bd89a7640 1 --2- 10.20.193.28:0/2123068255 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f4bcc0b89a0 0x7f4bcc119330 unknown :-1 s=CLOSED pgs=15 gs=2 cs=0 l=1 c_cookie=13243595404641277536 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.343+0000 7f4bd89a7640 1 --2- 10.20.193.28:0/2123068255 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4bcc0b7ff0 0x7f4bcc0b8460 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.343+0000 7f4bd89a7640 1 --2- 10.20.193.28:0/2123068255 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f4bcc0b6e60 0x7f4bcc0b7250 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.343+0000 7f4bd89a7640 1 -- 10.20.193.28:0/2123068255 >> 10.20.193.28:0/2123068255 conn(0x7f4bcc0945b0 msgr2=0x7f4bcc0b49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:42.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.343+0000 7f4bd89a7640 1 -- 10.20.193.28:0/2123068255 shutdown_connections 2026-02-24T09:13:42.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.343+0000 7f4bd89a7640 1 -- 10.20.193.28:0/2123068255 wait complete. 2026-02-24T09:13:42.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.343+0000 7f5295ffb640 1 -- 10.20.193.28:0/2982915687 <== mon.2 v2:10.20.193.74:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7f529c0542a0 con 0x7f52a0155860 2026-02-24T09:13:42.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.344+0000 7f52a4fa9640 1 --2- 10.20.193.28:0/2982915687 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f527c03fa80 0x7f527c05ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:42.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.344+0000 7f5295ffb640 1 -- 10.20.193.28:0/2982915687 <== mon.2 v2:10.20.193.74:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f529c054650 con 0x7f52a0155860 2026-02-24T09:13:42.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.345+0000 7f52a4fa9640 1 --2- 10.20.193.28:0/2982915687 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f527c03fa80 0x7f527c05ff30 secure :-1 s=READY pgs=19 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5290030810 tx=0x7f5290005ad0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:42.348 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:42.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.348+0000 7f4bd89a7640 1 Processor -- start 2026-02-24T09:13:42.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.348+0000 7f4bd89a7640 1 -- start start 2026-02-24T09:13:42.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.348+0000 7f4bd89a7640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f4bcc0b6e60 0x7f4bcc0c0e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.349+0000 7f4bd89a7640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f4bcc0b7ff0 0x7f4bcc0c1470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.349+0000 7f4bd89a7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4bcc0b89a0 0x7f4bcc0c2070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.349+0000 7f4bd89a7640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4bcc0c27b0 con 0x7f4bcc0b89a0 2026-02-24T09:13:42.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.349+0000 7f4bd89a7640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f4bcc0c2920 con 0x7f4bcc0b7ff0 2026-02-24T09:13:42.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.349+0000 7f4bd89a7640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4bcc0c2ae0 con 0x7f4bcc0b6e60 2026-02-24T09:13:42.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.349+0000 7f4bd2575640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f4bcc0b7ff0 0x7f4bcc0c1470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:42.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.349+0000 7f4bd2d76640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f4bcc0b6e60 0x7f4bcc0c0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:42.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.349+0000 7f4bd2d76640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f4bcc0b6e60 0x7f4bcc0c0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:33232/0 (socket says 10.20.193.28:33232) 2026-02-24T09:13:42.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.349+0000 7f4bd2d76640 1 -- 10.20.193.28:0/2803043292 learned_addr learned my addr 10.20.193.28:0/2803043292 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:13:42.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.351+0000 7f4bd2d76640 1 -- 10.20.193.28:0/2803043292 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f4bcc0b7ff0 msgr2=0x7f4bcc0c1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.351+0000 7f4bd2d76640 1 --2- 10.20.193.28:0/2803043292 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f4bcc0b7ff0 0x7f4bcc0c1470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.351+0000 7f4bd2d76640 1 -- 10.20.193.28:0/2803043292 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4bcc0b89a0 msgr2=0x7f4bcc0c2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.351+0000 7f4bd2d76640 1 --2- 10.20.193.28:0/2803043292 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4bcc0b89a0 0x7f4bcc0c2070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.351+0000 7f4bd2d76640 1 -- 10.20.193.28:0/2803043292 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc400a650 con 0x7f4bcc0b6e60 2026-02-24T09:13:42.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.351+0000 7f4bd2d76640 1 --2- 10.20.193.28:0/2803043292 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f4bcc0b6e60 0x7f4bcc0c0e20 secure :-1 s=READY pgs=15 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4bbc00b520 tx=0x7f4bbc00b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:42.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.352+0000 7f4bb3fff640 1 -- 10.20.193.28:0/2803043292 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4bbc0044a0 con 0x7f4bcc0b6e60 2026-02-24T09:13:42.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.352+0000 7f4bb3fff640 1 -- 10.20.193.28:0/2803043292 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f4bbc002c00 con 0x7f4bcc0b6e60 2026-02-24T09:13:42.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.352+0000 7f4bb3fff640 1 -- 10.20.193.28:0/2803043292 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4bbc00fce0 con 0x7f4bcc0b6e60 2026-02-24T09:13:42.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.352+0000 7f4bd89a7640 1 -- 10.20.193.28:0/2803043292 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bcc0c2dc0 con 0x7f4bcc0b6e60 2026-02-24T09:13:42.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.352+0000 7f4bd89a7640 1 -- 10.20.193.28:0/2803043292 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bcc103300 con 0x7f4bcc0b6e60 2026-02-24T09:13:42.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.353+0000 7f4bd89a7640 1 -- 10.20.193.28:0/2803043292 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ba0005300 con 0x7f4bcc0b6e60 2026-02-24T09:13:42.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.355+0000 7f4bb3fff640 1 -- 10.20.193.28:0/2803043292 <== mon.1 v2:10.20.193.159:3300/0 4 ==== mgrmap(e 16) ==== 52887+0+0 (secure 0 0 0) 0x7f4bbc002740 con 0x7f4bcc0b6e60 2026-02-24T09:13:42.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.355+0000 7f4bb3fff640 1 --2- 10.20.193.28:0/2803043292 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f4ba403fa70 0x7f4ba405ff20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.356+0000 7f4bb3fff640 1 -- 10.20.193.28:0/2803043292 <== mon.1 v2:10.20.193.159:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7f4bbc053d00 con 0x7f4bcc0b6e60 2026-02-24T09:13:42.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.356+0000 7f4bd2575640 1 --2- 10.20.193.28:0/2803043292 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f4ba403fa70 0x7f4ba405ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:42.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.357+0000 7f4bd2575640 1 --2- 10.20.193.28:0/2803043292 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f4ba403fa70 0x7f4ba405ff20 secure :-1 s=READY pgs=20 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4bc8004740 tx=0x7f4bc8009190 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:42.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.358+0000 7f4bb3fff640 1 -- 10.20.193.28:0/2803043292 <== mon.1 v2:10.20.193.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f4bbc01f9f0 con 0x7f4bcc0b6e60 2026-02-24T09:13:42.383 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:42 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/13977240' entity='client.admin' 2026-02-24T09:13:42.383 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:42 trial028 ceph-mon[40371]: from='client.? ' entity='client.admin' 2026-02-24T09:13:42.383 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:42 trial028 ceph-mon[40371]: from='client.? ' entity='client.admin' 2026-02-24T09:13:42.383 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:42 trial028 ceph-mon[40371]: from='client.? ' entity='client.admin' 2026-02-24T09:13:42.383 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:42 trial028 ceph-mon[40371]: from='client.? ' entity='client.admin' 2026-02-24T09:13:42.383 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:42 trial028 ceph-mon[40371]: mgrmap e16: x(active, since 2s) 2026-02-24T09:13:42.383 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:42 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:42.383 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:42 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:42.384 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:42 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial028", "name": "osd_memory_target"} : dispatch 2026-02-24T09:13:42.384 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:42 trial028 ceph-mon[40371]: from='client.? ' entity='client.admin' 2026-02-24T09:13:42.384 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:42 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:42.384 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:42 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:13:42.384 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:42 trial028 ceph-mon[40371]: from='client.? ' entity='client.admin' 2026-02-24T09:13:42.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.417+0000 7f8d231f0640 1 -- 10.20.193.28:0/2155398033 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8d1c1565b0 msgr2=0x7f8d1c176a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.417+0000 7f8d231f0640 1 --2- 10.20.193.28:0/2155398033 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8d1c1565b0 0x7f8d1c176a10 secure :-1 s=READY pgs=16 gs=3 cs=0 l=1 c_cookie=11946666640163904798 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d14010bd0 tx=0x7f8d14034430 comp rx=0 tx=0).stop 2026-02-24T09:13:42.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.418+0000 7f8d231f0640 1 -- 10.20.193.28:0/2155398033 shutdown_connections 2026-02-24T09:13:42.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.418+0000 7f8d231f0640 1 --2- 10.20.193.28:0/2155398033 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8d1c1565b0 0x7f8d1c176a10 unknown :-1 s=CLOSED pgs=16 gs=3 cs=0 l=1 c_cookie=11946666640163904798 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.418+0000 7f8d231f0640 1 --2- 10.20.193.28:0/2155398033 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8d1c05d3f0 0x7f8d1c156070 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.418+0000 7f8d231f0640 1 --2- 10.20.193.28:0/2155398033 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8d1c05e890 0x7f8d1c114650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.418+0000 7f8d231f0640 1 -- 10.20.193.28:0/2155398033 >> 10.20.193.28:0/2155398033 conn(0x7f8d1c05b480 msgr2=0x7f8d1c05b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:42.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.419+0000 7f8d231f0640 1 -- 10.20.193.28:0/2155398033 shutdown_connections 2026-02-24T09:13:42.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.419+0000 7f8d231f0640 1 -- 10.20.193.28:0/2155398033 wait complete. 2026-02-24T09:13:42.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.420+0000 7f8d231f0640 1 Processor -- start 2026-02-24T09:13:42.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.421+0000 7f8d231f0640 1 -- start start 2026-02-24T09:13:42.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.421+0000 7f8d231f0640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8d1c05d3f0 0x7f8d1c0ffad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.421+0000 7f8d231f0640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8d1c05e890 0x7f8d1c156070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.421+0000 7f8d231f0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8d1c1565b0 0x7f8d1c100330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.421+0000 7f8d231f0640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1c100f20 con 0x7f8d1c1565b0 2026-02-24T09:13:42.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.421+0000 7f8d231f0640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1c101090 con 0x7f8d1c05e890 2026-02-24T09:13:42.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.421+0000 7f8d231f0640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1c101250 con 0x7f8d1c05d3f0 2026-02-24T09:13:42.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.422+0000 7f8d1bfff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8d1c05e890 0x7f8d1c156070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:42.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.422+0000 7f8d21766640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8d1c1565b0 0x7f8d1c100330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:42.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.422+0000 7f8d21766640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8d1c1565b0 0x7f8d1c100330 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56406/0 (socket says 10.20.193.28:56406) 2026-02-24T09:13:42.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.422+0000 7f8d21766640 1 -- 10.20.193.28:0/791197676 learned_addr learned my addr 10.20.193.28:0/791197676 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:13:42.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.422+0000 7f8d21766640 1 -- 10.20.193.28:0/791197676 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8d1c05d3f0 msgr2=0x7f8d1c0ffad0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:13:42.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.422+0000 7f8d21766640 1 --2- 10.20.193.28:0/791197676 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8d1c05d3f0 0x7f8d1c0ffad0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.422+0000 7f8d21766640 1 -- 10.20.193.28:0/791197676 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8d1c05e890 msgr2=0x7f8d1c156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.423+0000 7f8d21766640 1 --2- 10.20.193.28:0/791197676 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8d1c05e890 0x7f8d1c156070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.423+0000 7f8d21766640 1 -- 10.20.193.28:0/791197676 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d140107f0 con 0x7f8d1c1565b0 2026-02-24T09:13:42.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.423+0000 7f8d1bfff640 1 --2- 10.20.193.28:0/791197676 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8d1c05e890 0x7f8d1c156070 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:13:42.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.423+0000 7f8d21766640 1 --2- 10.20.193.28:0/791197676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8d1c1565b0 0x7f8d1c100330 secure :-1 s=READY pgs=131 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d1400a2e0 tx=0x7f8d14010760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:42.427 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e9ad50af-1160-11f1-800e-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='trial028') 2026-02-24T09:13:42.427 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e9ad50af-1160-11f1-800e-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='trial028') 2026-02-24T09:13:42.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.433+0000 7f8d19ffb640 1 -- 10.20.193.28:0/791197676 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8d140053b0 con 0x7f8d1c1565b0 2026-02-24T09:13:42.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.434+0000 7f8d19ffb640 1 -- 10.20.193.28:0/791197676 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8d14005510 con 0x7f8d1c1565b0 2026-02-24T09:13:42.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.434+0000 7f8d19ffb640 1 -- 10.20.193.28:0/791197676 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8d14046710 con 0x7f8d1c1565b0 2026-02-24T09:13:42.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.435+0000 7f8d231f0640 1 -- 10.20.193.28:0/791197676 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d1c1014d0 con 0x7f8d1c1565b0 2026-02-24T09:13:42.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.435+0000 7f8d231f0640 1 -- 10.20.193.28:0/791197676 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d1c1018f0 con 0x7f8d1c1565b0 2026-02-24T09:13:42.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.436+0000 7f8d19ffb640 1 -- 10.20.193.28:0/791197676 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 52887+0+0 (secure 0 0 0) 0x7f8d14044020 con 0x7f8d1c1565b0 2026-02-24T09:13:42.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.436+0000 7f8d231f0640 1 -- 10.20.193.28:0/791197676 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d1c1824d0 con 0x7f8d1c1565b0 2026-02-24T09:13:42.441 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:42.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.437+0000 7f8d19ffb640 1 --2- 10.20.193.28:0/791197676 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8cf403fa70 0x7f8cf405ff20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.437+0000 7f8d19ffb640 1 -- 10.20.193.28:0/791197676 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7f8d1407a870 con 0x7f8d1c1565b0 2026-02-24T09:13:42.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.439+0000 7f8d19ffb640 1 -- 10.20.193.28:0/791197676 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f8d1400e340 con 0x7f8d1c1565b0 2026-02-24T09:13:42.445 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:42.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.462+0000 7f741e157640 1 -- 10.20.193.28:0/2363257091 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7418118cc0 msgr2=0x7f7418119130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.462+0000 7f741e157640 1 --2- 10.20.193.28:0/2363257091 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7418118cc0 0x7f7418119130 secure :-1 s=READY pgs=17 gs=3 cs=0 l=1 c_cookie=13373111678812250047 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7408009890 tx=0x7f740802f100 comp rx=0 tx=0).stop 2026-02-24T09:13:42.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.468+0000 7f741e157640 1 -- 10.20.193.28:0/2363257091 shutdown_connections 2026-02-24T09:13:42.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.468+0000 7f741e157640 1 --2- 10.20.193.28:0/2363257091 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7418119670 0x7f741817a000 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.468+0000 7f741e157640 1 --2- 10.20.193.28:0/2363257091 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7418118cc0 0x7f7418119130 unknown :-1 s=CLOSED pgs=17 gs=3 cs=0 l=1 c_cookie=13373111678812250047 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.469+0000 7f741e157640 1 --2- 10.20.193.28:0/2363257091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7418117b30 0x7f7418117f20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.469+0000 7f741e157640 1 -- 10.20.193.28:0/2363257091 >> 10.20.193.28:0/2363257091 conn(0x7f74180f5280 msgr2=0x7f7418115690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:42.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.470+0000 7f741e157640 1 -- 10.20.193.28:0/2363257091 shutdown_connections 2026-02-24T09:13:42.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.470+0000 7f741e157640 1 -- 10.20.193.28:0/2363257091 wait complete. 2026-02-24T09:13:42.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.477+0000 7f741e157640 1 Processor -- start 2026-02-24T09:13:42.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.477+0000 7f741e157640 1 -- start start 2026-02-24T09:13:42.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.478+0000 7f741e157640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7418117b30 0x7f741811abe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.479+0000 7f741e157640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7418118cc0 0x7f741811b230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.479+0000 7f741e157640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7418119670 0x7f741811be30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.479+0000 7f741e157640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f741811c570 con 0x7f7418117b30 2026-02-24T09:13:42.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.479+0000 7f741e157640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f741811c6e0 con 0x7f7418118cc0 2026-02-24T09:13:42.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.479+0000 7f741e157640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f741811c8a0 con 0x7f7418119670 2026-02-24T09:13:42.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.481+0000 7f741cece640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7418119670 0x7f741811be30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:42.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.481+0000 7f741cece640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7418119670 0x7f741811be30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:33278/0 (socket says 10.20.193.28:33278) 2026-02-24T09:13:42.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.481+0000 7f741cece640 1 -- 10.20.193.28:0/2927220821 learned_addr learned my addr 10.20.193.28:0/2927220821 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:13:42.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.484+0000 7f741cece640 1 -- 10.20.193.28:0/2927220821 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7418118cc0 msgr2=0x7f741811b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.484+0000 7f741cece640 1 --2- 10.20.193.28:0/2927220821 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7418118cc0 0x7f741811b230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.484+0000 7f741cece640 1 -- 10.20.193.28:0/2927220821 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7418117b30 msgr2=0x7f741811abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.484+0000 7f741cece640 1 --2- 10.20.193.28:0/2927220821 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7418117b30 0x7f741811abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.484+0000 7f741cece640 1 -- 10.20.193.28:0/2927220821 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74080094b0 con 0x7f7418119670 2026-02-24T09:13:42.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.486+0000 7f52a5fab640 1 -- 10.20.193.28:0/2982915687 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f52680055b0 con 0x7f52a0155860 2026-02-24T09:13:42.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.485+0000 7f741cece640 1 --2- 10.20.193.28:0/2927220821 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7418119670 0x7f741811be30 secure :-1 s=READY pgs=16 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7410005c80 tx=0x7f741000d0c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:42.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.486+0000 7f7414ff9640 1 -- 10.20.193.28:0/2927220821 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7410019070 con 0x7f7418119670 2026-02-24T09:13:42.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.486+0000 7f8d20f65640 1 --2- 10.20.193.28:0/791197676 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8cf403fa70 0x7f8cf405ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:42.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.486+0000 7f741e157640 1 -- 10.20.193.28:0/2927220821 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f741811cb20 con 0x7f7418119670 2026-02-24T09:13:42.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.487+0000 7f741e157640 1 -- 10.20.193.28:0/2927220821 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f741815d130 con 0x7f7418119670 2026-02-24T09:13:42.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.489+0000 7f7414ff9640 1 -- 10.20.193.28:0/2927220821 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7410010040 con 0x7f7418119670 2026-02-24T09:13:42.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.489+0000 7f7414ff9640 1 -- 10.20.193.28:0/2927220821 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7410008cf0 con 0x7f7418119670 2026-02-24T09:13:42.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.489+0000 7f7414ff9640 1 -- 10.20.193.28:0/2927220821 <== mon.1 v2:10.20.193.159:3300/0 4 ==== mgrmap(e 16) ==== 52887+0+0 (secure 0 0 0) 0x7f7410015480 con 0x7f7418119670 2026-02-24T09:13:42.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.492+0000 7f5295ffb640 1 -- 10.20.193.28:0/2982915687 <== mon.2 v2:10.20.193.74:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v20)=0 v20) ==== 121+0+0 (secure 0 0 0) 0x7f529c00d520 con 0x7f52a0155860 2026-02-24T09:13:42.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.495+0000 7f52a5fab640 1 -- 10.20.193.28:0/2982915687 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f527c03fa80 msgr2=0x7f527c05ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.495+0000 7f52a5fab640 1 --2- 10.20.193.28:0/2982915687 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f527c03fa80 0x7f527c05ff30 secure :-1 s=READY pgs=19 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5290030810 tx=0x7f5290005ad0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.495+0000 7f52a5fab640 1 -- 10.20.193.28:0/2982915687 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f52a0155860 msgr2=0x7f52a0141560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.495+0000 7f52a5fab640 1 --2- 10.20.193.28:0/2982915687 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f52a0155860 0x7f52a0141560 secure :-1 s=READY pgs=14 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f529c00c750 tx=0x7f529c00cc20 comp rx=0 tx=0).stop 2026-02-24T09:13:42.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.496+0000 7f52a5fab640 1 -- 10.20.193.28:0/2982915687 shutdown_connections 2026-02-24T09:13:42.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.496+0000 7f52a5fab640 1 --2- 10.20.193.28:0/2982915687 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f527c03fa80 0x7f527c05ff30 unknown :-1 s=CLOSED pgs=19 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.496+0000 7f52a5fab640 1 --2- 10.20.193.28:0/2982915687 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f52a0155860 0x7f52a0141560 unknown :-1 s=CLOSED pgs=14 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.496+0000 7f52a5fab640 1 --2- 10.20.193.28:0/2982915687 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f52a0134ca0 0x7f52a0134660 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.496+0000 7f52a5fab640 1 --2- 10.20.193.28:0/2982915687 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52a005e890 0x7f52a0140d00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.496+0000 7f52a5fab640 1 -- 10.20.193.28:0/2982915687 >> 10.20.193.28:0/2982915687 conn(0x7f52a005b480 msgr2=0x7f52a0137970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:42.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.496+0000 7f52a5fab640 1 -- 10.20.193.28:0/2982915687 shutdown_connections 2026-02-24T09:13:42.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.497+0000 7f52a5fab640 1 -- 10.20.193.28:0/2982915687 wait complete. 2026-02-24T09:13:42.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.494+0000 7f741e157640 1 -- 10.20.193.28:0/2927220821 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73e4005300 con 0x7f7418119670 2026-02-24T09:13:42.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.495+0000 7f7414ff9640 1 --2- 10.20.193.28:0/2927220821 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f73f003f9d0 0x7f73f005fe80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.495+0000 7f7414ff9640 1 -- 10.20.193.28:0/2927220821 <== mon.1 v2:10.20.193.159:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7f74100560e0 con 0x7f7418119670 2026-02-24T09:13:42.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.499+0000 7fc0931d0640 1 -- 10.20.193.28:0/4282344087 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc0840b4240 msgr2=0x7fc0840d4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.501+0000 7fc0931d0640 1 --2- 10.20.193.28:0/4282344087 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc0840b4240 0x7fc0840d4640 secure :-1 s=READY pgs=132 gs=1 cs=0 l=1 c_cookie=5262820965657154718 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc074009950 tx=0x7fc07402f190 comp rx=0 tx=0).stop 2026-02-24T09:13:42.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.505+0000 7f8d20f65640 1 --2- 10.20.193.28:0/791197676 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8cf403fa70 0x7f8cf405ff20 secure :-1 s=READY pgs=21 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d10004740 tx=0x7f8d10009310 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:42.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.502+0000 7fc0931d0640 1 -- 10.20.193.28:0/4282344087 shutdown_connections 2026-02-24T09:13:42.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.502+0000 7fc0931d0640 1 --2- 10.20.193.28:0/4282344087 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc0840f5840 0x7fc084115cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.502+0000 7fc0931d0640 1 --2- 10.20.193.28:0/4282344087 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc0840d4c80 0x7fc0840f5100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.502+0000 7fc0931d0640 1 --2- 10.20.193.28:0/4282344087 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc0840b4240 0x7fc0840d4640 unknown :-1 s=CLOSED pgs=132 gs=1 cs=0 l=1 c_cookie=5262820965657154718 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.502+0000 7fc0931d0640 1 -- 10.20.193.28:0/4282344087 >> 10.20.193.28:0/4282344087 conn(0x7fc084090520 msgr2=0x7fc0840b0950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:42.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.502+0000 7fc0931d0640 1 -- 10.20.193.28:0/4282344087 shutdown_connections 2026-02-24T09:13:42.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.502+0000 7fc0931d0640 1 -- 10.20.193.28:0/4282344087 wait complete. 2026-02-24T09:13:42.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.503+0000 7fc0931d0640 1 Processor -- start 2026-02-24T09:13:42.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.503+0000 7fc0931d0640 1 -- start start 2026-02-24T09:13:42.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.504+0000 7fc0931d0640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc0840b4240 0x7fc0840d4620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.504+0000 7fc0931d0640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc0840d4c80 0x7fc0840b0900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.504+0000 7fc0931d0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc0840f5840 0x7fc0840fe7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.504+0000 7fc0931d0640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc0840fef60 con 0x7fc0840f5840 2026-02-24T09:13:42.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.504+0000 7fc0931d0640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fc0840ff0d0 con 0x7fc0840b4240 2026-02-24T09:13:42.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.504+0000 7fc0931d0640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc0840ff290 con 0x7fc0840d4c80 2026-02-24T09:13:42.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.504+0000 7fc090f45640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc0840b4240 0x7fc0840d4620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:42.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.504+0000 7fc083fff640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc0840d4c80 0x7fc0840b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:42.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.505+0000 7fc090f45640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc0840b4240 0x7fc0840d4620 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:56838/0 (socket says 10.20.193.28:56838) 2026-02-24T09:13:42.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.505+0000 7fc090f45640 1 -- 10.20.193.28:0/2188046249 learned_addr learned my addr 10.20.193.28:0/2188046249 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:13:42.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.507+0000 7fc090f45640 1 -- 10.20.193.28:0/2188046249 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc0840d4c80 msgr2=0x7fc0840b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.507+0000 7fc090f45640 1 --2- 10.20.193.28:0/2188046249 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc0840d4c80 0x7fc0840b0900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.507+0000 7fc090f45640 1 -- 10.20.193.28:0/2188046249 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc0840f5840 msgr2=0x7fc0840fe7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.507+0000 7fc090f45640 1 --2- 10.20.193.28:0/2188046249 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc0840f5840 0x7fc0840fe7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.507+0000 7fc090f45640 1 -- 10.20.193.28:0/2188046249 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc074009570 con 0x7fc0840b4240 2026-02-24T09:13:42.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.508+0000 7f74177fe640 1 --2- 10.20.193.28:0/2927220821 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f73f003f9d0 0x7f73f005fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:42.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.509+0000 7fc083fff640 1 --2- 10.20.193.28:0/2188046249 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc0840d4c80 0x7fc0840b0900 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:13:42.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.509+0000 7fc090f45640 1 --2- 10.20.193.28:0/2188046249 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc0840b4240 0x7fc0840d4620 secure :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc0740098a0 tx=0x7fc0740028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:42.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.508+0000 7f7414ff9640 1 -- 10.20.193.28:0/2927220821 <== mon.1 v2:10.20.193.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f741001e7a0 con 0x7f7418119670 2026-02-24T09:13:42.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.512+0000 7f74177fe640 1 --2- 10.20.193.28:0/2927220821 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f73f003f9d0 0x7f73f005fe80 secure :-1 s=READY pgs=22 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7404004740 tx=0x7f7404006d40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:42.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.519+0000 7fc081ffb640 1 -- 10.20.193.28:0/2188046249 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc07403d070 con 0x7fc0840b4240 2026-02-24T09:13:42.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.519+0000 7fc081ffb640 1 -- 10.20.193.28:0/2188046249 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc07402fe20 con 0x7fc0840b4240 2026-02-24T09:13:42.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.519+0000 7fc081ffb640 1 -- 10.20.193.28:0/2188046249 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc074041890 con 0x7fc0840b4240 2026-02-24T09:13:42.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.519+0000 7fc0931d0640 1 -- 10.20.193.28:0/2188046249 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0840ff920 con 0x7fc0840b4240 2026-02-24T09:13:42.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.520+0000 7fc0931d0640 1 -- 10.20.193.28:0/2188046249 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0840ffd40 con 0x7fc0840b4240 2026-02-24T09:13:42.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.521+0000 7fc05b7fe640 1 -- 10.20.193.28:0/2188046249 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc04c005300 con 0x7fc0840b4240 2026-02-24T09:13:42.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.522+0000 7fc081ffb640 1 -- 10.20.193.28:0/2188046249 <== mon.2 v2:10.20.193.74:3300/0 4 ==== mgrmap(e 16) ==== 52887+0+0 (secure 0 0 0) 0x7fc074048020 con 0x7fc0840b4240 2026-02-24T09:13:42.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.523+0000 7fc081ffb640 1 --2- 10.20.193.28:0/2188046249 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc06803fa70 0x7fc06805ff20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.523+0000 7fc081ffb640 1 -- 10.20.193.28:0/2188046249 <== mon.2 v2:10.20.193.74:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7fc074078ad0 con 0x7fc0840b4240 2026-02-24T09:13:42.526 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:42.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.525+0000 7fc083fff640 1 --2- 10.20.193.28:0/2188046249 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc06803fa70 0x7fc06805ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:42.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.527+0000 7fc081ffb640 1 -- 10.20.193.28:0/2188046249 <== mon.2 v2:10.20.193.74:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fc074037c20 con 0x7fc0840b4240 2026-02-24T09:13:42.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.545+0000 7fc083fff640 1 --2- 10.20.193.28:0/2188046249 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc06803fa70 0x7fc06805ff20 secure :-1 s=READY pgs=23 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc07c004740 tx=0x7fc07c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:42.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.572+0000 7f4bd89a7640 1 -- 10.20.193.28:0/2803043292 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f4ba0005b30 con 0x7f4bcc0b6e60 2026-02-24T09:13:42.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.574+0000 7f8bf30de640 1 -- 10.20.193.28:0/614385851 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bec05e430 msgr2=0x7f8bec114650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.574+0000 7f8bf30de640 1 --2- 10.20.193.28:0/614385851 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bec05e430 0x7f8bec114650 secure :-1 s=READY pgs=133 gs=1 cs=0 l=1 c_cookie=6221878027044681391 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8be0009950 tx=0x7f8be002f1b0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.574+0000 7f8bf30de640 1 -- 10.20.193.28:0/614385851 shutdown_connections 2026-02-24T09:13:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.574+0000 7f8bf30de640 1 --2- 10.20.193.28:0/614385851 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8bec115540 0x7f8bec1159e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.574+0000 7f8bf30de640 1 --2- 10.20.193.28:0/614385851 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8bec114b90 0x7f8bec115000 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.574+0000 7f8bf30de640 1 --2- 10.20.193.28:0/614385851 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bec05e430 0x7f8bec114650 unknown :-1 s=CLOSED pgs=133 gs=1 cs=0 l=1 c_cookie=6221878027044681391 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.574+0000 7f8bf30de640 1 -- 10.20.193.28:0/614385851 >> 10.20.193.28:0/614385851 conn(0x7f8bec05b480 msgr2=0x7f8bec05b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:42.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.575+0000 7f8bf30de640 1 -- 10.20.193.28:0/614385851 shutdown_connections 2026-02-24T09:13:42.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.575+0000 7f8bf30de640 1 -- 10.20.193.28:0/614385851 wait complete. 2026-02-24T09:13:42.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.580+0000 7f4bb3fff640 1 -- 10.20.193.28:0/2803043292 <== mon.1 v2:10.20.193.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v21)=0 v21) ==== 118+0+0 (secure 0 0 0) 0x7f4bbc017dd0 con 0x7f4bcc0b6e60 2026-02-24T09:13:42.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.576+0000 7f8bf30de640 1 Processor -- start 2026-02-24T09:13:42.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.576+0000 7f8bf30de640 1 -- start start 2026-02-24T09:13:42.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.579+0000 7f8bf30de640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bec05e430 0x7f8bec1b4ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.579+0000 7f8bf30de640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8bec114b90 0x7f8bec1b5330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.580+0000 7f8bf30de640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8bec115540 0x7f8bec1b5f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.580+0000 7f8bf30de640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8bec1b65e0 con 0x7f8bec05e430 2026-02-24T09:13:42.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.580+0000 7f8bf18db640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8bec114b90 0x7f8bec1b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:42.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.580+0000 7f8bf18db640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8bec114b90 0x7f8bec1b5330 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:56852/0 (socket says 10.20.193.28:56852) 2026-02-24T09:13:42.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.580+0000 7f8bf18db640 1 -- 10.20.193.28:0/828314593 learned_addr learned my addr 10.20.193.28:0/828314593 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:13:42.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.580+0000 7f8bf30de640 1 -- 10.20.193.28:0/828314593 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f8bec1b6750 con 0x7f8bec114b90 2026-02-24T09:13:42.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.580+0000 7f8bf30de640 1 -- 10.20.193.28:0/828314593 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8bec1b6910 con 0x7f8bec115540 2026-02-24T09:13:42.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.580+0000 7f8bf28dd640 1 --2- 10.20.193.28:0/828314593 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8bec115540 0x7f8bec1b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:42.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.581+0000 7f8bf18db640 1 -- 10.20.193.28:0/828314593 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8bec115540 msgr2=0x7f8bec1b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.581+0000 7f8bf18db640 1 --2- 10.20.193.28:0/828314593 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8bec115540 0x7f8bec1b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.581+0000 7f8bf18db640 1 -- 10.20.193.28:0/828314593 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bec05e430 msgr2=0x7f8bec1b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.581+0000 7f8bf18db640 1 --2- 10.20.193.28:0/828314593 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bec05e430 0x7f8bec1b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.581+0000 7f8bf18db640 1 -- 10.20.193.28:0/828314593 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be0009570 con 0x7f8bec114b90 2026-02-24T09:13:42.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.581+0000 7f8bf18db640 1 --2- 10.20.193.28:0/828314593 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8bec114b90 0x7f8bec1b5330 secure :-1 s=READY pgs=19 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8be4006e90 tx=0x7f8be400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:42.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.592+0000 7f8bdb7fe640 1 -- 10.20.193.28:0/828314593 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8be4005500 con 0x7f8bec114b90 2026-02-24T09:13:42.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.592+0000 7f8bdb7fe640 1 -- 10.20.193.28:0/828314593 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8be400cd00 con 0x7f8bec114b90 2026-02-24T09:13:42.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.592+0000 7f8bdb7fe640 1 -- 10.20.193.28:0/828314593 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8be40116e0 con 0x7f8bec114b90 2026-02-24T09:13:42.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.592+0000 7f8bf30de640 1 -- 10.20.193.28:0/828314593 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bec1b6bf0 con 0x7f8bec114b90 2026-02-24T09:13:42.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.592+0000 7f8bf30de640 1 -- 10.20.193.28:0/828314593 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bec217170 con 0x7f8bec114b90 2026-02-24T09:13:42.595 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e9ad50af-1160-11f1-800e-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='trial028') 2026-02-24T09:13:42.595 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e9ad50af-1160-11f1-800e-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='trial028') 2026-02-24T09:13:42.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.594+0000 7f8bdb7fe640 1 -- 10.20.193.28:0/828314593 <== mon.2 v2:10.20.193.74:3300/0 4 ==== mgrmap(e 16) ==== 52887+0+0 (secure 0 0 0) 0x7f8be400c840 con 0x7f8bec114b90 2026-02-24T09:13:42.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.595+0000 7f8bdb7fe640 1 --2- 10.20.193.28:0/828314593 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8bc003fa70 0x7f8bc005ff20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.595+0000 7f8bdb7fe640 1 -- 10.20.193.28:0/828314593 <== mon.2 v2:10.20.193.74:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7f8be4055680 con 0x7f8bec114b90 2026-02-24T09:13:42.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.595+0000 7f8bf20dc640 1 --2- 10.20.193.28:0/828314593 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8bc003fa70 0x7f8bc005ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:42.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.596+0000 7f8bf20dc640 1 --2- 10.20.193.28:0/828314593 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8bc003fa70 0x7f8bc005ff20 secure :-1 s=READY pgs=24 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8be002f6c0 tx=0x7f8be0005dd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:42.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.608+0000 7f4bd89a7640 1 -- 10.20.193.28:0/2803043292 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f4ba403fa70 msgr2=0x7f4ba405ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.608+0000 7f4bd89a7640 1 --2- 10.20.193.28:0/2803043292 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f4ba403fa70 0x7f4ba405ff20 secure :-1 s=READY pgs=20 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4bc8004740 tx=0x7f4bc8009190 comp rx=0 tx=0).stop 2026-02-24T09:13:42.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.608+0000 7f4bd89a7640 1 -- 10.20.193.28:0/2803043292 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f4bcc0b6e60 msgr2=0x7f4bcc0c0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.608+0000 7f4bd89a7640 1 --2- 10.20.193.28:0/2803043292 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f4bcc0b6e60 0x7f4bcc0c0e20 secure :-1 s=READY pgs=15 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4bbc00b520 tx=0x7f4bbc00b9f0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.613+0000 7f8bf30de640 1 -- 10.20.193.28:0/828314593 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bec119a90 con 0x7f8bec114b90 2026-02-24T09:13:42.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.615+0000 7f4bd89a7640 1 -- 10.20.193.28:0/2803043292 shutdown_connections 2026-02-24T09:13:42.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.619+0000 7f8bdb7fe640 1 -- 10.20.193.28:0/828314593 <== mon.2 v2:10.20.193.74:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f8be401f080 con 0x7f8bec114b90 2026-02-24T09:13:42.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:42 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/13977240' entity='client.admin' 2026-02-24T09:13:42.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:42 trial074 ceph-mon[44412]: from='client.? ' entity='client.admin' 2026-02-24T09:13:42.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:42 trial074 ceph-mon[44412]: from='client.? ' entity='client.admin' 2026-02-24T09:13:42.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:42 trial074 ceph-mon[44412]: from='client.? ' entity='client.admin' 2026-02-24T09:13:42.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:42 trial074 ceph-mon[44412]: from='client.? ' entity='client.admin' 2026-02-24T09:13:42.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:42 trial074 ceph-mon[44412]: mgrmap e16: x(active, since 2s) 2026-02-24T09:13:42.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:42 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:42.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:42 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:42.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:42 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial028", "name": "osd_memory_target"} : dispatch 2026-02-24T09:13:42.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:42 trial074 ceph-mon[44412]: from='client.? ' entity='client.admin' 2026-02-24T09:13:42.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:42 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:42.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:42 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:13:42.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:42 trial074 ceph-mon[44412]: from='client.? ' entity='client.admin' 2026-02-24T09:13:42.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.615+0000 7f4bd89a7640 1 --2- 10.20.193.28:0/2803043292 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f4ba403fa70 0x7f4ba405ff20 unknown :-1 s=CLOSED pgs=20 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.615+0000 7f4bd89a7640 1 --2- 10.20.193.28:0/2803043292 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4bcc0b89a0 0x7f4bcc0c2070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.615+0000 7f4bd89a7640 1 --2- 10.20.193.28:0/2803043292 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f4bcc0b7ff0 0x7f4bcc0c1470 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.615+0000 7f4bd89a7640 1 --2- 10.20.193.28:0/2803043292 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f4bcc0b6e60 0x7f4bcc0c0e20 unknown :-1 s=CLOSED pgs=15 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.615+0000 7f4bd89a7640 1 -- 10.20.193.28:0/2803043292 >> 10.20.193.28:0/2803043292 conn(0x7f4bcc0945b0 msgr2=0x7f4bcc0b4990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:42.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.615+0000 7f4bd89a7640 1 -- 10.20.193.28:0/2803043292 shutdown_connections 2026-02-24T09:13:42.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.616+0000 7f4bd89a7640 1 -- 10.20.193.28:0/2803043292 wait complete. 2026-02-24T09:13:42.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.697+0000 7fa5e309e640 1 -- 10.20.193.28:0/3361723447 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa5dc05e890 msgr2=0x7fa5dc134660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.700+0000 7fa5e109a640 1 -- 10.20.193.28:0/3361723447 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa5d000d0d0 con 0x7fa5dc05e890 2026-02-24T09:13:42.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.700+0000 7fa5e309e640 1 --2- 10.20.193.28:0/3361723447 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa5dc05e890 0x7fa5dc134660 secure :-1 s=READY pgs=17 gs=1 cs=0 l=1 c_cookie=13508970758781579024 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5d000dde0 tx=0x7fa5d0033220 comp rx=0 tx=0).stop 2026-02-24T09:13:42.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.700+0000 7fa5e309e640 1 -- 10.20.193.28:0/3361723447 shutdown_connections 2026-02-24T09:13:42.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.701+0000 7fa5e309e640 1 --2- 10.20.193.28:0/3361723447 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa5dc155860 0x7fa5dc175d10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.701+0000 7fa5e309e640 1 --2- 10.20.193.28:0/3361723447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa5dc134ca0 0x7fa5dc155120 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.701+0000 7fa5e309e640 1 --2- 10.20.193.28:0/3361723447 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa5dc05e890 0x7fa5dc134660 unknown :-1 s=CLOSED pgs=17 gs=1 cs=0 l=1 c_cookie=13508970758781579024 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.701+0000 7fa5e309e640 1 -- 10.20.193.28:0/3361723447 >> 10.20.193.28:0/3361723447 conn(0x7fa5dc05b480 msgr2=0x7fa5dc05b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:42.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.705+0000 7fa5e309e640 1 -- 10.20.193.28:0/3361723447 shutdown_connections 2026-02-24T09:13:42.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.705+0000 7fa5e309e640 1 -- 10.20.193.28:0/3361723447 wait complete. 2026-02-24T09:13:42.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.707+0000 7fa5e309e640 1 Processor -- start 2026-02-24T09:13:42.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.707+0000 7fa5e309e640 1 -- start start 2026-02-24T09:13:42.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.708+0000 7fa5e309e640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa5dc05e890 0x7fa5dc1408b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.710+0000 7f11458e7640 1 -- 10.20.193.28:0/1849142512 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1140114b90 msgr2=0x7f1140115000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.710+0000 7f11458e7640 1 --2- 10.20.193.28:0/1849142512 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1140114b90 0x7f1140115000 secure :-1 s=READY pgs=18 gs=3 cs=0 l=1 c_cookie=4387343284012698043 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1134009890 tx=0x7f113402f100 comp rx=0 tx=0).stop 2026-02-24T09:13:42.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.710+0000 7fa5e209c640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa5dc05e890 0x7fa5dc1408b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:42.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.711+0000 7fa5e209c640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa5dc05e890 0x7fa5dc1408b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:56876/0 (socket says 10.20.193.28:56876) 2026-02-24T09:13:42.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.711+0000 7fa5e309e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa5dc134ca0 0x7fa5dc134660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.715+0000 7fa5e309e640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa5dc155860 0x7fa5dc141110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.715+0000 7fa5e209c640 1 -- 10.20.193.28:0/4223999142 learned_addr learned my addr 10.20.193.28:0/4223999142 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:13:42.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.717+0000 7fa5e309e640 1 -- 10.20.193.28:0/4223999142 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa5dc141d00 con 0x7fa5dc134ca0 2026-02-24T09:13:42.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.717+0000 7fa5e309e640 1 -- 10.20.193.28:0/4223999142 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fa5dc141e70 con 0x7fa5dc05e890 2026-02-24T09:13:42.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.717+0000 7fa5e309e640 1 -- 10.20.193.28:0/4223999142 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa5dc142030 con 0x7fa5dc155860 2026-02-24T09:13:42.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.717+0000 7fa5e289d640 1 --2- 10.20.193.28:0/4223999142 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa5dc155860 0x7fa5dc141110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:42.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.718+0000 7fa5e209c640 1 -- 10.20.193.28:0/4223999142 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa5dc155860 msgr2=0x7fa5dc141110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.718+0000 7fa5e209c640 1 --2- 10.20.193.28:0/4223999142 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa5dc155860 0x7fa5dc141110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.718+0000 7fa5e209c640 1 -- 10.20.193.28:0/4223999142 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa5dc134ca0 msgr2=0x7fa5dc134660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.718+0000 7fa5e209c640 1 --2- 10.20.193.28:0/4223999142 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa5dc134ca0 0x7fa5dc134660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.718+0000 7fa5e209c640 1 -- 10.20.193.28:0/4223999142 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5d000da80 con 0x7fa5dc05e890 2026-02-24T09:13:42.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.720+0000 7fa5e209c640 1 --2- 10.20.193.28:0/4223999142 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa5dc05e890 0x7fa5dc1408b0 secure :-1 s=READY pgs=20 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5d0006010 tx=0x7fa5d000be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:42.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.720+0000 7fa5cb7fe640 1 -- 10.20.193.28:0/4223999142 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa5d000d3f0 con 0x7fa5dc05e890 2026-02-24T09:13:42.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.721+0000 7fa5cb7fe640 1 -- 10.20.193.28:0/4223999142 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fa5d000d550 con 0x7fa5dc05e890 2026-02-24T09:13:42.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.723+0000 7fa5cb7fe640 1 -- 10.20.193.28:0/4223999142 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa5d003ca40 con 0x7fa5dc05e890 2026-02-24T09:13:42.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.723+0000 7fa5e309e640 1 -- 10.20.193.28:0/4223999142 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5dc1422b0 con 0x7fa5dc05e890 2026-02-24T09:13:42.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.723+0000 7fa5e309e640 1 -- 10.20.193.28:0/4223999142 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5dc1426a0 con 0x7fa5dc05e890 2026-02-24T09:13:42.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.727+0000 7fa5cb7fe640 1 -- 10.20.193.28:0/4223999142 <== mon.2 v2:10.20.193.74:3300/0 4 ==== mgrmap(e 16) ==== 52887+0+0 (secure 0 0 0) 0x7fa5d003cba0 con 0x7fa5dc05e890 2026-02-24T09:13:42.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.727+0000 7fa5cb7fe640 1 --2- 10.20.193.28:0/4223999142 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa5b003f9a0 0x7fa5b005fe50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.730+0000 7fa5cb7fe640 1 -- 10.20.193.28:0/4223999142 <== mon.2 v2:10.20.193.74:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7fa5d000ad30 con 0x7fa5dc05e890 2026-02-24T09:13:42.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.732+0000 7fb6c1d48640 1 -- 10.20.193.28:0/1459128860 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb6bc114650 msgr2=0x7fb6bc134a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.732+0000 7fb6c1d48640 1 --2- 10.20.193.28:0/1459128860 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb6bc114650 0x7fb6bc134a30 secure :-1 s=READY pgs=21 gs=1 cs=0 l=1 c_cookie=16971331349621580808 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6a4009890 tx=0x7fb6a402f100 comp rx=0 tx=0).stop 2026-02-24T09:13:42.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.736+0000 7fa5e309e640 1 -- 10.20.193.28:0/4223999142 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5ac005300 con 0x7fa5dc05e890 2026-02-24T09:13:42.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.738+0000 7fa5e189b640 1 --2- 10.20.193.28:0/4223999142 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa5b003f9a0 0x7fa5b005fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:42.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.739+0000 7fa5e189b640 1 --2- 10.20.193.28:0/4223999142 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa5b003f9a0 0x7fa5b005fe50 secure :-1 s=READY pgs=25 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5cc005db0 tx=0x7fa5cc005d20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:42.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.733+0000 7fb6c1d48640 1 -- 10.20.193.28:0/1459128860 shutdown_connections 2026-02-24T09:13:42.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.733+0000 7fb6c1d48640 1 --2- 10.20.193.28:0/1459128860 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb6bc05d520 0x7fb6bc176240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.733+0000 7fb6c1d48640 1 --2- 10.20.193.28:0/1459128860 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb6bc134f70 0x7fb6bc155350 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.733+0000 7fb6c1d48640 1 --2- 10.20.193.28:0/1459128860 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb6bc114650 0x7fb6bc134a30 unknown :-1 s=CLOSED pgs=21 gs=1 cs=0 l=1 c_cookie=16971331349621580808 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.733+0000 7fb6c1d48640 1 -- 10.20.193.28:0/1459128860 >> 10.20.193.28:0/1459128860 conn(0x7fb6bc05b580 msgr2=0x7fb6bc05b980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:42.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.733+0000 7fb6c1d48640 1 -- 10.20.193.28:0/1459128860 shutdown_connections 2026-02-24T09:13:42.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.733+0000 7fb6c1d48640 1 -- 10.20.193.28:0/1459128860 wait complete. 2026-02-24T09:13:42.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.734+0000 7fb6c1d48640 1 Processor -- start 2026-02-24T09:13:42.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.735+0000 7fb6c1d48640 1 -- start start 2026-02-24T09:13:42.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.735+0000 7fb6c1d48640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb6bc05d520 0x7fb6bc176240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.735+0000 7fb6c1d48640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb6bc114650 0x7fb6bc155350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.735+0000 7fb6c1d48640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb6bc134f70 0x7fb6bc129700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.735+0000 7fb6c1d48640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb6bc129e00 con 0x7fb6bc114650 2026-02-24T09:13:42.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.735+0000 7fb6c1d48640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fb6bc129f70 con 0x7fb6bc134f70 2026-02-24T09:13:42.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.735+0000 7fb6c1d48640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb6bc12a630 con 0x7fb6bc05d520 2026-02-24T09:13:42.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.736+0000 7fb6bb7fe640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb6bc05d520 0x7fb6bc176240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:42.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.736+0000 7fb6baffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb6bc114650 0x7fb6bc155350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:42.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.736+0000 7fb6baffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb6bc114650 0x7fb6bc155350 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56494/0 (socket says 10.20.193.28:56494) 2026-02-24T09:13:42.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.736+0000 7fb6bbfff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb6bc134f70 0x7fb6bc129700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:42.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.736+0000 7fb6baffd640 1 -- 10.20.193.28:0/108000611 learned_addr learned my addr 10.20.193.28:0/108000611 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:13:42.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.736+0000 7fb6bb7fe640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb6bc05d520 0x7fb6bc176240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:33380/0 (socket says 10.20.193.28:33380) 2026-02-24T09:13:42.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.736+0000 7fb6baffd640 1 -- 10.20.193.28:0/108000611 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb6bc05d520 msgr2=0x7fb6bc176240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.736+0000 7fb6baffd640 1 --2- 10.20.193.28:0/108000611 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb6bc05d520 0x7fb6bc176240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.736+0000 7fb6baffd640 1 -- 10.20.193.28:0/108000611 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb6bc134f70 msgr2=0x7fb6bc129700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.736+0000 7fb6baffd640 1 --2- 10.20.193.28:0/108000611 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb6bc134f70 0x7fb6bc129700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.736+0000 7fb6baffd640 1 -- 10.20.193.28:0/108000611 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6a40094b0 con 0x7fb6bc114650 2026-02-24T09:13:42.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.737+0000 7fb6baffd640 1 --2- 10.20.193.28:0/108000611 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb6bc114650 0x7fb6bc155350 secure :-1 s=READY pgs=134 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6b400dcb0 tx=0x7fb6b4008590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:42.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.740+0000 7fa5cb7fe640 1 -- 10.20.193.28:0/4223999142 <== mon.2 v2:10.20.193.74:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fa5d0047980 con 0x7fa5dc05e890 2026-02-24T09:13:42.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.727+0000 7f11458e7640 1 -- 10.20.193.28:0/1849142512 shutdown_connections 2026-02-24T09:13:42.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.727+0000 7f11458e7640 1 --2- 10.20.193.28:0/1849142512 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f1140115540 0x7f11401159e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.727+0000 7f11458e7640 1 --2- 10.20.193.28:0/1849142512 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1140114b90 0x7f1140115000 unknown :-1 s=CLOSED pgs=18 gs=3 cs=0 l=1 c_cookie=4387343284012698043 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.727+0000 7f11458e7640 1 --2- 10.20.193.28:0/1849142512 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f114005e510 0x7f1140114650 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.727+0000 7f11458e7640 1 -- 10.20.193.28:0/1849142512 >> 10.20.193.28:0/1849142512 conn(0x7f114005b580 msgr2=0x7f114005b980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:42.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.727+0000 7f11458e7640 1 -- 10.20.193.28:0/1849142512 shutdown_connections 2026-02-24T09:13:42.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.727+0000 7f11458e7640 1 -- 10.20.193.28:0/1849142512 wait complete. 2026-02-24T09:13:42.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.731+0000 7f11458e7640 1 Processor -- start 2026-02-24T09:13:42.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.732+0000 7f11458e7640 1 -- start start 2026-02-24T09:13:42.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.733+0000 7f11458e7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f114005e510 0x7f11401b4d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.733+0000 7f11458e7640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f1140114b90 0x7f11401b53d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.733+0000 7f11458e7640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1140115540 0x7f11401b5fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.733+0000 7f113effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f114005e510 0x7f11401b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:42.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.734+0000 7f113effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f114005e510 0x7f11401b4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56490/0 (socket says 10.20.193.28:56490) 2026-02-24T09:13:42.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.734+0000 7f11458e7640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f11401b6710 con 0x7f114005e510 2026-02-24T09:13:42.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.734+0000 7f11458e7640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f11401b6880 con 0x7f1140114b90 2026-02-24T09:13:42.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.734+0000 7f11458e7640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f11401b6a40 con 0x7f1140115540 2026-02-24T09:13:42.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.734+0000 7f113effd640 1 -- 10.20.193.28:0/2690012231 learned_addr learned my addr 10.20.193.28:0/2690012231 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:13:42.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.734+0000 7f113e7fc640 1 --2- 10.20.193.28:0/2690012231 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f1140114b90 0x7f11401b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:42.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.734+0000 7f113f7fe640 1 --2- 10.20.193.28:0/2690012231 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1140115540 0x7f11401b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:42.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.734+0000 7f113e7fc640 1 -- 10.20.193.28:0/2690012231 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1140115540 msgr2=0x7f11401b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.734+0000 7f113e7fc640 1 --2- 10.20.193.28:0/2690012231 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1140115540 0x7f11401b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.734+0000 7f113e7fc640 1 -- 10.20.193.28:0/2690012231 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f114005e510 msgr2=0x7f11401b4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.734+0000 7f113e7fc640 1 --2- 10.20.193.28:0/2690012231 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f114005e510 0x7f11401b4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.734+0000 7f113e7fc640 1 -- 10.20.193.28:0/2690012231 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11340094b0 con 0x7f1140114b90 2026-02-24T09:13:42.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.734+0000 7f113f7fe640 1 --2- 10.20.193.28:0/2690012231 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1140115540 0x7f11401b5fd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:13:42.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.735+0000 7f113e7fc640 1 --2- 10.20.193.28:0/2690012231 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f1140114b90 0x7f11401b53d0 secure :-1 s=READY pgs=22 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1134009230 tx=0x7f11340042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:42.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.735+0000 7f11448e5640 1 -- 10.20.193.28:0/2690012231 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f113403d070 con 0x7f1140114b90 2026-02-24T09:13:42.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.735+0000 7f11448e5640 1 -- 10.20.193.28:0/2690012231 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f1134002e20 con 0x7f1140114b90 2026-02-24T09:13:42.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.735+0000 7f11448e5640 1 -- 10.20.193.28:0/2690012231 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1134041960 con 0x7f1140114b90 2026-02-24T09:13:42.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.735+0000 7f11458e7640 1 -- 10.20.193.28:0/2690012231 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11401b6cc0 con 0x7f1140114b90 2026-02-24T09:13:42.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.735+0000 7f11458e7640 1 -- 10.20.193.28:0/2690012231 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1140217210 con 0x7f1140114b90 2026-02-24T09:13:42.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.737+0000 7f11448e5640 1 -- 10.20.193.28:0/2690012231 <== mon.2 v2:10.20.193.74:3300/0 4 ==== mgrmap(e 16) ==== 52887+0+0 (secure 0 0 0) 0x7f113404b440 con 0x7f1140114b90 2026-02-24T09:13:42.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.737+0000 7f11448e5640 1 --2- 10.20.193.28:0/2690012231 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f111403fa20 0x7f111405fed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.737+0000 7f11448e5640 1 -- 10.20.193.28:0/2690012231 <== mon.2 v2:10.20.193.74:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7f1134079ef0 con 0x7f1140114b90 2026-02-24T09:13:42.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.748+0000 7f113effd640 1 --2- 10.20.193.28:0/2690012231 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f111403fa20 0x7f111405fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:42.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.755+0000 7fc05b7fe640 1 -- 10.20.193.28:0/2188046249 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command([{prefix=config set, name=mds_use_global_snaprealm_seq_for_subvol}] v 0) -- 0x7fc04c0055b0 con 0x7fc0840b4240 2026-02-24T09:13:42.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.759+0000 7fc081ffb640 1 -- 10.20.193.28:0/2188046249 <== mon.2 v2:10.20.193.74:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_use_global_snaprealm_seq_for_subvol}]=0 v22)=0 v22) ==== 141+0+0 (secure 0 0 0) 0x7fc07405c030 con 0x7fc0840b4240 2026-02-24T09:13:42.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.739+0000 7fb6b8ff9640 1 -- 10.20.193.28:0/108000611 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6b40050d0 con 0x7fb6bc114650 2026-02-24T09:13:42.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.739+0000 7fb6b8ff9640 1 -- 10.20.193.28:0/108000611 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb6b4003780 con 0x7fb6bc114650 2026-02-24T09:13:42.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.739+0000 7fb6b8ff9640 1 -- 10.20.193.28:0/108000611 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6b40106d0 con 0x7fb6bc114650 2026-02-24T09:13:42.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.739+0000 7fb6c1d48640 1 -- 10.20.193.28:0/108000611 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6bc12a910 con 0x7fb6bc114650 2026-02-24T09:13:42.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.740+0000 7fb6c1d48640 1 -- 10.20.193.28:0/108000611 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6bc12ad90 con 0x7fb6bc114650 2026-02-24T09:13:42.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.742+0000 7fb6b8ff9640 1 -- 10.20.193.28:0/108000611 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 52887+0+0 (secure 0 0 0) 0x7fb6b4005230 con 0x7fb6bc114650 2026-02-24T09:13:42.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.742+0000 7fb6b8ff9640 1 --2- 10.20.193.28:0/108000611 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb68c03fa70 0x7fb68c05ff20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.743+0000 7fb6bb7fe640 1 --2- 10.20.193.28:0/108000611 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb68c03fa70 0x7fb68c05ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:42.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.743+0000 7fb6c1d48640 1 -- 10.20.193.28:0/108000611 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6bc055c40 con 0x7fb6bc114650 2026-02-24T09:13:42.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.745+0000 7fb6b8ff9640 1 -- 10.20.193.28:0/108000611 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7fb6b4055240 con 0x7fb6bc114650 2026-02-24T09:13:42.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.747+0000 7fb6bb7fe640 1 --2- 10.20.193.28:0/108000611 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb68c03fa70 0x7fb68c05ff20 secure :-1 s=READY pgs=26 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6a40023d0 tx=0x7fb6a4031040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:42.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.747+0000 7fb6b8ff9640 1 -- 10.20.193.28:0/108000611 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fb6b4019450 con 0x7fb6bc114650 2026-02-24T09:13:42.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:42 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/13977240' entity='client.admin' 2026-02-24T09:13:42.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:42 trial159 ceph-mon[44242]: from='client.? ' entity='client.admin' 2026-02-24T09:13:42.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:42 trial159 ceph-mon[44242]: from='client.? ' entity='client.admin' 2026-02-24T09:13:42.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:42 trial159 ceph-mon[44242]: from='client.? ' entity='client.admin' 2026-02-24T09:13:42.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:42 trial159 ceph-mon[44242]: from='client.? ' entity='client.admin' 2026-02-24T09:13:42.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:42 trial159 ceph-mon[44242]: mgrmap e16: x(active, since 2s) 2026-02-24T09:13:42.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:42 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:42.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:42 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:42.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:42 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial028", "name": "osd_memory_target"} : dispatch 2026-02-24T09:13:42.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:42 trial159 ceph-mon[44242]: from='client.? ' entity='client.admin' 2026-02-24T09:13:42.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:42 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:42.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:42 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:13:42.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:42 trial159 ceph-mon[44242]: from='client.? ' entity='client.admin' 2026-02-24T09:13:42.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.794+0000 7fc05b7fe640 1 -- 10.20.193.28:0/2188046249 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc06803fa70 msgr2=0x7fc06805ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.794+0000 7fc05b7fe640 1 --2- 10.20.193.28:0/2188046249 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc06803fa70 0x7fc06805ff20 secure :-1 s=READY pgs=23 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc07c004740 tx=0x7fc07c005f90 comp rx=0 tx=0).stop 2026-02-24T09:13:42.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.795+0000 7fc05b7fe640 1 -- 10.20.193.28:0/2188046249 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc0840b4240 msgr2=0x7fc0840d4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.795+0000 7fc05b7fe640 1 --2- 10.20.193.28:0/2188046249 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc0840b4240 0x7fc0840d4620 secure :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc0740098a0 tx=0x7fc0740028d0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.756+0000 7f11458e7640 1 -- 10.20.193.28:0/2690012231 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1104005300 con 0x7f1140114b90 2026-02-24T09:13:42.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.795+0000 7f8d231f0640 1 -- 10.20.193.28:0/791197676 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f8d1c181b90 con 0x7f8d1c1565b0 2026-02-24T09:13:42.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.796+0000 7fc05b7fe640 1 -- 10.20.193.28:0/2188046249 shutdown_connections 2026-02-24T09:13:42.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.796+0000 7fc05b7fe640 1 --2- 10.20.193.28:0/2188046249 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc06803fa70 0x7fc06805ff20 unknown :-1 s=CLOSED pgs=23 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.796+0000 7fc05b7fe640 1 --2- 10.20.193.28:0/2188046249 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc0840f5840 0x7fc0840fe7d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.796+0000 7fc05b7fe640 1 --2- 10.20.193.28:0/2188046249 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc0840d4c80 0x7fc0840b0900 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.796+0000 7fc05b7fe640 1 --2- 10.20.193.28:0/2188046249 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc0840b4240 0x7fc0840d4620 unknown :-1 s=CLOSED pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.796+0000 7fc05b7fe640 1 -- 10.20.193.28:0/2188046249 >> 10.20.193.28:0/2188046249 conn(0x7fc084090520 msgr2=0x7fc08411b320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:42.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.796+0000 7fc05b7fe640 1 -- 10.20.193.28:0/2188046249 shutdown_connections 2026-02-24T09:13:42.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.796+0000 7fc05b7fe640 1 -- 10.20.193.28:0/2188046249 wait complete. 2026-02-24T09:13:42.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.796+0000 7f113effd640 1 --2- 10.20.193.28:0/2690012231 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f111403fa20 0x7f111405fed0 secure :-1 s=READY pgs=27 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f112800b2c0 tx=0x7f112800b4a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:42.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.799+0000 7f8d19ffb640 1 -- 10.20.193.28:0/791197676 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v23)=0 v23) ==== 116+0+0 (secure 0 0 0) 0x7f8d1404b030 con 0x7f8d1c1565b0 2026-02-24T09:13:42.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.800+0000 7f11448e5640 1 -- 10.20.193.28:0/2690012231 <== mon.2 v2:10.20.193.74:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f113404a740 con 0x7f1140114b90 2026-02-24T09:13:42.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.804+0000 7f8d231f0640 1 -- 10.20.193.28:0/791197676 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8cf403fa70 msgr2=0x7f8cf405ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.804+0000 7f8d231f0640 1 --2- 10.20.193.28:0/791197676 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8cf403fa70 0x7f8cf405ff20 secure :-1 s=READY pgs=21 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d10004740 tx=0x7f8d10009310 comp rx=0 tx=0).stop 2026-02-24T09:13:42.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.804+0000 7f8d231f0640 1 -- 10.20.193.28:0/791197676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8d1c1565b0 msgr2=0x7f8d1c100330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.804+0000 7f8d231f0640 1 --2- 10.20.193.28:0/791197676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8d1c1565b0 0x7f8d1c100330 secure :-1 s=READY pgs=131 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d1400a2e0 tx=0x7f8d14010760 comp rx=0 tx=0).stop 2026-02-24T09:13:42.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.814+0000 7f8d231f0640 1 -- 10.20.193.28:0/791197676 shutdown_connections 2026-02-24T09:13:42.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.814+0000 7f8d231f0640 1 --2- 10.20.193.28:0/791197676 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8cf403fa70 0x7f8cf405ff20 unknown :-1 s=CLOSED pgs=21 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.814+0000 7f8d231f0640 1 --2- 10.20.193.28:0/791197676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8d1c1565b0 0x7f8d1c100330 unknown :-1 s=CLOSED pgs=131 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.814+0000 7f8d231f0640 1 --2- 10.20.193.28:0/791197676 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8d1c05e890 0x7f8d1c156070 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.814+0000 7f8d231f0640 1 --2- 10.20.193.28:0/791197676 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8d1c05d3f0 0x7f8d1c0ffad0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.814+0000 7f8d231f0640 1 -- 10.20.193.28:0/791197676 >> 10.20.193.28:0/791197676 conn(0x7f8d1c05b480 msgr2=0x7f8d1c0f61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:42.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.815+0000 7f8d231f0640 1 -- 10.20.193.28:0/791197676 shutdown_connections 2026-02-24T09:13:42.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.815+0000 7f8d231f0640 1 -- 10.20.193.28:0/791197676 wait complete. 2026-02-24T09:13:42.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.862+0000 7f81aeaaa640 1 -- 10.20.193.28:0/4147729173 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f81a810b0b0 msgr2=0x7f81a810b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.862+0000 7f81aeaaa640 1 --2- 10.20.193.28:0/4147729173 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f81a810b0b0 0x7f81a810b4a0 secure :-1 s=READY pgs=135 gs=1 cs=0 l=1 c_cookie=3181610619525592636 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f819c008520 tx=0x7f819c0312a0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.862+0000 7f81aeaaa640 1 -- 10.20.193.28:0/4147729173 shutdown_connections 2026-02-24T09:13:42.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.862+0000 7f81aeaaa640 1 --2- 10.20.193.28:0/4147729173 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f81a810cbf0 0x7f81a816d580 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.862+0000 7f81aeaaa640 1 --2- 10.20.193.28:0/4147729173 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f81a810c240 0x7f81a810c6b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.862+0000 7f81aeaaa640 1 --2- 10.20.193.28:0/4147729173 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f81a810b0b0 0x7f81a810b4a0 unknown :-1 s=CLOSED pgs=135 gs=1 cs=0 l=1 c_cookie=3181610619525592636 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.862+0000 7f81aeaaa640 1 -- 10.20.193.28:0/4147729173 >> 10.20.193.28:0/4147729173 conn(0x7f81a80e87e0 msgr2=0x7f81a8108c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:42.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.864+0000 7f81aeaaa640 1 -- 10.20.193.28:0/4147729173 shutdown_connections 2026-02-24T09:13:42.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.864+0000 7f81aeaaa640 1 -- 10.20.193.28:0/4147729173 wait complete. 2026-02-24T09:13:42.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.864+0000 7f81aeaaa640 1 Processor -- start 2026-02-24T09:13:42.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.864+0000 7f81aeaaa640 1 -- start start 2026-02-24T09:13:42.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.864+0000 7f81aeaaa640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f81a810b0b0 0x7f81a80eb220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.864+0000 7f81aeaaa640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f81a810c240 0x7f81a816d580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.864+0000 7f81aeaaa640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f81a810cbf0 0x7f81a80eba80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.864+0000 7f81aeaaa640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f81a80ec5e0 con 0x7f81a810b0b0 2026-02-24T09:13:42.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.864+0000 7f81aeaaa640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f81a80ec750 con 0x7f81a810cbf0 2026-02-24T09:13:42.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.864+0000 7f81aeaaa640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f81a80ec910 con 0x7f81a810c240 2026-02-24T09:13:42.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.864+0000 7f81ae2a9640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f81a810cbf0 0x7f81a80eba80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:42.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.864+0000 7f81ad2a7640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f81a810c240 0x7f81a816d580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:42.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.864+0000 7f81ae2a9640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f81a810cbf0 0x7f81a80eba80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:56924/0 (socket says 10.20.193.28:56924) 2026-02-24T09:13:42.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.864+0000 7f81ae2a9640 1 -- 10.20.193.28:0/2405143942 learned_addr learned my addr 10.20.193.28:0/2405143942 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:13:42.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.864+0000 7f81ae2a9640 1 -- 10.20.193.28:0/2405143942 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f81a810c240 msgr2=0x7f81a816d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.864+0000 7f81ae2a9640 1 --2- 10.20.193.28:0/2405143942 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f81a810c240 0x7f81a816d580 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.864+0000 7f81ae2a9640 1 -- 10.20.193.28:0/2405143942 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f81a810b0b0 msgr2=0x7f81a80eb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.864+0000 7f81ae2a9640 1 --2- 10.20.193.28:0/2405143942 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f81a810b0b0 0x7f81a80eb220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.864+0000 7f81ae2a9640 1 -- 10.20.193.28:0/2405143942 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f819c0081d0 con 0x7f81a810cbf0 2026-02-24T09:13:42.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.864+0000 7f81ad2a7640 1 --2- 10.20.193.28:0/2405143942 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f81a810c240 0x7f81a816d580 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:13:42.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.864+0000 7f81ae2a9640 1 --2- 10.20.193.28:0/2405143942 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f81a810cbf0 0x7f81a80eba80 secure :-1 s=READY pgs=23 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f81a400b270 tx=0x7f81a400de70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:42.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.872+0000 7f8196ffd640 1 -- 10.20.193.28:0/2405143942 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f81a4008cf0 con 0x7f81a810cbf0 2026-02-24T09:13:42.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.872+0000 7f8196ffd640 1 -- 10.20.193.28:0/2405143942 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f81a4008e50 con 0x7f81a810cbf0 2026-02-24T09:13:42.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.872+0000 7f8196ffd640 1 -- 10.20.193.28:0/2405143942 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f81a40106d0 con 0x7f81a810cbf0 2026-02-24T09:13:42.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.872+0000 7f81aeaaa640 1 -- 10.20.193.28:0/2405143942 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81a80ecbf0 con 0x7f81a810cbf0 2026-02-24T09:13:42.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.872+0000 7f81aeaaa640 1 -- 10.20.193.28:0/2405143942 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81a80ed070 con 0x7f81a810cbf0 2026-02-24T09:13:42.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.872+0000 7f8196ffd640 1 -- 10.20.193.28:0/2405143942 <== mon.2 v2:10.20.193.74:3300/0 4 ==== mgrmap(e 16) ==== 52887+0+0 (secure 0 0 0) 0x7f81a4010860 con 0x7f81a810cbf0 2026-02-24T09:13:42.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.872+0000 7f8196ffd640 1 --2- 10.20.193.28:0/2405143942 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f818003fa70 0x7f818005ff20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:42.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.872+0000 7f8196ffd640 1 -- 10.20.193.28:0/2405143942 <== mon.2 v2:10.20.193.74:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7f81a4055570 con 0x7f81a810cbf0 2026-02-24T09:13:42.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.872+0000 7f81adaa8640 1 --2- 10.20.193.28:0/2405143942 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f818003fa70 0x7f818005ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:42.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.878+0000 7f81adaa8640 1 --2- 10.20.193.28:0/2405143942 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f818003fa70 0x7f818005ff20 secure :-1 s=READY pgs=28 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f819c002b00 tx=0x7f819c0046a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:42.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.880+0000 7f81aeaaa640 1 -- 10.20.193.28:0/2405143942 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8170005300 con 0x7f81a810cbf0 2026-02-24T09:13:42.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.880+0000 7f8196ffd640 1 -- 10.20.193.28:0/2405143942 <== mon.2 v2:10.20.193.74:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f81a401e080 con 0x7f81a810cbf0 2026-02-24T09:13:42.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.918+0000 7fb6c1d48640 1 -- 10.20.193.28:0/108000611 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fb6bc179200 con 0x7fb6bc114650 2026-02-24T09:13:42.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.922+0000 7fb6b8ff9640 1 -- 10.20.193.28:0/108000611 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v24)=0 v24) ==== 119+0+0 (secure 0 0 0) 0x7fb6b400e340 con 0x7fb6bc114650 2026-02-24T09:13:42.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.931+0000 7fb6c1d48640 1 -- 10.20.193.28:0/108000611 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb68c03fa70 msgr2=0x7fb68c05ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.931+0000 7fb6c1d48640 1 --2- 10.20.193.28:0/108000611 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb68c03fa70 0x7fb68c05ff20 secure :-1 s=READY pgs=26 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6a40023d0 tx=0x7fb6a4031040 comp rx=0 tx=0).stop 2026-02-24T09:13:42.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.931+0000 7fb6c1d48640 1 -- 10.20.193.28:0/108000611 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb6bc114650 msgr2=0x7fb6bc155350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:42.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.931+0000 7fb6c1d48640 1 --2- 10.20.193.28:0/108000611 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb6bc114650 0x7fb6bc155350 secure :-1 s=READY pgs=134 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6b400dcb0 tx=0x7fb6b4008590 comp rx=0 tx=0).stop 2026-02-24T09:13:42.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.932+0000 7fb6c1d48640 1 -- 10.20.193.28:0/108000611 shutdown_connections 2026-02-24T09:13:42.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.932+0000 7fb6c1d48640 1 --2- 10.20.193.28:0/108000611 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb68c03fa70 0x7fb68c05ff20 unknown :-1 s=CLOSED pgs=26 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.932+0000 7fb6c1d48640 1 --2- 10.20.193.28:0/108000611 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb6bc134f70 0x7fb6bc129700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.932+0000 7fb6c1d48640 1 --2- 10.20.193.28:0/108000611 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb6bc114650 0x7fb6bc155350 unknown :-1 s=CLOSED pgs=134 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.932+0000 7fb6c1d48640 1 --2- 10.20.193.28:0/108000611 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb6bc05d520 0x7fb6bc176240 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:42.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.932+0000 7fb6c1d48640 1 -- 10.20.193.28:0/108000611 >> 10.20.193.28:0/108000611 conn(0x7fb6bc05b580 msgr2=0x7fb6bc114a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:42.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.932+0000 7fb6c1d48640 1 -- 10.20.193.28:0/108000611 shutdown_connections 2026-02-24T09:13:42.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:42.932+0000 7fb6c1d48640 1 -- 10.20.193.28:0/108000611 wait complete. 2026-02-24T09:13:42.999 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e9ad50af-1160-11f1-800e-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='trial028') 2026-02-24T09:13:43.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.014+0000 7f078ee10640 1 -- 10.20.193.28:0/2536137383 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f078810b0e0 msgr2=0x7f078810b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.014+0000 7f078ee10640 1 --2- 10.20.193.28:0/2536137383 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f078810b0e0 0x7f078810b4d0 secure :-1 s=READY pgs=136 gs=1 cs=0 l=1 c_cookie=10006624845532020008 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0774009430 tx=0x7f0774030490 comp rx=0 tx=0).stop 2026-02-24T09:13:43.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.018+0000 7f078ee10640 1 -- 10.20.193.28:0/2536137383 shutdown_connections 2026-02-24T09:13:43.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.018+0000 7f078ee10640 1 --2- 10.20.193.28:0/2536137383 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f078810cc20 0x7f078816d5b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.018+0000 7f078ee10640 1 --2- 10.20.193.28:0/2536137383 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f078810c270 0x7f078810c6e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.018+0000 7f078ee10640 1 --2- 10.20.193.28:0/2536137383 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f078810b0e0 0x7f078810b4d0 unknown :-1 s=CLOSED pgs=136 gs=1 cs=0 l=1 c_cookie=10006624845532020008 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.018+0000 7f078ee10640 1 -- 10.20.193.28:0/2536137383 >> 10.20.193.28:0/2536137383 conn(0x7f07880e8810 msgr2=0x7f0788108c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:43.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.018+0000 7f078ee10640 1 -- 10.20.193.28:0/2536137383 shutdown_connections 2026-02-24T09:13:43.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.018+0000 7f078ee10640 1 -- 10.20.193.28:0/2536137383 wait complete. 2026-02-24T09:13:43.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.020+0000 7f078ee10640 1 Processor -- start 2026-02-24T09:13:43.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.020+0000 7f078ee10640 1 -- start start 2026-02-24T09:13:43.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.020+0000 7f078ee10640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f078810b0e0 0x7f0788172af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.020+0000 7f078ee10640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f078810c270 0x7f078816d5b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.020+0000 7f078ee10640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f078810cc20 0x7f0788173350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.020+0000 7f078ee10640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0788173eb0 con 0x7f078810b0e0 2026-02-24T09:13:43.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.020+0000 7f078ee10640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f0788174020 con 0x7f078810cc20 2026-02-24T09:13:43.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.021+0000 7f078cb85640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f078810b0e0 0x7f0788172af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.021+0000 7f078cb85640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f078810b0e0 0x7f0788172af0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56528/0 (socket says 10.20.193.28:56528) 2026-02-24T09:13:43.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.021+0000 7f078cb85640 1 -- 10.20.193.28:0/2316068743 learned_addr learned my addr 10.20.193.28:0/2316068743 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:13:43.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.021+0000 7f078ee10640 1 -- 10.20.193.28:0/2316068743 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f07881741e0 con 0x7f078810c270 2026-02-24T09:13:43.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.021+0000 7f0787fff640 1 --2- 10.20.193.28:0/2316068743 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f078810c270 0x7f078816d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.021+0000 7f078d386640 1 --2- 10.20.193.28:0/2316068743 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f078810cc20 0x7f0788173350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.022+0000 7f078cb85640 1 -- 10.20.193.28:0/2316068743 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f078810c270 msgr2=0x7f078816d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.022+0000 7f078cb85640 1 --2- 10.20.193.28:0/2316068743 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f078810c270 0x7f078816d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.022+0000 7f078cb85640 1 -- 10.20.193.28:0/2316068743 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f078810cc20 msgr2=0x7f0788173350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.022+0000 7f078cb85640 1 --2- 10.20.193.28:0/2316068743 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f078810cc20 0x7f0788173350 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.022+0000 7f078cb85640 1 -- 10.20.193.28:0/2316068743 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0774009e20 con 0x7f078810b0e0 2026-02-24T09:13:43.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.022+0000 7f0787fff640 1 --2- 10.20.193.28:0/2316068743 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f078810c270 0x7f078816d5b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:13:43.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.022+0000 7f078d386640 1 --2- 10.20.193.28:0/2316068743 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f078810cc20 0x7f0788173350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:13:43.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.022+0000 7f078cb85640 1 --2- 10.20.193.28:0/2316068743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f078810b0e0 0x7f0788172af0 secure :-1 s=READY pgs=137 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0774005e10 tx=0x7f0774002d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:43.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.023+0000 7f0785ffb640 1 -- 10.20.193.28:0/2316068743 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f077403e070 con 0x7f078810b0e0 2026-02-24T09:13:43.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.023+0000 7f0785ffb640 1 -- 10.20.193.28:0/2316068743 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f0774037a00 con 0x7f078810b0e0 2026-02-24T09:13:43.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.023+0000 7f0785ffb640 1 -- 10.20.193.28:0/2316068743 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0774039b40 con 0x7f078810b0e0 2026-02-24T09:13:43.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.023+0000 7f078ee10640 1 -- 10.20.193.28:0/2316068743 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0788174460 con 0x7f078810b0e0 2026-02-24T09:13:43.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.025+0000 7f078ee10640 1 -- 10.20.193.28:0/2316068743 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07881748d0 con 0x7f078810b0e0 2026-02-24T09:13:43.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.025+0000 7f0785ffb640 1 -- 10.20.193.28:0/2316068743 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 52887+0+0 (secure 0 0 0) 0x7f077404a060 con 0x7f078810b0e0 2026-02-24T09:13:43.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.026+0000 7f0785ffb640 1 --2- 10.20.193.28:0/2316068743 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f075c03fa20 0x7f075c05fed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.027+0000 7f078ee10640 1 -- 10.20.193.28:0/2316068743 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07881703d0 con 0x7f078810b0e0 2026-02-24T09:13:43.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.030+0000 7f0787fff640 1 --2- 10.20.193.28:0/2316068743 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f075c03fa20 0x7f075c05fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.031+0000 7f0785ffb640 1 -- 10.20.193.28:0/2316068743 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7f0774047e10 con 0x7f078810b0e0 2026-02-24T09:13:43.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.031+0000 7f0785ffb640 1 -- 10.20.193.28:0/2316068743 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f0774080060 con 0x7f078810b0e0 2026-02-24T09:13:43.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.031+0000 7f0787fff640 1 --2- 10.20.193.28:0/2316068743 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f075c03fa20 0x7f075c05fed0 secure :-1 s=READY pgs=29 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0778004740 tx=0x7f0778005f20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:43.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.031+0000 7fbb7ffff640 1 -- 10.20.193.28:0/259025410 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fbb80115270 msgr2=0x7fbb80115bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.031+0000 7fbb7ffff640 1 --2- 10.20.193.28:0/259025410 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fbb80115270 0x7fbb80115bb0 secure :-1 s=READY pgs=19 gs=3 cs=0 l=1 c_cookie=6999819244608512523 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbb7800a970 tx=0x7fbb780301f0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.033+0000 7fbb7ffff640 1 -- 10.20.193.28:0/259025410 shutdown_connections 2026-02-24T09:13:43.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.034+0000 7fbb7ffff640 1 --2- 10.20.193.28:0/259025410 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fbb80115270 0x7fbb80115bb0 unknown :-1 s=CLOSED pgs=19 gs=3 cs=0 l=1 c_cookie=6999819244608512523 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.034+0000 7fbb7ffff640 1 --2- 10.20.193.28:0/259025410 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fbb801148c0 0x7fbb80114d30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.034+0000 7fbb7ffff640 1 --2- 10.20.193.28:0/259025410 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbb8005de60 0x7fbb8005e250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.034+0000 7fbb7ffff640 1 -- 10.20.193.28:0/259025410 >> 10.20.193.28:0/259025410 conn(0x7fbb8005b480 msgr2=0x7fbb8005b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:43.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.035+0000 7f5151362640 1 -- 10.20.193.28:0/1606125381 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5140004070 con 0x7f514c155970 2026-02-24T09:13:43.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.036+0000 7f51545ef640 1 -- 10.20.193.28:0/1606125381 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f514c155970 msgr2=0x7f514c175df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.036+0000 7f51545ef640 1 --2- 10.20.193.28:0/1606125381 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f514c155970 0x7f514c175df0 secure :-1 s=READY pgs=138 gs=1 cs=0 l=1 c_cookie=827002456713460080 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f514000bb10 tx=0x7f514002fab0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.035+0000 7fbb7ffff640 1 -- 10.20.193.28:0/259025410 shutdown_connections 2026-02-24T09:13:43.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.036+0000 7fbb7ffff640 1 -- 10.20.193.28:0/259025410 wait complete. 2026-02-24T09:13:43.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.037+0000 7fbb7ffff640 1 Processor -- start 2026-02-24T09:13:43.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.037+0000 7fbb7ffff640 1 -- start start 2026-02-24T09:13:43.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.037+0000 7fbb7ffff640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fbb8005de60 0x7fbb801b4c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.037+0000 7fbb7ffff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fbb801148c0 0x7fbb801b5290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.038+0000 7fbb7ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbb80115270 0x7fbb801b5e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.038+0000 7fbb7ffff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbb801b65d0 con 0x7fbb80115270 2026-02-24T09:13:43.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.038+0000 7fbb7ffff640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fbb801b6740 con 0x7fbb801148c0 2026-02-24T09:13:43.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.038+0000 7fbb7ffff640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbb801b6900 con 0x7fbb8005de60 2026-02-24T09:13:43.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.038+0000 7fbb7effd640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fbb8005de60 0x7fbb801b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.038+0000 7fbb7e7fc640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fbb801148c0 0x7fbb801b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.038+0000 7fbb7f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbb80115270 0x7fbb801b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.038+0000 7fbb7f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbb80115270 0x7fbb801b5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56554/0 (socket says 10.20.193.28:56554) 2026-02-24T09:13:43.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.038+0000 7fbb7f7fe640 1 -- 10.20.193.28:0/1340341743 learned_addr learned my addr 10.20.193.28:0/1340341743 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:13:43.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.038+0000 7fbb7e7fc640 1 -- 10.20.193.28:0/1340341743 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fbb8005de60 msgr2=0x7fbb801b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.038+0000 7fbb7e7fc640 1 --2- 10.20.193.28:0/1340341743 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fbb8005de60 0x7fbb801b4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.038+0000 7fbb7e7fc640 1 -- 10.20.193.28:0/1340341743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbb80115270 msgr2=0x7fbb801b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.038+0000 7fbb7e7fc640 1 --2- 10.20.193.28:0/1340341743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbb80115270 0x7fbb801b5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.038+0000 7fbb7e7fc640 1 -- 10.20.193.28:0/1340341743 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb7800a590 con 0x7fbb801148c0 2026-02-24T09:13:43.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.039+0000 7fbb7effd640 1 --2- 10.20.193.28:0/1340341743 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fbb8005de60 0x7fbb801b4c40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:13:43.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.039+0000 7fbb7e7fc640 1 --2- 10.20.193.28:0/1340341743 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fbb801148c0 0x7fbb801b5290 secure :-1 s=READY pgs=24 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbb74005b30 tx=0x7fbb7400dbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:43.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.040+0000 7fbb5ffff640 1 -- 10.20.193.28:0/1340341743 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbb74004500 con 0x7fbb801148c0 2026-02-24T09:13:43.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.040+0000 7fbb5ffff640 1 -- 10.20.193.28:0/1340341743 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fbb7400bcd0 con 0x7fbb801148c0 2026-02-24T09:13:43.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.040+0000 7fbb5ffff640 1 -- 10.20.193.28:0/1340341743 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbb74010460 con 0x7fbb801148c0 2026-02-24T09:13:43.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.040+0000 7fbb7ffff640 1 -- 10.20.193.28:0/1340341743 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb801b6be0 con 0x7fbb801148c0 2026-02-24T09:13:43.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.040+0000 7fbb7ffff640 1 -- 10.20.193.28:0/1340341743 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb802170d0 con 0x7fbb801148c0 2026-02-24T09:13:43.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.043+0000 7f51545ef640 1 -- 10.20.193.28:0/1606125381 shutdown_connections 2026-02-24T09:13:43.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.043+0000 7f51545ef640 1 --2- 10.20.193.28:0/1606125381 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f514c155970 0x7f514c175df0 unknown :-1 s=CLOSED pgs=138 gs=1 cs=0 l=1 c_cookie=827002456713460080 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.043+0000 7f51545ef640 1 --2- 10.20.193.28:0/1606125381 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f514c134f70 0x7f514c155350 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.043+0000 7f51545ef640 1 --2- 10.20.193.28:0/1606125381 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f514c114650 0x7f514c134a30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.043+0000 7f51545ef640 1 -- 10.20.193.28:0/1606125381 >> 10.20.193.28:0/1606125381 conn(0x7f514c05b580 msgr2=0x7f514c05b980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:43.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.043+0000 7f51545ef640 1 -- 10.20.193.28:0/1606125381 shutdown_connections 2026-02-24T09:13:43.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.043+0000 7f51545ef640 1 -- 10.20.193.28:0/1606125381 wait complete. 2026-02-24T09:13:43.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.044+0000 7fbb5ffff640 1 -- 10.20.193.28:0/1340341743 <== mon.2 v2:10.20.193.74:3300/0 4 ==== mgrmap(e 16) ==== 52887+0+0 (secure 0 0 0) 0x7fbb7400b810 con 0x7fbb801148c0 2026-02-24T09:13:43.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.045+0000 7fbb5ffff640 1 --2- 10.20.193.28:0/1340341743 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fbb5803f9a0 0x7fbb5805fe50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.045+0000 7fbb5ffff640 1 -- 10.20.193.28:0/1340341743 <== mon.2 v2:10.20.193.74:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7fbb740541f0 con 0x7fbb801148c0 2026-02-24T09:13:43.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.046+0000 7fbb7effd640 1 --2- 10.20.193.28:0/1340341743 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fbb5803f9a0 0x7fbb5805fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.046+0000 7fbb7effd640 1 --2- 10.20.193.28:0/1340341743 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fbb5803f9a0 0x7fbb5805fe50 secure :-1 s=READY pgs=30 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbb70004740 tx=0x7fbb70005f00 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:43.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.045+0000 7f51545ef640 1 Processor -- start 2026-02-24T09:13:43.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.047+0000 7f51545ef640 1 -- start start 2026-02-24T09:13:43.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.048+0000 7f51545ef640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f514c114650 0x7f514c155350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.048+0000 7f51545ef640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f514c134f70 0x7f514c175d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.048+0000 7f51545ef640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f514c155970 0x7f514c100390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.048+0000 7f51545ef640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f514c100b20 con 0x7f514c134f70 2026-02-24T09:13:43.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.048+0000 7f51545ef640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f514c100c90 con 0x7f514c155970 2026-02-24T09:13:43.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.048+0000 7f51545ef640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f514c101360 con 0x7f514c114650 2026-02-24T09:13:43.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.049+0000 7f5152b65640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f514c155970 0x7f514c100390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.049+0000 7f5151b63640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f514c134f70 0x7f514c175d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.049+0000 7f5152b65640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f514c155970 0x7f514c100390 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:56990/0 (socket says 10.20.193.28:56990) 2026-02-24T09:13:43.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.049+0000 7f5152b65640 1 -- 10.20.193.28:0/3044382323 learned_addr learned my addr 10.20.193.28:0/3044382323 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:13:43.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.049+0000 7f5151b63640 1 -- 10.20.193.28:0/3044382323 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f514c114650 msgr2=0x7f514c155350 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:13:43.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.049+0000 7f5151b63640 1 --2- 10.20.193.28:0/3044382323 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f514c114650 0x7f514c155350 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.049+0000 7f5151b63640 1 -- 10.20.193.28:0/3044382323 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f514c155970 msgr2=0x7f514c100390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.049+0000 7fbb7ffff640 1 -- 10.20.193.28:0/1340341743 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb4c005300 con 0x7fbb801148c0 2026-02-24T09:13:43.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.051+0000 7f5151b63640 1 --2- 10.20.193.28:0/3044382323 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f514c155970 0x7f514c100390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.051+0000 7f5151b63640 1 -- 10.20.193.28:0/3044382323 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5140009570 con 0x7f514c134f70 2026-02-24T09:13:43.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.051+0000 7f5152b65640 1 --2- 10.20.193.28:0/3044382323 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f514c155970 0x7f514c100390 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:13:43.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.052+0000 7fbb5ffff640 1 -- 10.20.193.28:0/1340341743 <== mon.2 v2:10.20.193.74:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fbb74018be0 con 0x7fbb801148c0 2026-02-24T09:13:43.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.055+0000 7f5151b63640 1 --2- 10.20.193.28:0/3044382323 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f514c134f70 0x7f514c175d50 secure :-1 s=READY pgs=139 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f513c00b750 tx=0x7f513c00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:43.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.055+0000 7f513bfff640 1 -- 10.20.193.28:0/3044382323 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f513c004290 con 0x7f514c134f70 2026-02-24T09:13:43.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.055+0000 7f51545ef640 1 -- 10.20.193.28:0/3044382323 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f514c101640 con 0x7f514c134f70 2026-02-24T09:13:43.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.055+0000 7f51545ef640 1 -- 10.20.193.28:0/3044382323 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f514c101be0 con 0x7f514c134f70 2026-02-24T09:13:43.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.055+0000 7f513bfff640 1 -- 10.20.193.28:0/3044382323 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f513c0043f0 con 0x7f514c134f70 2026-02-24T09:13:43.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.055+0000 7f513bfff640 1 -- 10.20.193.28:0/3044382323 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f513c004290 con 0x7f514c134f70 2026-02-24T09:13:43.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.056+0000 7f51545ef640 1 -- 10.20.193.28:0/3044382323 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f514c055c40 con 0x7f514c134f70 2026-02-24T09:13:43.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.068+0000 7f81aeaaa640 1 -- 10.20.193.28:0/2405143942 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) -- 0x7f8170005b30 con 0x7f81a810cbf0 2026-02-24T09:13:43.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.072+0000 7f8196ffd640 1 -- 10.20.193.28:0/2405143942 <== mon.2 v2:10.20.193.74:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v25)=0 v25) ==== 115+0+0 (secure 0 0 0) 0x7f81a4014020 con 0x7f81a810cbf0 2026-02-24T09:13:43.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.072+0000 7fc4ead8c640 1 -- 10.20.193.28:0/180157783 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc4dc0b6e50 msgr2=0x7fc4dc0b7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.072+0000 7fc4ead8c640 1 --2- 10.20.193.28:0/180157783 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc4dc0b6e50 0x7fc4dc0b7240 secure :-1 s=READY pgs=26 gs=1 cs=0 l=1 c_cookie=12763904977109604806 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4d4009890 tx=0x7fc4d402f100 comp rx=0 tx=0).stop 2026-02-24T09:13:43.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.074+0000 7fc4ead8c640 1 -- 10.20.193.28:0/180157783 shutdown_connections 2026-02-24T09:13:43.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.074+0000 7fc4ead8c640 1 --2- 10.20.193.28:0/180157783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4dc0b8990 0x7fc4dc119320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.074+0000 7fc4ead8c640 1 --2- 10.20.193.28:0/180157783 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc4dc0b7fe0 0x7fc4dc0b8450 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.074+0000 7fc4ead8c640 1 --2- 10.20.193.28:0/180157783 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc4dc0b6e50 0x7fc4dc0b7240 unknown :-1 s=CLOSED pgs=26 gs=1 cs=0 l=1 c_cookie=12763904977109604806 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.074+0000 7fc4ead8c640 1 -- 10.20.193.28:0/180157783 >> 10.20.193.28:0/180157783 conn(0x7fc4dc094580 msgr2=0x7fc4dc0b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:43.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.062+0000 7f757f03c640 1 -- 10.20.193.28:0/2475304046 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f757810bea0 msgr2=0x7f757810c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.062+0000 7f757f03c640 1 --2- 10.20.193.28:0/2475304046 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f757810bea0 0x7f757810c310 secure :-1 s=READY pgs=25 gs=3 cs=0 l=1 c_cookie=13708988319621117416 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7568009890 tx=0x7f756802f100 comp rx=0 tx=0).stop 2026-02-24T09:13:43.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.067+0000 7f757cdb1640 1 --2- 10.20.193.28:0/2475304046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7578060920 0x7f757810b960 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:13:43.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.067+0000 7f757f03c640 1 -- 10.20.193.28:0/2475304046 shutdown_connections 2026-02-24T09:13:43.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.067+0000 7f757f03c640 1 --2- 10.20.193.28:0/2475304046 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f757810ca00 0x7f757810cea0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.067+0000 7f757f03c640 1 --2- 10.20.193.28:0/2475304046 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f757810bea0 0x7f757810c310 unknown :-1 s=CLOSED pgs=25 gs=3 cs=0 l=1 c_cookie=13708988319621117416 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.067+0000 7f757f03c640 1 --2- 10.20.193.28:0/2475304046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7578060920 0x7f757810b960 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.067+0000 7f757f03c640 1 -- 10.20.193.28:0/2475304046 >> 10.20.193.28:0/2475304046 conn(0x7f75780e95a0 msgr2=0x7f75781099d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:43.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.068+0000 7f757f03c640 1 -- 10.20.193.28:0/2475304046 shutdown_connections 2026-02-24T09:13:43.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.068+0000 7f757f03c640 1 -- 10.20.193.28:0/2475304046 wait complete. 2026-02-24T09:13:43.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.072+0000 7f757f03c640 1 Processor -- start 2026-02-24T09:13:43.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.072+0000 7f757f03c640 1 -- start start 2026-02-24T09:13:43.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.072+0000 7f757f03c640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7578060920 0x7f75780f4b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.072+0000 7f757f03c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f757810bea0 0x7f75780f51d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.072+0000 7f757f03c640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f757810ca00 0x7f75780f5dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.073+0000 7f757f03c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f75780f6510 con 0x7f757810bea0 2026-02-24T09:13:43.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.073+0000 7f757f03c640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f75780f6680 con 0x7f7578060920 2026-02-24T09:13:43.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.073+0000 7f757f03c640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f75780f6840 con 0x7f757810ca00 2026-02-24T09:13:43.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.073+0000 7f756ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f757810bea0 0x7f75780f51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.073+0000 7f756ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f757810bea0 0x7f75780f51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56610/0 (socket says 10.20.193.28:56610) 2026-02-24T09:13:43.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.073+0000 7f756ffff640 1 -- 10.20.193.28:0/255151551 learned_addr learned my addr 10.20.193.28:0/255151551 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:13:43.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.073+0000 7f757cdb1640 1 --2- 10.20.193.28:0/255151551 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7578060920 0x7f75780f4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.073+0000 7f757d5b2640 1 --2- 10.20.193.28:0/255151551 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f757810ca00 0x7f75780f5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.075+0000 7f756ffff640 1 -- 10.20.193.28:0/255151551 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f757810ca00 msgr2=0x7f75780f5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.075+0000 7f756ffff640 1 --2- 10.20.193.28:0/255151551 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f757810ca00 0x7f75780f5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.075+0000 7f756ffff640 1 -- 10.20.193.28:0/255151551 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7578060920 msgr2=0x7f75780f4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.075+0000 7f756ffff640 1 --2- 10.20.193.28:0/255151551 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7578060920 0x7f75780f4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.075+0000 7f756ffff640 1 -- 10.20.193.28:0/255151551 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75680094b0 con 0x7f757810bea0 2026-02-24T09:13:43.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.076+0000 7f757cdb1640 1 --2- 10.20.193.28:0/255151551 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7578060920 0x7f75780f4b80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:13:43.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.076+0000 7f756ffff640 1 --2- 10.20.193.28:0/255151551 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f757810bea0 0x7f75780f51d0 secure :-1 s=READY pgs=140 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7568032040 tx=0x7f756802fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:43.084 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e9ad50af-1160-11f1-800e-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='trial028') 2026-02-24T09:13:43.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.063+0000 7f513bfff640 1 -- 10.20.193.28:0/3044382323 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 52887+0+0 (secure 0 0 0) 0x7f513c01c070 con 0x7f514c134f70 2026-02-24T09:13:43.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.074+0000 7fc4ead8c640 1 -- 10.20.193.28:0/180157783 shutdown_connections 2026-02-24T09:13:43.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.074+0000 7fc4ead8c640 1 -- 10.20.193.28:0/180157783 wait complete. 2026-02-24T09:13:43.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.064+0000 7f513bfff640 1 --2- 10.20.193.28:0/3044382323 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f512403fa80 0x7f512405ff30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.064+0000 7f513bfff640 1 -- 10.20.193.28:0/3044382323 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7f513c053110 con 0x7f514c134f70 2026-02-24T09:13:43.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.078+0000 7fc4ead8c640 1 Processor -- start 2026-02-24T09:13:43.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.078+0000 7fc4ead8c640 1 -- start start 2026-02-24T09:13:43.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.080+0000 7fc4ead8c640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc4dc0b6e50 0x7fc4dc0a0580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.080+0000 7fc4ead8c640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc4dc0b7fe0 0x7fc4dc119320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.080+0000 7fc4ead8c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4dc0b8990 0x7fc4dc0a0de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.080+0000 7fc4ea58b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4dc0b8990 0x7fc4dc0a0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.080+0000 7fc4ea58b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4dc0b8990 0x7fc4dc0a0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56614/0 (socket says 10.20.193.28:56614) 2026-02-24T09:13:43.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.080+0000 7fc4ea58b640 1 -- 10.20.193.28:0/3965948525 learned_addr learned my addr 10.20.193.28:0/3965948525 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:13:43.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.080+0000 7fc4ead8c640 1 -- 10.20.193.28:0/3965948525 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc4dc0a19d0 con 0x7fc4dc0b8990 2026-02-24T09:13:43.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.080+0000 7fc4ead8c640 1 -- 10.20.193.28:0/3965948525 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fc4dc0a1b40 con 0x7fc4dc0b6e50 2026-02-24T09:13:43.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.080+0000 7fc4ead8c640 1 -- 10.20.193.28:0/3965948525 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc4dc0a1d00 con 0x7fc4dc0b7fe0 2026-02-24T09:13:43.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.081+0000 7fc4ea58b640 1 -- 10.20.193.28:0/3965948525 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc4dc0b7fe0 msgr2=0x7fc4dc119320 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:13:43.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.081+0000 7fc4ea58b640 1 --2- 10.20.193.28:0/3965948525 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc4dc0b7fe0 0x7fc4dc119320 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.081+0000 7fc4ea58b640 1 -- 10.20.193.28:0/3965948525 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc4dc0b6e50 msgr2=0x7fc4dc0a0580 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-24T09:13:43.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.081+0000 7fc4e9d8a640 1 --2- 10.20.193.28:0/3965948525 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc4dc0b6e50 0x7fc4dc0a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.081+0000 7fc4ea58b640 1 --2- 10.20.193.28:0/3965948525 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc4dc0b6e50 0x7fc4dc0a0580 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.081+0000 7fc4ea58b640 1 -- 10.20.193.28:0/3965948525 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e000a590 con 0x7fc4dc0b8990 2026-02-24T09:13:43.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.081+0000 7fc4ea58b640 1 --2- 10.20.193.28:0/3965948525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4dc0b8990 0x7fc4dc0a0de0 secure :-1 s=READY pgs=141 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4e0003a00 tx=0x7fc4e0003ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:43.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.082+0000 7fc4d2ffd640 1 -- 10.20.193.28:0/3965948525 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc4e000fce0 con 0x7fc4dc0b8990 2026-02-24T09:13:43.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.082+0000 7fc4ead8c640 1 -- 10.20.193.28:0/3965948525 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4d40094b0 con 0x7fc4dc0b8990 2026-02-24T09:13:43.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.082+0000 7fc4d2ffd640 1 -- 10.20.193.28:0/3965948525 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc4e000fe40 con 0x7fc4dc0b8990 2026-02-24T09:13:43.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.082+0000 7fc4ead8c640 1 -- 10.20.193.28:0/3965948525 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4dc0a2320 con 0x7fc4dc0b8990 2026-02-24T09:13:43.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.082+0000 7fc4d2ffd640 1 -- 10.20.193.28:0/3965948525 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc4e001f9a0 con 0x7fc4dc0b8990 2026-02-24T09:13:43.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.066+0000 7f5152364640 1 --2- 10.20.193.28:0/3044382323 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f512403fa80 0x7f512405ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.067+0000 7f513bfff640 1 -- 10.20.193.28:0/3044382323 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f513c092890 con 0x7f514c134f70 2026-02-24T09:13:43.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.067+0000 7f5152364640 1 --2- 10.20.193.28:0/3044382323 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f512403fa80 0x7f512405ff30 secure :-1 s=READY pgs=31 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5148005820 tx=0x7f5148006d10 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:43.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.085+0000 7fc4ead8c640 1 -- 10.20.193.28:0/3965948525 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4dc0a2600 con 0x7fc4dc0b8990 2026-02-24T09:13:43.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.087+0000 7f0012d19640 1 -- 10.20.193.28:0/274143564 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f000c1348a0 msgr2=0x7f000c154d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.087+0000 7f0012d19640 1 --2- 10.20.193.28:0/274143564 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f000c1348a0 0x7f000c154d20 secure :-1 s=READY pgs=27 gs=1 cs=0 l=1 c_cookie=3770421233809584151 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efffc009950 tx=0x7efffc02f190 comp rx=0 tx=0).stop 2026-02-24T09:13:43.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.088+0000 7f0012d19640 1 -- 10.20.193.28:0/274143564 shutdown_connections 2026-02-24T09:13:43.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.088+0000 7f0012d19640 1 --2- 10.20.193.28:0/274143564 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f000c155460 0x7f000c175910 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.088+0000 7f0012d19640 1 --2- 10.20.193.28:0/274143564 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f000c1348a0 0x7f000c154d20 unknown :-1 s=CLOSED pgs=27 gs=1 cs=0 l=1 c_cookie=3770421233809584151 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.088+0000 7f0012d19640 1 --2- 10.20.193.28:0/274143564 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f000c113e80 0x7f000c134260 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.088+0000 7f0012d19640 1 -- 10.20.193.28:0/274143564 >> 10.20.193.28:0/274143564 conn(0x7f000c0646f0 msgr2=0x7f000c064af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:43.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.088+0000 7f0012d19640 1 -- 10.20.193.28:0/274143564 shutdown_connections 2026-02-24T09:13:43.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.089+0000 7f756dffb640 1 -- 10.20.193.28:0/255151551 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7568004570 con 0x7f757810bea0 2026-02-24T09:13:43.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.089+0000 7f756dffb640 1 -- 10.20.193.28:0/255151551 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7568038930 con 0x7f757810bea0 2026-02-24T09:13:43.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.089+0000 7f0012d19640 1 -- 10.20.193.28:0/274143564 wait complete. 2026-02-24T09:13:43.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.089+0000 7f81aeaaa640 1 -- 10.20.193.28:0/2405143942 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f818003fa70 msgr2=0x7f818005ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.089+0000 7f81aeaaa640 1 --2- 10.20.193.28:0/2405143942 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f818003fa70 0x7f818005ff20 secure :-1 s=READY pgs=28 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f819c002b00 tx=0x7f819c0046a0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.089+0000 7f81aeaaa640 1 -- 10.20.193.28:0/2405143942 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f81a810cbf0 msgr2=0x7f81a80eba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.089+0000 7f81aeaaa640 1 --2- 10.20.193.28:0/2405143942 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f81a810cbf0 0x7f81a80eba80 secure :-1 s=READY pgs=23 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f81a400b270 tx=0x7f81a400de70 comp rx=0 tx=0).stop 2026-02-24T09:13:43.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.090+0000 7f0012d19640 1 Processor -- start 2026-02-24T09:13:43.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.090+0000 7f0012d19640 1 -- start start 2026-02-24T09:13:43.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.090+0000 7f81aeaaa640 1 -- 10.20.193.28:0/2405143942 shutdown_connections 2026-02-24T09:13:43.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.090+0000 7f81aeaaa640 1 --2- 10.20.193.28:0/2405143942 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f818003fa70 0x7f818005ff20 unknown :-1 s=CLOSED pgs=28 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.090+0000 7f81aeaaa640 1 --2- 10.20.193.28:0/2405143942 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f81a810cbf0 0x7f81a80eba80 unknown :-1 s=CLOSED pgs=23 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.090+0000 7f81aeaaa640 1 --2- 10.20.193.28:0/2405143942 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f81a810c240 0x7f81a816d580 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.090+0000 7f81aeaaa640 1 --2- 10.20.193.28:0/2405143942 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f81a810b0b0 0x7f81a80eb220 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.090+0000 7f81aeaaa640 1 -- 10.20.193.28:0/2405143942 >> 10.20.193.28:0/2405143942 conn(0x7f81a80e87e0 msgr2=0x7f81a80ef350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:43.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.090+0000 7f81aeaaa640 1 -- 10.20.193.28:0/2405143942 shutdown_connections 2026-02-24T09:13:43.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.091+0000 7f81aeaaa640 1 -- 10.20.193.28:0/2405143942 wait complete. 2026-02-24T09:13:43.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.091+0000 7f0012d19640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f000c113e80 0x7f000c175910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.091+0000 7f0012d19640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f000c1348a0 0x7f000c154cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.091+0000 7f0012d19640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f000c155460 0x7f000c0ffbe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.091+0000 7f0012d19640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f000c100370 con 0x7f000c113e80 2026-02-24T09:13:43.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.091+0000 7f0012d19640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f000c1004e0 con 0x7f000c155460 2026-02-24T09:13:43.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.091+0000 7f0012d19640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f000c100b30 con 0x7f000c1348a0 2026-02-24T09:13:43.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.094+0000 7f001128f640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f000c155460 0x7f000c0ffbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.094+0000 7f001128f640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f000c155460 0x7f000c0ffbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:57058/0 (socket says 10.20.193.28:57058) 2026-02-24T09:13:43.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.094+0000 7f001128f640 1 -- 10.20.193.28:0/533240355 learned_addr learned my addr 10.20.193.28:0/533240355 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:13:43.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.096+0000 7f0010a8e640 1 --2- 10.20.193.28:0/533240355 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f000c113e80 0x7f000c175910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.096+0000 7f000bfff640 1 --2- 10.20.193.28:0/533240355 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f000c1348a0 0x7f000c154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.096+0000 7f001128f640 1 -- 10.20.193.28:0/533240355 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f000c1348a0 msgr2=0x7f000c154cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.096+0000 7f001128f640 1 --2- 10.20.193.28:0/533240355 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f000c1348a0 0x7f000c154cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.096+0000 7f001128f640 1 -- 10.20.193.28:0/533240355 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f000c113e80 msgr2=0x7f000c175910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.096+0000 7f001128f640 1 --2- 10.20.193.28:0/533240355 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f000c113e80 0x7f000c175910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.096+0000 7f001128f640 1 -- 10.20.193.28:0/533240355 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff80094b0 con 0x7f000c155460 2026-02-24T09:13:43.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.096+0000 7f000bfff640 1 --2- 10.20.193.28:0/533240355 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f000c1348a0 0x7f000c154cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:13:43.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.096+0000 7f0010a8e640 1 --2- 10.20.193.28:0/533240355 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f000c113e80 0x7f000c175910 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:13:43.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.097+0000 7f001128f640 1 --2- 10.20.193.28:0/533240355 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f000c155460 0x7f000c0ffbe0 secure :-1 s=READY pgs=28 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f000000f8d0 tx=0x7f000000fda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:43.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.097+0000 7f0009ffb640 1 -- 10.20.193.28:0/533240355 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f000000dce0 con 0x7f000c155460 2026-02-24T09:13:43.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.097+0000 7f0009ffb640 1 -- 10.20.193.28:0/533240355 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f000000de40 con 0x7f000c155460 2026-02-24T09:13:43.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.097+0000 7f0009ffb640 1 -- 10.20.193.28:0/533240355 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00000116b0 con 0x7f000c155460 2026-02-24T09:13:43.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.098+0000 7f0012d19640 1 -- 10.20.193.28:0/533240355 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efffc009570 con 0x7f000c155460 2026-02-24T09:13:43.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.098+0000 7f0012d19640 1 -- 10.20.193.28:0/533240355 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f000c1010d0 con 0x7f000c155460 2026-02-24T09:13:43.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.099+0000 7f0009ffb640 1 -- 10.20.193.28:0/533240355 <== mon.2 v2:10.20.193.74:3300/0 4 ==== mgrmap(e 16) ==== 52887+0+0 (secure 0 0 0) 0x7f0000020060 con 0x7f000c155460 2026-02-24T09:13:43.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.100+0000 7f0009ffb640 1 --2- 10.20.193.28:0/533240355 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7effec03fa70 0x7effec05ff20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.100+0000 7f0009ffb640 1 -- 10.20.193.28:0/533240355 <== mon.2 v2:10.20.193.74:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7f0000015070 con 0x7f000c155460 2026-02-24T09:13:43.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.100+0000 7f0010a8e640 1 --2- 10.20.193.28:0/533240355 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7effec03fa70 0x7effec05ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.102+0000 7f0012d19640 1 -- 10.20.193.28:0/533240355 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f000c100c70 con 0x7f000c155460 2026-02-24T09:13:43.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.106+0000 7f0009ffb640 1 -- 10.20.193.28:0/533240355 <== mon.2 v2:10.20.193.74:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f0000022630 con 0x7f000c155460 2026-02-24T09:13:43.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.099+0000 7fc4d2ffd640 1 -- 10.20.193.28:0/3965948525 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 52887+0+0 (secure 0 0 0) 0x7fc4e001fb30 con 0x7fc4dc0b8990 2026-02-24T09:13:43.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.107+0000 7fc4d2ffd640 1 --2- 10.20.193.28:0/3965948525 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc4bc03fa20 0x7fc4bc05fed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.107+0000 7fc4d2ffd640 1 -- 10.20.193.28:0/3965948525 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7fc4e005e500 con 0x7fc4dc0b8990 2026-02-24T09:13:43.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.107+0000 7fc4d2ffd640 1 -- 10.20.193.28:0/3965948525 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fc4e0060ab0 con 0x7fc4dc0b8990 2026-02-24T09:13:43.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.107+0000 7fc4e9d8a640 1 --2- 10.20.193.28:0/3965948525 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc4bc03fa20 0x7fc4bc05fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.118+0000 7f741e157640 1 -- 10.20.193.28:0/2927220821 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f73e40055b0 con 0x7f7418119670 2026-02-24T09:13:43.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.122+0000 7f7414ff9640 1 -- 10.20.193.28:0/2927220821 <== mon.1 v2:10.20.193.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v26)=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7f741001c310 con 0x7f7418119670 2026-02-24T09:13:43.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.116+0000 7fc4e9d8a640 1 --2- 10.20.193.28:0/3965948525 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc4bc03fa20 0x7fc4bc05fed0 secure :-1 s=READY pgs=32 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4d40097e0 tx=0x7fc4d402ff90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.118+0000 7f756dffb640 1 -- 10.20.193.28:0/255151551 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7568041a90 con 0x7f757810bea0 2026-02-24T09:13:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.118+0000 7f757f03c640 1 -- 10.20.193.28:0/255151551 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75780f6ac0 con 0x7f757810bea0 2026-02-24T09:13:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.118+0000 7f757f03c640 1 -- 10.20.193.28:0/255151551 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75780f6fe0 con 0x7f757810bea0 2026-02-24T09:13:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.125+0000 7f756dffb640 1 -- 10.20.193.28:0/255151551 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 52887+0+0 (secure 0 0 0) 0x7f756803f030 con 0x7f757810bea0 2026-02-24T09:13:43.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.129+0000 7f741e157640 1 -- 10.20.193.28:0/2927220821 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f73f003f9d0 msgr2=0x7f73f005fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.129+0000 7f741e157640 1 --2- 10.20.193.28:0/2927220821 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f73f003f9d0 0x7f73f005fe80 secure :-1 s=READY pgs=22 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7404004740 tx=0x7f7404006d40 comp rx=0 tx=0).stop 2026-02-24T09:13:43.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.129+0000 7f741e157640 1 -- 10.20.193.28:0/2927220821 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7418119670 msgr2=0x7f741811be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.129+0000 7f741e157640 1 --2- 10.20.193.28:0/2927220821 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7418119670 0x7f741811be30 secure :-1 s=READY pgs=16 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7410005c80 tx=0x7f741000d0c0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.129+0000 7f741e157640 1 -- 10.20.193.28:0/2927220821 shutdown_connections 2026-02-24T09:13:43.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.129+0000 7f741e157640 1 --2- 10.20.193.28:0/2927220821 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f73f003f9d0 0x7f73f005fe80 unknown :-1 s=CLOSED pgs=22 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.129+0000 7f741e157640 1 --2- 10.20.193.28:0/2927220821 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7418119670 0x7f741811be30 unknown :-1 s=CLOSED pgs=16 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.129+0000 7f741e157640 1 --2- 10.20.193.28:0/2927220821 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7418118cc0 0x7f741811b230 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.129+0000 7f741e157640 1 --2- 10.20.193.28:0/2927220821 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7418117b30 0x7f741811abe0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.129+0000 7f741e157640 1 -- 10.20.193.28:0/2927220821 >> 10.20.193.28:0/2927220821 conn(0x7f74180f5280 msgr2=0x7f7418115660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:43.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.129+0000 7f741e157640 1 -- 10.20.193.28:0/2927220821 shutdown_connections 2026-02-24T09:13:43.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.129+0000 7f741e157640 1 -- 10.20.193.28:0/2927220821 wait complete. 2026-02-24T09:13:43.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.134+0000 7f756dffb640 1 --2- 10.20.193.28:0/255151551 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f755403f9f0 0x7f755405fea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.134+0000 7f756dffb640 1 -- 10.20.193.28:0/255151551 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7f7568078b00 con 0x7f757810bea0 2026-02-24T09:13:43.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.134+0000 7f757cdb1640 1 --2- 10.20.193.28:0/255151551 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f755403f9f0 0x7f755405fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.135+0000 7f757cdb1640 1 --2- 10.20.193.28:0/255151551 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f755403f9f0 0x7f755405fea0 secure :-1 s=READY pgs=33 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7560004740 tx=0x7f7560005ab0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:43.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.142+0000 7fa5e309e640 1 -- 10.20.193.28:0/4223999142 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7fa5ac005880 con 0x7fa5dc05e890 2026-02-24T09:13:43.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.142+0000 7f757f03c640 1 -- 10.20.193.28:0/255151551 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7540005300 con 0x7f757810bea0 2026-02-24T09:13:43.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.152+0000 7f756dffb640 1 -- 10.20.193.28:0/255151551 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f756803d080 con 0x7f757810bea0 2026-02-24T09:13:43.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.124+0000 7fad13577640 1 -- 10.20.193.28:0/2082510079 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fad14115270 msgr2=0x7fad14115bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.124+0000 7fad13577640 1 --2- 10.20.193.28:0/2082510079 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fad14115270 0x7fad14115bb0 secure :-1 s=READY pgs=20 gs=2 cs=0 l=1 c_cookie=11975031700181560993 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fad08009950 tx=0x7fad0802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.124+0000 7fad13577640 1 -- 10.20.193.28:0/2082510079 shutdown_connections 2026-02-24T09:13:43.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.124+0000 7fad13577640 1 --2- 10.20.193.28:0/2082510079 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fad14115270 0x7fad14115bb0 unknown :-1 s=CLOSED pgs=20 gs=2 cs=0 l=1 c_cookie=11975031700181560993 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.124+0000 7fad13577640 1 --2- 10.20.193.28:0/2082510079 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fad141148c0 0x7fad14114d30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.124+0000 7fad13577640 1 --2- 10.20.193.28:0/2082510079 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad1405de60 0x7fad1405e250 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.124+0000 7fad13577640 1 -- 10.20.193.28:0/2082510079 >> 10.20.193.28:0/2082510079 conn(0x7fad1405b8e0 msgr2=0x7fad1405bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:43.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.125+0000 7fad13577640 1 -- 10.20.193.28:0/2082510079 shutdown_connections 2026-02-24T09:13:43.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.125+0000 7fad13577640 1 -- 10.20.193.28:0/2082510079 wait complete. 2026-02-24T09:13:43.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.126+0000 7fad13577640 1 Processor -- start 2026-02-24T09:13:43.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.126+0000 7fad13577640 1 -- start start 2026-02-24T09:13:43.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.126+0000 7fad13577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad1405de60 0x7fad141066d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.127+0000 7fad13577640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fad141148c0 0x7fad14106d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.127+0000 7fad13577640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fad14115270 0x7fad14107920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.127+0000 7fad13577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fad14108060 con 0x7fad1405de60 2026-02-24T09:13:43.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.127+0000 7fad13577640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fad141081d0 con 0x7fad14115270 2026-02-24T09:13:43.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.127+0000 7fad13577640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fad14108390 con 0x7fad141148c0 2026-02-24T09:13:43.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.127+0000 7fad12575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad1405de60 0x7fad141066d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.127+0000 7fad12575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad1405de60 0x7fad141066d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56630/0 (socket says 10.20.193.28:56630) 2026-02-24T09:13:43.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.127+0000 7fad12575640 1 -- 10.20.193.28:0/1992782900 learned_addr learned my addr 10.20.193.28:0/1992782900 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:13:43.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.127+0000 7fad11d74640 1 --2- 10.20.193.28:0/1992782900 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fad141148c0 0x7fad14106d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.127+0000 7fad12d76640 1 --2- 10.20.193.28:0/1992782900 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fad14115270 0x7fad14107920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.127+0000 7fad11d74640 1 -- 10.20.193.28:0/1992782900 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fad14115270 msgr2=0x7fad14107920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.127+0000 7fad11d74640 1 --2- 10.20.193.28:0/1992782900 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fad14115270 0x7fad14107920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.127+0000 7fad11d74640 1 -- 10.20.193.28:0/1992782900 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad1405de60 msgr2=0x7fad141066d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.127+0000 7fad11d74640 1 --2- 10.20.193.28:0/1992782900 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad1405de60 0x7fad141066d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.127+0000 7fad11d74640 1 -- 10.20.193.28:0/1992782900 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facfc0094b0 con 0x7fad141148c0 2026-02-24T09:13:43.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.128+0000 7fad12d76640 1 --2- 10.20.193.28:0/1992782900 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fad14115270 0x7fad14107920 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:13:43.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.128+0000 7fad11d74640 1 --2- 10.20.193.28:0/1992782900 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fad141148c0 0x7fad14106d20 secure :-1 s=READY pgs=21 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fad0400e950 tx=0x7fad0400ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:43.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.143+0000 7facfb7fe640 1 -- 10.20.193.28:0/1992782900 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fad04005500 con 0x7fad141148c0 2026-02-24T09:13:43.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.143+0000 7facfb7fe640 1 -- 10.20.193.28:0/1992782900 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fad0400cd00 con 0x7fad141148c0 2026-02-24T09:13:43.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.143+0000 7fad13577640 1 -- 10.20.193.28:0/1992782900 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad08009570 con 0x7fad141148c0 2026-02-24T09:13:43.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.143+0000 7facfb7fe640 1 -- 10.20.193.28:0/1992782900 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fad04011460 con 0x7fad141148c0 2026-02-24T09:13:43.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.144+0000 7fad13577640 1 -- 10.20.193.28:0/1992782900 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad14108b30 con 0x7fad141148c0 2026-02-24T09:13:43.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.160+0000 7f0010a8e640 1 --2- 10.20.193.28:0/533240355 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7effec03fa70 0x7effec05ff20 secure :-1 s=READY pgs=34 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efff8004740 tx=0x7efff8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:43.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.158+0000 7fa5cb7fe640 1 -- 10.20.193.28:0/4223999142 <== mon.2 v2:10.20.193.74:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v27)=0 v27) ==== 119+0+0 (secure 0 0 0) 0x7fa5d0042030 con 0x7fa5dc05e890 2026-02-24T09:13:43.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.164+0000 7fa5e309e640 1 -- 10.20.193.28:0/4223999142 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa5b003f9a0 msgr2=0x7fa5b005fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.164+0000 7fa5e309e640 1 --2- 10.20.193.28:0/4223999142 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa5b003f9a0 0x7fa5b005fe50 secure :-1 s=READY pgs=25 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5cc005db0 tx=0x7fa5cc005d20 comp rx=0 tx=0).stop 2026-02-24T09:13:43.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.164+0000 7fa5e309e640 1 -- 10.20.193.28:0/4223999142 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa5dc05e890 msgr2=0x7fa5dc1408b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.164+0000 7fa5e309e640 1 --2- 10.20.193.28:0/4223999142 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa5dc05e890 0x7fa5dc1408b0 secure :-1 s=READY pgs=20 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5d0006010 tx=0x7fa5d000be90 comp rx=0 tx=0).stop 2026-02-24T09:13:43.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.165+0000 7fa5e309e640 1 -- 10.20.193.28:0/4223999142 shutdown_connections 2026-02-24T09:13:43.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.165+0000 7fa5e309e640 1 --2- 10.20.193.28:0/4223999142 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa5b003f9a0 0x7fa5b005fe50 unknown :-1 s=CLOSED pgs=25 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.165+0000 7fa5e309e640 1 --2- 10.20.193.28:0/4223999142 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa5dc155860 0x7fa5dc141110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.165+0000 7fa5e309e640 1 --2- 10.20.193.28:0/4223999142 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa5dc134ca0 0x7fa5dc134660 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.165+0000 7fa5e309e640 1 --2- 10.20.193.28:0/4223999142 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa5dc05e890 0x7fa5dc1408b0 unknown :-1 s=CLOSED pgs=20 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.165+0000 7fa5e309e640 1 -- 10.20.193.28:0/4223999142 >> 10.20.193.28:0/4223999142 conn(0x7fa5dc05b480 msgr2=0x7fa5dc137450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:43.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.165+0000 7fa5e309e640 1 -- 10.20.193.28:0/4223999142 shutdown_connections 2026-02-24T09:13:43.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.165+0000 7fa5e309e640 1 -- 10.20.193.28:0/4223999142 wait complete. 2026-02-24T09:13:43.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.160+0000 7facfb7fe640 1 -- 10.20.193.28:0/1992782900 <== mon.1 v2:10.20.193.159:3300/0 4 ==== mgrmap(e 16) ==== 52887+0+0 (secure 0 0 0) 0x7fad040115f0 con 0x7fad141148c0 2026-02-24T09:13:43.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.178+0000 7facfb7fe640 1 --2- 10.20.193.28:0/1992782900 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7facf003faa0 0x7facf005ff50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.178+0000 7facfb7fe640 1 -- 10.20.193.28:0/1992782900 <== mon.1 v2:10.20.193.159:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7fad04055f80 con 0x7fad141148c0 2026-02-24T09:13:43.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.178+0000 7fad12575640 1 --2- 10.20.193.28:0/1992782900 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7facf003faa0 0x7facf005ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.184+0000 7fad12575640 1 --2- 10.20.193.28:0/1992782900 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7facf003faa0 0x7facf005ff50 secure :-1 s=READY pgs=35 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7facfc005c70 tx=0x7facfc005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:43.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.191+0000 7fad13577640 1 -- 10.20.193.28:0/1992782900 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facd8005300 con 0x7fad141148c0 2026-02-24T09:13:43.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.200+0000 7facfb7fe640 1 -- 10.20.193.28:0/1992782900 <== mon.1 v2:10.20.193.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fad04010750 con 0x7fad141148c0 2026-02-24T09:13:43.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.223+0000 7f31f57a0640 1 -- 10.20.193.28:0/1149574638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f31e80c5350 msgr2=0x7f31e80c57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.223+0000 7f31f57a0640 1 --2- 10.20.193.28:0/1149574638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f31e80c5350 0x7f31e80c57c0 secure :-1 s=READY pgs=142 gs=1 cs=0 l=1 c_cookie=17669639573862522664 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f31d4009950 tx=0x7f31d402f190 comp rx=0 tx=0).stop 2026-02-24T09:13:43.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.224+0000 7f31f57a0640 1 -- 10.20.193.28:0/1149574638 shutdown_connections 2026-02-24T09:13:43.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.224+0000 7f31f57a0640 1 --2- 10.20.193.28:0/1149574638 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f31e80c5d00 0x7f31e8126690 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.224+0000 7f31f57a0640 1 --2- 10.20.193.28:0/1149574638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f31e80c5350 0x7f31e80c57c0 unknown :-1 s=CLOSED pgs=142 gs=1 cs=0 l=1 c_cookie=17669639573862522664 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.224+0000 7f31f57a0640 1 --2- 10.20.193.28:0/1149574638 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f31e80c41c0 0x7f31e80c45b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.231+0000 7fbb7ffff640 1 -- 10.20.193.28:0/1340341743 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7fbb4c0055b0 con 0x7fbb801148c0 2026-02-24T09:13:43.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.244+0000 7fbb5ffff640 1 -- 10.20.193.28:0/1340341743 <== mon.2 v2:10.20.193.74:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v28)=0 v28) ==== 138+0+0 (secure 0 0 0) 0x7fbb740183b0 con 0x7fbb801148c0 2026-02-24T09:13:43.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.249+0000 7fbb7ffff640 1 -- 10.20.193.28:0/1340341743 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fbb5803f9a0 msgr2=0x7fbb5805fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.249+0000 7fbb7ffff640 1 --2- 10.20.193.28:0/1340341743 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fbb5803f9a0 0x7fbb5805fe50 secure :-1 s=READY pgs=30 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbb70004740 tx=0x7fbb70005f00 comp rx=0 tx=0).stop 2026-02-24T09:13:43.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.249+0000 7fbb7ffff640 1 -- 10.20.193.28:0/1340341743 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fbb801148c0 msgr2=0x7fbb801b5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.249+0000 7fbb7ffff640 1 --2- 10.20.193.28:0/1340341743 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fbb801148c0 0x7fbb801b5290 secure :-1 s=READY pgs=24 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbb74005b30 tx=0x7fbb7400dbc0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.249+0000 7fbb7ffff640 1 -- 10.20.193.28:0/1340341743 shutdown_connections 2026-02-24T09:13:43.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.249+0000 7fbb7ffff640 1 --2- 10.20.193.28:0/1340341743 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fbb5803f9a0 0x7fbb5805fe50 unknown :-1 s=CLOSED pgs=30 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.249+0000 7fbb7ffff640 1 --2- 10.20.193.28:0/1340341743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbb80115270 0x7fbb801b5e90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.249+0000 7fbb7ffff640 1 --2- 10.20.193.28:0/1340341743 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fbb801148c0 0x7fbb801b5290 unknown :-1 s=CLOSED pgs=24 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.249+0000 7fbb7ffff640 1 --2- 10.20.193.28:0/1340341743 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fbb8005de60 0x7fbb801b4c40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.249+0000 7fbb7ffff640 1 -- 10.20.193.28:0/1340341743 >> 10.20.193.28:0/1340341743 conn(0x7fbb8005b480 msgr2=0x7fbb801ab5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:43.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.249+0000 7fbb7ffff640 1 -- 10.20.193.28:0/1340341743 shutdown_connections 2026-02-24T09:13:43.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.249+0000 7fbb7ffff640 1 -- 10.20.193.28:0/1340341743 wait complete. 2026-02-24T09:13:43.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.252+0000 7f51545ef640 1 -- 10.20.193.28:0/3044382323 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f51100051d0 con 0x7f514c134f70 2026-02-24T09:13:43.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.224+0000 7f31f57a0640 1 -- 10.20.193.28:0/1149574638 >> 10.20.193.28:0/1149574638 conn(0x7f31e80a1630 msgr2=0x7f31e80c1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:43.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.226+0000 7f31f57a0640 1 -- 10.20.193.28:0/1149574638 shutdown_connections 2026-02-24T09:13:43.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.226+0000 7f31f57a0640 1 -- 10.20.193.28:0/1149574638 wait complete. 2026-02-24T09:13:43.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.227+0000 7f31f57a0640 1 Processor -- start 2026-02-24T09:13:43.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.227+0000 7f31f57a0640 1 -- start start 2026-02-24T09:13:43.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.228+0000 7f31f57a0640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f31e80c41c0 0x7f31e81363e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.228+0000 7f31f57a0640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f31e80c5350 0x7f31e8106680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.228+0000 7f31f57a0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f31e80c5d00 0x7f31e8106d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.228+0000 7f31f57a0640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f31e81074a0 con 0x7f31e80c5d00 2026-02-24T09:13:43.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.228+0000 7f31f57a0640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f31e8107610 con 0x7f31e80c41c0 2026-02-24T09:13:43.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.228+0000 7f31f57a0640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f31e81077d0 con 0x7f31e80c5350 2026-02-24T09:13:43.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.228+0000 7f31eeffd640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f31e80c5350 0x7f31e8106680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.228+0000 7f31eeffd640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f31e80c5350 0x7f31e8106680 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:33542/0 (socket says 10.20.193.28:33542) 2026-02-24T09:13:43.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.228+0000 7f31eeffd640 1 -- 10.20.193.28:0/2527965064 learned_addr learned my addr 10.20.193.28:0/2527965064 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:13:43.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.228+0000 7f31ef7fe640 1 --2- 10.20.193.28:0/2527965064 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f31e80c41c0 0x7f31e81363e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.228+0000 7f31effff640 1 --2- 10.20.193.28:0/2527965064 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f31e80c5d00 0x7f31e8106d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.228+0000 7f31eeffd640 1 -- 10.20.193.28:0/2527965064 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f31e80c41c0 msgr2=0x7f31e81363e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.228+0000 7f31eeffd640 1 --2- 10.20.193.28:0/2527965064 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f31e80c41c0 0x7f31e81363e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.228+0000 7f31eeffd640 1 -- 10.20.193.28:0/2527965064 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f31e80c5d00 msgr2=0x7f31e8106d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.228+0000 7f31eeffd640 1 --2- 10.20.193.28:0/2527965064 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f31e80c5d00 0x7f31e8106d10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.228+0000 7f31eeffd640 1 -- 10.20.193.28:0/2527965064 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d4009570 con 0x7f31e80c5350 2026-02-24T09:13:43.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.229+0000 7f31eeffd640 1 --2- 10.20.193.28:0/2527965064 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f31e80c5350 0x7f31e8106680 secure :-1 s=READY pgs=22 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f31d40092e0 tx=0x7f31d402fc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:43.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.229+0000 7f31ed7fa640 1 -- 10.20.193.28:0/2527965064 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f31d403d070 con 0x7f31e80c5350 2026-02-24T09:13:43.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.229+0000 7f31ed7fa640 1 -- 10.20.193.28:0/2527965064 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f31d4038470 con 0x7f31e80c5350 2026-02-24T09:13:43.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.229+0000 7f31ed7fa640 1 -- 10.20.193.28:0/2527965064 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f31d4041b50 con 0x7f31e80c5350 2026-02-24T09:13:43.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.229+0000 7f31f57a0640 1 -- 10.20.193.28:0/2527965064 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31e8107a50 con 0x7f31e80c5350 2026-02-24T09:13:43.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.230+0000 7f31f57a0640 1 -- 10.20.193.28:0/2527965064 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31e8107e70 con 0x7f31e80c5350 2026-02-24T09:13:43.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.230+0000 7f31c2ffd640 1 -- 10.20.193.28:0/2527965064 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31b8005300 con 0x7f31e80c5350 2026-02-24T09:13:43.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.234+0000 7f31ed7fa640 1 -- 10.20.193.28:0/2527965064 <== mon.1 v2:10.20.193.159:3300/0 4 ==== mgrmap(e 16) ==== 52887+0+0 (secure 0 0 0) 0x7f31d4041d20 con 0x7f31e80c5350 2026-02-24T09:13:43.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.235+0000 7f31ed7fa640 1 --2- 10.20.193.28:0/2527965064 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f31c403f9c0 0x7f31c405fe70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.235+0000 7f31ed7fa640 1 -- 10.20.193.28:0/2527965064 <== mon.1 v2:10.20.193.159:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7f31d4079640 con 0x7f31e80c5350 2026-02-24T09:13:43.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.235+0000 7f31ef7fe640 1 --2- 10.20.193.28:0/2527965064 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f31c403f9c0 0x7f31c405fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.236+0000 7f31ef7fe640 1 --2- 10.20.193.28:0/2527965064 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f31c403f9c0 0x7f31c405fe70 secure :-1 s=READY pgs=36 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f31e0004740 tx=0x7f31e0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:43.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.236+0000 7f31ed7fa640 1 -- 10.20.193.28:0/2527965064 <== mon.1 v2:10.20.193.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f31d4036920 con 0x7f31e80c5350 2026-02-24T09:13:43.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.256+0000 7f513bfff640 1 -- 10.20.193.28:0/3044382323 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v29)=0 v29) ==== 129+0+0 (secure 0 0 0) 0x7f513c092890 con 0x7f514c134f70 2026-02-24T09:13:43.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.264+0000 7f51545ef640 1 -- 10.20.193.28:0/3044382323 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f512403fa80 msgr2=0x7f512405ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.264+0000 7f51545ef640 1 --2- 10.20.193.28:0/3044382323 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f512403fa80 0x7f512405ff30 secure :-1 s=READY pgs=31 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5148005820 tx=0x7f5148006d10 comp rx=0 tx=0).stop 2026-02-24T09:13:43.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.264+0000 7f51545ef640 1 -- 10.20.193.28:0/3044382323 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f514c134f70 msgr2=0x7f514c175d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.264+0000 7f51545ef640 1 --2- 10.20.193.28:0/3044382323 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f514c134f70 0x7f514c175d50 secure :-1 s=READY pgs=139 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f513c00b750 tx=0x7f513c00bc20 comp rx=0 tx=0).stop 2026-02-24T09:13:43.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.264+0000 7f51545ef640 1 -- 10.20.193.28:0/3044382323 shutdown_connections 2026-02-24T09:13:43.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.264+0000 7f51545ef640 1 --2- 10.20.193.28:0/3044382323 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f512403fa80 0x7f512405ff30 unknown :-1 s=CLOSED pgs=31 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.264+0000 7f51545ef640 1 --2- 10.20.193.28:0/3044382323 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f514c155970 0x7f514c100390 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.264+0000 7f51545ef640 1 --2- 10.20.193.28:0/3044382323 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f514c134f70 0x7f514c175d50 unknown :-1 s=CLOSED pgs=139 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.264+0000 7f51545ef640 1 --2- 10.20.193.28:0/3044382323 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f514c114650 0x7f514c155350 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.264+0000 7f51545ef640 1 -- 10.20.193.28:0/3044382323 >> 10.20.193.28:0/3044382323 conn(0x7f514c05b580 msgr2=0x7f514c0f6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:43.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.265+0000 7f51545ef640 1 -- 10.20.193.28:0/3044382323 shutdown_connections 2026-02-24T09:13:43.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.265+0000 7f51545ef640 1 -- 10.20.193.28:0/3044382323 wait complete. 2026-02-24T09:13:43.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.279+0000 7f078ee10640 1 -- 10.20.193.28:0/2316068743 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f0788174b10 con 0x7f078810b0e0 2026-02-24T09:13:43.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.282+0000 7f0785ffb640 1 -- 10.20.193.28:0/2316068743 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v30)=0 v30) ==== 125+0+0 (secure 0 0 0) 0x7f0774032070 con 0x7f078810b0e0 2026-02-24T09:13:43.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.284+0000 7fc4ead8c640 1 -- 10.20.193.28:0/3965948525 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fc4dc0070e0 con 0x7fc4dc0b8990 2026-02-24T09:13:43.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.287+0000 7fc4d2ffd640 1 -- 10.20.193.28:0/3965948525 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v30)=0 v30) ==== 106+0+0 (secure 0 0 0) 0x7fc4e002a3f0 con 0x7fc4dc0b8990 2026-02-24T09:13:43.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.289+0000 7f078ee10640 1 -- 10.20.193.28:0/2316068743 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f075c03fa20 msgr2=0x7f075c05fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.289+0000 7fc4ead8c640 1 -- 10.20.193.28:0/3965948525 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc4bc03fa20 msgr2=0x7fc4bc05fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.289+0000 7fc4ead8c640 1 --2- 10.20.193.28:0/3965948525 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc4bc03fa20 0x7fc4bc05fed0 secure :-1 s=READY pgs=32 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4d40097e0 tx=0x7fc4d402ff90 comp rx=0 tx=0).stop 2026-02-24T09:13:43.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.290+0000 7fc4ead8c640 1 -- 10.20.193.28:0/3965948525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4dc0b8990 msgr2=0x7fc4dc0a0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.290+0000 7fc4ead8c640 1 --2- 10.20.193.28:0/3965948525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4dc0b8990 0x7fc4dc0a0de0 secure :-1 s=READY pgs=141 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4e0003a00 tx=0x7fc4e0003ed0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.291+0000 7fc4ead8c640 1 -- 10.20.193.28:0/3965948525 shutdown_connections 2026-02-24T09:13:43.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.291+0000 7fc4ead8c640 1 --2- 10.20.193.28:0/3965948525 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc4bc03fa20 0x7fc4bc05fed0 unknown :-1 s=CLOSED pgs=32 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.291+0000 7fc4ead8c640 1 --2- 10.20.193.28:0/3965948525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4dc0b8990 0x7fc4dc0a0de0 unknown :-1 s=CLOSED pgs=141 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.291+0000 7fc4ead8c640 1 --2- 10.20.193.28:0/3965948525 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc4dc0b7fe0 0x7fc4dc119320 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.291+0000 7fc4ead8c640 1 --2- 10.20.193.28:0/3965948525 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc4dc0b6e50 0x7fc4dc0a0580 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.291+0000 7fc4ead8c640 1 -- 10.20.193.28:0/3965948525 >> 10.20.193.28:0/3965948525 conn(0x7fc4dc094580 msgr2=0x7fc4dc096ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:43.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.292+0000 7fc4ead8c640 1 -- 10.20.193.28:0/3965948525 shutdown_connections 2026-02-24T09:13:43.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.292+0000 7fc4ead8c640 1 -- 10.20.193.28:0/3965948525 wait complete. 2026-02-24T09:13:43.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.297+0000 7f0012d19640 1 -- 10.20.193.28:0/533240355 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f000c179b40 con 0x7f000c155460 2026-02-24T09:13:43.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.298+0000 7f0009ffb640 1 -- 10.20.193.28:0/533240355 <== mon.2 v2:10.20.193.74:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v30)=0 v30) ==== 108+0+0 (secure 0 0 0) 0x7f0000020800 con 0x7f000c155460 2026-02-24T09:13:43.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.289+0000 7f078ee10640 1 --2- 10.20.193.28:0/2316068743 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f075c03fa20 0x7f075c05fed0 secure :-1 s=READY pgs=29 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0778004740 tx=0x7f0778005f20 comp rx=0 tx=0).stop 2026-02-24T09:13:43.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.289+0000 7f078ee10640 1 -- 10.20.193.28:0/2316068743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f078810b0e0 msgr2=0x7f0788172af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.289+0000 7f078ee10640 1 --2- 10.20.193.28:0/2316068743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f078810b0e0 0x7f0788172af0 secure :-1 s=READY pgs=137 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0774005e10 tx=0x7f0774002d40 comp rx=0 tx=0).stop 2026-02-24T09:13:43.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.289+0000 7f078ee10640 1 -- 10.20.193.28:0/2316068743 shutdown_connections 2026-02-24T09:13:43.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.289+0000 7f078ee10640 1 --2- 10.20.193.28:0/2316068743 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f075c03fa20 0x7f075c05fed0 unknown :-1 s=CLOSED pgs=29 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.289+0000 7f078ee10640 1 --2- 10.20.193.28:0/2316068743 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f078810cc20 0x7f0788173350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.289+0000 7f078ee10640 1 --2- 10.20.193.28:0/2316068743 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f078810c270 0x7f078816d5b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.289+0000 7f078ee10640 1 --2- 10.20.193.28:0/2316068743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f078810b0e0 0x7f0788172af0 unknown :-1 s=CLOSED pgs=137 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.289+0000 7f078ee10640 1 -- 10.20.193.28:0/2316068743 >> 10.20.193.28:0/2316068743 conn(0x7f07880e8810 msgr2=0x7f07880e9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:43.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.290+0000 7f078ee10640 1 -- 10.20.193.28:0/2316068743 shutdown_connections 2026-02-24T09:13:43.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.290+0000 7f078ee10640 1 -- 10.20.193.28:0/2316068743 wait complete. 2026-02-24T09:13:43.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.344+0000 7f0012d19640 1 -- 10.20.193.28:0/533240355 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7effec03fa70 msgr2=0x7effec05ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.344+0000 7f0012d19640 1 --2- 10.20.193.28:0/533240355 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7effec03fa70 0x7effec05ff20 secure :-1 s=READY pgs=34 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efff8004740 tx=0x7efff8005f90 comp rx=0 tx=0).stop 2026-02-24T09:13:43.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.344+0000 7f0012d19640 1 -- 10.20.193.28:0/533240355 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f000c155460 msgr2=0x7f000c0ffbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.344+0000 7f0012d19640 1 --2- 10.20.193.28:0/533240355 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f000c155460 0x7f000c0ffbe0 secure :-1 s=READY pgs=28 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f000000f8d0 tx=0x7f000000fda0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.344+0000 7f0012d19640 1 -- 10.20.193.28:0/533240355 shutdown_connections 2026-02-24T09:13:43.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.344+0000 7f0012d19640 1 --2- 10.20.193.28:0/533240355 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7effec03fa70 0x7effec05ff20 unknown :-1 s=CLOSED pgs=34 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.344+0000 7f0012d19640 1 --2- 10.20.193.28:0/533240355 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f000c155460 0x7f000c0ffbe0 unknown :-1 s=CLOSED pgs=28 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.344+0000 7f0012d19640 1 --2- 10.20.193.28:0/533240355 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f000c1348a0 0x7f000c154cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.344+0000 7f0012d19640 1 --2- 10.20.193.28:0/533240355 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f000c113e80 0x7f000c175910 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.344+0000 7f0012d19640 1 -- 10.20.193.28:0/533240355 >> 10.20.193.28:0/533240355 conn(0x7f000c0646f0 msgr2=0x7f000c0f6460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:43.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.345+0000 7f0012d19640 1 -- 10.20.193.28:0/533240355 shutdown_connections 2026-02-24T09:13:43.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.345+0000 7f0012d19640 1 -- 10.20.193.28:0/533240355 wait complete. 2026-02-24T09:13:43.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.358+0000 7f8bf30de640 1 -- 10.20.193.28:0/828314593 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f8bec119190 con 0x7f8bec114b90 2026-02-24T09:13:43.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.359+0000 7fad13577640 1 -- 10.20.193.28:0/1992782900 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7facd8005b30 con 0x7fad141148c0 2026-02-24T09:13:43.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.363+0000 7f8bdb7fe640 1 -- 10.20.193.28:0/828314593 <== mon.2 v2:10.20.193.74:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v31)=0 v31) ==== 115+0+0 (secure 0 0 0) 0x7f8be4015070 con 0x7f8bec114b90 2026-02-24T09:13:43.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.366+0000 7facfb7fe640 1 -- 10.20.193.28:0/1992782900 <== mon.1 v2:10.20.193.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v32)=0 v32) ==== 121+0+0 (secure 0 0 0) 0x7fad0401f070 con 0x7fad141148c0 2026-02-24T09:13:43.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.367+0000 7f1936fe9640 1 -- 10.20.193.28:0/108303332 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f193010eb30 msgr2=0x7f193016f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.367+0000 7f1936fe9640 1 --2- 10.20.193.28:0/108303332 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f193010eb30 0x7f193016f4c0 secure :-1 s=READY pgs=143 gs=1 cs=0 l=1 c_cookie=1300976948861560633 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1914009950 tx=0x7f191402f1b0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.367+0000 7f1936fe9640 1 -- 10.20.193.28:0/108303332 shutdown_connections 2026-02-24T09:13:43.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.367+0000 7f1936fe9640 1 --2- 10.20.193.28:0/108303332 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f193010eb30 0x7f193016f4c0 unknown :-1 s=CLOSED pgs=143 gs=1 cs=0 l=1 c_cookie=1300976948861560633 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.367+0000 7f1936fe9640 1 --2- 10.20.193.28:0/108303332 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f193010e180 0x7f193010e5f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.367+0000 7f1936fe9640 1 --2- 10.20.193.28:0/108303332 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f193010cff0 0x7f193010d3e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.367+0000 7f1936fe9640 1 -- 10.20.193.28:0/108303332 >> 10.20.193.28:0/108303332 conn(0x7f19300ea760 msgr2=0x7f193010ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:43.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.368+0000 7f1936fe9640 1 -- 10.20.193.28:0/108303332 shutdown_connections 2026-02-24T09:13:43.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.368+0000 7f1936fe9640 1 -- 10.20.193.28:0/108303332 wait complete. 2026-02-24T09:13:43.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.369+0000 7f1936fe9640 1 Processor -- start 2026-02-24T09:13:43.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.369+0000 7f1936fe9640 1 -- start start 2026-02-24T09:13:43.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.369+0000 7f1936fe9640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f193010cff0 0x7f19300f31d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.369+0000 7f1936fe9640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f193010e180 0x7f19300f3820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.369+0000 7f1936fe9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f193010eb30 0x7f19300f4420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.369+0000 7f1936fe9640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f19300f4b60 con 0x7f193010eb30 2026-02-24T09:13:43.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.369+0000 7f1936fe9640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f19300f4cd0 con 0x7f193010e180 2026-02-24T09:13:43.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.369+0000 7f1936fe9640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f19300f4e90 con 0x7f193010cff0 2026-02-24T09:13:43.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.369+0000 7f192ffff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f193010e180 0x7f19300f3820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.369+0000 7f192ffff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f193010e180 0x7f19300f3820 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:57104/0 (socket says 10.20.193.28:57104) 2026-02-24T09:13:43.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.369+0000 7f192ffff640 1 -- 10.20.193.28:0/3252583954 learned_addr learned my addr 10.20.193.28:0/3252583954 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:13:43.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.369+0000 7f1934d5e640 1 --2- 10.20.193.28:0/3252583954 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f193010cff0 0x7f19300f31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.370+0000 7f192ffff640 1 -- 10.20.193.28:0/3252583954 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f193010cff0 msgr2=0x7f19300f31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.370+0000 7f192ffff640 1 --2- 10.20.193.28:0/3252583954 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f193010cff0 0x7f19300f31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.370+0000 7f192ffff640 1 -- 10.20.193.28:0/3252583954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f193010eb30 msgr2=0x7f19300f4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.370+0000 7f192ffff640 1 --2- 10.20.193.28:0/3252583954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f193010eb30 0x7f19300f4420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.370+0000 7f192ffff640 1 -- 10.20.193.28:0/3252583954 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1914009570 con 0x7f193010e180 2026-02-24T09:13:43.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.370+0000 7f192ffff640 1 --2- 10.20.193.28:0/3252583954 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f193010e180 0x7f19300f3820 secure :-1 s=READY pgs=29 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f191c005db0 tx=0x7f191c00ddf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:43.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.370+0000 7f192dffb640 1 -- 10.20.193.28:0/3252583954 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f191c004500 con 0x7f193010e180 2026-02-24T09:13:43.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.370+0000 7f1936fe9640 1 -- 10.20.193.28:0/3252583954 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19300f5170 con 0x7f193010e180 2026-02-24T09:13:43.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.370+0000 7f1936fe9640 1 -- 10.20.193.28:0/3252583954 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19300f56e0 con 0x7f193010e180 2026-02-24T09:13:43.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.370+0000 7f192dffb640 1 -- 10.20.193.28:0/3252583954 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f191c004d10 con 0x7f193010e180 2026-02-24T09:13:43.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.373+0000 7f8bf30de640 1 -- 10.20.193.28:0/828314593 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8bc003fa70 msgr2=0x7f8bc005ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.373+0000 7f8bf30de640 1 --2- 10.20.193.28:0/828314593 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8bc003fa70 0x7f8bc005ff20 secure :-1 s=READY pgs=24 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8be002f6c0 tx=0x7f8be0005dd0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.373+0000 7f8bf30de640 1 -- 10.20.193.28:0/828314593 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8bec114b90 msgr2=0x7f8bec1b5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.373+0000 7f8bf30de640 1 --2- 10.20.193.28:0/828314593 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8bec114b90 0x7f8bec1b5330 secure :-1 s=READY pgs=19 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8be4006e90 tx=0x7f8be400edf0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.373+0000 7fad13577640 1 -- 10.20.193.28:0/1992782900 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7facf003faa0 msgr2=0x7facf005ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.373+0000 7fad13577640 1 --2- 10.20.193.28:0/1992782900 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7facf003faa0 0x7facf005ff50 secure :-1 s=READY pgs=35 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7facfc005c70 tx=0x7facfc005f90 comp rx=0 tx=0).stop 2026-02-24T09:13:43.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.373+0000 7fad13577640 1 -- 10.20.193.28:0/1992782900 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fad141148c0 msgr2=0x7fad14106d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.373+0000 7fad13577640 1 --2- 10.20.193.28:0/1992782900 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fad141148c0 0x7fad14106d20 secure :-1 s=READY pgs=21 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fad0400e950 tx=0x7fad0400ee20 comp rx=0 tx=0).stop 2026-02-24T09:13:43.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.374+0000 7f8bf30de640 1 -- 10.20.193.28:0/828314593 shutdown_connections 2026-02-24T09:13:43.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.373+0000 7fad13577640 1 -- 10.20.193.28:0/1992782900 shutdown_connections 2026-02-24T09:13:43.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.374+0000 7f8bf30de640 1 --2- 10.20.193.28:0/828314593 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8bc003fa70 0x7f8bc005ff20 unknown :-1 s=CLOSED pgs=24 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.374+0000 7f8bf30de640 1 --2- 10.20.193.28:0/828314593 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8bec115540 0x7f8bec1b5f30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.374+0000 7f8bf30de640 1 --2- 10.20.193.28:0/828314593 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8bec114b90 0x7f8bec1b5330 unknown :-1 s=CLOSED pgs=19 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.374+0000 7f8bf30de640 1 --2- 10.20.193.28:0/828314593 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bec05e430 0x7f8bec1b4ce0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.374+0000 7f8bf30de640 1 -- 10.20.193.28:0/828314593 >> 10.20.193.28:0/828314593 conn(0x7f8bec05b480 msgr2=0x7f8bec05c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:43.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.373+0000 7fad13577640 1 --2- 10.20.193.28:0/1992782900 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7facf003faa0 0x7facf005ff50 unknown :-1 s=CLOSED pgs=35 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.373+0000 7fad13577640 1 --2- 10.20.193.28:0/1992782900 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fad14115270 0x7fad14107920 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.374+0000 7f8bf30de640 1 -- 10.20.193.28:0/828314593 shutdown_connections 2026-02-24T09:13:43.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.374+0000 7f8bf30de640 1 -- 10.20.193.28:0/828314593 wait complete. 2026-02-24T09:13:43.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.373+0000 7fad13577640 1 --2- 10.20.193.28:0/1992782900 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fad141148c0 0x7fad14106d20 unknown :-1 s=CLOSED pgs=21 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.373+0000 7fad13577640 1 --2- 10.20.193.28:0/1992782900 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad1405de60 0x7fad141066d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.373+0000 7fad13577640 1 -- 10.20.193.28:0/1992782900 >> 10.20.193.28:0/1992782900 conn(0x7fad1405b8e0 msgr2=0x7fad1405ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:43.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.370+0000 7f192dffb640 1 -- 10.20.193.28:0/3252583954 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f191c004500 con 0x7f193010e180 2026-02-24T09:13:43.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.371+0000 7f192dffb640 1 -- 10.20.193.28:0/3252583954 <== mon.2 v2:10.20.193.74:3300/0 4 ==== mgrmap(e 16) ==== 52887+0+0 (secure 0 0 0) 0x7f191c005000 con 0x7f193010e180 2026-02-24T09:13:43.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.372+0000 7f1936fe9640 1 -- 10.20.193.28:0/3252583954 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1900016710 con 0x7f193010e180 2026-02-24T09:13:43.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.372+0000 7f192dffb640 1 --2- 10.20.193.28:0/3252583954 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f191003faa0 0x7f191005ff50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.372+0000 7f192dffb640 1 -- 10.20.193.28:0/3252583954 <== mon.2 v2:10.20.193.74:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7f191c0541b0 con 0x7f193010e180 2026-02-24T09:13:43.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.372+0000 7f1934d5e640 1 --2- 10.20.193.28:0/3252583954 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f191003faa0 0x7f191005ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.374+0000 7fad13577640 1 -- 10.20.193.28:0/1992782900 shutdown_connections 2026-02-24T09:13:43.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.375+0000 7f192dffb640 1 -- 10.20.193.28:0/3252583954 <== mon.2 v2:10.20.193.74:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f191c021350 con 0x7f193010e180 2026-02-24T09:13:43.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.375+0000 7fad13577640 1 -- 10.20.193.28:0/1992782900 wait complete. 2026-02-24T09:13:43.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.389+0000 7f1934d5e640 1 --2- 10.20.193.28:0/3252583954 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f191003faa0 0x7f191005ff50 secure :-1 s=READY pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1924006fd0 tx=0x7f1924006eb0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:43.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.453+0000 7fe37981f640 1 -- 10.20.193.28:0/1592858026 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3741149a0 msgr2=0x7fe374114e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.453+0000 7fe37981f640 1 --2- 10.20.193.28:0/1592858026 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3741149a0 0x7fe374114e10 secure :-1 s=READY pgs=144 gs=1 cs=0 l=1 c_cookie=1321628159334047565 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe368009950 tx=0x7fe36802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.454+0000 7fe37981f640 1 -- 10.20.193.28:0/1592858026 shutdown_connections 2026-02-24T09:13:43.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.454+0000 7fe37981f640 1 --2- 10.20.193.28:0/1592858026 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fe374115350 0x7fe374175cc0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.454+0000 7fe37981f640 1 --2- 10.20.193.28:0/1592858026 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3741149a0 0x7fe374114e10 unknown :-1 s=CLOSED pgs=144 gs=1 cs=0 l=1 c_cookie=1321628159334047565 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.454+0000 7fe37981f640 1 --2- 10.20.193.28:0/1592858026 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe374113870 0x7fe374113c60 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.454+0000 7fe37981f640 1 -- 10.20.193.28:0/1592858026 >> 10.20.193.28:0/1592858026 conn(0x7fe374064770 msgr2=0x7fe374064b70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:43.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.454+0000 7fe37981f640 1 -- 10.20.193.28:0/1592858026 shutdown_connections 2026-02-24T09:13:43.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.454+0000 7fe37981f640 1 -- 10.20.193.28:0/1592858026 wait complete. 2026-02-24T09:13:43.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.472+0000 7fe37981f640 1 Processor -- start 2026-02-24T09:13:43.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.472+0000 7fe37981f640 1 -- start start 2026-02-24T09:13:43.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.473+0000 7fe37981f640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe374113870 0x7fe3740fedc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.473+0000 7fe37981f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3741149a0 0x7fe374175cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.473+0000 7fe37981f640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fe374115350 0x7fe3740ff620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.474+0000 7fe37981f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe374100210 con 0x7fe3741149a0 2026-02-24T09:13:43.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.474+0000 7fe37981f640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fe374100380 con 0x7fe374115350 2026-02-24T09:13:43.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.474+0000 7fe37981f640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe374100540 con 0x7fe374113870 2026-02-24T09:13:43.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.475+0000 7fe3737fe640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fe374115350 0x7fe3740ff620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.475+0000 7fe372ffd640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe374113870 0x7fe3740fedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.475+0000 7fe3727fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3741149a0 0x7fe374175cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.475+0000 7fe3727fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3741149a0 0x7fe374175cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56674/0 (socket says 10.20.193.28:56674) 2026-02-24T09:13:43.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.475+0000 7fe3727fc640 1 -- 10.20.193.28:0/1363686631 learned_addr learned my addr 10.20.193.28:0/1363686631 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:13:43.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.475+0000 7fe3737fe640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fe374115350 0x7fe3740ff620 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:57134/0 (socket says 10.20.193.28:57134) 2026-02-24T09:13:43.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.476+0000 7fe3727fc640 1 -- 10.20.193.28:0/1363686631 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe374113870 msgr2=0x7fe3740fedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.476+0000 7fe3727fc640 1 --2- 10.20.193.28:0/1363686631 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe374113870 0x7fe3740fedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.476+0000 7fe3727fc640 1 -- 10.20.193.28:0/1363686631 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fe374115350 msgr2=0x7fe3740ff620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.476+0000 7fe3727fc640 1 --2- 10.20.193.28:0/1363686631 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fe374115350 0x7fe3740ff620 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.476+0000 7fe3727fc640 1 -- 10.20.193.28:0/1363686631 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe368009570 con 0x7fe3741149a0 2026-02-24T09:13:43.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.477+0000 7fe372ffd640 1 --2- 10.20.193.28:0/1363686631 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe374113870 0x7fe3740fedc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:13:43.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.477+0000 7fe3727fc640 1 --2- 10.20.193.28:0/1363686631 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3741149a0 0x7fe374175cc0 secure :-1 s=READY pgs=145 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe368005970 tx=0x7fe36802fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:43.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.478+0000 7fe37881d640 1 -- 10.20.193.28:0/1363686631 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe368004a10 con 0x7fe3741149a0 2026-02-24T09:13:43.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.478+0000 7fe37881d640 1 -- 10.20.193.28:0/1363686631 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fe3680054f0 con 0x7fe3741149a0 2026-02-24T09:13:43.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.478+0000 7fe37981f640 1 -- 10.20.193.28:0/1363686631 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3741007c0 con 0x7fe3741149a0 2026-02-24T09:13:43.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.484+0000 7fe37881d640 1 -- 10.20.193.28:0/1363686631 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe368038780 con 0x7fe3741149a0 2026-02-24T09:13:43.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.482+0000 7f1995a24640 1 -- 10.20.193.28:0/3853325027 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f19901348a0 msgr2=0x7f1990154d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.482+0000 7f1995a24640 1 --2- 10.20.193.28:0/3853325027 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f19901348a0 0x7f1990154d20 secure :-1 s=READY pgs=30 gs=3 cs=0 l=1 c_cookie=77462929082511964 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1978009950 tx=0x7f197802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.482+0000 7f1995a24640 1 -- 10.20.193.28:0/3853325027 shutdown_connections 2026-02-24T09:13:43.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.482+0000 7f1995a24640 1 --2- 10.20.193.28:0/3853325027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1990155460 0x7f1990175910 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.483+0000 7f1995a24640 1 --2- 10.20.193.28:0/3853325027 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f19901348a0 0x7f1990154d20 unknown :-1 s=CLOSED pgs=30 gs=3 cs=0 l=1 c_cookie=77462929082511964 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.483+0000 7f1995a24640 1 --2- 10.20.193.28:0/3853325027 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1990113e80 0x7f1990134260 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.483+0000 7f1995a24640 1 -- 10.20.193.28:0/3853325027 >> 10.20.193.28:0/3853325027 conn(0x7f1990064700 msgr2=0x7f1990064b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:43.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.483+0000 7f1995a24640 1 -- 10.20.193.28:0/3853325027 shutdown_connections 2026-02-24T09:13:43.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.485+0000 7fe37981f640 1 -- 10.20.193.28:0/1363686631 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe374100bd0 con 0x7fe3741149a0 2026-02-24T09:13:43.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.486+0000 7fe37881d640 1 -- 10.20.193.28:0/1363686631 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 52887+0+0 (secure 0 0 0) 0x7fe36803f030 con 0x7fe3741149a0 2026-02-24T09:13:43.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.487+0000 7fe37881d640 1 --2- 10.20.193.28:0/1363686631 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe35803faa0 0x7fe35805ff50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.487+0000 7fe37881d640 1 -- 10.20.193.28:0/1363686631 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7fe368078db0 con 0x7fe3741149a0 2026-02-24T09:13:43.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.486+0000 7f1995a24640 1 -- 10.20.193.28:0/3853325027 wait complete. 2026-02-24T09:13:43.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.489+0000 7fe372ffd640 1 --2- 10.20.193.28:0/1363686631 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe35803faa0 0x7fe35805ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.491+0000 7fe372ffd640 1 --2- 10.20.193.28:0/1363686631 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe35803faa0 0x7fe35805ff50 secure :-1 s=READY pgs=38 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe35c004760 tx=0x7fe35c009190 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:43.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.492+0000 7f11458e7640 1 -- 10.20.193.28:0/2690012231 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f1104005b30 con 0x7f1140114b90 2026-02-24T09:13:43.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.490+0000 7f1995a24640 1 Processor -- start 2026-02-24T09:13:43.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.493+0000 7fe37981f640 1 -- 10.20.193.28:0/1363686631 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe374100eb0 con 0x7fe3741149a0 2026-02-24T09:13:43.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.494+0000 7f1995a24640 1 -- start start 2026-02-24T09:13:43.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.495+0000 7f1995a24640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1990113e80 0x7f19901758b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.495+0000 7f1995a24640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f19901348a0 0x7f1990154cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.495+0000 7f1995a24640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1990155460 0x7f1990108a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.495+0000 7f1995a24640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1990109200 con 0x7f1990113e80 2026-02-24T09:13:43.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.495+0000 7f1995a24640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f1990109370 con 0x7f19901348a0 2026-02-24T09:13:43.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.495+0000 7f1995a24640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1990109530 con 0x7f1990155460 2026-02-24T09:13:43.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.495+0000 7f198effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1990113e80 0x7f19901758b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.495+0000 7f198effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1990113e80 0x7f19901758b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56680/0 (socket says 10.20.193.28:56680) 2026-02-24T09:13:43.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.495+0000 7f198effd640 1 -- 10.20.193.28:0/1061831474 learned_addr learned my addr 10.20.193.28:0/1061831474 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:13:43.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.496+0000 7f198e7fc640 1 --2- 10.20.193.28:0/1061831474 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f19901348a0 0x7f1990154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.496+0000 7f198f7fe640 1 --2- 10.20.193.28:0/1061831474 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1990155460 0x7f1990108a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.496+0000 7f198effd640 1 -- 10.20.193.28:0/1061831474 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1990155460 msgr2=0x7f1990108a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.496+0000 7f198effd640 1 --2- 10.20.193.28:0/1061831474 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1990155460 0x7f1990108a70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.496+0000 7f198effd640 1 -- 10.20.193.28:0/1061831474 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f19901348a0 msgr2=0x7f1990154cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.496+0000 7f198effd640 1 --2- 10.20.193.28:0/1061831474 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f19901348a0 0x7f1990154cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.496+0000 7f198effd640 1 -- 10.20.193.28:0/1061831474 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1978009570 con 0x7f1990113e80 2026-02-24T09:13:43.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.497+0000 7f198effd640 1 --2- 10.20.193.28:0/1061831474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1990113e80 0x7f19901758b0 secure :-1 s=READY pgs=146 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f198400e9c0 tx=0x7f198400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:43.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.499+0000 7f1994a22640 1 -- 10.20.193.28:0/1061831474 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f198400ccb0 con 0x7f1990113e80 2026-02-24T09:13:43.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.499+0000 7f1994a22640 1 -- 10.20.193.28:0/1061831474 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f198400ce10 con 0x7f1990113e80 2026-02-24T09:13:43.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.499+0000 7f1994a22640 1 -- 10.20.193.28:0/1061831474 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19840106b0 con 0x7f1990113e80 2026-02-24T09:13:43.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.500+0000 7f1995a24640 1 -- 10.20.193.28:0/1061831474 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1990109810 con 0x7f1990113e80 2026-02-24T09:13:43.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.500+0000 7f1995a24640 1 -- 10.20.193.28:0/1061831474 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1990109d10 con 0x7f1990113e80 2026-02-24T09:13:43.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.501+0000 7f11448e5640 1 -- 10.20.193.28:0/2690012231 <== mon.2 v2:10.20.193.74:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v33)=0 v33) ==== 121+0+0 (secure 0 0 0) 0x7f1134046020 con 0x7f1140114b90 2026-02-24T09:13:43.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.501+0000 7fe37881d640 1 -- 10.20.193.28:0/1363686631 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fe36803d030 con 0x7fe3741149a0 2026-02-24T09:13:43.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.502+0000 7f1994a22640 1 -- 10.20.193.28:0/1061831474 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 52887+0+0 (secure 0 0 0) 0x7f1984004080 con 0x7f1990113e80 2026-02-24T09:13:43.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.503+0000 7f1994a22640 1 --2- 10.20.193.28:0/1061831474 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f196003fa70 0x7f196005ff20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:43.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.503+0000 7f198e7fc640 1 --2- 10.20.193.28:0/1061831474 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f196003fa70 0x7f196005ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:43.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.504+0000 7f1994a22640 1 -- 10.20.193.28:0/1061831474 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7f1984014070 con 0x7f1990113e80 2026-02-24T09:13:43.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.505+0000 7f198e7fc640 1 --2- 10.20.193.28:0/1061831474 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f196003fa70 0x7f196005ff20 secure :-1 s=READY pgs=39 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19780098a0 tx=0x7f197803a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:43.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.507+0000 7f11458e7640 1 -- 10.20.193.28:0/2690012231 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f111403fa20 msgr2=0x7f111405fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.507+0000 7f11458e7640 1 --2- 10.20.193.28:0/2690012231 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f111403fa20 0x7f111405fed0 secure :-1 s=READY pgs=27 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f112800b2c0 tx=0x7f112800b4a0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.507+0000 7f11458e7640 1 -- 10.20.193.28:0/2690012231 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f1140114b90 msgr2=0x7f11401b53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.507+0000 7f11458e7640 1 --2- 10.20.193.28:0/2690012231 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f1140114b90 0x7f11401b53d0 secure :-1 s=READY pgs=22 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1134009230 tx=0x7f11340042f0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.508+0000 7f11458e7640 1 -- 10.20.193.28:0/2690012231 shutdown_connections 2026-02-24T09:13:43.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.508+0000 7f11458e7640 1 --2- 10.20.193.28:0/2690012231 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f111403fa20 0x7f111405fed0 unknown :-1 s=CLOSED pgs=27 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.508+0000 7f11458e7640 1 --2- 10.20.193.28:0/2690012231 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1140115540 0x7f11401b5fd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.508+0000 7f11458e7640 1 --2- 10.20.193.28:0/2690012231 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f1140114b90 0x7f11401b53d0 unknown :-1 s=CLOSED pgs=22 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.508+0000 7f11458e7640 1 --2- 10.20.193.28:0/2690012231 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f114005e510 0x7f11401b4d80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.508+0000 7f11458e7640 1 -- 10.20.193.28:0/2690012231 >> 10.20.193.28:0/2690012231 conn(0x7f114005b580 msgr2=0x7f11401ab5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:43.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.508+0000 7f1995a24640 1 -- 10.20.193.28:0/1061831474 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f199005f470 con 0x7f1990113e80 2026-02-24T09:13:43.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.511+0000 7f1994a22640 1 -- 10.20.193.28:0/1061831474 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f1984017790 con 0x7f1990113e80 2026-02-24T09:13:43.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.508+0000 7f11458e7640 1 -- 10.20.193.28:0/2690012231 shutdown_connections 2026-02-24T09:13:43.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.508+0000 7f11458e7640 1 -- 10.20.193.28:0/2690012231 wait complete. 2026-02-24T09:13:43.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.523+0000 7f1936fe9640 1 -- 10.20.193.28:0/3252583954 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f18f40051c0 con 0x7f193010e180 2026-02-24T09:13:43.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.534+0000 7f192dffb640 1 -- 10.20.193.28:0/3252583954 <== mon.2 v2:10.20.193.74:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v35)=0 v35) ==== 121+0+0 (secure 0 0 0) 0x7f191c0183b0 con 0x7f193010e180 2026-02-24T09:13:43.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.523+0000 7f757f03c640 1 -- 10.20.193.28:0/255151551 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f7540005b30 con 0x7f757810bea0 2026-02-24T09:13:43.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.544+0000 7f756dffb640 1 -- 10.20.193.28:0/255151551 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v34)=0 v34) ==== 120+0+0 (secure 0 0 0) 0x7f756804a400 con 0x7f757810bea0 2026-02-24T09:13:43.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.544+0000 7f1936fe9640 1 -- 10.20.193.28:0/3252583954 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f191003faa0 msgr2=0x7f191005ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.544+0000 7f1936fe9640 1 --2- 10.20.193.28:0/3252583954 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f191003faa0 0x7f191005ff50 secure :-1 s=READY pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1924006fd0 tx=0x7f1924006eb0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.544+0000 7f1936fe9640 1 -- 10.20.193.28:0/3252583954 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f193010e180 msgr2=0x7f19300f3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.544+0000 7f1936fe9640 1 --2- 10.20.193.28:0/3252583954 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f193010e180 0x7f19300f3820 secure :-1 s=READY pgs=29 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f191c005db0 tx=0x7f191c00ddf0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.547+0000 7f1936fe9640 1 -- 10.20.193.28:0/3252583954 shutdown_connections 2026-02-24T09:13:43.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.547+0000 7f1936fe9640 1 --2- 10.20.193.28:0/3252583954 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f191003faa0 0x7f191005ff50 unknown :-1 s=CLOSED pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.547+0000 7f1936fe9640 1 --2- 10.20.193.28:0/3252583954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f193010eb30 0x7f19300f4420 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.547+0000 7f1936fe9640 1 --2- 10.20.193.28:0/3252583954 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f193010e180 0x7f19300f3820 unknown :-1 s=CLOSED pgs=29 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.547+0000 7f1936fe9640 1 --2- 10.20.193.28:0/3252583954 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f193010cff0 0x7f19300f31d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.547+0000 7f1936fe9640 1 -- 10.20.193.28:0/3252583954 >> 10.20.193.28:0/3252583954 conn(0x7f19300ea760 msgr2=0x7f1930061660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:43.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.547+0000 7f1936fe9640 1 -- 10.20.193.28:0/3252583954 shutdown_connections 2026-02-24T09:13:43.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.547+0000 7f1936fe9640 1 -- 10.20.193.28:0/3252583954 wait complete. 2026-02-24T09:13:43.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.555+0000 7f757f03c640 1 -- 10.20.193.28:0/255151551 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f755403f9f0 msgr2=0x7f755405fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.555+0000 7f757f03c640 1 --2- 10.20.193.28:0/255151551 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f755403f9f0 0x7f755405fea0 secure :-1 s=READY pgs=33 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7560004740 tx=0x7f7560005ab0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.555+0000 7f757f03c640 1 -- 10.20.193.28:0/255151551 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f757810bea0 msgr2=0x7f75780f51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.555+0000 7f757f03c640 1 --2- 10.20.193.28:0/255151551 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f757810bea0 0x7f75780f51d0 secure :-1 s=READY pgs=140 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7568032040 tx=0x7f756802fcd0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.555+0000 7f757f03c640 1 -- 10.20.193.28:0/255151551 shutdown_connections 2026-02-24T09:13:43.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.555+0000 7f757f03c640 1 --2- 10.20.193.28:0/255151551 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f755403f9f0 0x7f755405fea0 unknown :-1 s=CLOSED pgs=33 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.555+0000 7f757f03c640 1 --2- 10.20.193.28:0/255151551 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f757810ca00 0x7f75780f5dd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.555+0000 7f757f03c640 1 --2- 10.20.193.28:0/255151551 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f757810bea0 0x7f75780f51d0 unknown :-1 s=CLOSED pgs=140 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.555+0000 7f757f03c640 1 --2- 10.20.193.28:0/255151551 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7578060920 0x7f75780f4b80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.555+0000 7f757f03c640 1 -- 10.20.193.28:0/255151551 >> 10.20.193.28:0/255151551 conn(0x7f75780e95a0 msgr2=0x7f75780eac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:43.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.560+0000 7f757f03c640 1 -- 10.20.193.28:0/255151551 shutdown_connections 2026-02-24T09:13:43.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.560+0000 7f757f03c640 1 -- 10.20.193.28:0/255151551 wait complete. 2026-02-24T09:13:43.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.570+0000 7f31c2ffd640 1 -- 10.20.193.28:0/2527965064 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f31b8005b30 con 0x7f31e80c5350 2026-02-24T09:13:43.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.570+0000 7f31ed7fa640 1 -- 10.20.193.28:0/2527965064 <== mon.1 v2:10.20.193.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v36)=0 v36) ==== 111+0+0 (secure 0 0 0) 0x7f31d4036b20 con 0x7f31e80c5350 2026-02-24T09:13:43.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.586+0000 7f31c2ffd640 1 -- 10.20.193.28:0/2527965064 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f31c403f9c0 msgr2=0x7f31c405fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.586+0000 7f31c2ffd640 1 --2- 10.20.193.28:0/2527965064 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f31c403f9c0 0x7f31c405fe70 secure :-1 s=READY pgs=36 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f31e0004740 tx=0x7f31e0005f90 comp rx=0 tx=0).stop 2026-02-24T09:13:43.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.586+0000 7f31c2ffd640 1 -- 10.20.193.28:0/2527965064 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f31e80c5350 msgr2=0x7f31e8106680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.586+0000 7f31c2ffd640 1 --2- 10.20.193.28:0/2527965064 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f31e80c5350 0x7f31e8106680 secure :-1 s=READY pgs=22 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f31d40092e0 tx=0x7f31d402fc20 comp rx=0 tx=0).stop 2026-02-24T09:13:43.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.586+0000 7f31c2ffd640 1 -- 10.20.193.28:0/2527965064 shutdown_connections 2026-02-24T09:13:43.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.586+0000 7f31c2ffd640 1 --2- 10.20.193.28:0/2527965064 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f31c403f9c0 0x7f31c405fe70 unknown :-1 s=CLOSED pgs=36 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.586+0000 7f31c2ffd640 1 --2- 10.20.193.28:0/2527965064 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f31e80c5d00 0x7f31e8106d10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.586+0000 7f31c2ffd640 1 --2- 10.20.193.28:0/2527965064 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f31e80c5350 0x7f31e8106680 unknown :-1 s=CLOSED pgs=22 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.586+0000 7f31c2ffd640 1 --2- 10.20.193.28:0/2527965064 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f31e80c41c0 0x7f31e81363e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.586+0000 7f31c2ffd640 1 -- 10.20.193.28:0/2527965064 >> 10.20.193.28:0/2527965064 conn(0x7f31e80a1630 msgr2=0x7f31e80c1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:43.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.586+0000 7f31c2ffd640 1 -- 10.20.193.28:0/2527965064 shutdown_connections 2026-02-24T09:13:43.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.586+0000 7f31c2ffd640 1 -- 10.20.193.28:0/2527965064 wait complete. 2026-02-24T09:13:43.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.653+0000 7f1995a24640 1 -- 10.20.193.28:0/1061831474 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f1990179c30 con 0x7f1990113e80 2026-02-24T09:13:43.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.665+0000 7f1994a22640 1 -- 10.20.193.28:0/1061831474 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v37)=0 v37) ==== 120+0+0 (secure 0 0 0) 0x7f1984017790 con 0x7f1990113e80 2026-02-24T09:13:43.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.668+0000 7f1995a24640 1 -- 10.20.193.28:0/1061831474 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f196003fa70 msgr2=0x7f196005ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.668+0000 7f1995a24640 1 --2- 10.20.193.28:0/1061831474 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f196003fa70 0x7f196005ff20 secure :-1 s=READY pgs=39 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19780098a0 tx=0x7f197803a040 comp rx=0 tx=0).stop 2026-02-24T09:13:43.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.668+0000 7f1995a24640 1 -- 10.20.193.28:0/1061831474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1990113e80 msgr2=0x7f19901758b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.668+0000 7f1995a24640 1 --2- 10.20.193.28:0/1061831474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1990113e80 0x7f19901758b0 secure :-1 s=READY pgs=146 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f198400e9c0 tx=0x7f198400ee90 comp rx=0 tx=0).stop 2026-02-24T09:13:43.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.668+0000 7f1995a24640 1 -- 10.20.193.28:0/1061831474 shutdown_connections 2026-02-24T09:13:43.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.668+0000 7f1995a24640 1 --2- 10.20.193.28:0/1061831474 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f196003fa70 0x7f196005ff20 unknown :-1 s=CLOSED pgs=39 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.668+0000 7f1995a24640 1 --2- 10.20.193.28:0/1061831474 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1990155460 0x7f1990108a70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.668+0000 7f1995a24640 1 --2- 10.20.193.28:0/1061831474 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f19901348a0 0x7f1990154cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.668+0000 7f1995a24640 1 --2- 10.20.193.28:0/1061831474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1990113e80 0x7f19901758b0 unknown :-1 s=CLOSED pgs=146 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.668+0000 7f1995a24640 1 -- 10.20.193.28:0/1061831474 >> 10.20.193.28:0/1061831474 conn(0x7f1990064700 msgr2=0x7f19900f6400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:43.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.668+0000 7f1995a24640 1 -- 10.20.193.28:0/1061831474 shutdown_connections 2026-02-24T09:13:43.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.669+0000 7f1995a24640 1 -- 10.20.193.28:0/1061831474 wait complete. 2026-02-24T09:13:43.677 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:43 trial028 ceph-mon[40371]: Updating trial028:/etc/ceph/ceph.conf 2026-02-24T09:13:43.678 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:43 trial028 ceph-mon[40371]: Updating trial074:/etc/ceph/ceph.conf 2026-02-24T09:13:43.678 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:43 trial028 ceph-mon[40371]: Updating trial159:/etc/ceph/ceph.conf 2026-02-24T09:13:43.678 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:43 trial028 ceph-mon[40371]: Updating trial074:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config/ceph.conf 2026-02-24T09:13:43.678 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:43 trial028 ceph-mon[40371]: Updating trial159:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config/ceph.conf 2026-02-24T09:13:43.678 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:43 trial028 ceph-mon[40371]: from='client.? ' entity='client.admin' 2026-02-24T09:13:43.678 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:43 trial028 ceph-mon[40371]: from='client.? ' entity='client.admin' 2026-02-24T09:13:43.678 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:43 trial028 ceph-mon[40371]: from='client.? ' entity='client.admin' 2026-02-24T09:13:43.678 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:43 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/791197676' entity='client.admin' 2026-02-24T09:13:43.679 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:43 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/108000611' entity='client.admin' 2026-02-24T09:13:43.679 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:43 trial028 ceph-mon[40371]: from='client.? ' entity='client.admin' 2026-02-24T09:13:43.679 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:43 trial028 ceph-mon[40371]: from='client.? ' entity='client.admin' 2026-02-24T09:13:43.679 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:43 trial028 ceph-mon[40371]: from='client.? ' entity='client.admin' 2026-02-24T09:13:43.679 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:43 trial028 ceph-mon[40371]: from='client.? ' entity='client.admin' 2026-02-24T09:13:43.679 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:43 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/3044382323' entity='client.admin' 2026-02-24T09:13:43.679 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:43 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/2316068743' entity='client.admin' 2026-02-24T09:13:43.679 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:43 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:43.679 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:43 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:43.679 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:43 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:43.680 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:43 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:43.680 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:43 trial028 ceph-mon[40371]: from='client.? ' entity='client.admin' 2026-02-24T09:13:43.680 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:43 trial028 ceph-mon[40371]: from='client.? ' entity='client.admin' 2026-02-24T09:13:43.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.695+0000 7fe37981f640 1 -- 10.20.193.28:0/1363686631 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7fe37405f600 con 0x7fe3741149a0 2026-02-24T09:13:43.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.695+0000 7fe37881d640 1 -- 10.20.193.28:0/1363686631 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v38)=0 v38) ==== 133+0+0 (secure 0 0 0) 0x7fe368041790 con 0x7fe3741149a0 2026-02-24T09:13:43.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.708+0000 7fe37981f640 1 -- 10.20.193.28:0/1363686631 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe35803faa0 msgr2=0x7fe35805ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.708+0000 7fe37981f640 1 --2- 10.20.193.28:0/1363686631 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe35803faa0 0x7fe35805ff50 secure :-1 s=READY pgs=38 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe35c004760 tx=0x7fe35c009190 comp rx=0 tx=0).stop 2026-02-24T09:13:43.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.708+0000 7fe37981f640 1 -- 10.20.193.28:0/1363686631 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3741149a0 msgr2=0x7fe374175cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:43.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.708+0000 7fe37981f640 1 --2- 10.20.193.28:0/1363686631 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3741149a0 0x7fe374175cc0 secure :-1 s=READY pgs=145 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe368005970 tx=0x7fe36802fce0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.708+0000 7fe37981f640 1 -- 10.20.193.28:0/1363686631 shutdown_connections 2026-02-24T09:13:43.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.708+0000 7fe37981f640 1 --2- 10.20.193.28:0/1363686631 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe35803faa0 0x7fe35805ff50 unknown :-1 s=CLOSED pgs=38 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.708+0000 7fe37981f640 1 --2- 10.20.193.28:0/1363686631 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fe374115350 0x7fe3740ff620 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.708+0000 7fe37981f640 1 --2- 10.20.193.28:0/1363686631 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3741149a0 0x7fe374175cc0 unknown :-1 s=CLOSED pgs=145 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.708+0000 7fe37981f640 1 --2- 10.20.193.28:0/1363686631 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe374113870 0x7fe3740fedc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:43.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.708+0000 7fe37981f640 1 -- 10.20.193.28:0/1363686631 >> 10.20.193.28:0/1363686631 conn(0x7fe374064770 msgr2=0x7fe3740f4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:43.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.708+0000 7fe37981f640 1 -- 10.20.193.28:0/1363686631 shutdown_connections 2026-02-24T09:13:43.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:43.708+0000 7fe37981f640 1 -- 10.20.193.28:0/1363686631 wait complete. 2026-02-24T09:13:43.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:43 trial159 ceph-mon[44242]: Updating trial028:/etc/ceph/ceph.conf 2026-02-24T09:13:43.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:43 trial159 ceph-mon[44242]: Updating trial074:/etc/ceph/ceph.conf 2026-02-24T09:13:43.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:43 trial159 ceph-mon[44242]: Updating trial159:/etc/ceph/ceph.conf 2026-02-24T09:13:43.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:43 trial159 ceph-mon[44242]: Updating trial074:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config/ceph.conf 2026-02-24T09:13:43.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:43 trial159 ceph-mon[44242]: Updating trial159:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config/ceph.conf 2026-02-24T09:13:43.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:43 trial159 ceph-mon[44242]: from='client.? ' entity='client.admin' 2026-02-24T09:13:43.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:43 trial159 ceph-mon[44242]: from='client.? ' entity='client.admin' 2026-02-24T09:13:43.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:43 trial159 ceph-mon[44242]: from='client.? ' entity='client.admin' 2026-02-24T09:13:43.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:43 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/791197676' entity='client.admin' 2026-02-24T09:13:43.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:43 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/108000611' entity='client.admin' 2026-02-24T09:13:43.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:43 trial159 ceph-mon[44242]: from='client.? ' entity='client.admin' 2026-02-24T09:13:43.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:43 trial159 ceph-mon[44242]: from='client.? ' entity='client.admin' 2026-02-24T09:13:43.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:43 trial159 ceph-mon[44242]: from='client.? ' entity='client.admin' 2026-02-24T09:13:43.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:43 trial159 ceph-mon[44242]: from='client.? ' entity='client.admin' 2026-02-24T09:13:43.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:43 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/3044382323' entity='client.admin' 2026-02-24T09:13:43.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:43 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/2316068743' entity='client.admin' 2026-02-24T09:13:43.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:43 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:43.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:43 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:43.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:43 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:43.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:43 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:43.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:43 trial159 ceph-mon[44242]: from='client.? ' entity='client.admin' 2026-02-24T09:13:43.782 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:43 trial159 ceph-mon[44242]: from='client.? ' entity='client.admin' 2026-02-24T09:13:43.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:43 trial074 ceph-mon[44412]: Updating trial028:/etc/ceph/ceph.conf 2026-02-24T09:13:43.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:43 trial074 ceph-mon[44412]: Updating trial074:/etc/ceph/ceph.conf 2026-02-24T09:13:43.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:43 trial074 ceph-mon[44412]: Updating trial159:/etc/ceph/ceph.conf 2026-02-24T09:13:43.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:43 trial074 ceph-mon[44412]: Updating trial074:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config/ceph.conf 2026-02-24T09:13:43.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:43 trial074 ceph-mon[44412]: Updating trial159:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config/ceph.conf 2026-02-24T09:13:43.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:43 trial074 ceph-mon[44412]: from='client.? ' entity='client.admin' 2026-02-24T09:13:43.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:43 trial074 ceph-mon[44412]: from='client.? ' entity='client.admin' 2026-02-24T09:13:43.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:43 trial074 ceph-mon[44412]: from='client.? ' entity='client.admin' 2026-02-24T09:13:43.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:43 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/791197676' entity='client.admin' 2026-02-24T09:13:43.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:43 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/108000611' entity='client.admin' 2026-02-24T09:13:43.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:43 trial074 ceph-mon[44412]: from='client.? ' entity='client.admin' 2026-02-24T09:13:43.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:43 trial074 ceph-mon[44412]: from='client.? ' entity='client.admin' 2026-02-24T09:13:43.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:43 trial074 ceph-mon[44412]: from='client.? ' entity='client.admin' 2026-02-24T09:13:43.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:43 trial074 ceph-mon[44412]: from='client.? ' entity='client.admin' 2026-02-24T09:13:43.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:43 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/3044382323' entity='client.admin' 2026-02-24T09:13:43.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:43 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/2316068743' entity='client.admin' 2026-02-24T09:13:43.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:43 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:43.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:43 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:43.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:43 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:43.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:43 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:43.876 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:43 trial074 ceph-mon[44412]: from='client.? ' entity='client.admin' 2026-02-24T09:13:43.876 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:43 trial074 ceph-mon[44412]: from='client.? ' entity='client.admin' 2026-02-24T09:13:43.907 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e9ad50af-1160-11f1-800e-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='trial028') 2026-02-24T09:13:43.907 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e9ad50af-1160-11f1-800e-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='trial028') 2026-02-24T09:13:43.907 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e9ad50af-1160-11f1-800e-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_use_global_snaprealm_seq_for_subvol', 'False'], check_status=True, hostname='trial028') 2026-02-24T09:13:43.907 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e9ad50af-1160-11f1-800e-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='trial028') 2026-02-24T09:13:43.907 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e9ad50af-1160-11f1-800e-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='trial028') 2026-02-24T09:13:44.112 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e9ad50af-1160-11f1-800e-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='trial028') 2026-02-24T09:13:44.112 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e9ad50af-1160-11f1-800e-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='trial028') 2026-02-24T09:13:44.112 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e9ad50af-1160-11f1-800e-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='trial028') 2026-02-24T09:13:44.112 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e9ad50af-1160-11f1-800e-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='trial028') 2026-02-24T09:13:44.112 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e9ad50af-1160-11f1-800e-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='trial028') 2026-02-24T09:13:44.112 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e9ad50af-1160-11f1-800e-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='trial028') 2026-02-24T09:13:44.112 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e9ad50af-1160-11f1-800e-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='trial028') 2026-02-24T09:13:44.112 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e9ad50af-1160-11f1-800e-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='trial028') 2026-02-24T09:13:44.112 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e9ad50af-1160-11f1-800e-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='trial028') 2026-02-24T09:13:44.112 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e9ad50af-1160-11f1-800e-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/log_level', 'debug'], check_status=True, hostname='trial028') 2026-02-24T09:13:44.112 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e9ad50af-1160-11f1-800e-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='trial028') 2026-02-24T09:13:44.112 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e9ad50af-1160-11f1-800e-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='trial028') 2026-02-24T09:13:44.112 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e9ad50af-1160-11f1-800e-d404e6e7d460', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='trial028') 2026-02-24T09:13:44.112 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config dump 2026-02-24T09:13:44.337 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:44.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.503+0000 7f5ead75e640 1 -- 10.20.193.28:0/1814398411 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ea8111540 msgr2=0x7f5ea81119e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:44.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.503+0000 7f5ead75e640 1 --2- 10.20.193.28:0/1814398411 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ea8111540 0x7f5ea81119e0 secure :-1 s=READY pgs=147 gs=1 cs=0 l=1 c_cookie=11066626187929211917 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e9800aa60 tx=0x7f5e980302b0 comp rx=0 tx=0).stop 2026-02-24T09:13:44.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.503+0000 7f5ead75e640 1 -- 10.20.193.28:0/1814398411 shutdown_connections 2026-02-24T09:13:44.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.503+0000 7f5ead75e640 1 --2- 10.20.193.28:0/1814398411 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ea8111540 0x7f5ea81119e0 unknown :-1 s=CLOSED pgs=147 gs=1 cs=0 l=1 c_cookie=11066626187929211917 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:44.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.503+0000 7f5ead75e640 1 --2- 10.20.193.28:0/1814398411 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5ea810c950 0x7f5ea8110f20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:44.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.503+0000 7f5ead75e640 1 --2- 10.20.193.28:0/1814398411 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5ea810bf60 0x7f5ea810c330 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:44.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.503+0000 7f5ead75e640 1 -- 10.20.193.28:0/1814398411 >> 10.20.193.28:0/1814398411 conn(0x7f5ea80e9bf0 msgr2=0x7f5ea810a000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:44.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.503+0000 7f5ead75e640 1 -- 10.20.193.28:0/1814398411 shutdown_connections 2026-02-24T09:13:44.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.503+0000 7f5ead75e640 1 -- 10.20.193.28:0/1814398411 wait complete. 2026-02-24T09:13:44.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.503+0000 7f5ead75e640 1 Processor -- start 2026-02-24T09:13:44.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.504+0000 7f5ead75e640 1 -- start start 2026-02-24T09:13:44.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.504+0000 7f5ead75e640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5ea810bf60 0x7f5ea81228a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:44.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.504+0000 7f5ead75e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ea810c950 0x7f5ea8122de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:44.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.504+0000 7f5ead75e640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5ea8111540 0x7f5ea81281b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:44.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.504+0000 7f5ead75e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea8128740 con 0x7f5ea810c950 2026-02-24T09:13:44.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.504+0000 7f5ead75e640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea81288b0 con 0x7f5ea810bf60 2026-02-24T09:13:44.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.504+0000 7f5ead75e640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea8128a70 con 0x7f5ea8111540 2026-02-24T09:13:44.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.504+0000 7f5ea67fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ea810c950 0x7f5ea8122de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:44.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.504+0000 7f5ea67fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ea810c950 0x7f5ea8122de0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56704/0 (socket says 10.20.193.28:56704) 2026-02-24T09:13:44.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.504+0000 7f5ea67fc640 1 -- 10.20.193.28:0/763080000 learned_addr learned my addr 10.20.193.28:0/763080000 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:13:44.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.504+0000 7f5ea67fc640 1 -- 10.20.193.28:0/763080000 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5ea8111540 msgr2=0x7f5ea81281b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:44.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.504+0000 7f5ea67fc640 1 --2- 10.20.193.28:0/763080000 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5ea8111540 0x7f5ea81281b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:44.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.504+0000 7f5ea67fc640 1 -- 10.20.193.28:0/763080000 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5ea810bf60 msgr2=0x7f5ea81228a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:44.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.504+0000 7f5ea67fc640 1 --2- 10.20.193.28:0/763080000 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5ea810bf60 0x7f5ea81228a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:44.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.504+0000 7f5ea67fc640 1 -- 10.20.193.28:0/763080000 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e9800a650 con 0x7f5ea810c950 2026-02-24T09:13:44.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.505+0000 7f5ea67fc640 1 --2- 10.20.193.28:0/763080000 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ea810c950 0x7f5ea8122de0 secure :-1 s=READY pgs=148 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e9000c9b0 tx=0x7f5e9000ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:44.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.505+0000 7f5e87fff640 1 -- 10.20.193.28:0/763080000 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e900044a0 con 0x7f5ea810c950 2026-02-24T09:13:44.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.505+0000 7f5e87fff640 1 -- 10.20.193.28:0/763080000 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f5e90007d80 con 0x7f5ea810c950 2026-02-24T09:13:44.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.505+0000 7f5e87fff640 1 -- 10.20.193.28:0/763080000 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e9000f6d0 con 0x7f5ea810c950 2026-02-24T09:13:44.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.505+0000 7f5ead75e640 1 -- 10.20.193.28:0/763080000 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ea8128d50 con 0x7f5ea810c950 2026-02-24T09:13:44.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.505+0000 7f5ead75e640 1 -- 10.20.193.28:0/763080000 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ea8169340 con 0x7f5ea810c950 2026-02-24T09:13:44.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.506+0000 7f5ead75e640 1 -- 10.20.193.28:0/763080000 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e6c005300 con 0x7f5ea810c950 2026-02-24T09:13:44.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.506+0000 7f5e87fff640 1 -- 10.20.193.28:0/763080000 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 52887+0+0 (secure 0 0 0) 0x7f5e900078c0 con 0x7f5ea810c950 2026-02-24T09:13:44.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.506+0000 7f5e87fff640 1 --2- 10.20.193.28:0/763080000 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5e7c03fa20 0x7f5e7c05fed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:44.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.506+0000 7f5e87fff640 1 -- 10.20.193.28:0/763080000 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7f5e90054170 con 0x7f5ea810c950 2026-02-24T09:13:44.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.507+0000 7f5ea6ffd640 1 --2- 10.20.193.28:0/763080000 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5e7c03fa20 0x7f5e7c05fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:44.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.507+0000 7f5ea6ffd640 1 --2- 10.20.193.28:0/763080000 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5e7c03fa20 0x7f5e7c05fed0 secure :-1 s=READY pgs=40 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e9c004740 tx=0x7f5e9c005d20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:44.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.509+0000 7f5e87fff640 1 -- 10.20.193.28:0/763080000 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f5e90018450 con 0x7f5ea810c950 2026-02-24T09:13:44.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.624+0000 7f5ead75e640 1 -- 10.20.193.28:0/763080000 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f5e6c005b30 con 0x7f5ea810c950 2026-02-24T09:13:44.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.625+0000 7f5e87fff640 1 -- 10.20.193.28:0/763080000 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v38) ==== 59+0+19936 (secure 0 0 0) 0x7f5e9000d340 con 0x7f5ea810c950 2026-02-24T09:13:44.626 INFO:teuthology.orchestra.run.trial028.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-24T09:13:44.626 INFO:teuthology.orchestra.run.trial028.stdout:global dev auth_debug true 2026-02-24T09:13:44.626 INFO:teuthology.orchestra.run.trial028.stdout:global basic container_image quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b * 2026-02-24T09:13:44.626 INFO:teuthology.orchestra.run.trial028.stdout:global dev debug_asserts_on_shutdown true 2026-02-24T09:13:44.626 INFO:teuthology.orchestra.run.trial028.stdout:global basic log_to_file true 2026-02-24T09:13:44.626 INFO:teuthology.orchestra.run.trial028.stdout:global basic log_to_journald false 2026-02-24T09:13:44.626 INFO:teuthology.orchestra.run.trial028.stdout:global basic log_to_stderr false 2026-02-24T09:13:44.626 INFO:teuthology.orchestra.run.trial028.stdout:global advanced mon_allow_pool_delete true 2026-02-24T09:13:44.626 INFO:teuthology.orchestra.run.trial028.stdout:global advanced mon_clock_drift_allowed 1.000000 2026-02-24T09:13:44.626 INFO:teuthology.orchestra.run.trial028.stdout:global advanced mon_cluster_log_to_file true 2026-02-24T09:13:44.626 INFO:teuthology.orchestra.run.trial028.stdout:global advanced mon_max_pg_per_osd 10000 2026-02-24T09:13:44.626 INFO:teuthology.orchestra.run.trial028.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2026-02-24T09:13:44.626 INFO:teuthology.orchestra.run.trial028.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2026-02-24T09:13:44.626 INFO:teuthology.orchestra.run.trial028.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2026-02-24T09:13:44.626 INFO:teuthology.orchestra.run.trial028.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2026-02-24T09:13:44.626 INFO:teuthology.orchestra.run.trial028.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2026-02-24T09:13:44.626 INFO:teuthology.orchestra.run.trial028.stdout:global advanced mon_warn_on_too_few_osds false 2026-02-24T09:13:44.626 INFO:teuthology.orchestra.run.trial028.stdout:global dev ms_die_on_bug true 2026-02-24T09:13:44.626 INFO:teuthology.orchestra.run.trial028.stdout:global dev ms_die_on_old_message true 2026-02-24T09:13:44.627 INFO:teuthology.orchestra.run.trial028.stdout:global advanced osd_pool_default_erasure_code_profile plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-24T09:13:44.627 INFO:teuthology.orchestra.run.trial028.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2026-02-24T09:13:44.627 INFO:teuthology.orchestra.run.trial028.stdout:global advanced public_network 10.20.192.0/20 * 2026-02-24T09:13:44.627 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2026-02-24T09:13:44.627 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2026-02-24T09:13:44.627 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced auth_service_ticket_ttl 240.000000 2026-02-24T09:13:44.627 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced debug_mon 20/20 2026-02-24T09:13:44.627 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced debug_ms 1/1 2026-02-24T09:13:44.627 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced debug_paxos 20/20 2026-02-24T09:13:44.627 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced mon_data_avail_warn 5 2026-02-24T09:13:44.627 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced mon_down_mkfs_grace 300 2026-02-24T09:13:44.627 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced mon_mgr_mkfs_grace 240 2026-02-24T09:13:44.627 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced mon_op_complaint_time 120 2026-02-24T09:13:44.627 INFO:teuthology.orchestra.run.trial028.stdout:mon dev mon_osd_prime_pg_temp true 2026-02-24T09:13:44.627 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced mon_osd_reporter_subtree_level osd 2026-02-24T09:13:44.627 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2026-02-24T09:13:44.627 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2026-02-24T09:13:44.627 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2026-02-24T09:13:44.627 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2026-02-24T09:13:44.627 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2026-02-24T09:13:44.627 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced client_mount_timeout 30 2026-02-24T09:13:44.627 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced debug_cephsqlite 20/20 2026-02-24T09:13:44.627 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced debug_client 20/20 2026-02-24T09:13:44.627 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced debug_mgr 20/20 2026-02-24T09:13:44.628 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced debug_ms 1/1 2026-02-24T09:13:44.628 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2026-02-24T09:13:44.628 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced mgr/cephadm/container_init True * 2026-02-24T09:13:44.628 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced mgr/cephadm/migration_current 8 * 2026-02-24T09:13:44.628 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2026-02-24T09:13:44.628 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2026-02-24T09:13:44.628 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced mgr/snap_schedule/allow_m_granularity true 2026-02-24T09:13:44.628 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced mgr/snap_schedule/dump_on_update true 2026-02-24T09:13:44.628 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced mgr/snap_schedule/log_level debug 2026-02-24T09:13:44.628 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2026-02-24T09:13:44.628 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2026-02-24T09:13:44.628 INFO:teuthology.orchestra.run.trial028.stdout:mgr dev mon_warn_on_pool_no_app false 2026-02-24T09:13:44.628 INFO:teuthology.orchestra.run.trial028.stdout:osd dev bdev_debug_aio true 2026-02-24T09:13:44.628 INFO:teuthology.orchestra.run.trial028.stdout:osd dev bluestore_block_size 96636764160 * 2026-02-24T09:13:44.629 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced bluestore_compression_mode aggressive 2026-02-24T09:13:44.629 INFO:teuthology.orchestra.run.trial028.stdout:osd dev bluestore_fsck_on_mount true 2026-02-24T09:13:44.629 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced debug_bluefs 20/20 2026-02-24T09:13:44.629 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced debug_bluestore 20/20 2026-02-24T09:13:44.629 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced debug_ms 1/1 2026-02-24T09:13:44.629 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced debug_osd 20/20 2026-02-24T09:13:44.629 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced debug_rocksdb 10/10 2026-02-24T09:13:44.629 INFO:teuthology.orchestra.run.trial028.stdout:osd dev osd_debug_misdirected_ops true 2026-02-24T09:13:44.629 INFO:teuthology.orchestra.run.trial028.stdout:osd dev osd_debug_op_order true 2026-02-24T09:13:44.629 INFO:teuthology.orchestra.run.trial028.stdout:osd dev osd_debug_pg_log_writeout true 2026-02-24T09:13:44.629 INFO:teuthology.orchestra.run.trial028.stdout:osd dev osd_debug_shutdown true 2026-02-24T09:13:44.629 INFO:teuthology.orchestra.run.trial028.stdout:osd dev osd_debug_verify_cached_snaps true 2026-02-24T09:13:44.629 INFO:teuthology.orchestra.run.trial028.stdout:osd dev osd_debug_verify_missing_on_start true 2026-02-24T09:13:44.629 INFO:teuthology.orchestra.run.trial028.stdout:osd dev osd_debug_verify_stray_on_activate true 2026-02-24T09:13:44.629 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2026-02-24T09:13:44.629 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2026-02-24T09:13:44.629 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_max_omap_entries_per_request 10 2026-02-24T09:13:44.629 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_mclock_profile high_recovery_ops 2026-02-24T09:13:44.629 INFO:teuthology.orchestra.run.trial028.stdout:osd dev osd_mclock_skip_benchmark true 2026-02-24T09:13:44.629 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_memory_target_autotune true 2026-02-24T09:13:44.629 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_objectstore bluestore * 2026-02-24T09:13:44.629 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_op_complaint_time 180.000000 2026-02-24T09:13:44.629 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_op_queue debug_random * 2026-02-24T09:13:44.629 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_op_queue_cut_off debug_random * 2026-02-24T09:13:44.629 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_recover_clone_overlap true 2026-02-24T09:13:44.630 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_recovery_max_chunk 1048576 2026-02-24T09:13:44.630 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_scrub_load_threshold 5.000000 2026-02-24T09:13:44.630 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_scrub_max_interval 600.000000 2026-02-24T09:13:44.630 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_shutdown_pgref_assert true 2026-02-24T09:13:44.630 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced debug_mds 20/20 2026-02-24T09:13:44.630 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced debug_mds_balancer 20/20 2026-02-24T09:13:44.630 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced debug_ms 2/2 2026-02-24T09:13:44.630 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced mds_bal_fragment_size_max 10000 2026-02-24T09:13:44.630 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced mds_bal_merge_size 5 2026-02-24T09:13:44.630 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced mds_bal_replicate_threshold 1.000000 2026-02-24T09:13:44.630 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced mds_bal_split_bits 3 2026-02-24T09:13:44.630 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced mds_bal_split_size 100 2026-02-24T09:13:44.630 INFO:teuthology.orchestra.run.trial028.stdout:mds dev mds_debug_frag true 2026-02-24T09:13:44.630 INFO:teuthology.orchestra.run.trial028.stdout:mds dev mds_debug_scatterstat true 2026-02-24T09:13:44.630 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced mds_export_ephemeral_random_max 0.200000 2026-02-24T09:13:44.630 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced mds_op_complaint_time 180.000000 2026-02-24T09:13:44.630 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced mds_use_global_snaprealm_seq_for_subvol false 2026-02-24T09:13:44.630 INFO:teuthology.orchestra.run.trial028.stdout:mds dev mds_verify_scatter true 2026-02-24T09:13:44.630 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced osd_op_complaint_time 180.000000 2026-02-24T09:13:44.630 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced rados_mon_op_timeout 900 2026-02-24T09:13:44.630 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced rados_osd_op_timeout 900 2026-02-24T09:13:44.630 INFO:teuthology.orchestra.run.trial028.stdout:client dev client_fscrypt_dummy_encryption true 2026-02-24T09:13:44.630 INFO:teuthology.orchestra.run.trial028.stdout:client advanced client_mount_timeout 600 2026-02-24T09:13:44.630 INFO:teuthology.orchestra.run.trial028.stdout:client advanced debug_client 20/20 2026-02-24T09:13:44.630 INFO:teuthology.orchestra.run.trial028.stdout:client advanced debug_ms 1/1 2026-02-24T09:13:44.631 INFO:teuthology.orchestra.run.trial028.stdout:client advanced rados_mon_op_timeout 900 2026-02-24T09:13:44.631 INFO:teuthology.orchestra.run.trial028.stdout:client advanced rados_osd_op_timeout 900 2026-02-24T09:13:44.631 INFO:teuthology.orchestra.run.trial028.stdout:client.rgw advanced rgw_cache_enabled true 2026-02-24T09:13:44.631 INFO:teuthology.orchestra.run.trial028.stdout:client.rgw advanced rgw_enable_ops_log true 2026-02-24T09:13:44.631 INFO:teuthology.orchestra.run.trial028.stdout:client.rgw advanced rgw_enable_usage_log true 2026-02-24T09:13:44.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.626+0000 7f5ead75e640 1 -- 10.20.193.28:0/763080000 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5e7c03fa20 msgr2=0x7f5e7c05fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:44.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.626+0000 7f5ead75e640 1 --2- 10.20.193.28:0/763080000 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5e7c03fa20 0x7f5e7c05fed0 secure :-1 s=READY pgs=40 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e9c004740 tx=0x7f5e9c005d20 comp rx=0 tx=0).stop 2026-02-24T09:13:44.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.626+0000 7f5ead75e640 1 -- 10.20.193.28:0/763080000 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ea810c950 msgr2=0x7f5ea8122de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:44.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.626+0000 7f5ead75e640 1 --2- 10.20.193.28:0/763080000 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ea810c950 0x7f5ea8122de0 secure :-1 s=READY pgs=148 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e9000c9b0 tx=0x7f5e9000ce80 comp rx=0 tx=0).stop 2026-02-24T09:13:44.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.626+0000 7f5ead75e640 1 -- 10.20.193.28:0/763080000 shutdown_connections 2026-02-24T09:13:44.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.626+0000 7f5ead75e640 1 --2- 10.20.193.28:0/763080000 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5e7c03fa20 0x7f5e7c05fed0 unknown :-1 s=CLOSED pgs=40 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:44.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.626+0000 7f5ead75e640 1 --2- 10.20.193.28:0/763080000 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5ea8111540 0x7f5ea81281b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:44.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.626+0000 7f5ead75e640 1 --2- 10.20.193.28:0/763080000 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ea810c950 0x7f5ea8122de0 unknown :-1 s=CLOSED pgs=148 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:44.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.626+0000 7f5ead75e640 1 --2- 10.20.193.28:0/763080000 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5ea810bf60 0x7f5ea81228a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:44.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.626+0000 7f5ead75e640 1 -- 10.20.193.28:0/763080000 >> 10.20.193.28:0/763080000 conn(0x7f5ea80e9bf0 msgr2=0x7f5ea8109fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:44.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.628+0000 7f5ead75e640 1 -- 10.20.193.28:0/763080000 shutdown_connections 2026-02-24T09:13:44.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:44.628+0000 7f5ead75e640 1 -- 10.20.193.28:0/763080000 wait complete. 2026-02-24T09:13:44.681 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:44 trial159 ceph-mon[44242]: Updating trial159:/etc/ceph/ceph.client.admin.keyring 2026-02-24T09:13:44.681 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:44 trial159 ceph-mon[44242]: Updating trial074:/etc/ceph/ceph.client.admin.keyring 2026-02-24T09:13:44.681 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:44 trial159 ceph-mon[44242]: Updating trial028:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config/ceph.conf 2026-02-24T09:13:44.681 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:44 trial159 ceph-mon[44242]: Updating trial159:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-24T09:13:44.681 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:44 trial159 ceph-mon[44242]: Updating trial074:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-24T09:13:44.681 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:44 trial159 ceph-mon[44242]: Updating trial028:/etc/ceph/ceph.client.admin.keyring 2026-02-24T09:13:44.681 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:44 trial159 ceph-mon[44242]: from='client.? ' entity='client.admin' 2026-02-24T09:13:44.681 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:44 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/255151551' entity='client.admin' 2026-02-24T09:13:44.682 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:44 trial159 ceph-mon[44242]: from='client.? ' entity='client.admin' 2026-02-24T09:13:44.682 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:44 trial159 ceph-mon[44242]: from='client.? ' entity='client.admin' 2026-02-24T09:13:44.682 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:44 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/1061831474' entity='client.admin' 2026-02-24T09:13:44.682 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:44 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/1363686631' entity='client.admin' 2026-02-24T09:13:44.682 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:44 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:44.682 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:44 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:44.682 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:44 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:44.682 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:44 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-24T09:13:44.682 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:44 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-24T09:13:44.682 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:44 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-24T09:13:44.682 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:44 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:44.726 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:44 trial028 ceph-mon[40371]: Updating trial159:/etc/ceph/ceph.client.admin.keyring 2026-02-24T09:13:44.726 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:44 trial028 ceph-mon[40371]: Updating trial074:/etc/ceph/ceph.client.admin.keyring 2026-02-24T09:13:44.726 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:44 trial028 ceph-mon[40371]: Updating trial028:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config/ceph.conf 2026-02-24T09:13:44.726 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:44 trial028 ceph-mon[40371]: Updating trial159:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-24T09:13:44.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:44 trial028 ceph-mon[40371]: Updating trial074:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-24T09:13:44.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:44 trial028 ceph-mon[40371]: Updating trial028:/etc/ceph/ceph.client.admin.keyring 2026-02-24T09:13:44.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:44 trial028 ceph-mon[40371]: from='client.? ' entity='client.admin' 2026-02-24T09:13:44.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:44 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/255151551' entity='client.admin' 2026-02-24T09:13:44.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:44 trial028 ceph-mon[40371]: from='client.? ' entity='client.admin' 2026-02-24T09:13:44.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:44 trial028 ceph-mon[40371]: from='client.? ' entity='client.admin' 2026-02-24T09:13:44.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:44 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/1061831474' entity='client.admin' 2026-02-24T09:13:44.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:44 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/1363686631' entity='client.admin' 2026-02-24T09:13:44.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:44 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:44.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:44 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:44.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:44 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:44.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:44 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-24T09:13:44.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:44 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-24T09:13:44.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:44 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-24T09:13:44.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:44 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:44.728 INFO:tasks.cephadm:Deploying OSDs... 2026-02-24T09:13:44.728 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-24T09:13:44.728 DEBUG:teuthology.orchestra.run.trial028:> dd if=/scratch_devs of=/dev/stdout 2026-02-24T09:13:44.767 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-24T09:13:44.767 DEBUG:teuthology.orchestra.run.trial028:> stat /dev/vg_nvme/lv_1 2026-02-24T09:13:44.844 INFO:teuthology.orchestra.run.trial028.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-24T09:13:44.844 INFO:teuthology.orchestra.run.trial028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T09:13:44.844 INFO:teuthology.orchestra.run.trial028.stdout:Device: 6h/6d Inode: 1093 Links: 1 2026-02-24T09:13:44.844 INFO:teuthology.orchestra.run.trial028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T09:13:44.844 INFO:teuthology.orchestra.run.trial028.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T09:13:44.844 INFO:teuthology.orchestra.run.trial028.stdout:Access: 2026-02-24 09:13:05.749963990 +0000 2026-02-24T09:13:44.844 INFO:teuthology.orchestra.run.trial028.stdout:Modify: 2026-02-24 09:11:48.151442896 +0000 2026-02-24T09:13:44.844 INFO:teuthology.orchestra.run.trial028.stdout:Change: 2026-02-24 09:11:48.151442896 +0000 2026-02-24T09:13:44.844 INFO:teuthology.orchestra.run.trial028.stdout: Birth: 2026-02-24 09:11:48.151442896 +0000 2026-02-24T09:13:44.845 DEBUG:teuthology.orchestra.run.trial028:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-24T09:13:44.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:44 trial074 ceph-mon[44412]: Updating trial159:/etc/ceph/ceph.client.admin.keyring 2026-02-24T09:13:44.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:44 trial074 ceph-mon[44412]: Updating trial074:/etc/ceph/ceph.client.admin.keyring 2026-02-24T09:13:44.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:44 trial074 ceph-mon[44412]: Updating trial028:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config/ceph.conf 2026-02-24T09:13:44.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:44 trial074 ceph-mon[44412]: Updating trial159:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-24T09:13:44.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:44 trial074 ceph-mon[44412]: Updating trial074:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-24T09:13:44.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:44 trial074 ceph-mon[44412]: Updating trial028:/etc/ceph/ceph.client.admin.keyring 2026-02-24T09:13:44.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:44 trial074 ceph-mon[44412]: from='client.? ' entity='client.admin' 2026-02-24T09:13:44.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:44 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/255151551' entity='client.admin' 2026-02-24T09:13:44.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:44 trial074 ceph-mon[44412]: from='client.? ' entity='client.admin' 2026-02-24T09:13:44.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:44 trial074 ceph-mon[44412]: from='client.? ' entity='client.admin' 2026-02-24T09:13:44.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:44 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/1061831474' entity='client.admin' 2026-02-24T09:13:44.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:44 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/1363686631' entity='client.admin' 2026-02-24T09:13:44.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:44 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:44.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:44 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:44.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:44 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:44.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:44 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-24T09:13:44.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:44 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-24T09:13:44.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:44 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-24T09:13:44.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:44 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:44.937 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records in 2026-02-24T09:13:44.937 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records out 2026-02-24T09:13:44.937 INFO:teuthology.orchestra.run.trial028.stderr:512 bytes copied, 0.000229827 s, 2.2 MB/s 2026-02-24T09:13:44.939 DEBUG:teuthology.orchestra.run.trial028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-24T09:13:44.977 DEBUG:teuthology.orchestra.run.trial028:> stat /dev/vg_nvme/lv_2 2026-02-24T09:13:45.029 INFO:journalctl@ceph.mgr.z.trial159.stdout:Feb 24 09:13:44 trial159 systemd[1]: Starting Ceph mgr.z for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:13:45.054 INFO:teuthology.orchestra.run.trial028.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-24T09:13:45.054 INFO:teuthology.orchestra.run.trial028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T09:13:45.054 INFO:teuthology.orchestra.run.trial028.stdout:Device: 6h/6d Inode: 1073 Links: 1 2026-02-24T09:13:45.055 INFO:teuthology.orchestra.run.trial028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T09:13:45.055 INFO:teuthology.orchestra.run.trial028.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T09:13:45.055 INFO:teuthology.orchestra.run.trial028.stdout:Access: 2026-02-24 09:13:05.786963304 +0000 2026-02-24T09:13:45.055 INFO:teuthology.orchestra.run.trial028.stdout:Modify: 2026-02-24 09:11:48.147122951 +0000 2026-02-24T09:13:45.055 INFO:teuthology.orchestra.run.trial028.stdout:Change: 2026-02-24 09:11:48.147122951 +0000 2026-02-24T09:13:45.055 INFO:teuthology.orchestra.run.trial028.stdout: Birth: 2026-02-24 09:11:48.147122951 +0000 2026-02-24T09:13:45.055 DEBUG:teuthology.orchestra.run.trial028:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-24T09:13:45.146 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records in 2026-02-24T09:13:45.146 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records out 2026-02-24T09:13:45.146 INFO:teuthology.orchestra.run.trial028.stderr:512 bytes copied, 0.000199371 s, 2.6 MB/s 2026-02-24T09:13:45.148 DEBUG:teuthology.orchestra.run.trial028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-24T09:13:45.187 DEBUG:teuthology.orchestra.run.trial028:> stat /dev/vg_nvme/lv_3 2026-02-24T09:13:45.265 INFO:teuthology.orchestra.run.trial028.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-24T09:13:45.265 INFO:teuthology.orchestra.run.trial028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T09:13:45.265 INFO:teuthology.orchestra.run.trial028.stdout:Device: 6h/6d Inode: 1079 Links: 1 2026-02-24T09:13:45.265 INFO:teuthology.orchestra.run.trial028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T09:13:45.265 INFO:teuthology.orchestra.run.trial028.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T09:13:45.265 INFO:teuthology.orchestra.run.trial028.stdout:Access: 2026-02-24 09:13:05.821962654 +0000 2026-02-24T09:13:45.265 INFO:teuthology.orchestra.run.trial028.stdout:Modify: 2026-02-24 09:11:48.148791657 +0000 2026-02-24T09:13:45.265 INFO:teuthology.orchestra.run.trial028.stdout:Change: 2026-02-24 09:11:48.148791657 +0000 2026-02-24T09:13:45.265 INFO:teuthology.orchestra.run.trial028.stdout: Birth: 2026-02-24 09:11:48.148791657 +0000 2026-02-24T09:13:45.265 DEBUG:teuthology.orchestra.run.trial028:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-24T09:13:45.359 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records in 2026-02-24T09:13:45.359 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records out 2026-02-24T09:13:45.359 INFO:teuthology.orchestra.run.trial028.stderr:512 bytes copied, 0.000297533 s, 1.7 MB/s 2026-02-24T09:13:45.361 DEBUG:teuthology.orchestra.run.trial028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-24T09:13:45.402 DEBUG:teuthology.orchestra.run.trial028:> stat /dev/vg_nvme/lv_4 2026-02-24T09:13:45.480 INFO:teuthology.orchestra.run.trial028.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-24T09:13:45.481 INFO:teuthology.orchestra.run.trial028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T09:13:45.481 INFO:teuthology.orchestra.run.trial028.stdout:Device: 6h/6d Inode: 1099 Links: 1 2026-02-24T09:13:45.481 INFO:teuthology.orchestra.run.trial028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T09:13:45.481 INFO:teuthology.orchestra.run.trial028.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T09:13:45.481 INFO:teuthology.orchestra.run.trial028.stdout:Access: 2026-02-24 09:13:05.855962024 +0000 2026-02-24T09:13:45.481 INFO:teuthology.orchestra.run.trial028.stdout:Modify: 2026-02-24 09:11:48.152617461 +0000 2026-02-24T09:13:45.481 INFO:teuthology.orchestra.run.trial028.stdout:Change: 2026-02-24 09:11:48.152617461 +0000 2026-02-24T09:13:45.481 INFO:teuthology.orchestra.run.trial028.stdout: Birth: 2026-02-24 09:11:48.152617461 +0000 2026-02-24T09:13:45.482 DEBUG:teuthology.orchestra.run.trial028:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-24T09:13:45.498 INFO:journalctl@ceph.mgr.z.trial159.stdout:Feb 24 09:13:45 trial159 podman[46427]: 2026-02-24 09:13:45.103250476 +0000 UTC m=+0.027757489 container create be3c8d53ef6cf7182b582a44a8de4433ad39f102d0fa7061fa8b926a48a9047b (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, CEPH_REF=wip-vshankar-testing-20260223.155722, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS) 2026-02-24T09:13:45.498 INFO:journalctl@ceph.mgr.z.trial159.stdout:Feb 24 09:13:45 trial159 podman[46427]: 2026-02-24 09:13:45.139075549 +0000 UTC m=+0.063582572 container init be3c8d53ef6cf7182b582a44a8de4433ad39f102d0fa7061fa8b926a48a9047b (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-z, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260223, CEPH_REF=wip-vshankar-testing-20260223.155722) 2026-02-24T09:13:45.498 INFO:journalctl@ceph.mgr.z.trial159.stdout:Feb 24 09:13:45 trial159 podman[46427]: 2026-02-24 09:13:45.144465741 +0000 UTC m=+0.068972764 container start be3c8d53ef6cf7182b582a44a8de4433ad39f102d0fa7061fa8b926a48a9047b (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-z, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260223, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b) 2026-02-24T09:13:45.498 INFO:journalctl@ceph.mgr.z.trial159.stdout:Feb 24 09:13:45 trial159 bash[46427]: be3c8d53ef6cf7182b582a44a8de4433ad39f102d0fa7061fa8b926a48a9047b 2026-02-24T09:13:45.498 INFO:journalctl@ceph.mgr.z.trial159.stdout:Feb 24 09:13:45 trial159 podman[46427]: 2026-02-24 09:13:45.093476332 +0000 UTC m=+0.017983365 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b 2026-02-24T09:13:45.498 INFO:journalctl@ceph.mgr.z.trial159.stdout:Feb 24 09:13:45 trial159 systemd[1]: Started Ceph mgr.z for e9ad50af-1160-11f1-800e-d404e6e7d460. 2026-02-24T09:13:45.498 INFO:journalctl@ceph.mgr.z.trial159.stdout:Feb 24 09:13:45 trial159 ceph-mgr[46446]: -- 10.20.193.159:0/2452296152 <== mon.1 v2:10.20.193.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x29d07a00 con 0x2aa95800 2026-02-24T09:13:45.574 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records in 2026-02-24T09:13:45.574 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records out 2026-02-24T09:13:45.574 INFO:teuthology.orchestra.run.trial028.stderr:512 bytes copied, 0.000219508 s, 2.3 MB/s 2026-02-24T09:13:45.576 DEBUG:teuthology.orchestra.run.trial028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-24T09:13:45.616 DEBUG:teuthology.orchestra.run.trial074:> set -ex 2026-02-24T09:13:45.616 DEBUG:teuthology.orchestra.run.trial074:> dd if=/scratch_devs of=/dev/stdout 2026-02-24T09:13:45.653 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-24T09:13:45.654 DEBUG:teuthology.orchestra.run.trial074:> stat /dev/vg_nvme/lv_1 2026-02-24T09:13:45.747 INFO:teuthology.orchestra.run.trial074.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-24T09:13:45.747 INFO:teuthology.orchestra.run.trial074.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T09:13:45.747 INFO:teuthology.orchestra.run.trial074.stdout:Device: 6h/6d Inode: 1102 Links: 1 2026-02-24T09:13:45.747 INFO:teuthology.orchestra.run.trial074.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T09:13:45.747 INFO:teuthology.orchestra.run.trial074.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T09:13:45.748 INFO:teuthology.orchestra.run.trial074.stdout:Access: 2026-02-24 09:13:26.190259132 +0000 2026-02-24T09:13:45.748 INFO:teuthology.orchestra.run.trial074.stdout:Modify: 2026-02-24 09:11:49.397018958 +0000 2026-02-24T09:13:45.748 INFO:teuthology.orchestra.run.trial074.stdout:Change: 2026-02-24 09:11:49.397018958 +0000 2026-02-24T09:13:45.748 INFO:teuthology.orchestra.run.trial074.stdout: Birth: 2026-02-24 09:11:49.397018958 +0000 2026-02-24T09:13:45.748 DEBUG:teuthology.orchestra.run.trial074:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-24T09:13:45.756 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:45 trial074 ceph-mon[44412]: Updating trial028:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-24T09:13:45.756 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:45 trial074 ceph-mon[44412]: Deploying daemon mgr.z on trial159 2026-02-24T09:13:45.756 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:45 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/763080000' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-24T09:13:45.756 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:45 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:45.757 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:45 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:45.757 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:45 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:45.757 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:45 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-24T09:13:45.757 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:45 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-24T09:13:45.757 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:45 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-24T09:13:45.757 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:45 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:45.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:45 trial159 ceph-mon[44242]: Updating trial028:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-24T09:13:45.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:45 trial159 ceph-mon[44242]: Deploying daemon mgr.z on trial159 2026-02-24T09:13:45.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:45 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/763080000' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-24T09:13:45.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:45 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:45.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:45 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:45.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:45 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:45.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:45 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-24T09:13:45.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:45 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-24T09:13:45.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:45 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-24T09:13:45.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:45 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:45.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:45 trial028 ceph-mon[40371]: Updating trial028:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-24T09:13:45.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:45 trial028 ceph-mon[40371]: Deploying daemon mgr.z on trial159 2026-02-24T09:13:45.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:45 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/763080000' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-24T09:13:45.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:45 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:45.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:45 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:45.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:45 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:45.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:45 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-24T09:13:45.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:45 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-24T09:13:45.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:45 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-24T09:13:45.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:45 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:45.949 INFO:teuthology.orchestra.run.trial074.stderr:1+0 records in 2026-02-24T09:13:45.949 INFO:teuthology.orchestra.run.trial074.stderr:1+0 records out 2026-02-24T09:13:45.950 INFO:teuthology.orchestra.run.trial074.stderr:512 bytes copied, 0.00022445 s, 2.3 MB/s 2026-02-24T09:13:45.952 DEBUG:teuthology.orchestra.run.trial074:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-24T09:13:45.993 DEBUG:teuthology.orchestra.run.trial074:> stat /dev/vg_nvme/lv_2 2026-02-24T09:13:46.074 INFO:teuthology.orchestra.run.trial074.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-24T09:13:46.074 INFO:teuthology.orchestra.run.trial074.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T09:13:46.074 INFO:teuthology.orchestra.run.trial074.stdout:Device: 6h/6d Inode: 1097 Links: 1 2026-02-24T09:13:46.075 INFO:teuthology.orchestra.run.trial074.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T09:13:46.075 INFO:teuthology.orchestra.run.trial074.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T09:13:46.075 INFO:teuthology.orchestra.run.trial074.stdout:Access: 2026-02-24 09:13:45.875115134 +0000 2026-02-24T09:13:46.075 INFO:teuthology.orchestra.run.trial074.stdout:Modify: 2026-02-24 09:11:49.395746936 +0000 2026-02-24T09:13:46.075 INFO:teuthology.orchestra.run.trial074.stdout:Change: 2026-02-24 09:11:49.395746936 +0000 2026-02-24T09:13:46.075 INFO:teuthology.orchestra.run.trial074.stdout: Birth: 2026-02-24 09:11:49.395746936 +0000 2026-02-24T09:13:46.076 DEBUG:teuthology.orchestra.run.trial074:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-24T09:13:46.175 INFO:teuthology.orchestra.run.trial074.stderr:1+0 records in 2026-02-24T09:13:46.175 INFO:teuthology.orchestra.run.trial074.stderr:1+0 records out 2026-02-24T09:13:46.175 INFO:teuthology.orchestra.run.trial074.stderr:512 bytes copied, 0.000217567 s, 2.4 MB/s 2026-02-24T09:13:46.177 DEBUG:teuthology.orchestra.run.trial074:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-24T09:13:46.216 DEBUG:teuthology.orchestra.run.trial074:> stat /dev/vg_nvme/lv_3 2026-02-24T09:13:46.297 INFO:teuthology.orchestra.run.trial074.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-24T09:13:46.297 INFO:teuthology.orchestra.run.trial074.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T09:13:46.297 INFO:teuthology.orchestra.run.trial074.stdout:Device: 6h/6d Inode: 1089 Links: 1 2026-02-24T09:13:46.297 INFO:teuthology.orchestra.run.trial074.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T09:13:46.297 INFO:teuthology.orchestra.run.trial074.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T09:13:46.297 INFO:teuthology.orchestra.run.trial074.stdout:Access: 2026-02-24 09:13:46.105113452 +0000 2026-02-24T09:13:46.297 INFO:teuthology.orchestra.run.trial074.stdout:Modify: 2026-02-24 09:11:49.394711399 +0000 2026-02-24T09:13:46.297 INFO:teuthology.orchestra.run.trial074.stdout:Change: 2026-02-24 09:11:49.394711399 +0000 2026-02-24T09:13:46.297 INFO:teuthology.orchestra.run.trial074.stdout: Birth: 2026-02-24 09:11:49.394711399 +0000 2026-02-24T09:13:46.297 DEBUG:teuthology.orchestra.run.trial074:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-24T09:13:46.391 INFO:teuthology.orchestra.run.trial074.stderr:1+0 records in 2026-02-24T09:13:46.391 INFO:teuthology.orchestra.run.trial074.stderr:1+0 records out 2026-02-24T09:13:46.391 INFO:teuthology.orchestra.run.trial074.stderr:512 bytes copied, 0.000292147 s, 1.8 MB/s 2026-02-24T09:13:46.393 DEBUG:teuthology.orchestra.run.trial074:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-24T09:13:46.433 DEBUG:teuthology.orchestra.run.trial074:> stat /dev/vg_nvme/lv_4 2026-02-24T09:13:46.436 INFO:journalctl@ceph.mgr.y.trial074.stdout:Feb 24 09:13:46 trial074 systemd[1]: Started Ceph mgr.y for e9ad50af-1160-11f1-800e-d404e6e7d460. 2026-02-24T09:13:46.476 INFO:teuthology.orchestra.run.trial074.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-24T09:13:46.476 INFO:teuthology.orchestra.run.trial074.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T09:13:46.476 INFO:teuthology.orchestra.run.trial074.stdout:Device: 6h/6d Inode: 1079 Links: 1 2026-02-24T09:13:46.476 INFO:teuthology.orchestra.run.trial074.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T09:13:46.476 INFO:teuthology.orchestra.run.trial074.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T09:13:46.477 INFO:teuthology.orchestra.run.trial074.stdout:Access: 2026-02-24 09:13:46.106113445 +0000 2026-02-24T09:13:46.477 INFO:teuthology.orchestra.run.trial074.stdout:Modify: 2026-02-24 09:11:49.394018986 +0000 2026-02-24T09:13:46.477 INFO:teuthology.orchestra.run.trial074.stdout:Change: 2026-02-24 09:11:49.394018986 +0000 2026-02-24T09:13:46.477 INFO:teuthology.orchestra.run.trial074.stdout: Birth: 2026-02-24 09:11:49.394018986 +0000 2026-02-24T09:13:46.477 DEBUG:teuthology.orchestra.run.trial074:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-24T09:13:46.570 INFO:teuthology.orchestra.run.trial074.stderr:1+0 records in 2026-02-24T09:13:46.571 INFO:teuthology.orchestra.run.trial074.stderr:1+0 records out 2026-02-24T09:13:46.571 INFO:teuthology.orchestra.run.trial074.stderr:512 bytes copied, 0.000290694 s, 1.8 MB/s 2026-02-24T09:13:46.573 DEBUG:teuthology.orchestra.run.trial074:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-24T09:13:46.614 DEBUG:teuthology.orchestra.run.trial159:> set -ex 2026-02-24T09:13:46.614 DEBUG:teuthology.orchestra.run.trial159:> dd if=/scratch_devs of=/dev/stdout 2026-02-24T09:13:46.650 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-24T09:13:46.650 DEBUG:teuthology.orchestra.run.trial159:> stat /dev/vg_nvme/lv_1 2026-02-24T09:13:46.727 INFO:teuthology.orchestra.run.trial159.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-24T09:13:46.727 INFO:teuthology.orchestra.run.trial159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T09:13:46.727 INFO:teuthology.orchestra.run.trial159.stdout:Device: 6h/6d Inode: 1085 Links: 1 2026-02-24T09:13:46.727 INFO:teuthology.orchestra.run.trial159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T09:13:46.728 INFO:teuthology.orchestra.run.trial159.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T09:13:46.728 INFO:teuthology.orchestra.run.trial159.stdout:Access: 2026-02-24 09:13:44.833444856 +0000 2026-02-24T09:13:46.728 INFO:teuthology.orchestra.run.trial159.stdout:Modify: 2026-02-24 09:11:44.214889042 +0000 2026-02-24T09:13:46.728 INFO:teuthology.orchestra.run.trial159.stdout:Change: 2026-02-24 09:11:44.214889042 +0000 2026-02-24T09:13:46.728 INFO:teuthology.orchestra.run.trial159.stdout: Birth: 2026-02-24 09:11:44.214889042 +0000 2026-02-24T09:13:46.728 DEBUG:teuthology.orchestra.run.trial159:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-24T09:13:46.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:46 trial159 ceph-mon[44242]: Deploying daemon mgr.y on trial074 2026-02-24T09:13:46.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:46 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:46.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:46 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:46.779 INFO:journalctl@ceph.mgr.z.trial159.stdout:Feb 24 09:13:46 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-z[46442]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-24T09:13:46.779 INFO:journalctl@ceph.mgr.z.trial159.stdout:Feb 24 09:13:46 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-z[46442]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-24T09:13:46.779 INFO:journalctl@ceph.mgr.z.trial159.stdout:Feb 24 09:13:46 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-z[46442]: from numpy import show_config as show_numpy_config 2026-02-24T09:13:46.822 INFO:teuthology.orchestra.run.trial159.stderr:1+0 records in 2026-02-24T09:13:46.823 INFO:teuthology.orchestra.run.trial159.stderr:1+0 records out 2026-02-24T09:13:46.823 INFO:teuthology.orchestra.run.trial159.stderr:512 bytes copied, 0.000247372 s, 2.1 MB/s 2026-02-24T09:13:46.825 DEBUG:teuthology.orchestra.run.trial159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-24T09:13:46.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:46 trial028 ceph-mon[40371]: Deploying daemon mgr.y on trial074 2026-02-24T09:13:46.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:46 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:46.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:46 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:46.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:46 trial074 ceph-mon[44412]: Deploying daemon mgr.y on trial074 2026-02-24T09:13:46.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:46 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:46.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:46 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:46.874 INFO:journalctl@ceph.mgr.y.trial074.stdout:Feb 24 09:13:46 trial074 ceph-mgr[46625]: -- 10.20.193.74:0/3028657549 <== mon.2 v2:10.20.193.74:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x40befa00 con 0x4197d800 2026-02-24T09:13:46.910 DEBUG:teuthology.orchestra.run.trial159:> stat /dev/vg_nvme/lv_2 2026-02-24T09:13:46.988 INFO:teuthology.orchestra.run.trial159.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-24T09:13:46.988 INFO:teuthology.orchestra.run.trial159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T09:13:46.988 INFO:teuthology.orchestra.run.trial159.stdout:Device: 6h/6d Inode: 1090 Links: 1 2026-02-24T09:13:46.988 INFO:teuthology.orchestra.run.trial159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T09:13:46.988 INFO:teuthology.orchestra.run.trial159.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T09:13:46.988 INFO:teuthology.orchestra.run.trial159.stdout:Access: 2026-02-24 09:13:44.833444856 +0000 2026-02-24T09:13:46.988 INFO:teuthology.orchestra.run.trial159.stdout:Modify: 2026-02-24 09:11:44.216215190 +0000 2026-02-24T09:13:46.988 INFO:teuthology.orchestra.run.trial159.stdout:Change: 2026-02-24 09:11:44.216215190 +0000 2026-02-24T09:13:46.988 INFO:teuthology.orchestra.run.trial159.stdout: Birth: 2026-02-24 09:11:44.216215190 +0000 2026-02-24T09:13:46.989 DEBUG:teuthology.orchestra.run.trial159:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-24T09:13:47.085 INFO:teuthology.orchestra.run.trial159.stderr:1+0 records in 2026-02-24T09:13:47.085 INFO:teuthology.orchestra.run.trial159.stderr:1+0 records out 2026-02-24T09:13:47.085 INFO:teuthology.orchestra.run.trial159.stderr:512 bytes copied, 0.000246451 s, 2.1 MB/s 2026-02-24T09:13:47.088 DEBUG:teuthology.orchestra.run.trial159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-24T09:13:47.127 DEBUG:teuthology.orchestra.run.trial159:> stat /dev/vg_nvme/lv_3 2026-02-24T09:13:47.211 INFO:teuthology.orchestra.run.trial159.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-24T09:13:47.211 INFO:teuthology.orchestra.run.trial159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T09:13:47.211 INFO:teuthology.orchestra.run.trial159.stdout:Device: 6h/6d Inode: 1092 Links: 1 2026-02-24T09:13:47.212 INFO:teuthology.orchestra.run.trial159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T09:13:47.212 INFO:teuthology.orchestra.run.trial159.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T09:13:47.212 INFO:teuthology.orchestra.run.trial159.stdout:Access: 2026-02-24 09:13:44.834444848 +0000 2026-02-24T09:13:47.212 INFO:teuthology.orchestra.run.trial159.stdout:Modify: 2026-02-24 09:11:44.216461404 +0000 2026-02-24T09:13:47.212 INFO:teuthology.orchestra.run.trial159.stdout:Change: 2026-02-24 09:11:44.216474668 +0000 2026-02-24T09:13:47.212 INFO:teuthology.orchestra.run.trial159.stdout: Birth: 2026-02-24 09:11:44.216461404 +0000 2026-02-24T09:13:47.212 DEBUG:teuthology.orchestra.run.trial159:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-24T09:13:47.307 INFO:teuthology.orchestra.run.trial159.stderr:1+0 records in 2026-02-24T09:13:47.308 INFO:teuthology.orchestra.run.trial159.stderr:1+0 records out 2026-02-24T09:13:47.308 INFO:teuthology.orchestra.run.trial159.stderr:512 bytes copied, 0.000285834 s, 1.8 MB/s 2026-02-24T09:13:47.310 DEBUG:teuthology.orchestra.run.trial159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-24T09:13:47.349 DEBUG:teuthology.orchestra.run.trial159:> stat /dev/vg_nvme/lv_4 2026-02-24T09:13:47.431 INFO:teuthology.orchestra.run.trial159.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-24T09:13:47.432 INFO:teuthology.orchestra.run.trial159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T09:13:47.432 INFO:teuthology.orchestra.run.trial159.stdout:Device: 6h/6d Inode: 1066 Links: 1 2026-02-24T09:13:47.432 INFO:teuthology.orchestra.run.trial159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T09:13:47.432 INFO:teuthology.orchestra.run.trial159.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T09:13:47.432 INFO:teuthology.orchestra.run.trial159.stdout:Access: 2026-02-24 09:13:44.835444840 +0000 2026-02-24T09:13:47.432 INFO:teuthology.orchestra.run.trial159.stdout:Modify: 2026-02-24 09:11:44.212839601 +0000 2026-02-24T09:13:47.432 INFO:teuthology.orchestra.run.trial159.stdout:Change: 2026-02-24 09:11:44.212839601 +0000 2026-02-24T09:13:47.432 INFO:teuthology.orchestra.run.trial159.stdout: Birth: 2026-02-24 09:11:44.212839601 +0000 2026-02-24T09:13:47.433 DEBUG:teuthology.orchestra.run.trial159:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-24T09:13:47.526 INFO:teuthology.orchestra.run.trial159.stderr:1+0 records in 2026-02-24T09:13:47.527 INFO:teuthology.orchestra.run.trial159.stderr:1+0 records out 2026-02-24T09:13:47.527 INFO:teuthology.orchestra.run.trial159.stderr:512 bytes copied, 0.00021962 s, 2.3 MB/s 2026-02-24T09:13:47.529 DEBUG:teuthology.orchestra.run.trial159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-24T09:13:47.571 INFO:tasks.cephadm:Deploying osd.0 on trial028 with /dev/vg_nvme/lv_4... 2026-02-24T09:13:47.572 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-24T09:13:47.754 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:47.754 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:47.754 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:13:47.754 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:47.754 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:47.754 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:47.754 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:47.754 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:47.754 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:13:47.755 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:47.755 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-24T09:13:47.755 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-24T09:13:47.755 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:47.766 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:47.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:47.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:47.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:13:47.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:47.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:47.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:47.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:47.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:47.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:13:47.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:47.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-24T09:13:47.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-24T09:13:47.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:47.799 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:47.799 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:47.799 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:13:47.799 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:47.799 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:47.799 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:47.799 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:47.799 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:47.800 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:13:47.800 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:47.800 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-24T09:13:47.800 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-24T09:13:47.800 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:48.124 INFO:journalctl@ceph.mgr.y.trial074.stdout:Feb 24 09:13:47 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-y[46612]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-24T09:13:48.124 INFO:journalctl@ceph.mgr.y.trial074.stdout:Feb 24 09:13:47 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-y[46612]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-24T09:13:48.124 INFO:journalctl@ceph.mgr.y.trial074.stdout:Feb 24 09:13:47 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-y[46612]: from numpy import show_config as show_numpy_config 2026-02-24T09:13:48.677 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:13:48.700 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph orch daemon add osd trial028:vg_nvme/lv_4 --skip-validation 2026-02-24T09:13:48.751 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:48 trial028 ceph-mon[40371]: Reconfiguring mgr.x (unknown last config time)... 2026-02-24T09:13:48.751 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:48 trial028 ceph-mon[40371]: Reconfiguring daemon mgr.x on trial028 2026-02-24T09:13:48.751 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:48 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:48.751 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:48 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:48.751 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:48 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:13:48.752 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:48 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:48.752 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:48 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:13:48.752 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:48 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:48.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:48 trial159 ceph-mon[44242]: Reconfiguring mgr.x (unknown last config time)... 2026-02-24T09:13:48.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:48 trial159 ceph-mon[44242]: Reconfiguring daemon mgr.x on trial028 2026-02-24T09:13:48.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:48 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:48.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:48 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:48.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:48 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:13:48.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:48 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:48.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:48 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:13:48.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:48 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:48.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:48 trial074 ceph-mon[44412]: Reconfiguring mgr.x (unknown last config time)... 2026-02-24T09:13:48.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:48 trial074 ceph-mon[44412]: Reconfiguring daemon mgr.x on trial028 2026-02-24T09:13:48.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:48 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:48.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:48 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:48.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:48 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:13:48.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:48 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:48.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:48 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:13:48.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:48 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:48.885 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:13:49.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.062+0000 7f58f241e640 1 -- 10.20.193.28:0/3721152380 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58ec1100b0 msgr2=0x7f58ec115100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:49.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.062+0000 7f58f241e640 1 --2- 10.20.193.28:0/3721152380 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58ec1100b0 0x7f58ec115100 secure :-1 s=READY pgs=149 gs=1 cs=0 l=1 c_cookie=11560639485698083327 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58dc009950 tx=0x7f58dc02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:13:49.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.062+0000 7f58f241e640 1 -- 10.20.193.28:0/3721152380 shutdown_connections 2026-02-24T09:13:49.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.062+0000 7f58f241e640 1 --2- 10.20.193.28:0/3721152380 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f58ec1158b0 0x7f58ec176280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:49.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.062+0000 7f58f241e640 1 --2- 10.20.193.28:0/3721152380 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58ec1100b0 0x7f58ec115100 unknown :-1 s=CLOSED pgs=149 gs=1 cs=0 l=1 c_cookie=11560639485698083327 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:49.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.062+0000 7f58f241e640 1 --2- 10.20.193.28:0/3721152380 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f58ec10f6c0 0x7f58ec10fa90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:49.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.062+0000 7f58f241e640 1 -- 10.20.193.28:0/3721152380 >> 10.20.193.28:0/3721152380 conn(0x7f58ec0ecfd0 msgr2=0x7f58ec10d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:49.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.062+0000 7f58f241e640 1 -- 10.20.193.28:0/3721152380 shutdown_connections 2026-02-24T09:13:49.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.062+0000 7f58f241e640 1 -- 10.20.193.28:0/3721152380 wait complete. 2026-02-24T09:13:49.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.063+0000 7f58f241e640 1 Processor -- start 2026-02-24T09:13:49.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.063+0000 7f58f241e640 1 -- start start 2026-02-24T09:13:49.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.063+0000 7f58f241e640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f58ec10f6c0 0x7f58ec0f9f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:49.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.063+0000 7f58f241e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58ec1100b0 0x7f58ec176180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:49.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.063+0000 7f58f241e640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f58ec1158b0 0x7f58ec0fa690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:49.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.063+0000 7f58f241e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f58ec0ff8a0 con 0x7f58ec1100b0 2026-02-24T09:13:49.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.063+0000 7f58f241e640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f58ec0ffa10 con 0x7f58ec10f6c0 2026-02-24T09:13:49.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.063+0000 7f58f241e640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f58ec0ffbd0 con 0x7f58ec1158b0 2026-02-24T09:13:49.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.064+0000 7f58ebfff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f58ec10f6c0 0x7f58ec0f9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:49.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.064+0000 7f58eb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58ec1100b0 0x7f58ec176180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:49.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.064+0000 7f58ebfff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f58ec10f6c0 0x7f58ec0f9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:44348/0 (socket says 10.20.193.28:44348) 2026-02-24T09:13:49.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.064+0000 7f58ebfff640 1 -- 10.20.193.28:0/1616943258 learned_addr learned my addr 10.20.193.28:0/1616943258 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:13:49.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.064+0000 7f58f0994640 1 --2- 10.20.193.28:0/1616943258 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f58ec1158b0 0x7f58ec0fa690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:49.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.064+0000 7f58eb7fe640 1 -- 10.20.193.28:0/1616943258 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f58ec1158b0 msgr2=0x7f58ec0fa690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:49.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.064+0000 7f58eb7fe640 1 --2- 10.20.193.28:0/1616943258 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f58ec1158b0 0x7f58ec0fa690 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:49.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.064+0000 7f58eb7fe640 1 -- 10.20.193.28:0/1616943258 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f58ec10f6c0 msgr2=0x7f58ec0f9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:49.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.064+0000 7f58eb7fe640 1 --2- 10.20.193.28:0/1616943258 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f58ec10f6c0 0x7f58ec0f9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:49.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.064+0000 7f58eb7fe640 1 -- 10.20.193.28:0/1616943258 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58dc009570 con 0x7f58ec1100b0 2026-02-24T09:13:49.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.064+0000 7f58eb7fe640 1 --2- 10.20.193.28:0/1616943258 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58ec1100b0 0x7f58ec176180 secure :-1 s=READY pgs=150 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58dc009950 tx=0x7f58dc0028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:49.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.065+0000 7f58e97fa640 1 -- 10.20.193.28:0/1616943258 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f58dc03d070 con 0x7f58ec1100b0 2026-02-24T09:13:49.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.065+0000 7f58e97fa640 1 -- 10.20.193.28:0/1616943258 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f58dc0043b0 con 0x7f58ec1100b0 2026-02-24T09:13:49.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.065+0000 7f58e97fa640 1 -- 10.20.193.28:0/1616943258 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f58dc041800 con 0x7f58ec1100b0 2026-02-24T09:13:49.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.065+0000 7f58f241e640 1 -- 10.20.193.28:0/1616943258 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58ec0ffe50 con 0x7f58ec1100b0 2026-02-24T09:13:49.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.065+0000 7f58f241e640 1 -- 10.20.193.28:0/1616943258 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58ec100270 con 0x7f58ec1100b0 2026-02-24T09:13:49.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.065+0000 7f58f241e640 1 -- 10.20.193.28:0/1616943258 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58b0005300 con 0x7f58ec1100b0 2026-02-24T09:13:49.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.066+0000 7f58e97fa640 1 -- 10.20.193.28:0/1616943258 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 52887+0+0 (secure 0 0 0) 0x7f58dc0386a0 con 0x7f58ec1100b0 2026-02-24T09:13:49.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.066+0000 7f58e97fa640 1 --2- 10.20.193.28:0/1616943258 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f58c003fa10 0x7f58c005fec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:49.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.066+0000 7f58e97fa640 1 -- 10.20.193.28:0/1616943258 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1365+0+0 (secure 0 0 0) 0x7f58dc078d70 con 0x7f58ec1100b0 2026-02-24T09:13:49.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.067+0000 7f58ebfff640 1 --2- 10.20.193.28:0/1616943258 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f58c003fa10 0x7f58c005fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:49.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.067+0000 7f58ebfff640 1 --2- 10.20.193.28:0/1616943258 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f58c003fa10 0x7f58c005fec0 secure :-1 s=READY pgs=42 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58d800b2a0 tx=0x7f58d8004050 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:49.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.069+0000 7f58e97fa640 1 -- 10.20.193.28:0/1616943258 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f58dc04a5e0 con 0x7f58ec1100b0 2026-02-24T09:13:49.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.187+0000 7f58f241e640 1 -- 10.20.193.28:0/1616943258 --> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f58b0002bb0 con 0x7f58c003fa10 2026-02-24T09:13:49.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:49.512+0000 7f58e97fa640 1 -- 10.20.193.28:0/1616943258 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mgrmap(e 17) ==== 104985+0+0 (secure 0 0 0) 0x7f58dc077320 con 0x7f58ec1100b0 2026-02-24T09:13:49.730 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:49 trial028 ceph-mon[40371]: Certificate for "cephadm-signed_agent_cert (trial028)" is still valid for 1824 days. 2026-02-24T09:13:49.730 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:49 trial028 ceph-mon[40371]: Standby manager daemon z started 2026-02-24T09:13:49.731 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:49 trial028 ceph-mon[40371]: from='mgr.? 10.20.193.159:0/3255517015' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2026-02-24T09:13:49.731 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:49 trial028 ceph-mon[40371]: from='mgr.? 10.20.193.159:0/3255517015' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2026-02-24T09:13:49.731 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:49 trial028 ceph-mon[40371]: from='mgr.? 10.20.193.159:0/3255517015' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2026-02-24T09:13:49.731 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:49 trial028 ceph-mon[40371]: from='mgr.? 10.20.193.159:0/3255517015' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2026-02-24T09:13:49.731 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:49 trial028 ceph-mon[40371]: from='client.14406 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:13:49.731 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:49 trial028 ceph-mon[40371]: osd.default does not exist. Creating it now. 2026-02-24T09:13:49.731 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:49 trial028 ceph-mon[40371]: Creating OSDs with service ID: default on trial028:['vg_nvme/lv_4'] 2026-02-24T09:13:49.731 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:49 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:49.731 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:49 trial028 ceph-mon[40371]: Marking host: trial028 for OSDSpec preview refresh. 2026-02-24T09:13:49.732 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:49 trial028 ceph-mon[40371]: Saving service osd.default spec with placement trial028 2026-02-24T09:13:49.732 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:49 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:49.732 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:49 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:13:49.732 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:49 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:13:49.732 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:49 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:13:49.732 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:49 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:49.732 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:49 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:49.732 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:49 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:49.732 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:49 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:49.732 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:49 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:13:49.732 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:49 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:49.732 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:49 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:13:49.733 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:49 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:13:49.733 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:49 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:49.733 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:49 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:49.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:49 trial159 ceph-mon[44242]: Certificate for "cephadm-signed_agent_cert (trial028)" is still valid for 1824 days. 2026-02-24T09:13:49.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:49 trial159 ceph-mon[44242]: Standby manager daemon z started 2026-02-24T09:13:49.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:49 trial159 ceph-mon[44242]: from='mgr.? 10.20.193.159:0/3255517015' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2026-02-24T09:13:49.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:49 trial159 ceph-mon[44242]: from='mgr.? 10.20.193.159:0/3255517015' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2026-02-24T09:13:49.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:49 trial159 ceph-mon[44242]: from='mgr.? 10.20.193.159:0/3255517015' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2026-02-24T09:13:49.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:49 trial159 ceph-mon[44242]: from='mgr.? 10.20.193.159:0/3255517015' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2026-02-24T09:13:49.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:49 trial159 ceph-mon[44242]: from='client.14406 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:13:49.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:49 trial159 ceph-mon[44242]: osd.default does not exist. Creating it now. 2026-02-24T09:13:49.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:49 trial159 ceph-mon[44242]: Creating OSDs with service ID: default on trial028:['vg_nvme/lv_4'] 2026-02-24T09:13:49.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:49 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:49.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:49 trial159 ceph-mon[44242]: Marking host: trial028 for OSDSpec preview refresh. 2026-02-24T09:13:49.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:49 trial159 ceph-mon[44242]: Saving service osd.default spec with placement trial028 2026-02-24T09:13:49.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:49 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:49.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:49 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:13:49.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:49 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:13:49.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:49 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:13:49.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:49 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:49.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:49 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:49.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:49 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:49.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:49 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:49.782 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:49 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:13:49.782 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:49 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:49.782 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:49 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:13:49.782 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:49 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:13:49.782 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:49 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:49.782 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:49 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:49.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:49 trial074 ceph-mon[44412]: Certificate for "cephadm-signed_agent_cert (trial028)" is still valid for 1824 days. 2026-02-24T09:13:49.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:49 trial074 ceph-mon[44412]: Standby manager daemon z started 2026-02-24T09:13:49.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:49 trial074 ceph-mon[44412]: from='mgr.? 10.20.193.159:0/3255517015' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2026-02-24T09:13:49.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:49 trial074 ceph-mon[44412]: from='mgr.? 10.20.193.159:0/3255517015' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2026-02-24T09:13:49.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:49 trial074 ceph-mon[44412]: from='mgr.? 10.20.193.159:0/3255517015' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2026-02-24T09:13:49.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:49 trial074 ceph-mon[44412]: from='mgr.? 10.20.193.159:0/3255517015' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2026-02-24T09:13:49.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:49 trial074 ceph-mon[44412]: from='client.14406 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:13:49.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:49 trial074 ceph-mon[44412]: osd.default does not exist. Creating it now. 2026-02-24T09:13:49.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:49 trial074 ceph-mon[44412]: Creating OSDs with service ID: default on trial028:['vg_nvme/lv_4'] 2026-02-24T09:13:49.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:49 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:49.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:49 trial074 ceph-mon[44412]: Marking host: trial028 for OSDSpec preview refresh. 2026-02-24T09:13:49.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:49 trial074 ceph-mon[44412]: Saving service osd.default spec with placement trial028 2026-02-24T09:13:49.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:49 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:49.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:49 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:13:49.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:49 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:13:49.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:49 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:13:49.876 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:49 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:49.876 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:49 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:49.876 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:49 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:49.876 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:49 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:49.876 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:49 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:13:49.876 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:49 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:49.876 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:49 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:13:49.876 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:49 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:13:49.876 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:49 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:49.876 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:49 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:50.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:50.517+0000 7f58e97fa640 1 -- 10.20.193.28:0/1616943258 <== mon.0 v2:10.20.193.28:3300/0 8 ==== mgrmap(e 18) ==== 157083+0+0 (secure 0 0 0) 0x7f58dc05c980 con 0x7f58ec1100b0 2026-02-24T09:13:50.763 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:50 trial028 ceph-mon[40371]: mgrmap e17: x(active, since 10s), standbys: z 2026-02-24T09:13:50.763 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:50 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-24T09:13:50.763 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:50 trial028 ceph-mon[40371]: Standby manager daemon y started 2026-02-24T09:13:50.763 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:50 trial028 ceph-mon[40371]: from='mgr.? 10.20.193.74:0/1710438096' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2026-02-24T09:13:50.763 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:50 trial028 ceph-mon[40371]: from='mgr.? 10.20.193.74:0/1710438096' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2026-02-24T09:13:50.763 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:50 trial028 ceph-mon[40371]: from='mgr.? 10.20.193.74:0/1710438096' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2026-02-24T09:13:50.763 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:50 trial028 ceph-mon[40371]: from='mgr.? 10.20.193.74:0/1710438096' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2026-02-24T09:13:50.763 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:50 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/1533140190' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b7836f68-f25a-4aea-830a-3c2ce8ac79e6"} : dispatch 2026-02-24T09:13:50.764 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:50 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/1533140190' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b7836f68-f25a-4aea-830a-3c2ce8ac79e6"}]': finished 2026-02-24T09:13:50.764 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:50 trial028 ceph-mon[40371]: osdmap e6: 1 total, 0 up, 1 in 2026-02-24T09:13:50.764 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:50 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:13:50.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:50 trial159 ceph-mon[44242]: mgrmap e17: x(active, since 10s), standbys: z 2026-02-24T09:13:50.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:50 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-24T09:13:50.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:50 trial159 ceph-mon[44242]: Standby manager daemon y started 2026-02-24T09:13:50.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:50 trial159 ceph-mon[44242]: from='mgr.? 10.20.193.74:0/1710438096' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2026-02-24T09:13:50.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:50 trial159 ceph-mon[44242]: from='mgr.? 10.20.193.74:0/1710438096' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2026-02-24T09:13:50.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:50 trial159 ceph-mon[44242]: from='mgr.? 10.20.193.74:0/1710438096' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2026-02-24T09:13:50.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:50 trial159 ceph-mon[44242]: from='mgr.? 10.20.193.74:0/1710438096' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2026-02-24T09:13:50.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:50 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/1533140190' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b7836f68-f25a-4aea-830a-3c2ce8ac79e6"} : dispatch 2026-02-24T09:13:50.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:50 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/1533140190' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b7836f68-f25a-4aea-830a-3c2ce8ac79e6"}]': finished 2026-02-24T09:13:50.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:50 trial159 ceph-mon[44242]: osdmap e6: 1 total, 0 up, 1 in 2026-02-24T09:13:50.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:50 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:13:50.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:50 trial074 ceph-mon[44412]: mgrmap e17: x(active, since 10s), standbys: z 2026-02-24T09:13:50.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:50 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-24T09:13:50.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:50 trial074 ceph-mon[44412]: Standby manager daemon y started 2026-02-24T09:13:50.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:50 trial074 ceph-mon[44412]: from='mgr.? 10.20.193.74:0/1710438096' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2026-02-24T09:13:50.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:50 trial074 ceph-mon[44412]: from='mgr.? 10.20.193.74:0/1710438096' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2026-02-24T09:13:50.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:50 trial074 ceph-mon[44412]: from='mgr.? 10.20.193.74:0/1710438096' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2026-02-24T09:13:50.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:50 trial074 ceph-mon[44412]: from='mgr.? 10.20.193.74:0/1710438096' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2026-02-24T09:13:50.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:50 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/1533140190' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b7836f68-f25a-4aea-830a-3c2ce8ac79e6"} : dispatch 2026-02-24T09:13:50.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:50 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/1533140190' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b7836f68-f25a-4aea-830a-3c2ce8ac79e6"}]': finished 2026-02-24T09:13:50.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:50 trial074 ceph-mon[44412]: osdmap e6: 1 total, 0 up, 1 in 2026-02-24T09:13:50.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:50 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:13:51.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:51 trial159 ceph-mon[44242]: mgrmap e18: x(active, since 11s), standbys: y, z 2026-02-24T09:13:51.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:51 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-24T09:13:51.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:51 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/3766304672' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:13:51.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:51 trial028 ceph-mon[40371]: mgrmap e18: x(active, since 11s), standbys: y, z 2026-02-24T09:13:51.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:51 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-24T09:13:51.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:51 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/3766304672' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:13:51.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:51 trial074 ceph-mon[44412]: mgrmap e18: x(active, since 11s), standbys: y, z 2026-02-24T09:13:51.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:51 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-24T09:13:51.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:51 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/3766304672' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:13:53.820 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:53 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-24T09:13:53.820 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:53 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:54.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:53 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-24T09:13:54.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:53 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:54.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:53 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-24T09:13:54.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:53 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:55.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:54 trial159 ceph-mon[44242]: Deploying daemon osd.0 on trial028 2026-02-24T09:13:55.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:54 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-24T09:13:55.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:54 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:55.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:54 trial159 ceph-mon[44242]: Deploying daemon osd.0 on trial028 2026-02-24T09:13:55.047 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:54 trial028 ceph-mon[40371]: Deploying daemon osd.0 on trial028 2026-02-24T09:13:55.047 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:54 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-24T09:13:55.048 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:54 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:55.048 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:54 trial028 ceph-mon[40371]: Deploying daemon osd.0 on trial028 2026-02-24T09:13:55.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:54 trial074 ceph-mon[44412]: Deploying daemon osd.0 on trial028 2026-02-24T09:13:55.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:54 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-24T09:13:55.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:54 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:55.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:54 trial074 ceph-mon[44412]: Deploying daemon osd.0 on trial028 2026-02-24T09:13:58.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:57 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:58.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:57 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:58.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:57 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:58.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:57 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:58.279 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:57 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:58.279 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:57 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:13:58.983 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:58 trial028 ceph-mon[40371]: from='osd.0 [v2:10.20.193.28:6802/958582032,v1:10.20.193.28:6803/958582032]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-24T09:13:59.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:59.067+0000 7f58f1c1d640 1 -- 10.20.193.28:0/1616943258 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=6}) -- 0x7f58cc003560 con 0x7f58ec1100b0 2026-02-24T09:13:59.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:13:59.067+0000 7f58e97fa640 1 -- 10.20.193.28:0/1616943258 <== mon.0 v2:10.20.193.28:3300/0 9 ==== osd_map(6..7 src has 1..7) ==== 1027+0+0 (secure 0 0 0) 0x7f58dc078580 con 0x7f58ec1100b0 2026-02-24T09:13:59.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:58 trial074 ceph-mon[44412]: from='osd.0 [v2:10.20.193.28:6802/958582032,v1:10.20.193.28:6803/958582032]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-24T09:13:59.279 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:58 trial159 ceph-mon[44242]: from='osd.0 [v2:10.20.193.28:6802/958582032,v1:10.20.193.28:6803/958582032]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-24T09:14:00.048 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:59 trial028 ceph-mon[40371]: from='osd.0 [v2:10.20.193.28:6802/958582032,v1:10.20.193.28:6803/958582032]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-24T09:14:00.048 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:59 trial028 ceph-mon[40371]: osdmap e7: 1 total, 0 up, 1 in 2026-02-24T09:14:00.048 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:59 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:14:00.049 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:13:59 trial028 ceph-mon[40371]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:14:00.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:59 trial074 ceph-mon[44412]: from='osd.0 [v2:10.20.193.28:6802/958582032,v1:10.20.193.28:6803/958582032]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-24T09:14:00.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:59 trial074 ceph-mon[44412]: osdmap e7: 1 total, 0 up, 1 in 2026-02-24T09:14:00.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:59 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:14:00.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:13:59 trial074 ceph-mon[44412]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:14:00.279 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:59 trial159 ceph-mon[44242]: from='osd.0 [v2:10.20.193.28:6802/958582032,v1:10.20.193.28:6803/958582032]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-24T09:14:00.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:59 trial159 ceph-mon[44242]: osdmap e7: 1 total, 0 up, 1 in 2026-02-24T09:14:00.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:59 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:14:00.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:13:59 trial159 ceph-mon[44242]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:14:01.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:01 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:01.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:01 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:01.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:01 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:01.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:01 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:01.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:01 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:14:01.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:01 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:01.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:01 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:01.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:01 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:01.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:01 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:01.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:01 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:14:01.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:01 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:01.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:01 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:01.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:01 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:01.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:01 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:01.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:01 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:14:01.969 INFO:teuthology.orchestra.run.trial028.stdout:Created osd(s) 0 on host 'trial028' 2026-02-24T09:14:01.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:01.966+0000 7f58e97fa640 1 -- 10.20.193.28:0/1616943258 <== mgr.14223 v2:10.20.193.28:6800/906910473 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f58b0002bb0 con 0x7f58c003fa10 2026-02-24T09:14:01.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:01.969+0000 7f58f241e640 1 -- 10.20.193.28:0/1616943258 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f58c003fa10 msgr2=0x7f58c005fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:01.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:01.969+0000 7f58f241e640 1 --2- 10.20.193.28:0/1616943258 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f58c003fa10 0x7f58c005fec0 secure :-1 s=READY pgs=42 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58d800b2a0 tx=0x7f58d8004050 comp rx=0 tx=0).stop 2026-02-24T09:14:01.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:01.969+0000 7f58f241e640 1 -- 10.20.193.28:0/1616943258 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58ec1100b0 msgr2=0x7f58ec176180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:01.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:01.969+0000 7f58f241e640 1 --2- 10.20.193.28:0/1616943258 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58ec1100b0 0x7f58ec176180 secure :-1 s=READY pgs=150 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58dc009950 tx=0x7f58dc0028d0 comp rx=0 tx=0).stop 2026-02-24T09:14:01.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:01.969+0000 7f58f241e640 1 -- 10.20.193.28:0/1616943258 shutdown_connections 2026-02-24T09:14:01.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:01.969+0000 7f58f241e640 1 --2- 10.20.193.28:0/1616943258 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f58c003fa10 0x7f58c005fec0 unknown :-1 s=CLOSED pgs=42 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:01.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:01.969+0000 7f58f241e640 1 --2- 10.20.193.28:0/1616943258 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f58ec1158b0 0x7f58ec0fa690 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:01.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:01.969+0000 7f58f241e640 1 --2- 10.20.193.28:0/1616943258 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58ec1100b0 0x7f58ec176180 unknown :-1 s=CLOSED pgs=150 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:01.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:01.969+0000 7f58f241e640 1 --2- 10.20.193.28:0/1616943258 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f58ec10f6c0 0x7f58ec0f9f90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:01.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:01.969+0000 7f58f241e640 1 -- 10.20.193.28:0/1616943258 >> 10.20.193.28:0/1616943258 conn(0x7f58ec0ecfd0 msgr2=0x7f58ec111ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:01.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:01.969+0000 7f58f241e640 1 -- 10.20.193.28:0/1616943258 shutdown_connections 2026-02-24T09:14:01.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:01.969+0000 7f58f241e640 1 -- 10.20.193.28:0/1616943258 wait complete. 2026-02-24T09:14:02.077 DEBUG:teuthology.orchestra.run.trial028:osd.0> sudo journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.0.service 2026-02-24T09:14:02.079 INFO:tasks.cephadm:Deploying osd.1 on trial074 with /dev/vg_nvme/lv_4... 2026-02-24T09:14:02.080 DEBUG:teuthology.orchestra.run.trial074:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-24T09:14:02.263 INFO:teuthology.orchestra.run.trial074.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.b/config 2026-02-24T09:14:02.393 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:02 trial074 ceph-mon[44412]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:14:02.393 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:02 trial074 ceph-mon[44412]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-24T09:14:02.393 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:02 trial074 ceph-mon[44412]: from='osd.0 [v2:10.20.193.28:6802/2124354447,v1:10.20.193.28:6803/2124354447]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-24T09:14:02.393 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:02 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:02.393 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:02 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:02.393 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:02 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:02.393 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:02 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:02.567 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:02 trial028 ceph-mon[40371]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:14:02.567 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:02 trial028 ceph-mon[40371]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-24T09:14:02.567 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:02 trial028 ceph-mon[40371]: from='osd.0 [v2:10.20.193.28:6802/2124354447,v1:10.20.193.28:6803/2124354447]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-24T09:14:02.567 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:02 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:02.567 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:02 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:02.567 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:02 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:02.567 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:02 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:02.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:02 trial159 ceph-mon[44242]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:14:02.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:02 trial159 ceph-mon[44242]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-24T09:14:02.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:02 trial159 ceph-mon[44242]: from='osd.0 [v2:10.20.193.28:6802/2124354447,v1:10.20.193.28:6803/2124354447]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-24T09:14:02.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:02 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:02.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:02 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:02.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:02 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:02.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:02 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:03.192 INFO:teuthology.orchestra.run.trial074.stdout: 2026-02-24T09:14:03.215 DEBUG:teuthology.orchestra.run.trial074:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph orch daemon add osd trial074:vg_nvme/lv_4 --skip-validation 2026-02-24T09:14:03.397 INFO:teuthology.orchestra.run.trial074.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.b/config 2026-02-24T09:14:03.464 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:03 trial074 ceph-mon[44412]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-24T09:14:03.464 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:03 trial074 ceph-mon[44412]: osdmap e8: 1 total, 0 up, 1 in 2026-02-24T09:14:03.464 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:03 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:14:03.464 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:03 trial074 ceph-mon[44412]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-24T09:14:03.465 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:03 trial074 ceph-mon[44412]: from='osd.0 [v2:10.20.193.28:6802/2124354447,v1:10.20.193.28:6803/2124354447]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-24T09:14:03.465 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:03 trial074 ceph-mon[44412]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-24T09:14:03.581 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.578+0000 7fdde7459640 1 -- 10.20.193.74:0/3740128825 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fdde0114650 msgr2=0x7fdde0176180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:03.581 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.578+0000 7fdde7459640 1 --2- 10.20.193.74:0/3740128825 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fdde0114650 0x7fdde0176180 secure :-1 s=READY pgs=33 gs=1 cs=0 l=1 c_cookie=9869270209739613294 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdddc00aa30 tx=0x7fdddc030270 comp rx=0 tx=0).stop 2026-02-24T09:14:03.581 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.578+0000 7fdde7459640 1 -- 10.20.193.74:0/3740128825 shutdown_connections 2026-02-24T09:14:03.581 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.578+0000 7fdde7459640 1 --2- 10.20.193.74:0/3740128825 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fdde0114650 0x7fdde0176180 unknown :-1 s=CLOSED pgs=33 gs=1 cs=0 l=1 c_cookie=9869270209739613294 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:03.581 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.578+0000 7fdde7459640 1 --2- 10.20.193.74:0/3740128825 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdde010c130 0x7fdde0113ed0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:03.582 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.578+0000 7fdde7459640 1 --2- 10.20.193.74:0/3740128825 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fdde010b790 0x7fdde010bb60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:03.582 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.578+0000 7fdde7459640 1 -- 10.20.193.74:0/3740128825 >> 10.20.193.74:0/3740128825 conn(0x7fdde00e9260 msgr2=0x7fdde0109670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:03.582 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.578+0000 7fdde7459640 1 -- 10.20.193.74:0/3740128825 shutdown_connections 2026-02-24T09:14:03.582 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.578+0000 7fdde7459640 1 -- 10.20.193.74:0/3740128825 wait complete. 2026-02-24T09:14:03.582 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.579+0000 7fdde7459640 1 Processor -- start 2026-02-24T09:14:03.582 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.579+0000 7fdde7459640 1 -- start start 2026-02-24T09:14:03.582 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.579+0000 7fdde7459640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fdde010b790 0x7fdde011def0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:03.582 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.579+0000 7fdde7459640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fdde010c130 0x7fdde011e430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:03.583 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.579+0000 7fdde7459640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdde0114650 0x7fdde0123800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:03.584 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.579+0000 7fdde7459640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdde0123e20 con 0x7fdde0114650 2026-02-24T09:14:03.584 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.579+0000 7fdde7459640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fdde0123f90 con 0x7fdde010c130 2026-02-24T09:14:03.584 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.579+0000 7fdde7459640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fdde0124150 con 0x7fdde010b790 2026-02-24T09:14:03.584 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.579+0000 7fdde5c56640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fdde010c130 0x7fdde011e430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:03.584 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.579+0000 7fdde5c56640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fdde010c130 0x7fdde011e430 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.74:44500/0 (socket says 10.20.193.74:44500) 2026-02-24T09:14:03.584 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.579+0000 7fdde5c56640 1 -- 10.20.193.74:0/1665096308 learned_addr learned my addr 10.20.193.74:0/1665096308 (peer_addr_for_me v2:10.20.193.74:0/0) 2026-02-24T09:14:03.584 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.579+0000 7fdde6457640 1 --2- 10.20.193.74:0/1665096308 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fdde010b790 0x7fdde011def0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:03.584 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.579+0000 7fdde6c58640 1 --2- 10.20.193.74:0/1665096308 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdde0114650 0x7fdde0123800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:03.584 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.580+0000 7fdde5c56640 1 -- 10.20.193.74:0/1665096308 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fdde010b790 msgr2=0x7fdde011def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:03.584 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.580+0000 7fdde5c56640 1 --2- 10.20.193.74:0/1665096308 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fdde010b790 0x7fdde011def0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:03.585 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.580+0000 7fdde5c56640 1 -- 10.20.193.74:0/1665096308 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdde0114650 msgr2=0x7fdde0123800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:03.585 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.580+0000 7fdde5c56640 1 --2- 10.20.193.74:0/1665096308 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdde0114650 0x7fdde0123800 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:03.585 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.580+0000 7fdde5c56640 1 -- 10.20.193.74:0/1665096308 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdddc00a650 con 0x7fdde010c130 2026-02-24T09:14:03.585 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.580+0000 7fdde6c58640 1 --2- 10.20.193.74:0/1665096308 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdde0114650 0x7fdde0123800 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:14:03.585 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.580+0000 7fdde5c56640 1 --2- 10.20.193.74:0/1665096308 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fdde010c130 0x7fdde011e430 secure :-1 s=READY pgs=34 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddd400d950 tx=0x7fddd400de20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:03.585 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.580+0000 7fddc77fe640 1 -- 10.20.193.74:0/1665096308 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fddd4004500 con 0x7fdde010c130 2026-02-24T09:14:03.585 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.580+0000 7fddc77fe640 1 -- 10.20.193.74:0/1665096308 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fddd400bd00 con 0x7fdde010c130 2026-02-24T09:14:03.585 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.580+0000 7fdde7459640 1 -- 10.20.193.74:0/1665096308 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdde0124430 con 0x7fdde010c130 2026-02-24T09:14:03.585 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.580+0000 7fddc77fe640 1 -- 10.20.193.74:0/1665096308 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fddd40106e0 con 0x7fdde010c130 2026-02-24T09:14:03.585 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.580+0000 7fdde7459640 1 -- 10.20.193.74:0/1665096308 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdde0164b30 con 0x7fdde010c130 2026-02-24T09:14:03.585 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.581+0000 7fdde7459640 1 -- 10.20.193.74:0/1665096308 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdde005fb10 con 0x7fdde010c130 2026-02-24T09:14:03.586 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.583+0000 7fddc77fe640 1 -- 10.20.193.74:0/1665096308 <== mon.2 v2:10.20.193.74:3300/0 4 ==== mgrmap(e 18) ==== 157083+0+0 (secure 0 0 0) 0x7fddd400b840 con 0x7fdde010c130 2026-02-24T09:14:03.587 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.585+0000 7fddc77fe640 1 --2- 10.20.193.74:0/1665096308 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fddbc0b56a0 0x7fddbc0d5b50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:03.587 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.585+0000 7fddc77fe640 1 -- 10.20.193.74:0/1665096308 <== mon.2 v2:10.20.193.74:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1695+0+0 (secure 0 0 0) 0x7fddd40e4de0 con 0x7fdde010c130 2026-02-24T09:14:03.587 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.585+0000 7fddc77fe640 1 -- 10.20.193.74:0/1665096308 <== mon.2 v2:10.20.193.74:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fddd411e890 con 0x7fdde010c130 2026-02-24T09:14:03.587 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.585+0000 7fdde6457640 1 --2- 10.20.193.74:0/1665096308 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fddbc0b56a0 0x7fddbc0d5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:03.588 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.586+0000 7fdde6457640 1 --2- 10.20.193.74:0/1665096308 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fddbc0b56a0 0x7fddbc0d5b50 secure :-1 s=READY pgs=49 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddd0004740 tx=0x7fddd0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:03.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:03 trial028 ceph-mon[40371]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-24T09:14:03.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:03 trial028 ceph-mon[40371]: osdmap e8: 1 total, 0 up, 1 in 2026-02-24T09:14:03.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:03 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:14:03.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:03 trial028 ceph-mon[40371]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-24T09:14:03.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:03 trial028 ceph-mon[40371]: from='osd.0 [v2:10.20.193.28:6802/2124354447,v1:10.20.193.28:6803/2124354447]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-24T09:14:03.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:03 trial028 ceph-mon[40371]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-24T09:14:03.611 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 24 09:14:03 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-0[60771]: 2026-02-24T09:14:03.346+0000 7fa8fc504640 -1 osd.0 0 waiting for initial osdmap 2026-02-24T09:14:03.611 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 24 09:14:03 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-0[60771]: 2026-02-24T09:14:03.350+0000 7fa8f43c3640 -1 osd.0 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T09:14:03.706 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:03.704+0000 7fdde7459640 1 -- 10.20.193.74:0/1665096308 --> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial074:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fdde011f050 con 0x7fddbc0b56a0 2026-02-24T09:14:03.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:03 trial159 ceph-mon[44242]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-24T09:14:03.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:03 trial159 ceph-mon[44242]: osdmap e8: 1 total, 0 up, 1 in 2026-02-24T09:14:03.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:03 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:14:03.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:03 trial159 ceph-mon[44242]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-24T09:14:03.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:03 trial159 ceph-mon[44242]: from='osd.0 [v2:10.20.193.28:6802/2124354447,v1:10.20.193.28:6803/2124354447]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-24T09:14:03.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:03 trial159 ceph-mon[44242]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-24T09:14:04.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:04 trial028 ceph-mon[40371]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:14:04.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:04 trial028 ceph-mon[40371]: osdmap e9: 1 total, 0 up, 1 in 2026-02-24T09:14:04.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:04 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:14:04.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:04 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:14:04.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:04 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:04.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:04 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:04.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:04 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:14:04.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:04 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:14:04.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:04 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:04.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:04 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:04.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:04 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:04.612 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:04 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T09:14:04.612 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:04 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:04.612 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:04 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:04.612 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:04 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:14:04.612 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:04 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:04.612 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:04 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:14:04.612 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:04 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:14:04.612 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:04 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:04.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:04 trial074 ceph-mon[44412]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:14:04.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:04 trial074 ceph-mon[44412]: osdmap e9: 1 total, 0 up, 1 in 2026-02-24T09:14:04.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:04 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:14:04.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:04 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:14:04.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:04 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:04.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:04 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:04.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:04 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:14:04.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:04 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:14:04.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:04 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:04.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:04 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:04.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:04 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:04.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:04 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T09:14:04.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:04 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:04.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:04 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:04.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:04 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:14:04.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:04 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:04.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:04 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:14:04.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:04 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:14:04.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:04 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:04.680 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:04 trial159 ceph-mon[44242]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:14:04.681 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:04 trial159 ceph-mon[44242]: osdmap e9: 1 total, 0 up, 1 in 2026-02-24T09:14:04.681 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:04 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:14:04.681 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:04 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:14:04.681 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:04 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:04.681 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:04 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:04.681 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:04 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:14:04.681 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:04 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:14:04.681 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:04 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:04.681 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:04 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:04.681 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:04 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:04.681 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:04 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T09:14:04.681 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:04 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:04.681 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:04 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:04.681 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:04 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:14:04.681 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:04 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:04.681 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:04 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:14:04.681 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:04 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:14:04.681 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:04 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:05.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:05 trial028 ceph-mon[40371]: purged_snaps scrub starts 2026-02-24T09:14:05.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:05 trial028 ceph-mon[40371]: purged_snaps scrub ok 2026-02-24T09:14:05.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:05 trial028 ceph-mon[40371]: from='client.24317 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial074:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:14:05.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:05 trial028 ceph-mon[40371]: osd.default does not exist. Creating it now. 2026-02-24T09:14:05.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:05 trial028 ceph-mon[40371]: Creating OSDs with service ID: default on trial074:['vg_nvme/lv_4'] 2026-02-24T09:14:05.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:05 trial028 ceph-mon[40371]: Marking host: trial074 for OSDSpec preview refresh. 2026-02-24T09:14:05.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:05 trial028 ceph-mon[40371]: Saving service osd.default spec with placement trial074 2026-02-24T09:14:05.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:05 trial028 ceph-mon[40371]: Detected new or changed devices on trial028 2026-02-24T09:14:05.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:05 trial028 ceph-mon[40371]: Adjusting osd_memory_target on trial028 to 84053M 2026-02-24T09:14:05.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:05 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:14:05.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:05 trial028 ceph-mon[40371]: osd.0 [v2:10.20.193.28:6802/2124354447,v1:10.20.193.28:6803/2124354447] boot 2026-02-24T09:14:05.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:05 trial028 ceph-mon[40371]: osdmap e10: 1 total, 1 up, 1 in 2026-02-24T09:14:05.612 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:05 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:14:05.612 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:05 trial028 ceph-mon[40371]: from='client.? 10.20.193.74:0/2900422083' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "04273ff8-91e3-4e70-8041-cc8c205b9a42"} : dispatch 2026-02-24T09:14:05.612 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:05 trial028 ceph-mon[40371]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "04273ff8-91e3-4e70-8041-cc8c205b9a42"} : dispatch 2026-02-24T09:14:05.612 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:05 trial028 ceph-mon[40371]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04273ff8-91e3-4e70-8041-cc8c205b9a42"}]': finished 2026-02-24T09:14:05.612 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:05 trial028 ceph-mon[40371]: osdmap e11: 2 total, 1 up, 2 in 2026-02-24T09:14:05.612 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:05 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:14:05.612 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:05 trial028 ceph-mon[40371]: from='client.? 10.20.193.74:0/3018353571' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:14:05.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:05 trial074 ceph-mon[44412]: purged_snaps scrub starts 2026-02-24T09:14:05.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:05 trial074 ceph-mon[44412]: purged_snaps scrub ok 2026-02-24T09:14:05.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:05 trial074 ceph-mon[44412]: from='client.24317 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial074:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:14:05.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:05 trial074 ceph-mon[44412]: osd.default does not exist. Creating it now. 2026-02-24T09:14:05.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:05 trial074 ceph-mon[44412]: Creating OSDs with service ID: default on trial074:['vg_nvme/lv_4'] 2026-02-24T09:14:05.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:05 trial074 ceph-mon[44412]: Marking host: trial074 for OSDSpec preview refresh. 2026-02-24T09:14:05.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:05 trial074 ceph-mon[44412]: Saving service osd.default spec with placement trial074 2026-02-24T09:14:05.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:05 trial074 ceph-mon[44412]: Detected new or changed devices on trial028 2026-02-24T09:14:05.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:05 trial074 ceph-mon[44412]: Adjusting osd_memory_target on trial028 to 84053M 2026-02-24T09:14:05.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:05 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:14:05.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:05 trial074 ceph-mon[44412]: osd.0 [v2:10.20.193.28:6802/2124354447,v1:10.20.193.28:6803/2124354447] boot 2026-02-24T09:14:05.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:05 trial074 ceph-mon[44412]: osdmap e10: 1 total, 1 up, 1 in 2026-02-24T09:14:05.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:05 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:14:05.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:05 trial074 ceph-mon[44412]: from='client.? 10.20.193.74:0/2900422083' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "04273ff8-91e3-4e70-8041-cc8c205b9a42"} : dispatch 2026-02-24T09:14:05.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:05 trial074 ceph-mon[44412]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "04273ff8-91e3-4e70-8041-cc8c205b9a42"} : dispatch 2026-02-24T09:14:05.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:05 trial074 ceph-mon[44412]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04273ff8-91e3-4e70-8041-cc8c205b9a42"}]': finished 2026-02-24T09:14:05.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:05 trial074 ceph-mon[44412]: osdmap e11: 2 total, 1 up, 2 in 2026-02-24T09:14:05.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:05 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:14:05.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:05 trial074 ceph-mon[44412]: from='client.? 10.20.193.74:0/3018353571' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:14:05.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:05 trial159 ceph-mon[44242]: purged_snaps scrub starts 2026-02-24T09:14:05.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:05 trial159 ceph-mon[44242]: purged_snaps scrub ok 2026-02-24T09:14:05.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:05 trial159 ceph-mon[44242]: from='client.24317 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial074:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:14:05.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:05 trial159 ceph-mon[44242]: osd.default does not exist. Creating it now. 2026-02-24T09:14:05.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:05 trial159 ceph-mon[44242]: Creating OSDs with service ID: default on trial074:['vg_nvme/lv_4'] 2026-02-24T09:14:05.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:05 trial159 ceph-mon[44242]: Marking host: trial074 for OSDSpec preview refresh. 2026-02-24T09:14:05.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:05 trial159 ceph-mon[44242]: Saving service osd.default spec with placement trial074 2026-02-24T09:14:05.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:05 trial159 ceph-mon[44242]: Detected new or changed devices on trial028 2026-02-24T09:14:05.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:05 trial159 ceph-mon[44242]: Adjusting osd_memory_target on trial028 to 84053M 2026-02-24T09:14:05.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:05 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:14:05.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:05 trial159 ceph-mon[44242]: osd.0 [v2:10.20.193.28:6802/2124354447,v1:10.20.193.28:6803/2124354447] boot 2026-02-24T09:14:05.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:05 trial159 ceph-mon[44242]: osdmap e10: 1 total, 1 up, 1 in 2026-02-24T09:14:05.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:05 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:14:05.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:05 trial159 ceph-mon[44242]: from='client.? 10.20.193.74:0/2900422083' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "04273ff8-91e3-4e70-8041-cc8c205b9a42"} : dispatch 2026-02-24T09:14:05.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:05 trial159 ceph-mon[44242]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "04273ff8-91e3-4e70-8041-cc8c205b9a42"} : dispatch 2026-02-24T09:14:05.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:05 trial159 ceph-mon[44242]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04273ff8-91e3-4e70-8041-cc8c205b9a42"}]': finished 2026-02-24T09:14:05.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:05 trial159 ceph-mon[44242]: osdmap e11: 2 total, 1 up, 2 in 2026-02-24T09:14:05.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:05 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:14:05.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:05 trial159 ceph-mon[44242]: from='client.? 10.20.193.74:0/3018353571' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:14:06.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:06 trial028 ceph-mon[40371]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:14:06.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:06 trial028 ceph-mon[40371]: osdmap e12: 2 total, 1 up, 2 in 2026-02-24T09:14:06.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:06 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:14:06.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:06 trial074 ceph-mon[44412]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:14:06.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:06 trial074 ceph-mon[44412]: osdmap e12: 2 total, 1 up, 2 in 2026-02-24T09:14:06.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:06 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:14:06.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:06 trial159 ceph-mon[44242]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:14:06.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:06 trial159 ceph-mon[44242]: osdmap e12: 2 total, 1 up, 2 in 2026-02-24T09:14:06.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:06 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:14:08.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:08 trial074 ceph-mon[44412]: pgmap v14: 0 pgs: ; 0 B data, 27 MiB used, 700 GiB / 700 GiB avail 2026-02-24T09:14:08.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:08 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-24T09:14:08.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:08 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:08.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:08 trial028 ceph-mon[40371]: pgmap v14: 0 pgs: ; 0 B data, 27 MiB used, 700 GiB / 700 GiB avail 2026-02-24T09:14:08.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:08 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-24T09:14:08.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:08 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:08.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:08 trial159 ceph-mon[44242]: pgmap v14: 0 pgs: ; 0 B data, 27 MiB used, 700 GiB / 700 GiB avail 2026-02-24T09:14:08.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:08 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-24T09:14:08.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:08 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:09.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:09 trial028 ceph-mon[40371]: Deploying daemon osd.1 on trial074 2026-02-24T09:14:09.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:09 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-24T09:14:09.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:09 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:09.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:09 trial074 ceph-mon[44412]: Deploying daemon osd.1 on trial074 2026-02-24T09:14:09.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:09 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-24T09:14:09.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:09 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:09.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:09 trial159 ceph-mon[44242]: Deploying daemon osd.1 on trial074 2026-02-24T09:14:09.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:09 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-24T09:14:09.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:09 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:10.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:10 trial028 ceph-mon[40371]: Deploying daemon osd.1 on trial074 2026-02-24T09:14:10.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:10 trial028 ceph-mon[40371]: pgmap v15: 0 pgs: ; 0 B data, 27 MiB used, 700 GiB / 700 GiB avail 2026-02-24T09:14:10.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:10 trial074 ceph-mon[44412]: Deploying daemon osd.1 on trial074 2026-02-24T09:14:10.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:10 trial074 ceph-mon[44412]: pgmap v15: 0 pgs: ; 0 B data, 27 MiB used, 700 GiB / 700 GiB avail 2026-02-24T09:14:10.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:10 trial159 ceph-mon[44242]: Deploying daemon osd.1 on trial074 2026-02-24T09:14:10.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:10 trial159 ceph-mon[44242]: pgmap v15: 0 pgs: ; 0 B data, 27 MiB used, 700 GiB / 700 GiB avail 2026-02-24T09:14:12.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:12 trial074 ceph-mon[44412]: pgmap v16: 0 pgs: ; 0 B data, 27 MiB used, 700 GiB / 700 GiB avail 2026-02-24T09:14:12.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:12 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:12.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:12 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:12.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:12 trial159 ceph-mon[44242]: pgmap v16: 0 pgs: ; 0 B data, 27 MiB used, 700 GiB / 700 GiB avail 2026-02-24T09:14:12.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:12 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:12.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:12 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:12.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:12 trial028 ceph-mon[40371]: pgmap v16: 0 pgs: ; 0 B data, 27 MiB used, 700 GiB / 700 GiB avail 2026-02-24T09:14:12.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:12 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:12.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:12 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:13.585 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:13.582+0000 7fdde7ee1640 1 -- 10.20.193.74:0/1665096308 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=10}) -- 0x7fddb8003560 con 0x7fdde010c130 2026-02-24T09:14:13.585 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:13.582+0000 7fddc77fe640 1 -- 10.20.193.74:0/1665096308 <== mon.2 v2:10.20.193.74:3300/0 7 ==== osd_map(10..13 src has 1..13) ==== 2100+0+0 (secure 0 0 0) 0x7fddd40027c0 con 0x7fdde010c130 2026-02-24T09:14:13.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:13 trial074 ceph-mon[44412]: from='osd.1 [v2:10.20.193.74:6800/3429747940,v1:10.20.193.74:6801/3429747940]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-24T09:14:13.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:13 trial074 ceph-mon[44412]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-24T09:14:13.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:13 trial159 ceph-mon[44242]: from='osd.1 [v2:10.20.193.74:6800/3429747940,v1:10.20.193.74:6801/3429747940]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-24T09:14:13.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:13 trial159 ceph-mon[44242]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-24T09:14:13.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:13 trial028 ceph-mon[40371]: from='osd.1 [v2:10.20.193.74:6800/3429747940,v1:10.20.193.74:6801/3429747940]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-24T09:14:13.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:13 trial028 ceph-mon[40371]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-24T09:14:14.464 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:14 trial074 ceph-mon[44412]: pgmap v17: 0 pgs: ; 0 B data, 27 MiB used, 700 GiB / 700 GiB avail 2026-02-24T09:14:14.464 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:14 trial074 ceph-mon[44412]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-24T09:14:14.464 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:14 trial074 ceph-mon[44412]: osdmap e13: 2 total, 1 up, 2 in 2026-02-24T09:14:14.464 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:14 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:14:14.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:14 trial159 ceph-mon[44242]: pgmap v17: 0 pgs: ; 0 B data, 27 MiB used, 700 GiB / 700 GiB avail 2026-02-24T09:14:14.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:14 trial159 ceph-mon[44242]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-24T09:14:14.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:14 trial159 ceph-mon[44242]: osdmap e13: 2 total, 1 up, 2 in 2026-02-24T09:14:14.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:14 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:14:14.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:14 trial028 ceph-mon[40371]: pgmap v17: 0 pgs: ; 0 B data, 27 MiB used, 700 GiB / 700 GiB avail 2026-02-24T09:14:14.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:14 trial028 ceph-mon[40371]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-24T09:14:14.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:14 trial028 ceph-mon[40371]: osdmap e13: 2 total, 1 up, 2 in 2026-02-24T09:14:14.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:14 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:14:15.506 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:15.503+0000 7fddc77fe640 1 -- 10.20.193.74:0/1665096308 <== mgr.14223 v2:10.20.193.28:6800/906910473 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fdde011f050 con 0x7fddbc0b56a0 2026-02-24T09:14:15.506 INFO:teuthology.orchestra.run.trial074.stdout:Created osd(s) 1 on host 'trial074' 2026-02-24T09:14:15.510 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:15.506+0000 7fdde7459640 1 -- 10.20.193.74:0/1665096308 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fddbc0b56a0 msgr2=0x7fddbc0d5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:15.510 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:15.506+0000 7fdde7459640 1 --2- 10.20.193.74:0/1665096308 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fddbc0b56a0 0x7fddbc0d5b50 secure :-1 s=READY pgs=49 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddd0004740 tx=0x7fddd0005f90 comp rx=0 tx=0).stop 2026-02-24T09:14:15.510 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:15.506+0000 7fdde7459640 1 -- 10.20.193.74:0/1665096308 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fdde010c130 msgr2=0x7fdde011e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:15.511 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:15.506+0000 7fdde7459640 1 --2- 10.20.193.74:0/1665096308 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fdde010c130 0x7fdde011e430 secure :-1 s=READY pgs=34 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddd400d950 tx=0x7fddd400de20 comp rx=0 tx=0).stop 2026-02-24T09:14:15.511 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:15.506+0000 7fdde7459640 1 -- 10.20.193.74:0/1665096308 shutdown_connections 2026-02-24T09:14:15.511 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:15.506+0000 7fdde7459640 1 --2- 10.20.193.74:0/1665096308 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fddbc0b56a0 0x7fddbc0d5b50 unknown :-1 s=CLOSED pgs=49 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:15.511 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:15.506+0000 7fdde7459640 1 --2- 10.20.193.74:0/1665096308 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdde0114650 0x7fdde0123800 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:15.511 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:15.506+0000 7fdde7459640 1 --2- 10.20.193.74:0/1665096308 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fdde010c130 0x7fdde011e430 unknown :-1 s=CLOSED pgs=34 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:15.511 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:15.506+0000 7fdde7459640 1 --2- 10.20.193.74:0/1665096308 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fdde010b790 0x7fdde011def0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:15.511 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:15.506+0000 7fdde7459640 1 -- 10.20.193.74:0/1665096308 >> 10.20.193.74:0/1665096308 conn(0x7fdde00e9260 msgr2=0x7fdde0109640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:15.511 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:15.507+0000 7fdde7459640 1 -- 10.20.193.74:0/1665096308 shutdown_connections 2026-02-24T09:14:15.511 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:15.507+0000 7fdde7459640 1 -- 10.20.193.74:0/1665096308 wait complete. 2026-02-24T09:14:15.607 DEBUG:teuthology.orchestra.run.trial074:osd.1> sudo journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.1.service 2026-02-24T09:14:15.611 INFO:tasks.cephadm:Deploying osd.2 on trial159 with /dev/vg_nvme/lv_4... 2026-02-24T09:14:15.612 DEBUG:teuthology.orchestra.run.trial159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-24T09:14:15.796 INFO:teuthology.orchestra.run.trial159.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.c/config 2026-02-24T09:14:15.921 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:15 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:15.921 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:15 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:15.922 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:15 trial159 ceph-mon[44242]: pgmap v19: 0 pgs: ; 0 B data, 27 MiB used, 700 GiB / 700 GiB avail 2026-02-24T09:14:15.922 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:15 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:15.922 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:15 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:15.922 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:15 trial159 ceph-mon[44242]: from='osd.1 [v2:10.20.193.74:6800/267363486,v1:10.20.193.74:6801/267363486]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-24T09:14:15.922 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:15 trial159 ceph-mon[44242]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-24T09:14:16.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:15 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:16.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:15 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:16.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:15 trial028 ceph-mon[40371]: pgmap v19: 0 pgs: ; 0 B data, 27 MiB used, 700 GiB / 700 GiB avail 2026-02-24T09:14:16.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:15 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:16.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:15 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:16.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:15 trial028 ceph-mon[40371]: from='osd.1 [v2:10.20.193.74:6800/267363486,v1:10.20.193.74:6801/267363486]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-24T09:14:16.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:15 trial028 ceph-mon[40371]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-24T09:14:16.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:15 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:16.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:15 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:16.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:15 trial074 ceph-mon[44412]: pgmap v19: 0 pgs: ; 0 B data, 27 MiB used, 700 GiB / 700 GiB avail 2026-02-24T09:14:16.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:15 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:16.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:15 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:16.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:15 trial074 ceph-mon[44412]: from='osd.1 [v2:10.20.193.74:6800/267363486,v1:10.20.193.74:6801/267363486]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-24T09:14:16.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:15 trial074 ceph-mon[44412]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-24T09:14:16.125 INFO:journalctl@ceph.osd.1.trial074.stdout:Feb 24 09:14:15 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-1[51395]: 2026-02-24T09:14:15.741+0000 7f6e8fe46780 -1 osd.1 0 log_to_monitors true 2026-02-24T09:14:17.056 INFO:teuthology.orchestra.run.trial159.stdout: 2026-02-24T09:14:17.080 DEBUG:teuthology.orchestra.run.trial159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph orch daemon add osd trial159:vg_nvme/lv_4 --skip-validation 2026-02-24T09:14:17.266 INFO:teuthology.orchestra.run.trial159.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.c/config 2026-02-24T09:14:17.436 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.434+0000 7f761544e640 1 -- 10.20.193.159:0/1675727251 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f76101158b0 msgr2=0x7f7610176280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:17.436 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.434+0000 7f761544e640 1 --2- 10.20.193.159:0/1675727251 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f76101158b0 0x7f7610176280 secure :-1 s=READY pgs=27 gs=1 cs=0 l=1 c_cookie=13528866388399647918 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f760000aa30 tx=0x7f7600030270 comp rx=0 tx=0).stop 2026-02-24T09:14:17.436 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.434+0000 7f761544e640 1 -- 10.20.193.159:0/1675727251 shutdown_connections 2026-02-24T09:14:17.436 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.434+0000 7f761544e640 1 --2- 10.20.193.159:0/1675727251 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f76101158b0 0x7f7610176280 unknown :-1 s=CLOSED pgs=27 gs=1 cs=0 l=1 c_cookie=13528866388399647918 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:17.436 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.434+0000 7f761544e640 1 --2- 10.20.193.159:0/1675727251 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f76101100b0 0x7f7610115100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:17.436 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.434+0000 7f761544e640 1 --2- 10.20.193.159:0/1675727251 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f761010f6c0 0x7f761010fa90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:17.436 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.434+0000 7f761544e640 1 -- 10.20.193.159:0/1675727251 >> 10.20.193.159:0/1675727251 conn(0x7f76100ecfd0 msgr2=0x7f761010d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:17.437 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.434+0000 7f761544e640 1 -- 10.20.193.159:0/1675727251 shutdown_connections 2026-02-24T09:14:17.437 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.434+0000 7f761544e640 1 -- 10.20.193.159:0/1675727251 wait complete. 2026-02-24T09:14:17.437 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.435+0000 7f761544e640 1 Processor -- start 2026-02-24T09:14:17.437 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.435+0000 7f761544e640 1 -- start start 2026-02-24T09:14:17.437 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.435+0000 7f761544e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f761010f6c0 0x7f7610066f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:17.437 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.435+0000 7f761544e640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f76101100b0 0x7f76100631d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:17.437 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.435+0000 7f761544e640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f76101158b0 0x7f7610063830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:17.437 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.435+0000 7f761544e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7610063fc0 con 0x7f761010f6c0 2026-02-24T09:14:17.437 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.435+0000 7f761544e640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f7610168870 con 0x7f76101158b0 2026-02-24T09:14:17.437 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.435+0000 7f761544e640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7610168a30 con 0x7f76101100b0 2026-02-24T09:14:17.437 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.435+0000 7f760e7fc640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f76101100b0 0x7f76100631d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:17.437 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.435+0000 7f760e7fc640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f76101100b0 0x7f76100631d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.159:59658/0 (socket says 10.20.193.159:59658) 2026-02-24T09:14:17.438 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.435+0000 7f760e7fc640 1 -- 10.20.193.159:0/4014120215 learned_addr learned my addr 10.20.193.159:0/4014120215 (peer_addr_for_me v2:10.20.193.159:0/0) 2026-02-24T09:14:17.438 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.435+0000 7f760effd640 1 --2- 10.20.193.159:0/4014120215 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f761010f6c0 0x7f7610066f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:17.438 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.435+0000 7f760f7fe640 1 --2- 10.20.193.159:0/4014120215 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f76101158b0 0x7f7610063830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:17.438 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.435+0000 7f760e7fc640 1 -- 10.20.193.159:0/4014120215 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f76101158b0 msgr2=0x7f7610063830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:17.438 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.435+0000 7f760e7fc640 1 --2- 10.20.193.159:0/4014120215 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f76101158b0 0x7f7610063830 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:17.438 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.435+0000 7f760e7fc640 1 -- 10.20.193.159:0/4014120215 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f761010f6c0 msgr2=0x7f7610066f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:17.438 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.435+0000 7f760e7fc640 1 --2- 10.20.193.159:0/4014120215 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f761010f6c0 0x7f7610066f60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:17.438 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.435+0000 7f760e7fc640 1 -- 10.20.193.159:0/4014120215 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f760000a650 con 0x7f76101100b0 2026-02-24T09:14:17.438 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.436+0000 7f760e7fc640 1 --2- 10.20.193.159:0/4014120215 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f76101100b0 0x7f76100631d0 secure :-1 s=READY pgs=28 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f75f8005db0 tx=0x7f75f800ddf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:17.438 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.436+0000 7f75effff640 1 -- 10.20.193.159:0/4014120215 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f75f8004500 con 0x7f76101100b0 2026-02-24T09:14:17.438 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.436+0000 7f75effff640 1 -- 10.20.193.159:0/4014120215 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f75f8004d10 con 0x7f76101100b0 2026-02-24T09:14:17.438 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.436+0000 7f761544e640 1 -- 10.20.193.159:0/4014120215 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7610168d10 con 0x7f76101100b0 2026-02-24T09:14:17.439 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.436+0000 7f75effff640 1 -- 10.20.193.159:0/4014120215 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f75f8005280 con 0x7f76101100b0 2026-02-24T09:14:17.439 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.436+0000 7f761544e640 1 -- 10.20.193.159:0/4014120215 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76101691e0 con 0x7f76101100b0 2026-02-24T09:14:17.439 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.436+0000 7f75edffb640 1 -- 10.20.193.159:0/4014120215 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76101109a0 con 0x7f76101100b0 2026-02-24T09:14:17.440 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.439+0000 7f75effff640 1 -- 10.20.193.159:0/4014120215 <== mon.1 v2:10.20.193.159:3300/0 4 ==== mgrmap(e 18) ==== 157083+0+0 (secure 0 0 0) 0x7f75f8005410 con 0x7f76101100b0 2026-02-24T09:14:17.441 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.441+0000 7f75effff640 1 --2- 10.20.193.159:0/4014120215 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f75e40b5720 0x7f75e40d5bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:17.441 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.441+0000 7f75effff640 1 -- 10.20.193.159:0/4014120215 <== mon.1 v2:10.20.193.159:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2111+0+0 (secure 0 0 0) 0x7f75f80e5680 con 0x7f76101100b0 2026-02-24T09:14:17.441 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.441+0000 7f75effff640 1 -- 10.20.193.159:0/4014120215 <== mon.1 v2:10.20.193.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f75f80e5ab0 con 0x7f76101100b0 2026-02-24T09:14:17.441 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.441+0000 7f760effd640 1 --2- 10.20.193.159:0/4014120215 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f75e40b5720 0x7f75e40d5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:17.442 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.442+0000 7f760effd640 1 --2- 10.20.193.159:0/4014120215 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f75e40b5720 0x7f75e40d5bd0 secure :-1 s=READY pgs=54 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7604004740 tx=0x7f7604005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:17.561 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:17.561+0000 7f75edffb640 1 -- 10.20.193.159:0/4014120215 --> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial159:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f76100644d0 con 0x7f75e40b5720 2026-02-24T09:14:17.662 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:17 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:17.663 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:17 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:17.663 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:17 trial028 ceph-mon[40371]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-24T09:14:17.663 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:17 trial028 ceph-mon[40371]: osdmap e14: 2 total, 1 up, 2 in 2026-02-24T09:14:17.663 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:17 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:14:17.663 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:17 trial028 ceph-mon[40371]: from='osd.1 [v2:10.20.193.74:6800/267363486,v1:10.20.193.74:6801/267363486]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial074", "root=default"]} : dispatch 2026-02-24T09:14:17.663 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:17 trial028 ceph-mon[40371]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial074", "root=default"]} : dispatch 2026-02-24T09:14:17.663 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:17 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:14:17.663 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:17 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:17.663 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:17 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:17.663 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:17 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:17.663 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:17 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:17.697 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:17 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:17.698 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:17 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:17.698 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:17 trial074 ceph-mon[44412]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-24T09:14:17.698 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:17 trial074 ceph-mon[44412]: osdmap e14: 2 total, 1 up, 2 in 2026-02-24T09:14:17.698 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:17 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:14:17.698 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:17 trial074 ceph-mon[44412]: from='osd.1 [v2:10.20.193.74:6800/267363486,v1:10.20.193.74:6801/267363486]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial074", "root=default"]} : dispatch 2026-02-24T09:14:17.698 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:17 trial074 ceph-mon[44412]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial074", "root=default"]} : dispatch 2026-02-24T09:14:17.698 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:17 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:14:17.698 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:17 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:17.698 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:17 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:17.698 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:17 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:17.699 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:17 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:17.699 INFO:journalctl@ceph.osd.1.trial074.stdout:Feb 24 09:14:17 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-1[51395]: 2026-02-24T09:14:17.511+0000 7f6e8bdc8640 -1 osd.1 0 waiting for initial osdmap 2026-02-24T09:14:17.699 INFO:journalctl@ceph.osd.1.trial074.stdout:Feb 24 09:14:17 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-1[51395]: 2026-02-24T09:14:17.515+0000 7f6e87c8f640 -1 osd.1 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T09:14:17.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:17 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:17.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:17 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:17.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:17 trial159 ceph-mon[44242]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-24T09:14:17.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:17 trial159 ceph-mon[44242]: osdmap e14: 2 total, 1 up, 2 in 2026-02-24T09:14:17.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:17 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:14:17.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:17 trial159 ceph-mon[44242]: from='osd.1 [v2:10.20.193.74:6800/267363486,v1:10.20.193.74:6801/267363486]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial074", "root=default"]} : dispatch 2026-02-24T09:14:17.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:17 trial159 ceph-mon[44242]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial074", "root=default"]} : dispatch 2026-02-24T09:14:17.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:17 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:14:17.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:17 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:17.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:17 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:17.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:17 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:17.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:17 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:18.770 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:18 trial028 ceph-mon[40371]: pgmap v21: 0 pgs: ; 0 B data, 27 MiB used, 700 GiB / 700 GiB avail 2026-02-24T09:14:18.770 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:18 trial028 ceph-mon[40371]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial074", "root=default"]}]': finished 2026-02-24T09:14:18.770 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:18 trial028 ceph-mon[40371]: osdmap e15: 2 total, 1 up, 2 in 2026-02-24T09:14:18.770 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:18 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:14:18.770 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:18 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:14:18.770 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:18 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:18.770 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:18 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:18.770 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:18 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:14:18.770 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:18 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:14:18.771 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:18 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:18.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:18 trial159 ceph-mon[44242]: pgmap v21: 0 pgs: ; 0 B data, 27 MiB used, 700 GiB / 700 GiB avail 2026-02-24T09:14:18.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:18 trial159 ceph-mon[44242]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial074", "root=default"]}]': finished 2026-02-24T09:14:18.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:18 trial159 ceph-mon[44242]: osdmap e15: 2 total, 1 up, 2 in 2026-02-24T09:14:18.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:18 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:14:18.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:18 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:14:18.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:18 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:18.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:18 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:18.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:18 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:14:18.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:18 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:14:18.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:18 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:18.826 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:18 trial074 ceph-mon[44412]: pgmap v21: 0 pgs: ; 0 B data, 27 MiB used, 700 GiB / 700 GiB avail 2026-02-24T09:14:18.827 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:18 trial074 ceph-mon[44412]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial074", "root=default"]}]': finished 2026-02-24T09:14:18.827 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:18 trial074 ceph-mon[44412]: osdmap e15: 2 total, 1 up, 2 in 2026-02-24T09:14:18.827 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:18 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:14:18.827 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:18 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:14:18.827 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:18 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:18.827 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:18 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:18.827 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:18 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:14:18.827 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:18 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:14:18.828 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:18 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:19.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:19 trial159 ceph-mon[44242]: purged_snaps scrub starts 2026-02-24T09:14:19.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:19 trial159 ceph-mon[44242]: purged_snaps scrub ok 2026-02-24T09:14:19.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:19 trial159 ceph-mon[44242]: from='client.24328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial159:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:14:19.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:19 trial159 ceph-mon[44242]: osd.default does not exist. Creating it now. 2026-02-24T09:14:19.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:19 trial159 ceph-mon[44242]: Creating OSDs with service ID: default on trial159:['vg_nvme/lv_4'] 2026-02-24T09:14:19.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:19 trial159 ceph-mon[44242]: Marking host: trial159 for OSDSpec preview refresh. 2026-02-24T09:14:19.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:19 trial159 ceph-mon[44242]: Saving service osd.default spec with placement trial159 2026-02-24T09:14:19.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:19 trial159 ceph-mon[44242]: osd.1 [v2:10.20.193.74:6800/267363486,v1:10.20.193.74:6801/267363486] boot 2026-02-24T09:14:19.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:19 trial159 ceph-mon[44242]: osdmap e16: 2 total, 2 up, 2 in 2026-02-24T09:14:19.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:19 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:14:19.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:19 trial159 ceph-mon[44242]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dea96db1-588b-4d08-8e52-52c4c995bdc0"} : dispatch 2026-02-24T09:14:19.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:19 trial159 ceph-mon[44242]: from='client.? 10.20.193.159:0/3151424219' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dea96db1-588b-4d08-8e52-52c4c995bdc0"} : dispatch 2026-02-24T09:14:19.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:19 trial159 ceph-mon[44242]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dea96db1-588b-4d08-8e52-52c4c995bdc0"}]': finished 2026-02-24T09:14:19.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:19 trial159 ceph-mon[44242]: osdmap e17: 3 total, 2 up, 3 in 2026-02-24T09:14:19.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:19 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:14:19.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:19 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:19.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:19 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:19.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:19 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:19.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:19 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:19.782 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:19 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:19.782 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:19 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:19.782 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:19 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T09:14:19.782 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:19 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:19.782 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:19 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:19.782 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:19 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:14:19.782 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:19 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:19.782 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:19 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:14:19.782 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:19 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:14:19.782 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:19 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:19.782 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:19 trial159 ceph-mon[44242]: from='client.? 10.20.193.159:0/1622236989' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:14:19.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:19 trial028 ceph-mon[40371]: purged_snaps scrub starts 2026-02-24T09:14:19.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:19 trial028 ceph-mon[40371]: purged_snaps scrub ok 2026-02-24T09:14:19.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:19 trial028 ceph-mon[40371]: from='client.24328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial159:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:14:19.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:19 trial028 ceph-mon[40371]: osd.default does not exist. Creating it now. 2026-02-24T09:14:19.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:19 trial028 ceph-mon[40371]: Creating OSDs with service ID: default on trial159:['vg_nvme/lv_4'] 2026-02-24T09:14:19.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:19 trial028 ceph-mon[40371]: Marking host: trial159 for OSDSpec preview refresh. 2026-02-24T09:14:19.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:19 trial028 ceph-mon[40371]: Saving service osd.default spec with placement trial159 2026-02-24T09:14:19.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:19 trial028 ceph-mon[40371]: osd.1 [v2:10.20.193.74:6800/267363486,v1:10.20.193.74:6801/267363486] boot 2026-02-24T09:14:19.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:19 trial028 ceph-mon[40371]: osdmap e16: 2 total, 2 up, 2 in 2026-02-24T09:14:19.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:19 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:14:19.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:19 trial028 ceph-mon[40371]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dea96db1-588b-4d08-8e52-52c4c995bdc0"} : dispatch 2026-02-24T09:14:19.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:19 trial028 ceph-mon[40371]: from='client.? 10.20.193.159:0/3151424219' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dea96db1-588b-4d08-8e52-52c4c995bdc0"} : dispatch 2026-02-24T09:14:19.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:19 trial028 ceph-mon[40371]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dea96db1-588b-4d08-8e52-52c4c995bdc0"}]': finished 2026-02-24T09:14:19.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:19 trial028 ceph-mon[40371]: osdmap e17: 3 total, 2 up, 3 in 2026-02-24T09:14:19.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:19 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:14:19.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:19 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:19.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:19 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:19.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:19 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:19.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:19 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:19.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:19 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:19.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:19 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:19.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:19 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T09:14:19.863 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:19 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:19.863 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:19 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:19.863 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:19 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:14:19.863 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:19 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:19.863 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:19 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:14:19.863 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:19 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:14:19.863 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:19 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:19.863 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:19 trial028 ceph-mon[40371]: from='client.? 10.20.193.159:0/1622236989' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:14:19.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:19 trial074 ceph-mon[44412]: purged_snaps scrub starts 2026-02-24T09:14:19.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:19 trial074 ceph-mon[44412]: purged_snaps scrub ok 2026-02-24T09:14:19.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:19 trial074 ceph-mon[44412]: from='client.24328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial159:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:14:19.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:19 trial074 ceph-mon[44412]: osd.default does not exist. Creating it now. 2026-02-24T09:14:19.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:19 trial074 ceph-mon[44412]: Creating OSDs with service ID: default on trial159:['vg_nvme/lv_4'] 2026-02-24T09:14:19.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:19 trial074 ceph-mon[44412]: Marking host: trial159 for OSDSpec preview refresh. 2026-02-24T09:14:19.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:19 trial074 ceph-mon[44412]: Saving service osd.default spec with placement trial159 2026-02-24T09:14:19.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:19 trial074 ceph-mon[44412]: osd.1 [v2:10.20.193.74:6800/267363486,v1:10.20.193.74:6801/267363486] boot 2026-02-24T09:14:19.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:19 trial074 ceph-mon[44412]: osdmap e16: 2 total, 2 up, 2 in 2026-02-24T09:14:19.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:19 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:14:19.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:19 trial074 ceph-mon[44412]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dea96db1-588b-4d08-8e52-52c4c995bdc0"} : dispatch 2026-02-24T09:14:19.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:19 trial074 ceph-mon[44412]: from='client.? 10.20.193.159:0/3151424219' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dea96db1-588b-4d08-8e52-52c4c995bdc0"} : dispatch 2026-02-24T09:14:19.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:19 trial074 ceph-mon[44412]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dea96db1-588b-4d08-8e52-52c4c995bdc0"}]': finished 2026-02-24T09:14:19.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:19 trial074 ceph-mon[44412]: osdmap e17: 3 total, 2 up, 3 in 2026-02-24T09:14:19.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:19 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:14:19.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:19 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:19.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:19 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:19.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:19 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:19.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:19 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:19.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:19 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:19.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:19 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:19.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:19 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T09:14:19.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:19 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:19.876 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:19 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:19.876 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:19 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:14:19.876 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:19 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:19.876 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:19 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:14:19.876 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:19 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:14:19.876 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:19 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:19.876 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:19 trial074 ceph-mon[44412]: from='client.? 10.20.193.159:0/1622236989' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:14:20.709 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:20 trial159 ceph-mon[44242]: Detected new or changed devices on trial074 2026-02-24T09:14:20.709 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:20 trial159 ceph-mon[44242]: Adjusting osd_memory_target on trial074 to 84053M 2026-02-24T09:14:20.710 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:20 trial159 ceph-mon[44242]: pgmap v25: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T09:14:20.710 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:20 trial159 ceph-mon[44242]: osdmap e18: 3 total, 2 up, 3 in 2026-02-24T09:14:20.710 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:20 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:14:20.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:20 trial028 ceph-mon[40371]: Detected new or changed devices on trial074 2026-02-24T09:14:20.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:20 trial028 ceph-mon[40371]: Adjusting osd_memory_target on trial074 to 84053M 2026-02-24T09:14:20.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:20 trial028 ceph-mon[40371]: pgmap v25: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T09:14:20.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:20 trial028 ceph-mon[40371]: osdmap e18: 3 total, 2 up, 3 in 2026-02-24T09:14:20.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:20 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:14:20.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:20 trial074 ceph-mon[44412]: Detected new or changed devices on trial074 2026-02-24T09:14:20.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:20 trial074 ceph-mon[44412]: Adjusting osd_memory_target on trial074 to 84053M 2026-02-24T09:14:20.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:20 trial074 ceph-mon[44412]: pgmap v25: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T09:14:20.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:20 trial074 ceph-mon[44412]: osdmap e18: 3 total, 2 up, 3 in 2026-02-24T09:14:20.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:20 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:14:22.572 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:22 trial159 ceph-mon[44242]: pgmap v27: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T09:14:22.572 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:22 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-24T09:14:22.572 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:22 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:22.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:22 trial028 ceph-mon[40371]: pgmap v27: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T09:14:22.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:22 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-24T09:14:22.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:22 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:22.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:22 trial074 ceph-mon[44412]: pgmap v27: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T09:14:22.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:22 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-24T09:14:22.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:22 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:23.774 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:23 trial159 ceph-mon[44242]: Deploying daemon osd.2 on trial159 2026-02-24T09:14:23.774 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:23 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-24T09:14:23.774 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:23 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:23.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:23 trial028 ceph-mon[40371]: Deploying daemon osd.2 on trial159 2026-02-24T09:14:23.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:23 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-24T09:14:23.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:23 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:23.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:23 trial074 ceph-mon[44412]: Deploying daemon osd.2 on trial159 2026-02-24T09:14:23.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:23 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-24T09:14:23.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:23 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:24.709 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:24 trial159 ceph-mon[44242]: Deploying daemon osd.2 on trial159 2026-02-24T09:14:24.710 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:24 trial159 ceph-mon[44242]: pgmap v28: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T09:14:24.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:24 trial028 ceph-mon[40371]: Deploying daemon osd.2 on trial159 2026-02-24T09:14:24.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:24 trial028 ceph-mon[40371]: pgmap v28: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T09:14:24.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:24 trial074 ceph-mon[44412]: Deploying daemon osd.2 on trial159 2026-02-24T09:14:24.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:24 trial074 ceph-mon[44412]: pgmap v28: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T09:14:26.505 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:26 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:26.506 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:26 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:26.506 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:26 trial159 ceph-mon[44242]: pgmap v29: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T09:14:26.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:26 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:26.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:26 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:26.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:26 trial028 ceph-mon[40371]: pgmap v29: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T09:14:26.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:26 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:26.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:26 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:26.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:26 trial074 ceph-mon[44412]: pgmap v29: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T09:14:27.360 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:27 trial159 ceph-mon[44242]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-24T09:14:27.360 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:27 trial159 ceph-mon[44242]: from='osd.2 [v2:10.20.193.159:6800/3211167479,v1:10.20.193.159:6801/3211167479]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-24T09:14:27.438 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:27.438+0000 7f7614c4d640 1 -- 10.20.193.159:0/4014120215 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=15}) -- 0x7f75e8003560 con 0x7f76101100b0 2026-02-24T09:14:27.438 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:27.438+0000 7f75effff640 1 -- 10.20.193.159:0/4014120215 <== mon.1 v2:10.20.193.159:3300/0 7 ==== osd_map(15..19 src has 1..19) ==== 3217+0+0 (secure 0 0 0) 0x7f75f8009940 con 0x7f76101100b0 2026-02-24T09:14:27.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:27 trial028 ceph-mon[40371]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-24T09:14:27.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:27 trial028 ceph-mon[40371]: from='osd.2 [v2:10.20.193.159:6800/3211167479,v1:10.20.193.159:6801/3211167479]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-24T09:14:27.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:27 trial074 ceph-mon[44412]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-24T09:14:27.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:27 trial074 ceph-mon[44412]: from='osd.2 [v2:10.20.193.159:6800/3211167479,v1:10.20.193.159:6801/3211167479]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-24T09:14:28.369 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:28 trial159 ceph-mon[44242]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-24T09:14:28.369 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:28 trial159 ceph-mon[44242]: osdmap e19: 3 total, 2 up, 3 in 2026-02-24T09:14:28.369 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:28 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:14:28.369 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:28 trial159 ceph-mon[44242]: pgmap v31: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T09:14:28.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:28 trial028 ceph-mon[40371]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-24T09:14:28.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:28 trial028 ceph-mon[40371]: osdmap e19: 3 total, 2 up, 3 in 2026-02-24T09:14:28.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:28 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:14:28.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:28 trial028 ceph-mon[40371]: pgmap v31: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T09:14:28.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:28 trial074 ceph-mon[44412]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-24T09:14:28.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:28 trial074 ceph-mon[44412]: osdmap e19: 3 total, 2 up, 3 in 2026-02-24T09:14:28.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:28 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:14:28.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:28 trial074 ceph-mon[44412]: pgmap v31: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T09:14:29.428 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:29.428+0000 7f75effff640 1 -- 10.20.193.159:0/4014120215 <== mgr.14223 v2:10.20.193.28:6800/906910473 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f76100644d0 con 0x7f75e40b5720 2026-02-24T09:14:29.428 INFO:teuthology.orchestra.run.trial159.stdout:Created osd(s) 2 on host 'trial159' 2026-02-24T09:14:29.431 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:29.431+0000 7f75edffb640 1 -- 10.20.193.159:0/4014120215 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f75e40b5720 msgr2=0x7f75e40d5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:29.431 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:29.431+0000 7f75edffb640 1 --2- 10.20.193.159:0/4014120215 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f75e40b5720 0x7f75e40d5bd0 secure :-1 s=READY pgs=54 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7604004740 tx=0x7f7604005f90 comp rx=0 tx=0).stop 2026-02-24T09:14:29.431 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:29.431+0000 7f75edffb640 1 -- 10.20.193.159:0/4014120215 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f76101100b0 msgr2=0x7f76100631d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:29.431 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:29.431+0000 7f75edffb640 1 --2- 10.20.193.159:0/4014120215 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f76101100b0 0x7f76100631d0 secure :-1 s=READY pgs=28 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f75f8005db0 tx=0x7f75f800ddf0 comp rx=0 tx=0).stop 2026-02-24T09:14:29.431 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:29.431+0000 7f75edffb640 1 -- 10.20.193.159:0/4014120215 shutdown_connections 2026-02-24T09:14:29.432 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:29.431+0000 7f75edffb640 1 --2- 10.20.193.159:0/4014120215 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f75e40b5720 0x7f75e40d5bd0 unknown :-1 s=CLOSED pgs=54 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:29.432 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:29.431+0000 7f75edffb640 1 --2- 10.20.193.159:0/4014120215 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f76101158b0 0x7f7610063830 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:29.432 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:29.431+0000 7f75edffb640 1 --2- 10.20.193.159:0/4014120215 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f76101100b0 0x7f76100631d0 unknown :-1 s=CLOSED pgs=28 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:29.432 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:29.431+0000 7f75edffb640 1 --2- 10.20.193.159:0/4014120215 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f761010f6c0 0x7f7610066f60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:29.432 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:29.431+0000 7f75edffb640 1 -- 10.20.193.159:0/4014120215 >> 10.20.193.159:0/4014120215 conn(0x7f76100ecfd0 msgr2=0x7f761010d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:29.432 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:29.431+0000 7f75edffb640 1 -- 10.20.193.159:0/4014120215 shutdown_connections 2026-02-24T09:14:29.432 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:29.431+0000 7f75edffb640 1 -- 10.20.193.159:0/4014120215 wait complete. 2026-02-24T09:14:29.531 DEBUG:teuthology.orchestra.run.trial159:osd.2> sudo journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.2.service 2026-02-24T09:14:29.535 INFO:tasks.cephadm:Deploying osd.3 on trial028 with /dev/vg_nvme/lv_3... 2026-02-24T09:14:29.535 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-24T09:14:29.728 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:14:29.853 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:29 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:29.854 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:29 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:29.854 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:29 trial028 ceph-mon[40371]: pgmap v32: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T09:14:29.854 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:29 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:29.854 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:29 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:30.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:29 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:30.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:29 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:30.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:29 trial159 ceph-mon[44242]: pgmap v32: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T09:14:30.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:29 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:30.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:29 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:30.030 INFO:journalctl@ceph.osd.2.trial159.stdout:Feb 24 09:14:29 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-2[51436]: 2026-02-24T09:14:29.658+0000 7fa16e2e8780 -1 osd.2 0 log_to_monitors true 2026-02-24T09:14:30.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:29 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:30.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:29 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:30.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:29 trial074 ceph-mon[44412]: pgmap v32: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T09:14:30.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:29 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:30.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:29 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:30.650 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:14:30.676 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph orch daemon add osd trial028:vg_nvme/lv_3 --skip-validation 2026-02-24T09:14:30.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:30 trial028 ceph-mon[40371]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-24T09:14:30.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:30 trial028 ceph-mon[40371]: from='osd.2 [v2:10.20.193.159:6800/3320466721,v1:10.20.193.159:6801/3320466721]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-24T09:14:30.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:30 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:30.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:30 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:30.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:30 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:14:30.863 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:14:31.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:30 trial159 ceph-mon[44242]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-24T09:14:31.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:30 trial159 ceph-mon[44242]: from='osd.2 [v2:10.20.193.159:6800/3320466721,v1:10.20.193.159:6801/3320466721]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-24T09:14:31.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:30 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:31.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:30 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:31.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:30 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:14:31.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.051+0000 7f533d82d640 1 -- 10.20.193.28:0/2536698966 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53381158b0 msgr2=0x7f5338176280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:31.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.051+0000 7f533d82d640 1 --2- 10.20.193.28:0/2536698966 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53381158b0 0x7f5338176280 secure :-1 s=READY pgs=160 gs=1 cs=0 l=1 c_cookie=8421598026767241530 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f532800aa30 tx=0x7f5328030270 comp rx=0 tx=0).stop 2026-02-24T09:14:31.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.051+0000 7f533d82d640 1 -- 10.20.193.28:0/2536698966 shutdown_connections 2026-02-24T09:14:31.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.051+0000 7f533d82d640 1 --2- 10.20.193.28:0/2536698966 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53381158b0 0x7f5338176280 unknown :-1 s=CLOSED pgs=160 gs=1 cs=0 l=1 c_cookie=8421598026767241530 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:31.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.051+0000 7f533d82d640 1 --2- 10.20.193.28:0/2536698966 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f53381100b0 0x7f5338115100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:31.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.051+0000 7f533d82d640 1 --2- 10.20.193.28:0/2536698966 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f533810f6c0 0x7f533810fa90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:31.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.051+0000 7f533d82d640 1 -- 10.20.193.28:0/2536698966 >> 10.20.193.28:0/2536698966 conn(0x7f53380ecfd0 msgr2=0x7f533810d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:31.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.051+0000 7f533d82d640 1 -- 10.20.193.28:0/2536698966 shutdown_connections 2026-02-24T09:14:31.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.051+0000 7f533d82d640 1 -- 10.20.193.28:0/2536698966 wait complete. 2026-02-24T09:14:31.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.052+0000 7f533d82d640 1 Processor -- start 2026-02-24T09:14:31.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.052+0000 7f533d82d640 1 -- start start 2026-02-24T09:14:31.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.052+0000 7f533d82d640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f533810f6c0 0x7f533811df20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:31.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.052+0000 7f533d82d640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f53381100b0 0x7f533811e460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:31.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.052+0000 7f533d82d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53381158b0 0x7f5338123830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:31.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.052+0000 7f533d82d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5338123e50 con 0x7f53381158b0 2026-02-24T09:14:31.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.052+0000 7f533d82d640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f5338123fc0 con 0x7f53381100b0 2026-02-24T09:14:31.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.052+0000 7f533d82d640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5338124180 con 0x7f533810f6c0 2026-02-24T09:14:31.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.052+0000 7f53377fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53381158b0 0x7f5338123830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:31.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.052+0000 7f53377fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53381158b0 0x7f5338123830 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54272/0 (socket says 10.20.193.28:54272) 2026-02-24T09:14:31.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.052+0000 7f53377fe640 1 -- 10.20.193.28:0/1695788414 learned_addr learned my addr 10.20.193.28:0/1695788414 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:14:31.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.053+0000 7f53367fc640 1 --2- 10.20.193.28:0/1695788414 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f53381100b0 0x7f533811e460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:31.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.053+0000 7f5336ffd640 1 --2- 10.20.193.28:0/1695788414 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f533810f6c0 0x7f533811df20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:31.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.053+0000 7f53377fe640 1 -- 10.20.193.28:0/1695788414 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f533810f6c0 msgr2=0x7f533811df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:31.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.053+0000 7f53377fe640 1 --2- 10.20.193.28:0/1695788414 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f533810f6c0 0x7f533811df20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:31.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.053+0000 7f53377fe640 1 -- 10.20.193.28:0/1695788414 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f53381100b0 msgr2=0x7f533811e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:31.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.053+0000 7f53377fe640 1 --2- 10.20.193.28:0/1695788414 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f53381100b0 0x7f533811e460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:31.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.053+0000 7f53377fe640 1 -- 10.20.193.28:0/1695788414 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f532800a650 con 0x7f53381158b0 2026-02-24T09:14:31.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.053+0000 7f53377fe640 1 --2- 10.20.193.28:0/1695788414 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53381158b0 0x7f5338123830 secure :-1 s=READY pgs=161 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5328033040 tx=0x7f5328030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:31.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.053+0000 7f533c82b640 1 -- 10.20.193.28:0/1695788414 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f532803e070 con 0x7f53381158b0 2026-02-24T09:14:31.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.053+0000 7f533c82b640 1 -- 10.20.193.28:0/1695788414 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f5328005580 con 0x7f53381158b0 2026-02-24T09:14:31.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.053+0000 7f533c82b640 1 -- 10.20.193.28:0/1695788414 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5328042d30 con 0x7f53381158b0 2026-02-24T09:14:31.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.053+0000 7f533d82d640 1 -- 10.20.193.28:0/1695788414 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5338124400 con 0x7f53381158b0 2026-02-24T09:14:31.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.053+0000 7f533d82d640 1 -- 10.20.193.28:0/1695788414 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53381649c0 con 0x7f53381158b0 2026-02-24T09:14:31.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.054+0000 7f533d82d640 1 -- 10.20.193.28:0/1695788414 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52fc005300 con 0x7f53381158b0 2026-02-24T09:14:31.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.056+0000 7f533c82b640 1 -- 10.20.193.28:0/1695788414 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 18) ==== 157083+0+0 (secure 0 0 0) 0x7f5328039470 con 0x7f53381158b0 2026-02-24T09:14:31.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.057+0000 7f533c82b640 1 --2- 10.20.193.28:0/1695788414 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f530c0b5720 0x7f530c0d5bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:31.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.058+0000 7f533c82b640 1 -- 10.20.193.28:0/1695788414 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 2651+0+0 (secure 0 0 0) 0x7f532810b740 con 0x7f53381158b0 2026-02-24T09:14:31.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.058+0000 7f533c82b640 1 -- 10.20.193.28:0/1695788414 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f532810bb70 con 0x7f53381158b0 2026-02-24T09:14:31.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.058+0000 7f5336ffd640 1 --2- 10.20.193.28:0/1695788414 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f530c0b5720 0x7f530c0d5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:31.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.058+0000 7f5336ffd640 1 --2- 10.20.193.28:0/1695788414 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f530c0b5720 0x7f530c0d5bd0 secure :-1 s=READY pgs=59 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f532c004740 tx=0x7f532c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:31.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:30 trial074 ceph-mon[44412]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-24T09:14:31.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:30 trial074 ceph-mon[44412]: from='osd.2 [v2:10.20.193.159:6800/3320466721,v1:10.20.193.159:6801/3320466721]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-24T09:14:31.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:30 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:31.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:30 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:31.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:30 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:14:31.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:31.178+0000 7f533d82d640 1 -- 10.20.193.28:0/1695788414 --> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f52fc002bb0 con 0x7f530c0b5720 2026-02-24T09:14:31.717 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:31 trial028 ceph-mon[40371]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-24T09:14:31.717 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:31 trial028 ceph-mon[40371]: osdmap e20: 3 total, 2 up, 3 in 2026-02-24T09:14:31.717 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:31 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:14:31.717 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:31 trial028 ceph-mon[40371]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial159", "root=default"]} : dispatch 2026-02-24T09:14:31.717 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:31 trial028 ceph-mon[40371]: from='osd.2 [v2:10.20.193.159:6800/3320466721,v1:10.20.193.159:6801/3320466721]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial159", "root=default"]} : dispatch 2026-02-24T09:14:31.717 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:31 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:31.717 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:31 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:31.718 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:31 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:31.718 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:31 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:31.718 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:31 trial028 ceph-mon[40371]: from='client.14496 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:14:31.718 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:31 trial028 ceph-mon[40371]: osd.default does not exist. Creating it now. 2026-02-24T09:14:31.718 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:31 trial028 ceph-mon[40371]: Creating OSDs with service ID: default on trial028:['vg_nvme/lv_3'] 2026-02-24T09:14:31.718 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:31 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:31.718 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:31 trial028 ceph-mon[40371]: Marking host: trial028 for OSDSpec preview refresh. 2026-02-24T09:14:31.718 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:31 trial028 ceph-mon[40371]: Saving service osd.default spec with placement trial028 2026-02-24T09:14:31.718 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:31 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:31.718 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:31 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:14:31.718 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:31 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:14:31.718 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:31 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:31.718 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:31 trial028 ceph-mon[40371]: pgmap v34: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T09:14:31.779 INFO:journalctl@ceph.osd.2.trial159.stdout:Feb 24 09:14:31 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-2[51436]: 2026-02-24T09:14:31.664+0000 7fa16a26a640 -1 osd.2 0 waiting for initial osdmap 2026-02-24T09:14:31.780 INFO:journalctl@ceph.osd.2.trial159.stdout:Feb 24 09:14:31 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-2[51436]: 2026-02-24T09:14:31.669+0000 7fa166131640 -1 osd.2 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T09:14:31.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:31 trial159 ceph-mon[44242]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-24T09:14:31.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:31 trial159 ceph-mon[44242]: osdmap e20: 3 total, 2 up, 3 in 2026-02-24T09:14:31.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:31 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:14:31.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:31 trial159 ceph-mon[44242]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial159", "root=default"]} : dispatch 2026-02-24T09:14:31.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:31 trial159 ceph-mon[44242]: from='osd.2 [v2:10.20.193.159:6800/3320466721,v1:10.20.193.159:6801/3320466721]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial159", "root=default"]} : dispatch 2026-02-24T09:14:31.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:31 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:31.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:31 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:31.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:31 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:31.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:31 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:31.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:31 trial159 ceph-mon[44242]: from='client.14496 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:14:31.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:31 trial159 ceph-mon[44242]: osd.default does not exist. Creating it now. 2026-02-24T09:14:31.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:31 trial159 ceph-mon[44242]: Creating OSDs with service ID: default on trial028:['vg_nvme/lv_3'] 2026-02-24T09:14:31.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:31 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:31.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:31 trial159 ceph-mon[44242]: Marking host: trial028 for OSDSpec preview refresh. 2026-02-24T09:14:31.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:31 trial159 ceph-mon[44242]: Saving service osd.default spec with placement trial028 2026-02-24T09:14:31.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:31 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:31.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:31 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:14:31.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:31 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:14:31.782 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:31 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:31.782 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:31 trial159 ceph-mon[44242]: pgmap v34: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T09:14:31.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:31 trial074 ceph-mon[44412]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-24T09:14:31.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:31 trial074 ceph-mon[44412]: osdmap e20: 3 total, 2 up, 3 in 2026-02-24T09:14:31.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:31 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:14:31.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:31 trial074 ceph-mon[44412]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial159", "root=default"]} : dispatch 2026-02-24T09:14:31.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:31 trial074 ceph-mon[44412]: from='osd.2 [v2:10.20.193.159:6800/3320466721,v1:10.20.193.159:6801/3320466721]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial159", "root=default"]} : dispatch 2026-02-24T09:14:31.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:31 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:31.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:31 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:31.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:31 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:31.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:31 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:31.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:31 trial074 ceph-mon[44412]: from='client.14496 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:14:31.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:31 trial074 ceph-mon[44412]: osd.default does not exist. Creating it now. 2026-02-24T09:14:31.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:31 trial074 ceph-mon[44412]: Creating OSDs with service ID: default on trial028:['vg_nvme/lv_3'] 2026-02-24T09:14:31.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:31 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:31.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:31 trial074 ceph-mon[44412]: Marking host: trial028 for OSDSpec preview refresh. 2026-02-24T09:14:31.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:31 trial074 ceph-mon[44412]: Saving service osd.default spec with placement trial028 2026-02-24T09:14:31.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:31 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:31.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:31 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:14:31.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:31 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:14:31.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:31 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:31.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:31 trial074 ceph-mon[44412]: pgmap v34: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T09:14:32.802 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:32 trial028 ceph-mon[40371]: purged_snaps scrub starts 2026-02-24T09:14:32.802 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:32 trial028 ceph-mon[40371]: purged_snaps scrub ok 2026-02-24T09:14:32.802 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:32 trial028 ceph-mon[40371]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial159", "root=default"]}]': finished 2026-02-24T09:14:32.802 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:32 trial028 ceph-mon[40371]: osdmap e21: 3 total, 2 up, 3 in 2026-02-24T09:14:32.802 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:32 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:14:32.802 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:32 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:14:32.802 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:32 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/2195066846' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c785c244-eb3f-4af5-83c6-cd492459f75e"} : dispatch 2026-02-24T09:14:32.803 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:32 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/2195066846' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c785c244-eb3f-4af5-83c6-cd492459f75e"}]': finished 2026-02-24T09:14:32.803 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:32 trial028 ceph-mon[40371]: osd.2 [v2:10.20.193.159:6800/3320466721,v1:10.20.193.159:6801/3320466721] boot 2026-02-24T09:14:32.803 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:32 trial028 ceph-mon[40371]: osdmap e22: 4 total, 3 up, 4 in 2026-02-24T09:14:32.803 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:32 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:14:32.803 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:32 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:14:32.803 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:32 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:32.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:32 trial074 ceph-mon[44412]: purged_snaps scrub starts 2026-02-24T09:14:32.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:32 trial074 ceph-mon[44412]: purged_snaps scrub ok 2026-02-24T09:14:32.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:32 trial074 ceph-mon[44412]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial159", "root=default"]}]': finished 2026-02-24T09:14:32.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:32 trial074 ceph-mon[44412]: osdmap e21: 3 total, 2 up, 3 in 2026-02-24T09:14:32.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:32 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:14:32.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:32 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:14:32.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:32 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/2195066846' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c785c244-eb3f-4af5-83c6-cd492459f75e"} : dispatch 2026-02-24T09:14:32.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:32 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/2195066846' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c785c244-eb3f-4af5-83c6-cd492459f75e"}]': finished 2026-02-24T09:14:32.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:32 trial074 ceph-mon[44412]: osd.2 [v2:10.20.193.159:6800/3320466721,v1:10.20.193.159:6801/3320466721] boot 2026-02-24T09:14:32.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:32 trial074 ceph-mon[44412]: osdmap e22: 4 total, 3 up, 4 in 2026-02-24T09:14:32.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:32 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:14:32.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:32 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:14:32.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:32 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:33.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:32 trial159 ceph-mon[44242]: purged_snaps scrub starts 2026-02-24T09:14:33.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:32 trial159 ceph-mon[44242]: purged_snaps scrub ok 2026-02-24T09:14:33.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:32 trial159 ceph-mon[44242]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial159", "root=default"]}]': finished 2026-02-24T09:14:33.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:32 trial159 ceph-mon[44242]: osdmap e21: 3 total, 2 up, 3 in 2026-02-24T09:14:33.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:32 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:14:33.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:32 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:14:33.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:32 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/2195066846' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c785c244-eb3f-4af5-83c6-cd492459f75e"} : dispatch 2026-02-24T09:14:33.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:32 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/2195066846' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c785c244-eb3f-4af5-83c6-cd492459f75e"}]': finished 2026-02-24T09:14:33.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:32 trial159 ceph-mon[44242]: osd.2 [v2:10.20.193.159:6800/3320466721,v1:10.20.193.159:6801/3320466721] boot 2026-02-24T09:14:33.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:32 trial159 ceph-mon[44242]: osdmap e22: 4 total, 3 up, 4 in 2026-02-24T09:14:33.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:32 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:14:33.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:32 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:14:33.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:32 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:34.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:33 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:34.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:33 trial159 ceph-mon[44242]: Detected new or changed devices on trial159 2026-02-24T09:14:34.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:33 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:34.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:33 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:34.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:33 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:34.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:33 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:34.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:33 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T09:14:34.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:33 trial159 ceph-mon[44242]: Adjusting osd_memory_target on trial159 to 84053M 2026-02-24T09:14:34.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:33 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:34.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:33 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:34.031 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:33 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:14:34.031 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:33 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:34.031 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:33 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:14:34.031 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:33 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:14:34.031 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:33 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:34.031 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:33 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/1735421115' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:14:34.031 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:33 trial159 ceph-mon[44242]: pgmap v37: 0 pgs: ; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T09:14:34.031 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:33 trial159 ceph-mon[44242]: osdmap e23: 4 total, 3 up, 4 in 2026-02-24T09:14:34.031 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:33 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:14:34.031 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:33 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-24T09:14:34.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:33 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:34.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:33 trial028 ceph-mon[40371]: Detected new or changed devices on trial159 2026-02-24T09:14:34.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:33 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:34.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:33 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:34.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:33 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:34.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:33 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:34.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:33 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T09:14:34.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:33 trial028 ceph-mon[40371]: Adjusting osd_memory_target on trial159 to 84053M 2026-02-24T09:14:34.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:33 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:34.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:33 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:34.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:33 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:14:34.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:33 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:34.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:33 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:14:34.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:33 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:14:34.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:33 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:34.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:33 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/1735421115' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:14:34.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:33 trial028 ceph-mon[40371]: pgmap v37: 0 pgs: ; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T09:14:34.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:33 trial028 ceph-mon[40371]: osdmap e23: 4 total, 3 up, 4 in 2026-02-24T09:14:34.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:33 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:14:34.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:33 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-24T09:14:34.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:33 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:34.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:33 trial074 ceph-mon[44412]: Detected new or changed devices on trial159 2026-02-24T09:14:34.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:33 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:34.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:33 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:34.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:33 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:34.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:33 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:34.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:33 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T09:14:34.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:33 trial074 ceph-mon[44412]: Adjusting osd_memory_target on trial159 to 84053M 2026-02-24T09:14:34.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:33 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:34.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:33 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:34.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:33 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:14:34.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:33 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:34.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:33 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:14:34.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:33 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:14:34.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:33 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:34.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:33 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/1735421115' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:14:34.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:33 trial074 ceph-mon[44412]: pgmap v37: 0 pgs: ; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T09:14:34.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:33 trial074 ceph-mon[44412]: osdmap e23: 4 total, 3 up, 4 in 2026-02-24T09:14:34.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:33 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:14:34.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:33 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-24T09:14:35.597 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:35 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-24T09:14:35.597 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:35 trial028 ceph-mon[40371]: osdmap e24: 4 total, 3 up, 4 in 2026-02-24T09:14:35.597 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:35 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:14:35.597 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:35 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-24T09:14:35.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:35 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-24T09:14:35.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:35 trial159 ceph-mon[44242]: osdmap e24: 4 total, 3 up, 4 in 2026-02-24T09:14:35.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:35 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:14:35.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:35 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-24T09:14:35.844 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:35 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-24T09:14:35.844 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:35 trial074 ceph-mon[44412]: osdmap e24: 4 total, 3 up, 4 in 2026-02-24T09:14:35.844 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:35 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:14:35.844 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:35 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-24T09:14:35.847 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 24 09:14:35 trial028 sudo[71303]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-24T09:14:35.847 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 24 09:14:35 trial028 sudo[71303]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T09:14:35.847 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 24 09:14:35 trial028 sudo[71303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T09:14:35.847 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 24 09:14:35 trial028 sudo[71303]: pam_unix(sudo:session): session closed for user root 2026-02-24T09:14:35.847 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 24 09:14:35 trial028 sudo[71309]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-24T09:14:35.848 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 24 09:14:35 trial028 sudo[71309]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T09:14:35.848 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 24 09:14:35 trial028 sudo[71309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T09:14:35.848 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 24 09:14:35 trial028 sudo[71309]: pam_unix(sudo:session): session closed for user root 2026-02-24T09:14:36.092 INFO:journalctl@ceph.osd.2.trial159.stdout:Feb 24 09:14:35 trial159 sudo[55895]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-24T09:14:36.092 INFO:journalctl@ceph.osd.2.trial159.stdout:Feb 24 09:14:35 trial159 sudo[55895]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T09:14:36.093 INFO:journalctl@ceph.osd.2.trial159.stdout:Feb 24 09:14:35 trial159 sudo[55895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T09:14:36.093 INFO:journalctl@ceph.osd.2.trial159.stdout:Feb 24 09:14:35 trial159 sudo[55895]: pam_unix(sudo:session): session closed for user root 2026-02-24T09:14:36.093 INFO:journalctl@ceph.osd.2.trial159.stdout:Feb 24 09:14:35 trial159 sudo[55899]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-24T09:14:36.093 INFO:journalctl@ceph.osd.2.trial159.stdout:Feb 24 09:14:35 trial159 sudo[55899]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T09:14:36.093 INFO:journalctl@ceph.osd.2.trial159.stdout:Feb 24 09:14:35 trial159 sudo[55899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T09:14:36.093 INFO:journalctl@ceph.osd.2.trial159.stdout:Feb 24 09:14:35 trial159 sudo[55899]: pam_unix(sudo:session): session closed for user root 2026-02-24T09:14:36.103 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 sudo[71365]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-24T09:14:36.103 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 sudo[71365]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T09:14:36.103 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 sudo[71365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T09:14:36.103 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 sudo[71365]: pam_unix(sudo:session): session closed for user root 2026-02-24T09:14:36.103 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 sudo[71394]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-24T09:14:36.104 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 sudo[71394]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T09:14:36.104 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 sudo[71394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T09:14:36.104 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 sudo[71394]: pam_unix(sudo:session): session closed for user root 2026-02-24T09:14:36.123 INFO:journalctl@ceph.osd.1.trial074.stdout:Feb 24 09:14:35 trial074 sudo[59773]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-24T09:14:36.124 INFO:journalctl@ceph.osd.1.trial074.stdout:Feb 24 09:14:35 trial074 sudo[59773]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T09:14:36.124 INFO:journalctl@ceph.osd.1.trial074.stdout:Feb 24 09:14:35 trial074 sudo[59773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T09:14:36.124 INFO:journalctl@ceph.osd.1.trial074.stdout:Feb 24 09:14:35 trial074 sudo[59773]: pam_unix(sudo:session): session closed for user root 2026-02-24T09:14:36.124 INFO:journalctl@ceph.osd.1.trial074.stdout:Feb 24 09:14:35 trial074 sudo[59777]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-24T09:14:36.124 INFO:journalctl@ceph.osd.1.trial074.stdout:Feb 24 09:14:35 trial074 sudo[59777]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T09:14:36.124 INFO:journalctl@ceph.osd.1.trial074.stdout:Feb 24 09:14:35 trial074 sudo[59777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T09:14:36.124 INFO:journalctl@ceph.osd.1.trial074.stdout:Feb 24 09:14:35 trial074 sudo[59777]: pam_unix(sudo:session): session closed for user root 2026-02-24T09:14:36.394 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 sudo[55903]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2026-02-24T09:14:36.394 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 sudo[55903]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T09:14:36.394 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 sudo[55903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T09:14:36.394 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 sudo[55903]: pam_unix(sudo:session): session closed for user root 2026-02-24T09:14:36.394 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 sudo[55907]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme0n1 2026-02-24T09:14:36.394 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 sudo[55907]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T09:14:36.394 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 sudo[55907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T09:14:36.394 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 sudo[55907]: pam_unix(sudo:session): session closed for user root 2026-02-24T09:14:36.614 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 ceph-mon[40371]: pgmap v40: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T09:14:36.614 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-24T09:14:36.614 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 ceph-mon[40371]: osdmap e25: 4 total, 3 up, 4 in 2026-02-24T09:14:36.614 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:14:36.614 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:36.614 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:36.614 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-24T09:14:36.614 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:36.614 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:36.614 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:14:36.614 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 ceph-mon[40371]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-24T09:14:36.614 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 ceph-mon[40371]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-24T09:14:36.614 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:14:36.614 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:14:36.614 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:36.614 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:14:36.614 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:14:36.614 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:14:36.614 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 ceph-mon[40371]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-24T09:14:36.614 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 ceph-mon[40371]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-24T09:14:36.614 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:36.614 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 ceph-mon[40371]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-24T09:14:36.614 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:14:36.614 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:14:36.614 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:14:36.614 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 ceph-mon[40371]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-24T09:14:36.614 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:36 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:36.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 sudo[59781]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2026-02-24T09:14:36.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 sudo[59781]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T09:14:36.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 sudo[59781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T09:14:36.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 sudo[59781]: pam_unix(sudo:session): session closed for user root 2026-02-24T09:14:36.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 sudo[59785]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme0n1 2026-02-24T09:14:36.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 sudo[59785]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T09:14:36.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 sudo[59785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T09:14:36.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 sudo[59785]: pam_unix(sudo:session): session closed for user root 2026-02-24T09:14:36.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 ceph-mon[44412]: pgmap v40: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T09:14:36.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-24T09:14:36.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 ceph-mon[44412]: osdmap e25: 4 total, 3 up, 4 in 2026-02-24T09:14:36.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:14:36.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:36.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:36.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-24T09:14:36.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:36.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:36.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:14:36.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 ceph-mon[44412]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-24T09:14:36.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 ceph-mon[44412]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-24T09:14:36.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:14:36.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:14:36.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:36.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:14:36.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:14:36.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:14:36.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 ceph-mon[44412]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-24T09:14:36.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 ceph-mon[44412]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-24T09:14:36.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:36.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 ceph-mon[44412]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-24T09:14:36.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:14:36.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:14:36.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:14:36.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 ceph-mon[44412]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-24T09:14:36.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:36 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:36.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 ceph-mon[44242]: pgmap v40: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T09:14:36.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-24T09:14:36.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 ceph-mon[44242]: osdmap e25: 4 total, 3 up, 4 in 2026-02-24T09:14:36.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:14:36.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:36.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:36.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-24T09:14:36.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:36.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:36.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:14:36.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 ceph-mon[44242]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-24T09:14:36.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 ceph-mon[44242]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-24T09:14:36.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:14:36.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:14:36.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:36.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:14:36.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:14:36.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:14:36.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 ceph-mon[44242]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-24T09:14:36.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 ceph-mon[44242]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-24T09:14:36.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:36.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 ceph-mon[44242]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-24T09:14:36.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:14:36.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:14:36.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:14:36.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 ceph-mon[44242]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-24T09:14:36.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:36 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:37.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:37.407+0000 7f533c82b640 1 -- 10.20.193.28:0/1695788414 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mgrmap(e 19) ==== 157139+0+0 (secure 0 0 0) 0x7f53280cf3c0 con 0x7f53381158b0 2026-02-24T09:14:37.561 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:37 trial028 ceph-mon[40371]: Deploying daemon osd.3 on trial028 2026-02-24T09:14:37.562 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:37 trial028 ceph-mon[40371]: osdmap e26: 4 total, 3 up, 4 in 2026-02-24T09:14:37.562 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:37 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:14:37.562 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:37 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-24T09:14:37.562 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:37 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:37.562 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:37 trial028 ceph-mon[40371]: Deploying daemon osd.3 on trial028 2026-02-24T09:14:37.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:37 trial159 ceph-mon[44242]: Deploying daemon osd.3 on trial028 2026-02-24T09:14:37.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:37 trial159 ceph-mon[44242]: osdmap e26: 4 total, 3 up, 4 in 2026-02-24T09:14:37.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:37 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:14:37.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:37 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-24T09:14:37.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:37 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:37.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:37 trial159 ceph-mon[44242]: Deploying daemon osd.3 on trial028 2026-02-24T09:14:37.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:37 trial074 ceph-mon[44412]: Deploying daemon osd.3 on trial028 2026-02-24T09:14:37.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:37 trial074 ceph-mon[44412]: osdmap e26: 4 total, 3 up, 4 in 2026-02-24T09:14:37.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:37 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:14:37.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:37 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-24T09:14:37.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:37 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:37.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:37 trial074 ceph-mon[44412]: Deploying daemon osd.3 on trial028 2026-02-24T09:14:38.675 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:38 trial028 ceph-mon[40371]: pgmap v43: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T09:14:38.675 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:38 trial028 ceph-mon[40371]: mgrmap e19: x(active, since 58s), standbys: y, z 2026-02-24T09:14:38.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:38 trial159 ceph-mon[44242]: pgmap v43: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T09:14:38.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:38 trial159 ceph-mon[44242]: mgrmap e19: x(active, since 58s), standbys: y, z 2026-02-24T09:14:38.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:38 trial074 ceph-mon[44412]: pgmap v43: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T09:14:38.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:38 trial074 ceph-mon[44412]: mgrmap e19: x(active, since 58s), standbys: y, z 2026-02-24T09:14:40.250 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:40.250 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:40.250 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:40 trial028 ceph-mon[40371]: pgmap v44: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T09:14:40.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:40.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:40.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:40 trial074 ceph-mon[44412]: pgmap v44: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T09:14:40.529 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:40.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:40.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:40 trial159 ceph-mon[44242]: pgmap v44: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T09:14:41.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:41.055+0000 7f533d02c640 1 -- 10.20.193.28:0/1695788414 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=21}) -- 0x7f5310003560 con 0x7f53381158b0 2026-02-24T09:14:41.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:41.056+0000 7f533c82b640 1 -- 10.20.193.28:0/1695788414 <== mon.0 v2:10.20.193.28:3300/0 8 ==== osd_map(21..26 src has 1..26) ==== 4005+0+0 (secure 0 0 0) 0x7f53280d3b50 con 0x7f53381158b0 2026-02-24T09:14:41.327 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:41 trial028 ceph-mon[40371]: from='osd.3 [v2:10.20.193.28:6810/1450054730,v1:10.20.193.28:6811/1450054730]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-24T09:14:41.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:41 trial074 ceph-mon[44412]: from='osd.3 [v2:10.20.193.28:6810/1450054730,v1:10.20.193.28:6811/1450054730]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-24T09:14:41.529 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:41 trial159 ceph-mon[44242]: from='osd.3 [v2:10.20.193.28:6810/1450054730,v1:10.20.193.28:6811/1450054730]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-24T09:14:42.219 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:42 trial028 ceph-mon[40371]: from='osd.3 [v2:10.20.193.28:6810/1450054730,v1:10.20.193.28:6811/1450054730]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-24T09:14:42.219 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:42 trial028 ceph-mon[40371]: osdmap e27: 4 total, 3 up, 4 in 2026-02-24T09:14:42.220 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:42 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:14:42.220 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:42 trial028 ceph-mon[40371]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T09:14:42.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:42 trial074 ceph-mon[44412]: from='osd.3 [v2:10.20.193.28:6810/1450054730,v1:10.20.193.28:6811/1450054730]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-24T09:14:42.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:42 trial074 ceph-mon[44412]: osdmap e27: 4 total, 3 up, 4 in 2026-02-24T09:14:42.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:42 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:14:42.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:42 trial074 ceph-mon[44412]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T09:14:42.529 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:42 trial159 ceph-mon[44242]: from='osd.3 [v2:10.20.193.28:6810/1450054730,v1:10.20.193.28:6811/1450054730]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-24T09:14:42.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:42 trial159 ceph-mon[44242]: osdmap e27: 4 total, 3 up, 4 in 2026-02-24T09:14:42.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:42 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:14:42.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:42 trial159 ceph-mon[44242]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T09:14:43.303 INFO:teuthology.orchestra.run.trial028.stdout:Created osd(s) 3 on host 'trial028' 2026-02-24T09:14:43.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:43.302+0000 7f533c82b640 1 -- 10.20.193.28:0/1695788414 <== mgr.14223 v2:10.20.193.28:6800/906910473 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f52fc002bb0 con 0x7f530c0b5720 2026-02-24T09:14:43.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:43.305+0000 7f533d82d640 1 -- 10.20.193.28:0/1695788414 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f530c0b5720 msgr2=0x7f530c0d5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:43.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:43.305+0000 7f533d82d640 1 --2- 10.20.193.28:0/1695788414 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f530c0b5720 0x7f530c0d5bd0 secure :-1 s=READY pgs=59 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f532c004740 tx=0x7f532c005f90 comp rx=0 tx=0).stop 2026-02-24T09:14:43.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:43.305+0000 7f533d82d640 1 -- 10.20.193.28:0/1695788414 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53381158b0 msgr2=0x7f5338123830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:43.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:43.305+0000 7f533d82d640 1 --2- 10.20.193.28:0/1695788414 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53381158b0 0x7f5338123830 secure :-1 s=READY pgs=161 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5328033040 tx=0x7f5328030d00 comp rx=0 tx=0).stop 2026-02-24T09:14:43.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:43.306+0000 7f533d82d640 1 -- 10.20.193.28:0/1695788414 shutdown_connections 2026-02-24T09:14:43.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:43.306+0000 7f533d82d640 1 --2- 10.20.193.28:0/1695788414 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f530c0b5720 0x7f530c0d5bd0 unknown :-1 s=CLOSED pgs=59 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:43.306+0000 7f533d82d640 1 --2- 10.20.193.28:0/1695788414 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53381158b0 0x7f5338123830 unknown :-1 s=CLOSED pgs=161 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:43.306+0000 7f533d82d640 1 --2- 10.20.193.28:0/1695788414 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f53381100b0 0x7f533811e460 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:43.306+0000 7f533d82d640 1 --2- 10.20.193.28:0/1695788414 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f533810f6c0 0x7f533811df20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:43.306+0000 7f533d82d640 1 -- 10.20.193.28:0/1695788414 >> 10.20.193.28:0/1695788414 conn(0x7f53380ecfd0 msgr2=0x7f533810d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:43.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:43.306+0000 7f533d82d640 1 -- 10.20.193.28:0/1695788414 shutdown_connections 2026-02-24T09:14:43.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:14:43.306+0000 7f533d82d640 1 -- 10.20.193.28:0/1695788414 wait complete. 2026-02-24T09:14:43.452 DEBUG:teuthology.orchestra.run.trial028:osd.3> sudo journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.3.service 2026-02-24T09:14:43.455 INFO:tasks.cephadm:Deploying osd.4 on trial074 with /dev/vg_nvme/lv_3... 2026-02-24T09:14:43.455 DEBUG:teuthology.orchestra.run.trial074:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-24T09:14:43.642 INFO:teuthology.orchestra.run.trial074.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.b/config 2026-02-24T09:14:43.774 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:43 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:43.774 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:43 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:43.774 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:43 trial074 ceph-mon[44412]: pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T09:14:43.774 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:43 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:43.774 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:43 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:43.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:43 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:43.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:43 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:43.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:43 trial159 ceph-mon[44242]: pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T09:14:43.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:43 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:43.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:43 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:43.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:43 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:43.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:43 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:43.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:43 trial028 ceph-mon[40371]: pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T09:14:43.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:43 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:43.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:43 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:43.862 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 24 09:14:43 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-3[73566]: 2026-02-24T09:14:43.528+0000 7fb52bc1a780 -1 osd.3 0 log_to_monitors true 2026-02-24T09:14:44.597 INFO:teuthology.orchestra.run.trial074.stdout: 2026-02-24T09:14:44.619 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:44 trial074 ceph-mon[44412]: from='osd.3 [v2:10.20.193.28:6810/1790609615,v1:10.20.193.28:6811/1790609615]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-24T09:14:44.619 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:44 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:44.619 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:44 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:44.619 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:44 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:14:44.621 DEBUG:teuthology.orchestra.run.trial074:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph orch daemon add osd trial074:vg_nvme/lv_3 --skip-validation 2026-02-24T09:14:44.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:44 trial159 ceph-mon[44242]: from='osd.3 [v2:10.20.193.28:6810/1790609615,v1:10.20.193.28:6811/1790609615]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-24T09:14:44.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:44 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:44.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:44 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:44.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:44 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:14:44.807 INFO:teuthology.orchestra.run.trial074.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.b/config 2026-02-24T09:14:44.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:44 trial028 ceph-mon[40371]: from='osd.3 [v2:10.20.193.28:6810/1790609615,v1:10.20.193.28:6811/1790609615]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-24T09:14:44.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:44 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:44.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:44 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:44.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:44 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:14:44.982 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.980+0000 7f75ab14d640 1 -- 10.20.193.74:0/2926400081 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f75a4113200 msgr2=0x7f75a4173bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:44.983 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.980+0000 7f75ab14d640 1 --2- 10.20.193.74:0/2926400081 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f75a4113200 0x7f75a4173bd0 secure :-1 s=READY pgs=45 gs=1 cs=0 l=1 c_cookie=15932140248695439099 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f75a000aa30 tx=0x7f75a0030270 comp rx=0 tx=0).stop 2026-02-24T09:14:44.983 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.980+0000 7f75ab14d640 1 -- 10.20.193.74:0/2926400081 shutdown_connections 2026-02-24T09:14:44.983 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.980+0000 7f75ab14d640 1 --2- 10.20.193.74:0/2926400081 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f75a4113200 0x7f75a4173bd0 unknown :-1 s=CLOSED pgs=45 gs=1 cs=0 l=1 c_cookie=15932140248695439099 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:44.983 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.980+0000 7f75ab14d640 1 --2- 10.20.193.74:0/2926400081 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f75a410da00 0x7f75a4112a50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:44.983 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.980+0000 7f75ab14d640 1 --2- 10.20.193.74:0/2926400081 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f75a410d010 0x7f75a410d3e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:44.983 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.980+0000 7f75ab14d640 1 -- 10.20.193.74:0/2926400081 >> 10.20.193.74:0/2926400081 conn(0x7f75a405f830 msgr2=0x7f75a410ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:44.983 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.980+0000 7f75ab14d640 1 -- 10.20.193.74:0/2926400081 shutdown_connections 2026-02-24T09:14:44.984 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.980+0000 7f75ab14d640 1 -- 10.20.193.74:0/2926400081 wait complete. 2026-02-24T09:14:44.986 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.981+0000 7f75ab14d640 1 Processor -- start 2026-02-24T09:14:44.986 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.981+0000 7f75ab14d640 1 -- start start 2026-02-24T09:14:44.986 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.981+0000 7f75ab14d640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f75a410d010 0x7f75a40f56b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:44.986 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.981+0000 7f75ab14d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f75a410da00 0x7f75a4173ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:44.986 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.981+0000 7f75ab14d640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f75a4113200 0x7f75a40f5db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:44.986 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.981+0000 7f75ab14d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f75a40fafc0 con 0x7f75a410da00 2026-02-24T09:14:44.986 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.981+0000 7f75ab14d640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f75a40fb130 con 0x7f75a4113200 2026-02-24T09:14:44.987 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.981+0000 7f75ab14d640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f75a40fb2f0 con 0x7f75a410d010 2026-02-24T09:14:44.987 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.982+0000 7f75a96c3640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f75a4113200 0x7f75a40f5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:44.987 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.982+0000 7f75a96c3640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f75a4113200 0x7f75a40f5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.74:49204/0 (socket says 10.20.193.74:49204) 2026-02-24T09:14:44.987 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.982+0000 7f75a96c3640 1 -- 10.20.193.74:0/3311300396 learned_addr learned my addr 10.20.193.74:0/3311300396 (peer_addr_for_me v2:10.20.193.74:0/0) 2026-02-24T09:14:44.987 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.982+0000 7f759bfff640 1 --2- 10.20.193.74:0/3311300396 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f75a410da00 0x7f75a4173ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:44.987 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.982+0000 7f75a8ec2640 1 --2- 10.20.193.74:0/3311300396 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f75a410d010 0x7f75a40f56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:44.987 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.982+0000 7f75a96c3640 1 -- 10.20.193.74:0/3311300396 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f75a410d010 msgr2=0x7f75a40f56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:44.987 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.982+0000 7f75a96c3640 1 --2- 10.20.193.74:0/3311300396 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f75a410d010 0x7f75a40f56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:44.987 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.982+0000 7f75a96c3640 1 -- 10.20.193.74:0/3311300396 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f75a410da00 msgr2=0x7f75a4173ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:44.987 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.982+0000 7f75a96c3640 1 --2- 10.20.193.74:0/3311300396 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f75a410da00 0x7f75a4173ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:44.988 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.982+0000 7f75a96c3640 1 -- 10.20.193.74:0/3311300396 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a000a650 con 0x7f75a4113200 2026-02-24T09:14:44.988 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.982+0000 7f75a96c3640 1 --2- 10.20.193.74:0/3311300396 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f75a4113200 0x7f75a40f5db0 secure :-1 s=READY pgs=46 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f75a0006a50 tx=0x7f75a0030ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:44.988 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.982+0000 7f7599ffb640 1 -- 10.20.193.74:0/3311300396 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f75a003e070 con 0x7f75a4113200 2026-02-24T09:14:44.988 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.982+0000 7f75ab14d640 1 -- 10.20.193.74:0/3311300396 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75a40fb570 con 0x7f75a4113200 2026-02-24T09:14:44.988 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.982+0000 7f7599ffb640 1 -- 10.20.193.74:0/3311300396 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f75a0039de0 con 0x7f75a4113200 2026-02-24T09:14:44.988 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.982+0000 7f75ab14d640 1 -- 10.20.193.74:0/3311300396 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75a40fb9e0 con 0x7f75a4113200 2026-02-24T09:14:44.988 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.982+0000 7f7599ffb640 1 -- 10.20.193.74:0/3311300396 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f75a0042820 con 0x7f75a4113200 2026-02-24T09:14:44.988 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.983+0000 7f75ab14d640 1 -- 10.20.193.74:0/3311300396 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75a410e2f0 con 0x7f75a4113200 2026-02-24T09:14:44.989 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.985+0000 7f7599ffb640 1 -- 10.20.193.74:0/3311300396 <== mon.2 v2:10.20.193.74:3300/0 4 ==== mgrmap(e 19) ==== 157139+0+0 (secure 0 0 0) 0x7f75a0039920 con 0x7f75a4113200 2026-02-24T09:14:44.989 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.987+0000 7f7599ffb640 1 --2- 10.20.193.74:0/3311300396 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f75800b57a0 0x7f75800d5c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:44.990 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.987+0000 7f7599ffb640 1 -- 10.20.193.74:0/3311300396 <== mon.2 v2:10.20.193.74:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3580+0+0 (secure 0 0 0) 0x7f75a010b5f0 con 0x7f75a4113200 2026-02-24T09:14:44.990 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.987+0000 7f7599ffb640 1 -- 10.20.193.74:0/3311300396 <== mon.2 v2:10.20.193.74:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f75a010ba70 con 0x7f75a4113200 2026-02-24T09:14:44.990 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.987+0000 7f75a8ec2640 1 --2- 10.20.193.74:0/3311300396 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f75800b57a0 0x7f75800d5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:44.990 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:44.988+0000 7f75a8ec2640 1 --2- 10.20.193.74:0/3311300396 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f75800b57a0 0x7f75800d5c50 secure :-1 s=READY pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7594004740 tx=0x7f7594005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:45.109 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:45.107+0000 7f75ab14d640 1 -- 10.20.193.74:0/3311300396 --> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial074:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f75a40f6810 con 0x7f75800b57a0 2026-02-24T09:14:45.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:45 trial074 ceph-mon[44412]: from='osd.3 [v2:10.20.193.28:6810/1790609615,v1:10.20.193.28:6811/1790609615]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-24T09:14:45.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:45 trial074 ceph-mon[44412]: osdmap e28: 4 total, 3 up, 4 in 2026-02-24T09:14:45.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:45 trial074 ceph-mon[44412]: from='osd.3 [v2:10.20.193.28:6810/1790609615,v1:10.20.193.28:6811/1790609615]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-24T09:14:45.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:45 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:14:45.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:45 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:45.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:45 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:45.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:45 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:45.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:45 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:45.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:45 trial074 ceph-mon[44412]: from='client.24422 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial074:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:14:45.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:45 trial074 ceph-mon[44412]: osd.default does not exist. Creating it now. 2026-02-24T09:14:45.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:45 trial074 ceph-mon[44412]: Creating OSDs with service ID: default on trial074:['vg_nvme/lv_3'] 2026-02-24T09:14:45.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:45 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:45.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:45 trial074 ceph-mon[44412]: Marking host: trial074 for OSDSpec preview refresh. 2026-02-24T09:14:45.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:45 trial074 ceph-mon[44412]: Saving service osd.default spec with placement trial074 2026-02-24T09:14:45.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:45 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:45.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:45 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:14:45.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:45 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:14:45.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:45 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:45.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:45 trial074 ceph-mon[44412]: pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T09:14:45.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:45 trial159 ceph-mon[44242]: from='osd.3 [v2:10.20.193.28:6810/1790609615,v1:10.20.193.28:6811/1790609615]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-24T09:14:45.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:45 trial159 ceph-mon[44242]: osdmap e28: 4 total, 3 up, 4 in 2026-02-24T09:14:45.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:45 trial159 ceph-mon[44242]: from='osd.3 [v2:10.20.193.28:6810/1790609615,v1:10.20.193.28:6811/1790609615]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-24T09:14:45.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:45 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:14:45.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:45 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:45.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:45 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:45.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:45 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:45.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:45 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:45.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:45 trial159 ceph-mon[44242]: from='client.24422 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial074:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:14:45.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:45 trial159 ceph-mon[44242]: osd.default does not exist. Creating it now. 2026-02-24T09:14:45.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:45 trial159 ceph-mon[44242]: Creating OSDs with service ID: default on trial074:['vg_nvme/lv_3'] 2026-02-24T09:14:45.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:45 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:45.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:45 trial159 ceph-mon[44242]: Marking host: trial074 for OSDSpec preview refresh. 2026-02-24T09:14:45.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:45 trial159 ceph-mon[44242]: Saving service osd.default spec with placement trial074 2026-02-24T09:14:45.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:45 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:45.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:45 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:14:45.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:45 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:14:45.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:45 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:45.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:45 trial159 ceph-mon[44242]: pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T09:14:45.788 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 24 09:14:45 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-3[73566]: 2026-02-24T09:14:45.524+0000 7fb527b9c640 -1 osd.3 0 waiting for initial osdmap 2026-02-24T09:14:45.788 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 24 09:14:45 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-3[73566]: 2026-02-24T09:14:45.530+0000 7fb51fa5b640 -1 osd.3 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T09:14:45.788 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:45 trial028 ceph-mon[40371]: from='osd.3 [v2:10.20.193.28:6810/1790609615,v1:10.20.193.28:6811/1790609615]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-24T09:14:45.789 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:45 trial028 ceph-mon[40371]: osdmap e28: 4 total, 3 up, 4 in 2026-02-24T09:14:45.789 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:45 trial028 ceph-mon[40371]: from='osd.3 [v2:10.20.193.28:6810/1790609615,v1:10.20.193.28:6811/1790609615]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-24T09:14:45.789 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:45 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:14:45.789 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:45 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:45.789 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:45 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:45.789 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:45 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:45.789 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:45 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:45.789 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:45 trial028 ceph-mon[40371]: from='client.24422 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial074:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:14:45.789 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:45 trial028 ceph-mon[40371]: osd.default does not exist. Creating it now. 2026-02-24T09:14:45.789 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:45 trial028 ceph-mon[40371]: Creating OSDs with service ID: default on trial074:['vg_nvme/lv_3'] 2026-02-24T09:14:45.789 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:45 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:45.789 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:45 trial028 ceph-mon[40371]: Marking host: trial074 for OSDSpec preview refresh. 2026-02-24T09:14:45.789 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:45 trial028 ceph-mon[40371]: Saving service osd.default spec with placement trial074 2026-02-24T09:14:45.789 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:45 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:45.790 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:45 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:14:45.790 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:45 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:14:45.790 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:45 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:45.790 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:45 trial028 ceph-mon[40371]: pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T09:14:46.670 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:46 trial074 ceph-mon[44412]: from='osd.3 [v2:10.20.193.28:6810/1790609615,v1:10.20.193.28:6811/1790609615]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-24T09:14:46.670 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:46 trial074 ceph-mon[44412]: osdmap e29: 4 total, 3 up, 4 in 2026-02-24T09:14:46.670 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:46 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:14:46.670 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:46 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:14:46.670 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:46 trial074 ceph-mon[44412]: osd.3 [v2:10.20.193.28:6810/1790609615,v1:10.20.193.28:6811/1790609615] boot 2026-02-24T09:14:46.670 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:46 trial074 ceph-mon[44412]: osdmap e30: 4 total, 4 up, 4 in 2026-02-24T09:14:46.670 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:46 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:14:46.670 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:46 trial074 ceph-mon[44412]: from='client.? 10.20.193.74:0/2706311469' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "041239c2-6187-4154-9557-b1b5846f9e0e"} : dispatch 2026-02-24T09:14:46.670 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:46 trial074 ceph-mon[44412]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "041239c2-6187-4154-9557-b1b5846f9e0e"} : dispatch 2026-02-24T09:14:46.671 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:46 trial074 ceph-mon[44412]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "041239c2-6187-4154-9557-b1b5846f9e0e"}]': finished 2026-02-24T09:14:46.671 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:46 trial074 ceph-mon[44412]: osdmap e31: 5 total, 4 up, 5 in 2026-02-24T09:14:46.671 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:46 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:14:46.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:46 trial159 ceph-mon[44242]: from='osd.3 [v2:10.20.193.28:6810/1790609615,v1:10.20.193.28:6811/1790609615]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-24T09:14:46.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:46 trial159 ceph-mon[44242]: osdmap e29: 4 total, 3 up, 4 in 2026-02-24T09:14:46.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:46 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:14:46.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:46 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:14:46.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:46 trial159 ceph-mon[44242]: osd.3 [v2:10.20.193.28:6810/1790609615,v1:10.20.193.28:6811/1790609615] boot 2026-02-24T09:14:46.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:46 trial159 ceph-mon[44242]: osdmap e30: 4 total, 4 up, 4 in 2026-02-24T09:14:46.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:46 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:14:46.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:46 trial159 ceph-mon[44242]: from='client.? 10.20.193.74:0/2706311469' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "041239c2-6187-4154-9557-b1b5846f9e0e"} : dispatch 2026-02-24T09:14:46.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:46 trial159 ceph-mon[44242]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "041239c2-6187-4154-9557-b1b5846f9e0e"} : dispatch 2026-02-24T09:14:46.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:46 trial159 ceph-mon[44242]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "041239c2-6187-4154-9557-b1b5846f9e0e"}]': finished 2026-02-24T09:14:46.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:46 trial159 ceph-mon[44242]: osdmap e31: 5 total, 4 up, 5 in 2026-02-24T09:14:46.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:46 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:14:46.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:46 trial028 ceph-mon[40371]: from='osd.3 [v2:10.20.193.28:6810/1790609615,v1:10.20.193.28:6811/1790609615]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-24T09:14:46.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:46 trial028 ceph-mon[40371]: osdmap e29: 4 total, 3 up, 4 in 2026-02-24T09:14:46.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:46 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:14:46.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:46 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:14:46.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:46 trial028 ceph-mon[40371]: osd.3 [v2:10.20.193.28:6810/1790609615,v1:10.20.193.28:6811/1790609615] boot 2026-02-24T09:14:46.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:46 trial028 ceph-mon[40371]: osdmap e30: 4 total, 4 up, 4 in 2026-02-24T09:14:46.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:46 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:14:46.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:46 trial028 ceph-mon[40371]: from='client.? 10.20.193.74:0/2706311469' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "041239c2-6187-4154-9557-b1b5846f9e0e"} : dispatch 2026-02-24T09:14:46.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:46 trial028 ceph-mon[40371]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "041239c2-6187-4154-9557-b1b5846f9e0e"} : dispatch 2026-02-24T09:14:46.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:46 trial028 ceph-mon[40371]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "041239c2-6187-4154-9557-b1b5846f9e0e"}]': finished 2026-02-24T09:14:46.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:46 trial028 ceph-mon[40371]: osdmap e31: 5 total, 4 up, 5 in 2026-02-24T09:14:46.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:46 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:14:47.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:47 trial159 ceph-mon[44242]: purged_snaps scrub starts 2026-02-24T09:14:47.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:47 trial159 ceph-mon[44242]: purged_snaps scrub ok 2026-02-24T09:14:47.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:47 trial159 ceph-mon[44242]: from='client.? 10.20.193.74:0/1456419648' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:14:47.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:47.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:47.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:47 trial159 ceph-mon[44242]: Detected new or changed devices on trial028 2026-02-24T09:14:47.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:47.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:47.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:47.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:47.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T09:14:47.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-24T09:14:47.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:47 trial159 ceph-mon[44242]: Adjusting osd_memory_target on trial028 to 42026M 2026-02-24T09:14:47.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:47.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:47.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:14:47.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:47.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:14:47.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:14:47.782 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:47.782 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:47 trial159 ceph-mon[44242]: pgmap v53: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T09:14:47.782 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:47 trial159 ceph-mon[44242]: osdmap e32: 5 total, 4 up, 5 in 2026-02-24T09:14:47.782 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:14:47.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:47 trial028 ceph-mon[40371]: purged_snaps scrub starts 2026-02-24T09:14:47.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:47 trial028 ceph-mon[40371]: purged_snaps scrub ok 2026-02-24T09:14:47.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:47 trial028 ceph-mon[40371]: from='client.? 10.20.193.74:0/1456419648' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:14:47.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:47.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:47.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:47 trial028 ceph-mon[40371]: Detected new or changed devices on trial028 2026-02-24T09:14:47.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:47.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:47.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:47.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:47.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T09:14:47.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-24T09:14:47.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:47 trial028 ceph-mon[40371]: Adjusting osd_memory_target on trial028 to 42026M 2026-02-24T09:14:47.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:47.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:47.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:14:47.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:47.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:14:47.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:14:47.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:47.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:47 trial028 ceph-mon[40371]: pgmap v53: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T09:14:47.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:47 trial028 ceph-mon[40371]: osdmap e32: 5 total, 4 up, 5 in 2026-02-24T09:14:47.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:14:47.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:47 trial074 ceph-mon[44412]: purged_snaps scrub starts 2026-02-24T09:14:47.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:47 trial074 ceph-mon[44412]: purged_snaps scrub ok 2026-02-24T09:14:47.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:47 trial074 ceph-mon[44412]: from='client.? 10.20.193.74:0/1456419648' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:14:47.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:47.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:47.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:47 trial074 ceph-mon[44412]: Detected new or changed devices on trial028 2026-02-24T09:14:47.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:47.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:47.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:47.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:47.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T09:14:47.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-24T09:14:47.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:47 trial074 ceph-mon[44412]: Adjusting osd_memory_target on trial028 to 42026M 2026-02-24T09:14:47.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:47.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:47.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:14:47.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:47.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:14:47.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:14:47.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:47.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:47 trial074 ceph-mon[44412]: pgmap v53: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T09:14:47.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:47 trial074 ceph-mon[44412]: osdmap e32: 5 total, 4 up, 5 in 2026-02-24T09:14:47.876 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:14:49.346 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:49 trial074 ceph-mon[44412]: osdmap e33: 5 total, 4 up, 5 in 2026-02-24T09:14:49.346 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:49 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:14:49.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:49 trial028 ceph-mon[40371]: osdmap e33: 5 total, 4 up, 5 in 2026-02-24T09:14:49.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:49 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:14:49.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:49 trial159 ceph-mon[44242]: osdmap e33: 5 total, 4 up, 5 in 2026-02-24T09:14:49.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:49 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:14:50.478 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:50 trial074 ceph-mon[44412]: pgmap v56: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 2.7 TiB / 2.7 TiB avail; 154 KiB/s, 0 objects/s recovering 2026-02-24T09:14:50.479 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:50 trial074 ceph-mon[44412]: osdmap e34: 5 total, 4 up, 5 in 2026-02-24T09:14:50.479 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:50 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:14:50.479 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:50 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-24T09:14:50.479 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:50 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:50.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:50 trial028 ceph-mon[40371]: pgmap v56: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 2.7 TiB / 2.7 TiB avail; 154 KiB/s, 0 objects/s recovering 2026-02-24T09:14:50.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:50 trial028 ceph-mon[40371]: osdmap e34: 5 total, 4 up, 5 in 2026-02-24T09:14:50.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:50 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:14:50.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:50 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-24T09:14:50.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:50 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:50.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:50 trial159 ceph-mon[44242]: pgmap v56: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 2.7 TiB / 2.7 TiB avail; 154 KiB/s, 0 objects/s recovering 2026-02-24T09:14:50.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:50 trial159 ceph-mon[44242]: osdmap e34: 5 total, 4 up, 5 in 2026-02-24T09:14:50.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:50 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:14:50.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:50 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-24T09:14:50.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:50 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:51.489 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:51 trial074 ceph-mon[44412]: Deploying daemon osd.4 on trial074 2026-02-24T09:14:51.490 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:51 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-24T09:14:51.490 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:51 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:51.490 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:51 trial074 ceph-mon[44412]: Deploying daemon osd.4 on trial074 2026-02-24T09:14:51.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:51 trial028 ceph-mon[40371]: Deploying daemon osd.4 on trial074 2026-02-24T09:14:51.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:51 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-24T09:14:51.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:51 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:51.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:51 trial028 ceph-mon[40371]: Deploying daemon osd.4 on trial074 2026-02-24T09:14:51.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:51 trial159 ceph-mon[44242]: Deploying daemon osd.4 on trial074 2026-02-24T09:14:51.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:51 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-24T09:14:51.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:51 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:51.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:51 trial159 ceph-mon[44242]: Deploying daemon osd.4 on trial074 2026-02-24T09:14:52.552 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:52 trial074 ceph-mon[44412]: pgmap v58: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 2.7 TiB / 2.7 TiB avail; 116 KiB/s, 0 objects/s recovering 2026-02-24T09:14:52.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:52 trial028 ceph-mon[40371]: pgmap v58: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 2.7 TiB / 2.7 TiB avail; 116 KiB/s, 0 objects/s recovering 2026-02-24T09:14:52.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:52 trial159 ceph-mon[44242]: pgmap v58: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 2.7 TiB / 2.7 TiB avail; 116 KiB/s, 0 objects/s recovering 2026-02-24T09:14:54.106 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:53 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:54.107 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:53 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:54.107 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:53 trial074 ceph-mon[44412]: pgmap v59: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-24T09:14:54.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:53 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:54.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:53 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:54.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:53 trial028 ceph-mon[40371]: pgmap v59: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-24T09:14:54.279 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:53 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:54.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:53 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:54.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:53 trial159 ceph-mon[44242]: pgmap v59: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-24T09:14:54.962 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:54 trial074 ceph-mon[44412]: from='osd.4 [v2:10.20.193.74:6808/1528330227,v1:10.20.193.74:6809/1528330227]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-24T09:14:54.986 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:54.984+0000 7f75aa94c640 1 -- 10.20.193.74:0/3311300396 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=29}) -- 0x7f757c003560 con 0x7f75a4113200 2026-02-24T09:14:54.986 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:54.984+0000 7f7599ffb640 1 -- 10.20.193.74:0/3311300396 <== mon.2 v2:10.20.193.74:3300/0 7 ==== osd_map(29..35 src has 1..35) ==== 4229+0+0 (secure 0 0 0) 0x7f75a0039c00 con 0x7f75a4113200 2026-02-24T09:14:55.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:54 trial028 ceph-mon[40371]: from='osd.4 [v2:10.20.193.74:6808/1528330227,v1:10.20.193.74:6809/1528330227]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-24T09:14:55.279 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:54 trial159 ceph-mon[44242]: from='osd.4 [v2:10.20.193.74:6808/1528330227,v1:10.20.193.74:6809/1528330227]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-24T09:14:55.893 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:55 trial074 ceph-mon[44412]: from='osd.4 [v2:10.20.193.74:6808/1528330227,v1:10.20.193.74:6809/1528330227]' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-24T09:14:55.893 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:55 trial074 ceph-mon[44412]: osdmap e35: 5 total, 4 up, 5 in 2026-02-24T09:14:55.893 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:55 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:14:55.894 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:55 trial074 ceph-mon[44412]: pgmap v61: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 83 KiB/s, 0 objects/s recovering 2026-02-24T09:14:56.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:55 trial028 ceph-mon[40371]: from='osd.4 [v2:10.20.193.74:6808/1528330227,v1:10.20.193.74:6809/1528330227]' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-24T09:14:56.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:55 trial028 ceph-mon[40371]: osdmap e35: 5 total, 4 up, 5 in 2026-02-24T09:14:56.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:55 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:14:56.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:55 trial028 ceph-mon[40371]: pgmap v61: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 83 KiB/s, 0 objects/s recovering 2026-02-24T09:14:56.279 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:55 trial159 ceph-mon[44242]: from='osd.4 [v2:10.20.193.74:6808/1528330227,v1:10.20.193.74:6809/1528330227]' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-24T09:14:56.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:55 trial159 ceph-mon[44242]: osdmap e35: 5 total, 4 up, 5 in 2026-02-24T09:14:56.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:55 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:14:56.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:55 trial159 ceph-mon[44242]: pgmap v61: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 83 KiB/s, 0 objects/s recovering 2026-02-24T09:14:56.945 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:56.943+0000 7f7599ffb640 1 -- 10.20.193.74:0/3311300396 <== mgr.14223 v2:10.20.193.28:6800/906910473 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f75a40f6810 con 0x7f75800b57a0 2026-02-24T09:14:56.946 INFO:teuthology.orchestra.run.trial074.stdout:Created osd(s) 4 on host 'trial074' 2026-02-24T09:14:56.947 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:56.946+0000 7f75ab14d640 1 -- 10.20.193.74:0/3311300396 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f75800b57a0 msgr2=0x7f75800d5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:56.948 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:56.946+0000 7f75ab14d640 1 --2- 10.20.193.74:0/3311300396 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f75800b57a0 0x7f75800d5c50 secure :-1 s=READY pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7594004740 tx=0x7f7594005f90 comp rx=0 tx=0).stop 2026-02-24T09:14:56.948 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:56.946+0000 7f75ab14d640 1 -- 10.20.193.74:0/3311300396 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f75a4113200 msgr2=0x7f75a40f5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:56.948 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:56.946+0000 7f75ab14d640 1 --2- 10.20.193.74:0/3311300396 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f75a4113200 0x7f75a40f5db0 secure :-1 s=READY pgs=46 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f75a0006a50 tx=0x7f75a0030ce0 comp rx=0 tx=0).stop 2026-02-24T09:14:56.948 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:56.946+0000 7f75ab14d640 1 -- 10.20.193.74:0/3311300396 shutdown_connections 2026-02-24T09:14:56.948 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:56.946+0000 7f75ab14d640 1 --2- 10.20.193.74:0/3311300396 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f75800b57a0 0x7f75800d5c50 unknown :-1 s=CLOSED pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:56.949 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:56.946+0000 7f75ab14d640 1 --2- 10.20.193.74:0/3311300396 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f75a4113200 0x7f75a40f5db0 unknown :-1 s=CLOSED pgs=46 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:56.949 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:56.946+0000 7f75ab14d640 1 --2- 10.20.193.74:0/3311300396 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f75a410da00 0x7f75a4173ad0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:56.949 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:56.946+0000 7f75ab14d640 1 --2- 10.20.193.74:0/3311300396 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f75a410d010 0x7f75a40f56b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:56.949 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:56.946+0000 7f75ab14d640 1 -- 10.20.193.74:0/3311300396 >> 10.20.193.74:0/3311300396 conn(0x7f75a405f830 msgr2=0x7f75a410b500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:56.949 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:56.946+0000 7f75ab14d640 1 -- 10.20.193.74:0/3311300396 shutdown_connections 2026-02-24T09:14:56.949 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:14:56.946+0000 7f75ab14d640 1 -- 10.20.193.74:0/3311300396 wait complete. 2026-02-24T09:14:57.052 DEBUG:teuthology.orchestra.run.trial074:osd.4> sudo journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.4.service 2026-02-24T09:14:57.056 INFO:tasks.cephadm:Deploying osd.5 on trial159 with /dev/vg_nvme/lv_3... 2026-02-24T09:14:57.057 DEBUG:teuthology.orchestra.run.trial159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-24T09:14:57.248 INFO:teuthology.orchestra.run.trial159.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.c/config 2026-02-24T09:14:57.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:57 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:57.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:57 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:57.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:57 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:57.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:57 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:57.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:57 trial074 ceph-mon[44412]: from='osd.4 [v2:10.20.193.74:6808/610990618,v1:10.20.193.74:6809/610990618]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-24T09:14:57.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:57 trial074 ceph-mon[44412]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-24T09:14:57.375 INFO:journalctl@ceph.osd.4.trial074.stdout:Feb 24 09:14:57 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-4[64243]: 2026-02-24T09:14:57.176+0000 7f4a3a3a4780 -1 osd.4 0 log_to_monitors true 2026-02-24T09:14:57.376 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:57 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:57.376 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:57 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:57.376 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:57 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:57.376 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:57 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:57.377 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:57 trial159 ceph-mon[44242]: from='osd.4 [v2:10.20.193.74:6808/610990618,v1:10.20.193.74:6809/610990618]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-24T09:14:57.377 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:57 trial159 ceph-mon[44242]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-24T09:14:57.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:57 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:57.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:57 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:57.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:57 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:57.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:57 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:57.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:57 trial028 ceph-mon[40371]: from='osd.4 [v2:10.20.193.74:6808/610990618,v1:10.20.193.74:6809/610990618]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-24T09:14:57.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:57 trial028 ceph-mon[40371]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-24T09:14:58.170 INFO:teuthology.orchestra.run.trial159.stdout: 2026-02-24T09:14:58.195 DEBUG:teuthology.orchestra.run.trial159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph orch daemon add osd trial159:vg_nvme/lv_3 --skip-validation 2026-02-24T09:14:58.245 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:58 trial159 ceph-mon[44242]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T09:14:58.245 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:58 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:58.246 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:58 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:58.246 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:58 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:14:58.246 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:58 trial159 ceph-mon[44242]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-24T09:14:58.246 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:58 trial159 ceph-mon[44242]: osdmap e36: 5 total, 4 up, 5 in 2026-02-24T09:14:58.246 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:58 trial159 ceph-mon[44242]: from='osd.4 [v2:10.20.193.74:6808/610990618,v1:10.20.193.74:6809/610990618]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial074", "root=default"]} : dispatch 2026-02-24T09:14:58.246 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:58 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:14:58.246 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:58 trial159 ceph-mon[44242]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial074", "root=default"]} : dispatch 2026-02-24T09:14:58.382 INFO:teuthology.orchestra.run.trial159.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.c/config 2026-02-24T09:14:58.552 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.551+0000 7fbdb2c49640 1 -- 10.20.193.159:0/2668007420 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fbdac10bcc0 msgr2=0x7fbdac112de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:58.552 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.551+0000 7fbdb2c49640 1 --2- 10.20.193.159:0/2668007420 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fbdac10bcc0 0x7fbdac112de0 secure :-1 s=READY pgs=38 gs=1 cs=0 l=1 c_cookie=17903864265689913642 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbda0009950 tx=0x7fbda002f190 comp rx=0 tx=0).stop 2026-02-24T09:14:58.552 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.551+0000 7fbdb2c49640 1 -- 10.20.193.159:0/2668007420 shutdown_connections 2026-02-24T09:14:58.552 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.551+0000 7fbdb2c49640 1 --2- 10.20.193.159:0/2668007420 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbdac113590 0x7fbdac173f60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:58.552 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.551+0000 7fbdb2c49640 1 --2- 10.20.193.159:0/2668007420 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fbdac10bcc0 0x7fbdac112de0 unknown :-1 s=CLOSED pgs=38 gs=1 cs=0 l=1 c_cookie=17903864265689913642 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:58.552 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.551+0000 7fbdb2c49640 1 --2- 10.20.193.159:0/2668007420 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fbdac10b2d0 0x7fbdac10b6a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:58.553 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.551+0000 7fbdb2c49640 1 -- 10.20.193.159:0/2668007420 >> 10.20.193.159:0/2668007420 conn(0x7fbdac0e8e40 msgr2=0x7fbdac109250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:58.553 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.551+0000 7fbdb2c49640 1 -- 10.20.193.159:0/2668007420 shutdown_connections 2026-02-24T09:14:58.553 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.551+0000 7fbdb2c49640 1 -- 10.20.193.159:0/2668007420 wait complete. 2026-02-24T09:14:58.553 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.551+0000 7fbdb2c49640 1 Processor -- start 2026-02-24T09:14:58.554 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.552+0000 7fbdb2c49640 1 -- start start 2026-02-24T09:14:58.555 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.552+0000 7fbdb2c49640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fbdac10b2d0 0x7fbdac0f3ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:58.555 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.552+0000 7fbdb2c49640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbdac10bcc0 0x7fbdac173e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:58.555 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.552+0000 7fbdb2c49640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fbdac113590 0x7fbdac0f41d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:58.555 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.552+0000 7fbdb2c49640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac0f93e0 con 0x7fbdac10bcc0 2026-02-24T09:14:58.555 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.552+0000 7fbdb2c49640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac0f9550 con 0x7fbdac10b2d0 2026-02-24T09:14:58.555 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.552+0000 7fbdb2c49640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac0f9710 con 0x7fbdac113590 2026-02-24T09:14:58.555 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.552+0000 7fbdb2448640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fbdac113590 0x7fbdac0f41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:58.555 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.552+0000 7fbdb2448640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fbdac113590 0x7fbdac0f41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.159:58180/0 (socket says 10.20.193.159:58180) 2026-02-24T09:14:58.555 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.552+0000 7fbdb2448640 1 -- 10.20.193.159:0/3643482384 learned_addr learned my addr 10.20.193.159:0/3643482384 (peer_addr_for_me v2:10.20.193.159:0/0) 2026-02-24T09:14:58.555 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.552+0000 7fbdb1446640 1 --2- 10.20.193.159:0/3643482384 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbdac10bcc0 0x7fbdac173e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:58.555 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.552+0000 7fbdb1c47640 1 --2- 10.20.193.159:0/3643482384 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fbdac10b2d0 0x7fbdac0f3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:58.556 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.552+0000 7fbdb2448640 1 -- 10.20.193.159:0/3643482384 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fbdac10b2d0 msgr2=0x7fbdac0f3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:58.556 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.552+0000 7fbdb2448640 1 --2- 10.20.193.159:0/3643482384 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fbdac10b2d0 0x7fbdac0f3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:58.556 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.552+0000 7fbdb2448640 1 -- 10.20.193.159:0/3643482384 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbdac10bcc0 msgr2=0x7fbdac173e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:58.556 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.552+0000 7fbdb2448640 1 --2- 10.20.193.159:0/3643482384 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbdac10bcc0 0x7fbdac173e60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:58.556 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.552+0000 7fbdb2448640 1 -- 10.20.193.159:0/3643482384 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda0009570 con 0x7fbdac113590 2026-02-24T09:14:58.556 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.553+0000 7fbdb2448640 1 --2- 10.20.193.159:0/3643482384 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fbdac113590 0x7fbdac0f41d0 secure :-1 s=READY pgs=39 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbda800f8d0 tx=0x7fbda800fda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:58.556 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.553+0000 7fbd9affd640 1 -- 10.20.193.159:0/3643482384 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbda800dce0 con 0x7fbdac113590 2026-02-24T09:14:58.556 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.553+0000 7fbd9affd640 1 -- 10.20.193.159:0/3643482384 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fbda800de40 con 0x7fbdac113590 2026-02-24T09:14:58.556 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.553+0000 7fbd9affd640 1 -- 10.20.193.159:0/3643482384 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbda80116b0 con 0x7fbdac113590 2026-02-24T09:14:58.556 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.553+0000 7fbdb2c49640 1 -- 10.20.193.159:0/3643482384 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdac0f99f0 con 0x7fbdac113590 2026-02-24T09:14:58.556 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.553+0000 7fbdb2c49640 1 -- 10.20.193.159:0/3643482384 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdac0f9f10 con 0x7fbdac113590 2026-02-24T09:14:58.556 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.553+0000 7fbdb2c49640 1 -- 10.20.193.159:0/3643482384 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdac10c3f0 con 0x7fbdac113590 2026-02-24T09:14:58.557 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.556+0000 7fbd9affd640 1 -- 10.20.193.159:0/3643482384 <== mon.1 v2:10.20.193.159:3300/0 4 ==== mgrmap(e 19) ==== 157139+0+0 (secure 0 0 0) 0x7fbda8020060 con 0x7fbdac113590 2026-02-24T09:14:58.558 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.557+0000 7fbd9affd640 1 --2- 10.20.193.159:0/3643482384 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fbd880b57a0 0x7fbd880d5c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:58.558 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.557+0000 7fbd9affd640 1 -- 10.20.193.159:0/3643482384 <== mon.1 v2:10.20.193.159:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4012+0+0 (secure 0 0 0) 0x7fbda8015070 con 0x7fbdac113590 2026-02-24T09:14:58.558 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.557+0000 7fbdb1c47640 1 --2- 10.20.193.159:0/3643482384 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fbd880b57a0 0x7fbd880d5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:58.558 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.557+0000 7fbd9affd640 1 -- 10.20.193.159:0/3643482384 <== mon.1 v2:10.20.193.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fbda80aa780 con 0x7fbdac113590 2026-02-24T09:14:58.559 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.558+0000 7fbdb1c47640 1 --2- 10.20.193.159:0/3643482384 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fbd880b57a0 0x7fbd880d5c50 secure :-1 s=READY pgs=70 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd9c005970 tx=0x7fbd9c005900 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:58.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:58 trial028 ceph-mon[40371]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T09:14:58.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:58 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:58.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:58 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:58.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:58 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:14:58.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:58 trial028 ceph-mon[40371]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-24T09:14:58.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:58 trial028 ceph-mon[40371]: osdmap e36: 5 total, 4 up, 5 in 2026-02-24T09:14:58.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:58 trial028 ceph-mon[40371]: from='osd.4 [v2:10.20.193.74:6808/610990618,v1:10.20.193.74:6809/610990618]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial074", "root=default"]} : dispatch 2026-02-24T09:14:58.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:58 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:14:58.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:58 trial028 ceph-mon[40371]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial074", "root=default"]} : dispatch 2026-02-24T09:14:58.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:58 trial074 ceph-mon[44412]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T09:14:58.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:58 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:58.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:58 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:58.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:58 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:14:58.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:58 trial074 ceph-mon[44412]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-24T09:14:58.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:58 trial074 ceph-mon[44412]: osdmap e36: 5 total, 4 up, 5 in 2026-02-24T09:14:58.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:58 trial074 ceph-mon[44412]: from='osd.4 [v2:10.20.193.74:6808/610990618,v1:10.20.193.74:6809/610990618]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial074", "root=default"]} : dispatch 2026-02-24T09:14:58.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:58 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:14:58.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:58 trial074 ceph-mon[44412]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial074", "root=default"]} : dispatch 2026-02-24T09:14:58.680 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:14:58.680+0000 7fbdb2c49640 1 -- 10.20.193.159:0/3643482384 --> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial159:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fbdac0f4c30 con 0x7fbd880b57a0 2026-02-24T09:14:59.042 INFO:journalctl@ceph.osd.4.trial074.stdout:Feb 24 09:14:58 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-4[64243]: 2026-02-24T09:14:58.951+0000 7f4a36326640 -1 osd.4 0 waiting for initial osdmap 2026-02-24T09:14:59.043 INFO:journalctl@ceph.osd.4.trial074.stdout:Feb 24 09:14:58 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-4[64243]: 2026-02-24T09:14:58.957+0000 7f4a2e1e5640 -1 osd.4 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T09:14:59.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:59 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:59.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:59 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:59.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:59 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:59.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:59 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:59.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:59 trial028 ceph-mon[40371]: from='client.24436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial159:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:14:59.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:59 trial028 ceph-mon[40371]: osd.default does not exist. Creating it now. 2026-02-24T09:14:59.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:59 trial028 ceph-mon[40371]: Creating OSDs with service ID: default on trial159:['vg_nvme/lv_3'] 2026-02-24T09:14:59.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:59 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:59.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:59 trial028 ceph-mon[40371]: Marking host: trial159 for OSDSpec preview refresh. 2026-02-24T09:14:59.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:59 trial028 ceph-mon[40371]: Saving service osd.default spec with placement trial159 2026-02-24T09:14:59.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:59 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:59.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:59 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:14:59.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:59 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:14:59.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:59 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:59.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:59 trial028 ceph-mon[40371]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial074", "root=default"]}]': finished 2026-02-24T09:14:59.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:59 trial028 ceph-mon[40371]: osdmap e37: 5 total, 4 up, 5 in 2026-02-24T09:14:59.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:59 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:14:59.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:59 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:14:59.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:14:59 trial028 ceph-mon[40371]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T09:14:59.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:59 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:59.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:59 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:59.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:59 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:59.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:59 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:59.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:59 trial074 ceph-mon[44412]: from='client.24436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial159:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:14:59.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:59 trial074 ceph-mon[44412]: osd.default does not exist. Creating it now. 2026-02-24T09:14:59.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:59 trial074 ceph-mon[44412]: Creating OSDs with service ID: default on trial159:['vg_nvme/lv_3'] 2026-02-24T09:14:59.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:59 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:59.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:59 trial074 ceph-mon[44412]: Marking host: trial159 for OSDSpec preview refresh. 2026-02-24T09:14:59.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:59 trial074 ceph-mon[44412]: Saving service osd.default spec with placement trial159 2026-02-24T09:14:59.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:59 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:14:59.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:59 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:14:59.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:59 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:14:59.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:59 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:59.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:59 trial074 ceph-mon[44412]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial074", "root=default"]}]': finished 2026-02-24T09:14:59.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:59 trial074 ceph-mon[44412]: osdmap e37: 5 total, 4 up, 5 in 2026-02-24T09:14:59.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:59 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:14:59.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:59 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:14:59.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:14:59 trial074 ceph-mon[44412]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T09:15:00.000 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:59 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:00.000 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:59 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:00.000 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:59 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:00.000 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:59 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:00.000 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:59 trial159 ceph-mon[44242]: from='client.24436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial159:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:15:00.000 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:59 trial159 ceph-mon[44242]: osd.default does not exist. Creating it now. 2026-02-24T09:15:00.000 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:59 trial159 ceph-mon[44242]: Creating OSDs with service ID: default on trial159:['vg_nvme/lv_3'] 2026-02-24T09:15:00.001 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:59 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:00.001 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:59 trial159 ceph-mon[44242]: Marking host: trial159 for OSDSpec preview refresh. 2026-02-24T09:15:00.001 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:59 trial159 ceph-mon[44242]: Saving service osd.default spec with placement trial159 2026-02-24T09:15:00.001 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:59 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:00.001 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:59 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:15:00.001 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:59 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:15:00.001 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:59 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:00.001 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:59 trial159 ceph-mon[44242]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial074", "root=default"]}]': finished 2026-02-24T09:15:00.001 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:59 trial159 ceph-mon[44242]: osdmap e37: 5 total, 4 up, 5 in 2026-02-24T09:15:00.001 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:59 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:15:00.001 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:59 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:15:00.001 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:14:59 trial159 ceph-mon[44242]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T09:15:00.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:00 trial159 ceph-mon[44242]: purged_snaps scrub starts 2026-02-24T09:15:00.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:00 trial159 ceph-mon[44242]: purged_snaps scrub ok 2026-02-24T09:15:00.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:00 trial159 ceph-mon[44242]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ffeeb021-0924-4421-aecf-bac2e74364a9"} : dispatch 2026-02-24T09:15:00.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:00 trial159 ceph-mon[44242]: from='client.? 10.20.193.159:0/1371235722' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ffeeb021-0924-4421-aecf-bac2e74364a9"} : dispatch 2026-02-24T09:15:00.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:00 trial159 ceph-mon[44242]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ffeeb021-0924-4421-aecf-bac2e74364a9"}]': finished 2026-02-24T09:15:00.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:00 trial159 ceph-mon[44242]: osd.4 [v2:10.20.193.74:6808/610990618,v1:10.20.193.74:6809/610990618] boot 2026-02-24T09:15:00.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:00 trial159 ceph-mon[44242]: osdmap e38: 6 total, 5 up, 6 in 2026-02-24T09:15:00.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:00 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:15:00.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:00 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:15:00.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:00 trial159 ceph-mon[44242]: Detected new or changed devices on trial074 2026-02-24T09:15:00.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:00 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:00.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:00 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:00.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:00 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:00.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:00 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:00.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:00 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:00.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:00 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:00.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:00 trial159 ceph-mon[44242]: Adjusting osd_memory_target on trial074 to 42026M 2026-02-24T09:15:00.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:00 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:00.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:00 trial159 ceph-mon[44242]: from='client.? 10.20.193.159:0/2596873256' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:15:00.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:00 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:00.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:00 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:00.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:00 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:00.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:00 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:15:00.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:00 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:00.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:00 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:15:00.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:00 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:15:00.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:00 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:00.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:00 trial028 ceph-mon[40371]: purged_snaps scrub starts 2026-02-24T09:15:00.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:00 trial028 ceph-mon[40371]: purged_snaps scrub ok 2026-02-24T09:15:00.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:00 trial028 ceph-mon[40371]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ffeeb021-0924-4421-aecf-bac2e74364a9"} : dispatch 2026-02-24T09:15:00.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:00 trial028 ceph-mon[40371]: from='client.? 10.20.193.159:0/1371235722' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ffeeb021-0924-4421-aecf-bac2e74364a9"} : dispatch 2026-02-24T09:15:00.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:00 trial028 ceph-mon[40371]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ffeeb021-0924-4421-aecf-bac2e74364a9"}]': finished 2026-02-24T09:15:00.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:00 trial028 ceph-mon[40371]: osd.4 [v2:10.20.193.74:6808/610990618,v1:10.20.193.74:6809/610990618] boot 2026-02-24T09:15:00.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:00 trial028 ceph-mon[40371]: osdmap e38: 6 total, 5 up, 6 in 2026-02-24T09:15:00.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:00 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:15:00.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:00 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:15:00.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:00 trial028 ceph-mon[40371]: Detected new or changed devices on trial074 2026-02-24T09:15:00.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:00 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:00.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:00 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:00.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:00 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:00.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:00 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:00.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:00 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:00.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:00 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:00.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:00 trial028 ceph-mon[40371]: Adjusting osd_memory_target on trial074 to 42026M 2026-02-24T09:15:00.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:00 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:00.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:00 trial028 ceph-mon[40371]: from='client.? 10.20.193.159:0/2596873256' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:15:00.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:00 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:00.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:00 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:00.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:00 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:00.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:00 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:15:00.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:00 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:00.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:00 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:15:00.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:00 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:15:00.863 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:00 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:00.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:00 trial074 ceph-mon[44412]: purged_snaps scrub starts 2026-02-24T09:15:00.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:00 trial074 ceph-mon[44412]: purged_snaps scrub ok 2026-02-24T09:15:00.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:00 trial074 ceph-mon[44412]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ffeeb021-0924-4421-aecf-bac2e74364a9"} : dispatch 2026-02-24T09:15:00.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:00 trial074 ceph-mon[44412]: from='client.? 10.20.193.159:0/1371235722' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ffeeb021-0924-4421-aecf-bac2e74364a9"} : dispatch 2026-02-24T09:15:00.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:00 trial074 ceph-mon[44412]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ffeeb021-0924-4421-aecf-bac2e74364a9"}]': finished 2026-02-24T09:15:00.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:00 trial074 ceph-mon[44412]: osd.4 [v2:10.20.193.74:6808/610990618,v1:10.20.193.74:6809/610990618] boot 2026-02-24T09:15:00.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:00 trial074 ceph-mon[44412]: osdmap e38: 6 total, 5 up, 6 in 2026-02-24T09:15:00.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:00 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:15:00.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:00 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:15:00.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:00 trial074 ceph-mon[44412]: Detected new or changed devices on trial074 2026-02-24T09:15:00.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:00 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:00.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:00 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:00.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:00 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:00.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:00 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:00.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:00 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:00.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:00 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:00.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:00 trial074 ceph-mon[44412]: Adjusting osd_memory_target on trial074 to 42026M 2026-02-24T09:15:00.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:00 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:00.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:00 trial074 ceph-mon[44412]: from='client.? 10.20.193.159:0/2596873256' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:15:00.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:00 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:00.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:00 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:00.876 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:00 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:00.876 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:00 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:15:00.876 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:00 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:00.876 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:00 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:15:00.876 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:00 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:15:00.876 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:00 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:02.226 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:02 trial159 ceph-mon[44242]: osdmap e39: 6 total, 5 up, 6 in 2026-02-24T09:15:02.226 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:02 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:15:02.227 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:02 trial159 ceph-mon[44242]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-24T09:15:02.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:02 trial074 ceph-mon[44412]: osdmap e39: 6 total, 5 up, 6 in 2026-02-24T09:15:02.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:02 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:15:02.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:02 trial074 ceph-mon[44412]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-24T09:15:02.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:02 trial028 ceph-mon[40371]: osdmap e39: 6 total, 5 up, 6 in 2026-02-24T09:15:02.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:02 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:15:02.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:02 trial028 ceph-mon[40371]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-24T09:15:03.386 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:03 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-24T09:15:03.386 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:03 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:03.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:03 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-24T09:15:03.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:03 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:03.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:03 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-24T09:15:03.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:03 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:04.529 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:04 trial159 ceph-mon[44242]: Deploying daemon osd.5 on trial159 2026-02-24T09:15:04.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:04 trial159 ceph-mon[44242]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-24T09:15:04.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:04 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-24T09:15:04.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:04 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:04.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:04 trial028 ceph-mon[40371]: Deploying daemon osd.5 on trial159 2026-02-24T09:15:04.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:04 trial028 ceph-mon[40371]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-24T09:15:04.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:04 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-24T09:15:04.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:04 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:04.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:04 trial074 ceph-mon[44412]: Deploying daemon osd.5 on trial159 2026-02-24T09:15:04.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:04 trial074 ceph-mon[44412]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-24T09:15:04.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:04 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-24T09:15:04.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:04 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:05.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:05 trial028 ceph-mon[40371]: Deploying daemon osd.5 on trial159 2026-02-24T09:15:05.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:05 trial074 ceph-mon[44412]: Deploying daemon osd.5 on trial159 2026-02-24T09:15:05.732 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:05 trial159 ceph-mon[44242]: Deploying daemon osd.5 on trial159 2026-02-24T09:15:06.499 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:06 trial159 ceph-mon[44242]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-24T09:15:06.499 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:06 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:06.499 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:06 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:06.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:06 trial028 ceph-mon[40371]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-24T09:15:06.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:06 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:06.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:06 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:06.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:06 trial074 ceph-mon[44412]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-24T09:15:06.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:06 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:06.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:06 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:07.500 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:07 trial159 ceph-mon[44242]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-24T09:15:07.500 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:07 trial159 ceph-mon[44242]: from='osd.5 [v2:10.20.193.159:6808/3420316658,v1:10.20.193.159:6809/3420316658]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-24T09:15:07.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:07 trial028 ceph-mon[40371]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-24T09:15:07.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:07 trial028 ceph-mon[40371]: from='osd.5 [v2:10.20.193.159:6808/3420316658,v1:10.20.193.159:6809/3420316658]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-24T09:15:07.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:07 trial074 ceph-mon[44412]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-24T09:15:07.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:07 trial074 ceph-mon[44412]: from='osd.5 [v2:10.20.193.159:6808/3420316658,v1:10.20.193.159:6809/3420316658]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-24T09:15:08.324 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:08 trial159 ceph-mon[44242]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-24T09:15:08.324 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:08 trial159 ceph-mon[44242]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-24T09:15:08.324 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:08 trial159 ceph-mon[44242]: osdmap e40: 6 total, 5 up, 6 in 2026-02-24T09:15:08.557 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:08.555+0000 7fbdb36d1640 1 -- 10.20.193.159:0/3643482384 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=37}) -- 0x7fbd84003560 con 0x7fbdac113590 2026-02-24T09:15:08.557 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:08.555+0000 7fbd9affd640 1 -- 10.20.193.159:0/3643482384 <== mon.1 v2:10.20.193.159:3300/0 7 ==== osd_map(37..41 src has 1..41) ==== 4652+0+0 (secure 0 0 0) 0x7fbda80061d0 con 0x7fbdac113590 2026-02-24T09:15:08.604 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:08 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:15:08.604 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:08 trial159 ceph-mon[44242]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial159", "root=default"]} : dispatch 2026-02-24T09:15:08.604 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:08 trial159 ceph-mon[44242]: from='osd.5 [v2:10.20.193.159:6808/3420316658,v1:10.20.193.159:6809/3420316658]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial159", "root=default"]} : dispatch 2026-02-24T09:15:08.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:08 trial028 ceph-mon[40371]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-24T09:15:08.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:08 trial028 ceph-mon[40371]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-24T09:15:08.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:08 trial028 ceph-mon[40371]: osdmap e40: 6 total, 5 up, 6 in 2026-02-24T09:15:08.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:08 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:15:08.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:08 trial028 ceph-mon[40371]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial159", "root=default"]} : dispatch 2026-02-24T09:15:08.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:08 trial028 ceph-mon[40371]: from='osd.5 [v2:10.20.193.159:6808/3420316658,v1:10.20.193.159:6809/3420316658]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial159", "root=default"]} : dispatch 2026-02-24T09:15:08.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:08 trial074 ceph-mon[44412]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-24T09:15:08.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:08 trial074 ceph-mon[44412]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-24T09:15:08.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:08 trial074 ceph-mon[44412]: osdmap e40: 6 total, 5 up, 6 in 2026-02-24T09:15:08.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:08 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:15:08.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:08 trial074 ceph-mon[44412]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial159", "root=default"]} : dispatch 2026-02-24T09:15:08.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:08 trial074 ceph-mon[44412]: from='osd.5 [v2:10.20.193.159:6808/3420316658,v1:10.20.193.159:6809/3420316658]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial159", "root=default"]} : dispatch 2026-02-24T09:15:09.363 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:09 trial159 ceph-mon[44242]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial159", "root=default"]}]': finished 2026-02-24T09:15:09.363 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:09 trial159 ceph-mon[44242]: osdmap e41: 6 total, 5 up, 6 in 2026-02-24T09:15:09.363 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:09 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:15:09.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:09 trial028 ceph-mon[40371]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial159", "root=default"]}]': finished 2026-02-24T09:15:09.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:09 trial028 ceph-mon[40371]: osdmap e41: 6 total, 5 up, 6 in 2026-02-24T09:15:09.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:09 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:15:09.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:09 trial074 ceph-mon[44412]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial159", "root=default"]}]': finished 2026-02-24T09:15:09.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:09 trial074 ceph-mon[44412]: osdmap e41: 6 total, 5 up, 6 in 2026-02-24T09:15:09.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:09 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:15:10.431 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:10.430+0000 7fbd9affd640 1 -- 10.20.193.159:0/3643482384 <== mgr.14223 v2:10.20.193.28:6800/906910473 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fbdac0f4c30 con 0x7fbd880b57a0 2026-02-24T09:15:10.431 INFO:teuthology.orchestra.run.trial159.stdout:Created osd(s) 5 on host 'trial159' 2026-02-24T09:15:10.434 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:10.433+0000 7fbdb2c49640 1 -- 10.20.193.159:0/3643482384 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fbd880b57a0 msgr2=0x7fbd880d5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:10.435 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:10.433+0000 7fbdb2c49640 1 --2- 10.20.193.159:0/3643482384 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fbd880b57a0 0x7fbd880d5c50 secure :-1 s=READY pgs=70 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd9c005970 tx=0x7fbd9c005900 comp rx=0 tx=0).stop 2026-02-24T09:15:10.435 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:10.433+0000 7fbdb2c49640 1 -- 10.20.193.159:0/3643482384 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fbdac113590 msgr2=0x7fbdac0f41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:10.435 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:10.433+0000 7fbdb2c49640 1 --2- 10.20.193.159:0/3643482384 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fbdac113590 0x7fbdac0f41d0 secure :-1 s=READY pgs=39 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbda800f8d0 tx=0x7fbda800fda0 comp rx=0 tx=0).stop 2026-02-24T09:15:10.435 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:10.434+0000 7fbdb2c49640 1 -- 10.20.193.159:0/3643482384 shutdown_connections 2026-02-24T09:15:10.435 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:10.434+0000 7fbdb2c49640 1 --2- 10.20.193.159:0/3643482384 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fbd880b57a0 0x7fbd880d5c50 unknown :-1 s=CLOSED pgs=70 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:10.435 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:10.434+0000 7fbdb2c49640 1 --2- 10.20.193.159:0/3643482384 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fbdac113590 0x7fbdac0f41d0 unknown :-1 s=CLOSED pgs=39 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:10.435 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:10.434+0000 7fbdb2c49640 1 --2- 10.20.193.159:0/3643482384 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbdac10bcc0 0x7fbdac173e60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:10.435 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:10.434+0000 7fbdb2c49640 1 --2- 10.20.193.159:0/3643482384 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fbdac10b2d0 0x7fbdac0f3ad0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:10.435 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:10.434+0000 7fbdb2c49640 1 -- 10.20.193.159:0/3643482384 >> 10.20.193.159:0/3643482384 conn(0x7fbdac0e8e40 msgr2=0x7fbdac110a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:10.435 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:10.434+0000 7fbdb2c49640 1 -- 10.20.193.159:0/3643482384 shutdown_connections 2026-02-24T09:15:10.436 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:10.434+0000 7fbdb2c49640 1 -- 10.20.193.159:0/3643482384 wait complete. 2026-02-24T09:15:10.578 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:10 trial159 ceph-mon[44242]: pgmap v74: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-24T09:15:10.578 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:10 trial159 ceph-mon[44242]: osdmap e42: 6 total, 5 up, 6 in 2026-02-24T09:15:10.579 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:10 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:15:10.579 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:10 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:10.579 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:10 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:10.580 DEBUG:teuthology.orchestra.run.trial159:osd.5> sudo journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.5.service 2026-02-24T09:15:10.583 INFO:tasks.cephadm:Deploying osd.6 on trial028 with /dev/vg_nvme/lv_2... 2026-02-24T09:15:10.584 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-24T09:15:10.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:10 trial028 ceph-mon[40371]: pgmap v74: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-24T09:15:10.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:10 trial028 ceph-mon[40371]: osdmap e42: 6 total, 5 up, 6 in 2026-02-24T09:15:10.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:10 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:15:10.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:10 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:10.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:10 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:10.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:10 trial074 ceph-mon[44412]: pgmap v74: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-24T09:15:10.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:10 trial074 ceph-mon[44412]: osdmap e42: 6 total, 5 up, 6 in 2026-02-24T09:15:10.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:10 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:15:10.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:10 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:10.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:10 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:10.773 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:15:11.030 INFO:journalctl@ceph.osd.5.trial159.stdout:Feb 24 09:15:10 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-5[63490]: 2026-02-24T09:15:10.693+0000 7fae92b01780 -1 osd.5 0 log_to_monitors true 2026-02-24T09:15:11.456 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:11 trial028 ceph-mon[40371]: osdmap e43: 6 total, 5 up, 6 in 2026-02-24T09:15:11.456 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:11 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:15:11.456 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:11 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:11.456 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:11 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:11.457 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:11 trial028 ceph-mon[40371]: from='osd.5 [v2:10.20.193.159:6808/1653417923,v1:10.20.193.159:6809/1653417923]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-24T09:15:11.457 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:11 trial028 ceph-mon[40371]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-24T09:15:11.457 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:11 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:11.457 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:11 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:11.457 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:11 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:15:11.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:11 trial074 ceph-mon[44412]: osdmap e43: 6 total, 5 up, 6 in 2026-02-24T09:15:11.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:11 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:15:11.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:11 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:11.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:11 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:11.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:11 trial074 ceph-mon[44412]: from='osd.5 [v2:10.20.193.159:6808/1653417923,v1:10.20.193.159:6809/1653417923]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-24T09:15:11.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:11 trial074 ceph-mon[44412]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-24T09:15:11.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:11 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:11.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:11 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:11.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:11 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:15:11.654 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:11 trial159 ceph-mon[44242]: osdmap e43: 6 total, 5 up, 6 in 2026-02-24T09:15:11.654 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:11 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:15:11.655 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:11 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:11.655 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:11 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:11.655 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:11 trial159 ceph-mon[44242]: from='osd.5 [v2:10.20.193.159:6808/1653417923,v1:10.20.193.159:6809/1653417923]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-24T09:15:11.655 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:11 trial159 ceph-mon[44242]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-24T09:15:11.655 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:11 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:11.655 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:11 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:11.655 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:11 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:15:11.655 INFO:journalctl@ceph.osd.5.trial159.stdout:Feb 24 09:15:11 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-5[63490]: 2026-02-24T09:15:11.437+0000 7fae8ea83640 -1 osd.5 0 waiting for initial osdmap 2026-02-24T09:15:11.655 INFO:journalctl@ceph.osd.5.trial159.stdout:Feb 24 09:15:11 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-5[63490]: 2026-02-24T09:15:11.445+0000 7fae86942640 -1 osd.5 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T09:15:11.658 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:15:11.683 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph orch daemon add osd trial028:vg_nvme/lv_2 --skip-validation 2026-02-24T09:15:11.911 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:15:12.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.080+0000 7f9d0ae60640 1 -- 10.20.193.28:0/3912475400 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d0410bde0 msgr2=0x7f9d04112e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:12.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.080+0000 7f9d0ae60640 1 --2- 10.20.193.28:0/3912475400 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d0410bde0 0x7f9d04112e90 secure :-1 s=READY pgs=177 gs=1 cs=0 l=1 c_cookie=341217687038359337 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cf8009950 tx=0x7f9cf802f190 comp rx=0 tx=0).stop 2026-02-24T09:15:12.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.080+0000 7f9d0ae60640 1 -- 10.20.193.28:0/3912475400 shutdown_connections 2026-02-24T09:15:12.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.080+0000 7f9d0ae60640 1 --2- 10.20.193.28:0/3912475400 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f9d04113610 0x7f9d04173f80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:12.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.080+0000 7f9d0ae60640 1 --2- 10.20.193.28:0/3912475400 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d0410bde0 0x7f9d04112e90 unknown :-1 s=CLOSED pgs=177 gs=1 cs=0 l=1 c_cookie=341217687038359337 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:12.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.080+0000 7f9d0ae60640 1 --2- 10.20.193.28:0/3912475400 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f9d0410b3f0 0x7f9d0410b7c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:12.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.080+0000 7f9d0ae60640 1 -- 10.20.193.28:0/3912475400 >> 10.20.193.28:0/3912475400 conn(0x7f9d040e8e40 msgr2=0x7f9d04109250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:12.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.080+0000 7f9d0ae60640 1 -- 10.20.193.28:0/3912475400 shutdown_connections 2026-02-24T09:15:12.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.080+0000 7f9d0ae60640 1 -- 10.20.193.28:0/3912475400 wait complete. 2026-02-24T09:15:12.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.081+0000 7f9d0ae60640 1 Processor -- start 2026-02-24T09:15:12.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.081+0000 7f9d0ae60640 1 -- start start 2026-02-24T09:15:12.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.081+0000 7f9d0ae60640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f9d0410b3f0 0x7f9d040f3a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:12.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.081+0000 7f9d0ae60640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d0410bde0 0x7f9d04173f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:12.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.081+0000 7f9d0ae60640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f9d04113610 0x7f9d040f41d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:12.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.081+0000 7f9d0ae60640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9d040f9400 con 0x7f9d0410bde0 2026-02-24T09:15:12.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.081+0000 7f9d0ae60640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f9d040f9570 con 0x7f9d0410b3f0 2026-02-24T09:15:12.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.081+0000 7f9d0ae60640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9d040f9730 con 0x7f9d04113610 2026-02-24T09:15:12.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.081+0000 7f9d0965d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d0410bde0 0x7f9d04173f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:12.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.081+0000 7f9d0965d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d0410bde0 0x7f9d04173f60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36560/0 (socket says 10.20.193.28:36560) 2026-02-24T09:15:12.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.081+0000 7f9d0965d640 1 -- 10.20.193.28:0/2812265513 learned_addr learned my addr 10.20.193.28:0/2812265513 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:15:12.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.081+0000 7f9d09e5e640 1 --2- 10.20.193.28:0/2812265513 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f9d0410b3f0 0x7f9d040f3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:12.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.081+0000 7f9d0a65f640 1 --2- 10.20.193.28:0/2812265513 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f9d04113610 0x7f9d040f41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:12.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.081+0000 7f9d0965d640 1 -- 10.20.193.28:0/2812265513 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f9d04113610 msgr2=0x7f9d040f41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:12.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.081+0000 7f9d0965d640 1 --2- 10.20.193.28:0/2812265513 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f9d04113610 0x7f9d040f41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:12.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.081+0000 7f9d0965d640 1 -- 10.20.193.28:0/2812265513 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f9d0410b3f0 msgr2=0x7f9d040f3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:12.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.081+0000 7f9d0965d640 1 --2- 10.20.193.28:0/2812265513 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f9d0410b3f0 0x7f9d040f3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:12.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.081+0000 7f9d0965d640 1 -- 10.20.193.28:0/2812265513 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cf8009570 con 0x7f9d0410bde0 2026-02-24T09:15:12.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.082+0000 7f9d0965d640 1 --2- 10.20.193.28:0/2812265513 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d0410bde0 0x7f9d04173f60 secure :-1 s=READY pgs=178 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cf80098a0 tx=0x7f9cf80028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:12.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.082+0000 7f9cf2ffd640 1 -- 10.20.193.28:0/2812265513 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9cf803d070 con 0x7f9d0410bde0 2026-02-24T09:15:12.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.082+0000 7f9cf2ffd640 1 -- 10.20.193.28:0/2812265513 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f9cf8002a40 con 0x7f9d0410bde0 2026-02-24T09:15:12.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.082+0000 7f9cf2ffd640 1 -- 10.20.193.28:0/2812265513 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9cf8041820 con 0x7f9d0410bde0 2026-02-24T09:15:12.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.082+0000 7f9d0ae60640 1 -- 10.20.193.28:0/2812265513 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d040f99b0 con 0x7f9d0410bde0 2026-02-24T09:15:12.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.082+0000 7f9d0ae60640 1 -- 10.20.193.28:0/2812265513 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d040f9e20 con 0x7f9d0410bde0 2026-02-24T09:15:12.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.083+0000 7f9cf0ff9640 1 -- 10.20.193.28:0/2812265513 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d0410c420 con 0x7f9d0410bde0 2026-02-24T09:15:12.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.085+0000 7f9cf2ffd640 1 -- 10.20.193.28:0/2812265513 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 19) ==== 157139+0+0 (secure 0 0 0) 0x7f9cf80419c0 con 0x7f9d0410bde0 2026-02-24T09:15:12.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.087+0000 7f9cf2ffd640 1 --2- 10.20.193.28:0/2812265513 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f9ce00b5730 0x7f9ce00d5be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:12.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.087+0000 7f9cf2ffd640 1 -- 10.20.193.28:0/2812265513 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4493+0+0 (secure 0 0 0) 0x7f9cf810a510 con 0x7f9d0410bde0 2026-02-24T09:15:12.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.087+0000 7f9cf2ffd640 1 -- 10.20.193.28:0/2812265513 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f9cf810a990 con 0x7f9d0410bde0 2026-02-24T09:15:12.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.087+0000 7f9d09e5e640 1 --2- 10.20.193.28:0/2812265513 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f9ce00b5730 0x7f9ce00d5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:12.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.087+0000 7f9d09e5e640 1 --2- 10.20.193.28:0/2812265513 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f9ce00b5730 0x7f9ce00d5be0 secure :-1 s=READY pgs=76 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cf4004740 tx=0x7f9cf40073d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:12.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:12.207+0000 7f9cf0ff9640 1 -- 10.20.193.28:0/2812265513 --> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f9d040f4b90 con 0x7f9ce00b5730 2026-02-24T09:15:12.508 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:12 trial074 ceph-mon[44412]: pgmap v77: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-24T09:15:12.509 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:12 trial074 ceph-mon[44412]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-24T09:15:12.509 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:12 trial074 ceph-mon[44412]: osdmap e44: 6 total, 5 up, 6 in 2026-02-24T09:15:12.509 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:12 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:15:12.509 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:12 trial074 ceph-mon[44412]: from='osd.5 [v2:10.20.193.159:6808/1653417923,v1:10.20.193.159:6809/1653417923]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial159", "root=default"]} : dispatch 2026-02-24T09:15:12.509 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:12 trial074 ceph-mon[44412]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial159", "root=default"]} : dispatch 2026-02-24T09:15:12.509 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:12 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:15:12.509 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:12 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:12.509 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:12 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:12.509 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:12 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:12.509 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:12 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:12.509 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:12 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:12.509 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:12 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:12.509 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:12 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:15:12.509 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:12 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:15:12.509 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:12 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:12.516 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:12 trial159 ceph-mon[44242]: pgmap v77: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-24T09:15:12.516 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:12 trial159 ceph-mon[44242]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-24T09:15:12.516 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:12 trial159 ceph-mon[44242]: osdmap e44: 6 total, 5 up, 6 in 2026-02-24T09:15:12.516 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:12 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:15:12.516 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:12 trial159 ceph-mon[44242]: from='osd.5 [v2:10.20.193.159:6808/1653417923,v1:10.20.193.159:6809/1653417923]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial159", "root=default"]} : dispatch 2026-02-24T09:15:12.516 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:12 trial159 ceph-mon[44242]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial159", "root=default"]} : dispatch 2026-02-24T09:15:12.516 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:12 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:15:12.516 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:12 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:12.516 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:12 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:12.516 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:12 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:12.516 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:12 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:12.516 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:12 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:12.516 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:12 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:12.516 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:12 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:15:12.516 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:12 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:15:12.516 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:12 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:12.708 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:12 trial028 ceph-mon[40371]: pgmap v77: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-24T09:15:12.708 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:12 trial028 ceph-mon[40371]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-24T09:15:12.708 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:12 trial028 ceph-mon[40371]: osdmap e44: 6 total, 5 up, 6 in 2026-02-24T09:15:12.708 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:12 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:15:12.708 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:12 trial028 ceph-mon[40371]: from='osd.5 [v2:10.20.193.159:6808/1653417923,v1:10.20.193.159:6809/1653417923]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial159", "root=default"]} : dispatch 2026-02-24T09:15:12.708 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:12 trial028 ceph-mon[40371]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial159", "root=default"]} : dispatch 2026-02-24T09:15:12.708 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:12 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:15:12.708 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:12 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:12.708 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:12 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:12.708 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:12 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:12.708 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:12 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:12.708 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:12 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:12.708 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:12 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:12.708 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:12 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:15:12.708 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:12 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:15:12.708 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:12 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:13.772 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:13 trial028 ceph-mon[40371]: from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:15:13.773 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:13 trial028 ceph-mon[40371]: osd.default does not exist. Creating it now. 2026-02-24T09:15:13.773 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:13 trial028 ceph-mon[40371]: Creating OSDs with service ID: default on trial028:['vg_nvme/lv_2'] 2026-02-24T09:15:13.773 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:13 trial028 ceph-mon[40371]: Marking host: trial028 for OSDSpec preview refresh. 2026-02-24T09:15:13.773 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:13 trial028 ceph-mon[40371]: Saving service osd.default spec with placement trial028 2026-02-24T09:15:13.773 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:13 trial028 ceph-mon[40371]: osd.5 [v2:10.20.193.159:6808/1653417923,v1:10.20.193.159:6809/1653417923] boot 2026-02-24T09:15:13.773 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:13 trial028 ceph-mon[40371]: osdmap e45: 6 total, 6 up, 6 in 2026-02-24T09:15:13.773 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:13 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:15:13.773 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:13 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/3336501789' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f3736156-4951-4901-9323-7930fb73b8dd"} : dispatch 2026-02-24T09:15:13.773 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:13 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/3336501789' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f3736156-4951-4901-9323-7930fb73b8dd"}]': finished 2026-02-24T09:15:13.773 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:13 trial028 ceph-mon[40371]: osdmap e46: 7 total, 6 up, 7 in 2026-02-24T09:15:13.773 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:13 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:15:13.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:13 trial159 ceph-mon[44242]: from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:15:13.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:13 trial159 ceph-mon[44242]: osd.default does not exist. Creating it now. 2026-02-24T09:15:13.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:13 trial159 ceph-mon[44242]: Creating OSDs with service ID: default on trial028:['vg_nvme/lv_2'] 2026-02-24T09:15:13.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:13 trial159 ceph-mon[44242]: Marking host: trial028 for OSDSpec preview refresh. 2026-02-24T09:15:13.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:13 trial159 ceph-mon[44242]: Saving service osd.default spec with placement trial028 2026-02-24T09:15:13.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:13 trial159 ceph-mon[44242]: osd.5 [v2:10.20.193.159:6808/1653417923,v1:10.20.193.159:6809/1653417923] boot 2026-02-24T09:15:13.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:13 trial159 ceph-mon[44242]: osdmap e45: 6 total, 6 up, 6 in 2026-02-24T09:15:13.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:13 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:15:13.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:13 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/3336501789' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f3736156-4951-4901-9323-7930fb73b8dd"} : dispatch 2026-02-24T09:15:13.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:13 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/3336501789' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f3736156-4951-4901-9323-7930fb73b8dd"}]': finished 2026-02-24T09:15:13.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:13 trial159 ceph-mon[44242]: osdmap e46: 7 total, 6 up, 7 in 2026-02-24T09:15:13.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:13 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:15:13.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:13 trial074 ceph-mon[44412]: from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:15:13.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:13 trial074 ceph-mon[44412]: osd.default does not exist. Creating it now. 2026-02-24T09:15:13.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:13 trial074 ceph-mon[44412]: Creating OSDs with service ID: default on trial028:['vg_nvme/lv_2'] 2026-02-24T09:15:13.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:13 trial074 ceph-mon[44412]: Marking host: trial028 for OSDSpec preview refresh. 2026-02-24T09:15:13.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:13 trial074 ceph-mon[44412]: Saving service osd.default spec with placement trial028 2026-02-24T09:15:13.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:13 trial074 ceph-mon[44412]: osd.5 [v2:10.20.193.159:6808/1653417923,v1:10.20.193.159:6809/1653417923] boot 2026-02-24T09:15:13.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:13 trial074 ceph-mon[44412]: osdmap e45: 6 total, 6 up, 6 in 2026-02-24T09:15:13.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:13 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:15:13.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:13 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/3336501789' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f3736156-4951-4901-9323-7930fb73b8dd"} : dispatch 2026-02-24T09:15:13.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:13 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/3336501789' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f3736156-4951-4901-9323-7930fb73b8dd"}]': finished 2026-02-24T09:15:13.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:13 trial074 ceph-mon[44412]: osdmap e46: 7 total, 6 up, 7 in 2026-02-24T09:15:13.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:13 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:15:14.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:14 trial159 ceph-mon[44242]: purged_snaps scrub starts 2026-02-24T09:15:14.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:14 trial159 ceph-mon[44242]: purged_snaps scrub ok 2026-02-24T09:15:14.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:14 trial159 ceph-mon[44242]: pgmap v80: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-24T09:15:14.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:14 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:14.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:14 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:14.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:14 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:14.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:14 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:14.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:14 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:14.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:14 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:14.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:14 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:14.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:14 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:14.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:14 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:14.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:14 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:14.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:14 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:15:14.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:14 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:14.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:14 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:15:14.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:14 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:15:14.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:14 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:14.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:14 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/3203423631' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:15:14.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:14 trial159 ceph-mon[44242]: osdmap e47: 7 total, 6 up, 7 in 2026-02-24T09:15:14.782 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:14 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:15:14.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:14 trial028 ceph-mon[40371]: purged_snaps scrub starts 2026-02-24T09:15:14.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:14 trial028 ceph-mon[40371]: purged_snaps scrub ok 2026-02-24T09:15:14.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:14 trial028 ceph-mon[40371]: pgmap v80: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-24T09:15:14.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:14 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:14.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:14 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:14.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:14 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:14.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:14 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:14.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:14 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:14.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:14 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:14.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:14 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:14.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:14 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:14.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:14 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:14.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:14 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:14.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:14 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:15:14.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:14 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:14.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:14 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:15:14.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:14 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:15:14.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:14 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:14.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:14 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/3203423631' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:15:14.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:14 trial028 ceph-mon[40371]: osdmap e47: 7 total, 6 up, 7 in 2026-02-24T09:15:14.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:14 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:15:14.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:14 trial074 ceph-mon[44412]: purged_snaps scrub starts 2026-02-24T09:15:14.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:14 trial074 ceph-mon[44412]: purged_snaps scrub ok 2026-02-24T09:15:14.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:14 trial074 ceph-mon[44412]: pgmap v80: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-24T09:15:14.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:14 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:14.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:14 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:14.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:14 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:14.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:14 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:14.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:14 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:14.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:14 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:14.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:14 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:14.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:14 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:14.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:14 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:14.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:14 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:14.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:14 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:15:14.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:14 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:14.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:14 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:15:14.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:14 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:15:14.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:14 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:14.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:14 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/3203423631' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:15:14.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:14 trial074 ceph-mon[44412]: osdmap e47: 7 total, 6 up, 7 in 2026-02-24T09:15:14.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:14 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:15:15.763 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:15 trial028 ceph-mon[40371]: Detected new or changed devices on trial159 2026-02-24T09:15:15.763 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:15 trial028 ceph-mon[40371]: Adjusting osd_memory_target on trial159 to 42026M 2026-02-24T09:15:15.763 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:15 trial028 ceph-mon[40371]: osdmap e48: 7 total, 6 up, 7 in 2026-02-24T09:15:15.763 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:15 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:15:15.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:15 trial159 ceph-mon[44242]: Detected new or changed devices on trial159 2026-02-24T09:15:15.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:15 trial159 ceph-mon[44242]: Adjusting osd_memory_target on trial159 to 42026M 2026-02-24T09:15:15.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:15 trial159 ceph-mon[44242]: osdmap e48: 7 total, 6 up, 7 in 2026-02-24T09:15:15.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:15 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:15:15.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:15 trial074 ceph-mon[44412]: Detected new or changed devices on trial159 2026-02-24T09:15:15.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:15 trial074 ceph-mon[44412]: Adjusting osd_memory_target on trial159 to 42026M 2026-02-24T09:15:15.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:15 trial074 ceph-mon[44412]: osdmap e48: 7 total, 6 up, 7 in 2026-02-24T09:15:15.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:15 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:15:16.551 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:16 trial028 ceph-mon[40371]: pgmap v83: 1 pgs: 1 remapped+peering; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-24T09:15:16.551 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:16 trial028 ceph-mon[40371]: osdmap e49: 7 total, 6 up, 7 in 2026-02-24T09:15:16.551 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:16 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:15:16.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:16 trial159 ceph-mon[44242]: pgmap v83: 1 pgs: 1 remapped+peering; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-24T09:15:16.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:16 trial159 ceph-mon[44242]: osdmap e49: 7 total, 6 up, 7 in 2026-02-24T09:15:16.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:16 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:15:16.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:16 trial074 ceph-mon[44412]: pgmap v83: 1 pgs: 1 remapped+peering; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-24T09:15:16.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:16 trial074 ceph-mon[44412]: osdmap e49: 7 total, 6 up, 7 in 2026-02-24T09:15:16.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:16 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:15:17.674 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:17 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-24T09:15:17.674 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:17 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:17.674 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:17 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-24T09:15:17.674 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:17 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:17.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:17 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-24T09:15:17.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:17 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:17.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:17 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-24T09:15:17.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:17 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:17.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:17 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-24T09:15:17.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:17 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:17.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:17 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-24T09:15:17.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:17 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:18.687 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:18 trial028 ceph-mon[40371]: Deploying daemon osd.6 on trial028 2026-02-24T09:15:18.687 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:18 trial028 ceph-mon[40371]: Deploying daemon osd.6 on trial028 2026-02-24T09:15:18.687 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:18 trial028 ceph-mon[40371]: pgmap v86: 1 pgs: 1 remapped+peering; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-24T09:15:18.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:18 trial159 ceph-mon[44242]: Deploying daemon osd.6 on trial028 2026-02-24T09:15:18.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:18 trial159 ceph-mon[44242]: Deploying daemon osd.6 on trial028 2026-02-24T09:15:18.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:18 trial159 ceph-mon[44242]: pgmap v86: 1 pgs: 1 remapped+peering; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-24T09:15:18.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:18 trial074 ceph-mon[44412]: Deploying daemon osd.6 on trial028 2026-02-24T09:15:18.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:18 trial074 ceph-mon[44412]: Deploying daemon osd.6 on trial028 2026-02-24T09:15:18.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:18 trial074 ceph-mon[44412]: pgmap v86: 1 pgs: 1 remapped+peering; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-24T09:15:20.645 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:20 trial028 ceph-mon[40371]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 98 KiB/s, 0 objects/s recovering 2026-02-24T09:15:20.646 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:20 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:20.646 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:20 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:20.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:20 trial159 ceph-mon[44242]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 98 KiB/s, 0 objects/s recovering 2026-02-24T09:15:20.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:20 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:20.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:20 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:20.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:20 trial074 ceph-mon[44412]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 98 KiB/s, 0 objects/s recovering 2026-02-24T09:15:20.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:20 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:20.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:20 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:21.589 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:21 trial028 ceph-mon[40371]: from='osd.6 [v2:10.20.193.28:6818/2088394415,v1:10.20.193.28:6819/2088394415]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-24T09:15:21.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:21 trial159 ceph-mon[44242]: from='osd.6 [v2:10.20.193.28:6818/2088394415,v1:10.20.193.28:6819/2088394415]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-24T09:15:21.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:21 trial074 ceph-mon[44412]: from='osd.6 [v2:10.20.193.28:6818/2088394415,v1:10.20.193.28:6819/2088394415]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-24T09:15:22.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:22.084+0000 7f9d0b8e8640 1 -- 10.20.193.28:0/2812265513 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=45}) -- 0x7f9cdc003560 con 0x7f9d0410bde0 2026-02-24T09:15:22.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:22.084+0000 7f9cf2ffd640 1 -- 10.20.193.28:0/2812265513 <== mon.0 v2:10.20.193.28:3300/0 7 ==== osd_map(45..50 src has 1..50) ==== 3087+0+0 (secure 0 0 0) 0x7f9cf80d2110 con 0x7f9d0410bde0 2026-02-24T09:15:22.467 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:22 trial028 ceph-mon[40371]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 84 KiB/s, 0 objects/s recovering 2026-02-24T09:15:22.467 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:22 trial028 ceph-mon[40371]: from='osd.6 [v2:10.20.193.28:6818/2088394415,v1:10.20.193.28:6819/2088394415]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-24T09:15:22.468 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:22 trial028 ceph-mon[40371]: osdmap e50: 7 total, 6 up, 7 in 2026-02-24T09:15:22.468 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:22 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:15:22.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:22 trial159 ceph-mon[44242]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 84 KiB/s, 0 objects/s recovering 2026-02-24T09:15:22.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:22 trial159 ceph-mon[44242]: from='osd.6 [v2:10.20.193.28:6818/2088394415,v1:10.20.193.28:6819/2088394415]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-24T09:15:22.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:22 trial159 ceph-mon[44242]: osdmap e50: 7 total, 6 up, 7 in 2026-02-24T09:15:22.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:22 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:15:22.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:22 trial074 ceph-mon[44412]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 84 KiB/s, 0 objects/s recovering 2026-02-24T09:15:22.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:22 trial074 ceph-mon[44412]: from='osd.6 [v2:10.20.193.28:6818/2088394415,v1:10.20.193.28:6819/2088394415]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-24T09:15:22.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:22 trial074 ceph-mon[44412]: osdmap e50: 7 total, 6 up, 7 in 2026-02-24T09:15:22.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:22 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:15:23.789 INFO:teuthology.orchestra.run.trial028.stdout:Created osd(s) 6 on host 'trial028' 2026-02-24T09:15:23.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:23.787+0000 7f9cf2ffd640 1 -- 10.20.193.28:0/2812265513 <== mgr.14223 v2:10.20.193.28:6800/906910473 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f9d040f4b90 con 0x7f9ce00b5730 2026-02-24T09:15:23.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:23.790+0000 7f9cf0ff9640 1 -- 10.20.193.28:0/2812265513 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f9ce00b5730 msgr2=0x7f9ce00d5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:23.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:23.790+0000 7f9cf0ff9640 1 --2- 10.20.193.28:0/2812265513 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f9ce00b5730 0x7f9ce00d5be0 secure :-1 s=READY pgs=76 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cf4004740 tx=0x7f9cf40073d0 comp rx=0 tx=0).stop 2026-02-24T09:15:23.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:23.790+0000 7f9cf0ff9640 1 -- 10.20.193.28:0/2812265513 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d0410bde0 msgr2=0x7f9d04173f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:23.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:23.790+0000 7f9cf0ff9640 1 --2- 10.20.193.28:0/2812265513 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d0410bde0 0x7f9d04173f60 secure :-1 s=READY pgs=178 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cf80098a0 tx=0x7f9cf80028d0 comp rx=0 tx=0).stop 2026-02-24T09:15:23.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:23.791+0000 7f9cf0ff9640 1 -- 10.20.193.28:0/2812265513 shutdown_connections 2026-02-24T09:15:23.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:23.791+0000 7f9cf0ff9640 1 --2- 10.20.193.28:0/2812265513 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f9ce00b5730 0x7f9ce00d5be0 unknown :-1 s=CLOSED pgs=76 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:23.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:23.791+0000 7f9cf0ff9640 1 --2- 10.20.193.28:0/2812265513 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f9d04113610 0x7f9d040f41d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:23.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:23.791+0000 7f9cf0ff9640 1 --2- 10.20.193.28:0/2812265513 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d0410bde0 0x7f9d04173f60 unknown :-1 s=CLOSED pgs=178 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:23.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:23.791+0000 7f9cf0ff9640 1 --2- 10.20.193.28:0/2812265513 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f9d0410b3f0 0x7f9d040f3a30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:23.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:23.791+0000 7f9cf0ff9640 1 -- 10.20.193.28:0/2812265513 >> 10.20.193.28:0/2812265513 conn(0x7f9d040e8e40 msgr2=0x7f9d04112cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:23.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:23.791+0000 7f9cf0ff9640 1 -- 10.20.193.28:0/2812265513 shutdown_connections 2026-02-24T09:15:23.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:23.791+0000 7f9cf0ff9640 1 -- 10.20.193.28:0/2812265513 wait complete. 2026-02-24T09:15:23.896 DEBUG:teuthology.orchestra.run.trial028:osd.6> sudo journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.6.service 2026-02-24T09:15:23.901 INFO:tasks.cephadm:Deploying osd.7 on trial074 with /dev/vg_nvme/lv_2... 2026-02-24T09:15:23.901 DEBUG:teuthology.orchestra.run.trial074:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-24T09:15:24.090 INFO:teuthology.orchestra.run.trial074.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.b/config 2026-02-24T09:15:24.220 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:24 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:24.220 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:24 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:24.221 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:24 trial074 ceph-mon[44412]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 73 KiB/s, 0 objects/s recovering 2026-02-24T09:15:24.221 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:24 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:24.221 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:24 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:24.404 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:24 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:24.404 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:24 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:24.404 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:24 trial028 ceph-mon[40371]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 73 KiB/s, 0 objects/s recovering 2026-02-24T09:15:24.404 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:24 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:24.405 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:24 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:24.405 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:15:24 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-6[86503]: 2026-02-24T09:15:24.147+0000 7fe0edde3780 -1 osd.6 0 log_to_monitors true 2026-02-24T09:15:24.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:24 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:24.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:24 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:24.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:24 trial159 ceph-mon[44242]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 73 KiB/s, 0 objects/s recovering 2026-02-24T09:15:24.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:24 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:24.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:24 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:25.032 INFO:teuthology.orchestra.run.trial074.stdout: 2026-02-24T09:15:25.055 DEBUG:teuthology.orchestra.run.trial074:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph orch daemon add osd trial074:vg_nvme/lv_2 --skip-validation 2026-02-24T09:15:25.240 INFO:teuthology.orchestra.run.trial074.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.b/config 2026-02-24T09:15:25.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:25 trial028 ceph-mon[40371]: from='osd.6 [v2:10.20.193.28:6818/1891043856,v1:10.20.193.28:6819/1891043856]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-24T09:15:25.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:25 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:25.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:25 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:25.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:25 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:15:25.361 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:25 trial074 ceph-mon[44412]: from='osd.6 [v2:10.20.193.28:6818/1891043856,v1:10.20.193.28:6819/1891043856]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-24T09:15:25.362 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:25 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:25.362 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:25 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:25.362 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:25 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:15:25.440 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.438+0000 7f710e41a640 1 -- 10.20.193.74:0/3896934958 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f71081100b0 msgr2=0x7f7108115100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:25.441 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.438+0000 7f710e41a640 1 --2- 10.20.193.74:0/3896934958 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f71081100b0 0x7f7108115100 secure :-1 s=READY pgs=55 gs=1 cs=0 l=1 c_cookie=9851284302882021329 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70f8009950 tx=0x7f70f802f190 comp rx=0 tx=0).stop 2026-02-24T09:15:25.441 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.438+0000 7f710e41a640 1 -- 10.20.193.74:0/3896934958 shutdown_connections 2026-02-24T09:15:25.441 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.438+0000 7f710e41a640 1 --2- 10.20.193.74:0/3896934958 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71081158b0 0x7f7108176280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:25.441 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.438+0000 7f710e41a640 1 --2- 10.20.193.74:0/3896934958 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f71081100b0 0x7f7108115100 unknown :-1 s=CLOSED pgs=55 gs=1 cs=0 l=1 c_cookie=9851284302882021329 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:25.441 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.438+0000 7f710e41a640 1 --2- 10.20.193.74:0/3896934958 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f710810f6c0 0x7f710810fa90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:25.441 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.438+0000 7f710e41a640 1 -- 10.20.193.74:0/3896934958 >> 10.20.193.74:0/3896934958 conn(0x7f71080ecfd0 msgr2=0x7f710810d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:25.441 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.438+0000 7f710e41a640 1 -- 10.20.193.74:0/3896934958 shutdown_connections 2026-02-24T09:15:25.441 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.438+0000 7f710e41a640 1 -- 10.20.193.74:0/3896934958 wait complete. 2026-02-24T09:15:25.442 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.439+0000 7f710e41a640 1 Processor -- start 2026-02-24T09:15:25.442 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.439+0000 7f710e41a640 1 -- start start 2026-02-24T09:15:25.444 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.439+0000 7f710e41a640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f710810f6c0 0x7f71080f5a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:25.444 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.439+0000 7f710e41a640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f71081100b0 0x7f7108176180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:25.444 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.439+0000 7f710e41a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71081158b0 0x7f71080f6170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:25.444 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.439+0000 7f710e41a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f71080fb380 con 0x7f71081158b0 2026-02-24T09:15:25.444 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.439+0000 7f710e41a640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f71080fb4f0 con 0x7f710810f6c0 2026-02-24T09:15:25.444 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.439+0000 7f710e41a640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f71080fb6b0 con 0x7f71081100b0 2026-02-24T09:15:25.444 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.439+0000 7f7107fff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f710810f6c0 0x7f71080f5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:25.445 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.439+0000 7f71077fe640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f71081100b0 0x7f7108176180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:25.445 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.439+0000 7f7107fff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f710810f6c0 0x7f71080f5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.74:42756/0 (socket says 10.20.193.74:42756) 2026-02-24T09:15:25.445 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.439+0000 7f7107fff640 1 -- 10.20.193.74:0/3152153163 learned_addr learned my addr 10.20.193.74:0/3152153163 (peer_addr_for_me v2:10.20.193.74:0/0) 2026-02-24T09:15:25.445 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.440+0000 7f710c990640 1 --2- 10.20.193.74:0/3152153163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71081158b0 0x7f71080f6170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:25.445 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.440+0000 7f7107fff640 1 -- 10.20.193.74:0/3152153163 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f71081100b0 msgr2=0x7f7108176180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:25.445 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.440+0000 7f7107fff640 1 --2- 10.20.193.74:0/3152153163 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f71081100b0 0x7f7108176180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:25.445 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.440+0000 7f7107fff640 1 -- 10.20.193.74:0/3152153163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71081158b0 msgr2=0x7f71080f6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:25.445 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.440+0000 7f7107fff640 1 --2- 10.20.193.74:0/3152153163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71081158b0 0x7f71080f6170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:25.445 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.440+0000 7f7107fff640 1 -- 10.20.193.74:0/3152153163 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70f8009570 con 0x7f710810f6c0 2026-02-24T09:15:25.445 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.440+0000 7f7107fff640 1 --2- 10.20.193.74:0/3152153163 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f710810f6c0 0x7f71080f5a70 secure :-1 s=READY pgs=56 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70f4009480 tx=0x7f70f400ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:25.445 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.440+0000 7f71057fa640 1 -- 10.20.193.74:0/3152153163 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f70f400cd40 con 0x7f710810f6c0 2026-02-24T09:15:25.445 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.440+0000 7f71057fa640 1 -- 10.20.193.74:0/3152153163 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f70f4004d10 con 0x7f710810f6c0 2026-02-24T09:15:25.446 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.440+0000 7f71057fa640 1 -- 10.20.193.74:0/3152153163 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f70f40106b0 con 0x7f710810f6c0 2026-02-24T09:15:25.446 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.440+0000 7f710e41a640 1 -- 10.20.193.74:0/3152153163 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71080fb990 con 0x7f710810f6c0 2026-02-24T09:15:25.446 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.440+0000 7f710e41a640 1 -- 10.20.193.74:0/3152153163 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71080fbe10 con 0x7f710810f6c0 2026-02-24T09:15:25.446 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.441+0000 7f70daffd640 1 -- 10.20.193.74:0/3152153163 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71081109a0 con 0x7f710810f6c0 2026-02-24T09:15:25.447 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.443+0000 7f71057fa640 1 -- 10.20.193.74:0/3152153163 <== mon.2 v2:10.20.193.74:3300/0 4 ==== mgrmap(e 19) ==== 157139+0+0 (secure 0 0 0) 0x7f70f4004770 con 0x7f710810f6c0 2026-02-24T09:15:25.447 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.444+0000 7f71057fa640 1 --2- 10.20.193.74:0/3152153163 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f70dc0b57a0 0x7f70dc0d5c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:25.447 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.444+0000 7f71057fa640 1 -- 10.20.193.74:0/3152153163 <== mon.2 v2:10.20.193.74:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4876+0+0 (secure 0 0 0) 0x7f70f4014070 con 0x7f710810f6c0 2026-02-24T09:15:25.447 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.444+0000 7f71057fa640 1 -- 10.20.193.74:0/3152153163 <== mon.2 v2:10.20.193.74:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f70f405d890 con 0x7f710810f6c0 2026-02-24T09:15:25.447 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.444+0000 7f71077fe640 1 --2- 10.20.193.74:0/3152153163 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f70dc0b57a0 0x7f70dc0d5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:25.447 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.445+0000 7f71077fe640 1 --2- 10.20.193.74:0/3152153163 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f70dc0b57a0 0x7f70dc0d5c50 secure :-1 s=READY pgs=80 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70f80023d0 tx=0x7f70f8031040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:25.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:25 trial159 ceph-mon[44242]: from='osd.6 [v2:10.20.193.28:6818/1891043856,v1:10.20.193.28:6819/1891043856]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-24T09:15:25.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:25 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:25.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:25 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:25.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:25 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:15:25.566 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:25.564+0000 7f70daffd640 1 -- 10.20.193.74:0/3152153163 --> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial074:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f71080f6bd0 con 0x7f70dc0b57a0 2026-02-24T09:15:26.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:26 trial159 ceph-mon[44242]: from='osd.6 [v2:10.20.193.28:6818/1891043856,v1:10.20.193.28:6819/1891043856]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-24T09:15:26.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:26 trial159 ceph-mon[44242]: osdmap e51: 7 total, 6 up, 7 in 2026-02-24T09:15:26.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:26 trial159 ceph-mon[44242]: from='osd.6 [v2:10.20.193.28:6818/1891043856,v1:10.20.193.28:6819/1891043856]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-24T09:15:26.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:26 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:15:26.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:26 trial159 ceph-mon[44242]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 72 KiB/s, 0 objects/s recovering 2026-02-24T09:15:26.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:26 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:26.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:26 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:26.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:26 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:26.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:26 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:26.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:26 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:26.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:26 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:26.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:26 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:15:26.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:26 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:15:26.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:26 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:26.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:26 trial028 ceph-mon[40371]: from='osd.6 [v2:10.20.193.28:6818/1891043856,v1:10.20.193.28:6819/1891043856]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-24T09:15:26.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:26 trial028 ceph-mon[40371]: osdmap e51: 7 total, 6 up, 7 in 2026-02-24T09:15:26.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:26 trial028 ceph-mon[40371]: from='osd.6 [v2:10.20.193.28:6818/1891043856,v1:10.20.193.28:6819/1891043856]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-24T09:15:26.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:26 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:15:26.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:26 trial028 ceph-mon[40371]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 72 KiB/s, 0 objects/s recovering 2026-02-24T09:15:26.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:26 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:26.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:26 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:26.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:26 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:26.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:26 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:26.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:26 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:26.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:26 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:26.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:26 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:15:26.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:26 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:15:26.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:26 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:26.361 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:15:26 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-6[86503]: 2026-02-24T09:15:26.130+0000 7fe0e9d65640 -1 osd.6 0 waiting for initial osdmap 2026-02-24T09:15:26.361 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:15:26 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-6[86503]: 2026-02-24T09:15:26.138+0000 7fe0e1c24640 -1 osd.6 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T09:15:26.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:26 trial074 ceph-mon[44412]: from='osd.6 [v2:10.20.193.28:6818/1891043856,v1:10.20.193.28:6819/1891043856]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-24T09:15:26.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:26 trial074 ceph-mon[44412]: osdmap e51: 7 total, 6 up, 7 in 2026-02-24T09:15:26.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:26 trial074 ceph-mon[44412]: from='osd.6 [v2:10.20.193.28:6818/1891043856,v1:10.20.193.28:6819/1891043856]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-24T09:15:26.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:26 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:15:26.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:26 trial074 ceph-mon[44412]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 72 KiB/s, 0 objects/s recovering 2026-02-24T09:15:26.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:26 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:26.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:26 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:26.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:26 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:26.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:26 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:26.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:26 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:26.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:26 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:26.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:26 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:15:26.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:26 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:15:26.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:26 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:27.279 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:27 trial159 ceph-mon[44242]: from='client.24512 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial074:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:15:27.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:27 trial159 ceph-mon[44242]: osd.default does not exist. Creating it now. 2026-02-24T09:15:27.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:27 trial159 ceph-mon[44242]: Creating OSDs with service ID: default on trial074:['vg_nvme/lv_2'] 2026-02-24T09:15:27.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:27 trial159 ceph-mon[44242]: Marking host: trial074 for OSDSpec preview refresh. 2026-02-24T09:15:27.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:27 trial159 ceph-mon[44242]: Saving service osd.default spec with placement trial074 2026-02-24T09:15:27.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:27 trial159 ceph-mon[44242]: from='osd.6 [v2:10.20.193.28:6818/1891043856,v1:10.20.193.28:6819/1891043856]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-24T09:15:27.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:27 trial159 ceph-mon[44242]: osdmap e52: 7 total, 6 up, 7 in 2026-02-24T09:15:27.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:27 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:15:27.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:27 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:15:27.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:27 trial159 ceph-mon[44242]: from='client.? 10.20.193.74:0/175836436' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "214b27ee-75f9-4a54-a59b-e8bfbb895903"} : dispatch 2026-02-24T09:15:27.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:27 trial159 ceph-mon[44242]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "214b27ee-75f9-4a54-a59b-e8bfbb895903"} : dispatch 2026-02-24T09:15:27.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:27 trial159 ceph-mon[44242]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "214b27ee-75f9-4a54-a59b-e8bfbb895903"}]': finished 2026-02-24T09:15:27.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:27 trial159 ceph-mon[44242]: osd.6 [v2:10.20.193.28:6818/1891043856,v1:10.20.193.28:6819/1891043856] boot 2026-02-24T09:15:27.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:27 trial159 ceph-mon[44242]: osdmap e53: 8 total, 7 up, 8 in 2026-02-24T09:15:27.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:27 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:15:27.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:27 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:15:27.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:27 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:27.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:27 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:27.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:27 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:27.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:27 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:27.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:27 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:27.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:27 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:27.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:27 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:27.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:27 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:27.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:27 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:27.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:27 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:27.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:27 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:27.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:27 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:15:27.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:27 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:27.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:27 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:15:27.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:27 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:15:27.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:27 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:27.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:27 trial159 ceph-mon[44242]: from='client.? 10.20.193.74:0/981600354' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:15:27.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:27 trial074 ceph-mon[44412]: from='client.24512 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial074:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:15:27.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:27 trial074 ceph-mon[44412]: osd.default does not exist. Creating it now. 2026-02-24T09:15:27.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:27 trial074 ceph-mon[44412]: Creating OSDs with service ID: default on trial074:['vg_nvme/lv_2'] 2026-02-24T09:15:27.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:27 trial074 ceph-mon[44412]: Marking host: trial074 for OSDSpec preview refresh. 2026-02-24T09:15:27.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:27 trial074 ceph-mon[44412]: Saving service osd.default spec with placement trial074 2026-02-24T09:15:27.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:27 trial074 ceph-mon[44412]: from='osd.6 [v2:10.20.193.28:6818/1891043856,v1:10.20.193.28:6819/1891043856]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-24T09:15:27.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:27 trial074 ceph-mon[44412]: osdmap e52: 7 total, 6 up, 7 in 2026-02-24T09:15:27.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:27 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:15:27.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:27 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:15:27.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:27 trial074 ceph-mon[44412]: from='client.? 10.20.193.74:0/175836436' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "214b27ee-75f9-4a54-a59b-e8bfbb895903"} : dispatch 2026-02-24T09:15:27.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:27 trial074 ceph-mon[44412]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "214b27ee-75f9-4a54-a59b-e8bfbb895903"} : dispatch 2026-02-24T09:15:27.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:27 trial074 ceph-mon[44412]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "214b27ee-75f9-4a54-a59b-e8bfbb895903"}]': finished 2026-02-24T09:15:27.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:27 trial074 ceph-mon[44412]: osd.6 [v2:10.20.193.28:6818/1891043856,v1:10.20.193.28:6819/1891043856] boot 2026-02-24T09:15:27.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:27 trial074 ceph-mon[44412]: osdmap e53: 8 total, 7 up, 8 in 2026-02-24T09:15:27.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:27 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:15:27.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:27 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:15:27.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:27 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:27.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:27 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:27.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:27 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:27.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:27 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:27.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:27 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:27.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:27 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:27.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:27 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:27.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:27 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:27.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:27 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:27.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:27 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:27.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:27 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:27.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:27 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:15:27.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:27 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:27.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:27 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:15:27.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:27 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:15:27.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:27 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:27.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:27 trial074 ceph-mon[44412]: from='client.? 10.20.193.74:0/981600354' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:15:27.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:27 trial028 ceph-mon[40371]: from='client.24512 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial074:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:15:27.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:27 trial028 ceph-mon[40371]: osd.default does not exist. Creating it now. 2026-02-24T09:15:27.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:27 trial028 ceph-mon[40371]: Creating OSDs with service ID: default on trial074:['vg_nvme/lv_2'] 2026-02-24T09:15:27.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:27 trial028 ceph-mon[40371]: Marking host: trial074 for OSDSpec preview refresh. 2026-02-24T09:15:27.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:27 trial028 ceph-mon[40371]: Saving service osd.default spec with placement trial074 2026-02-24T09:15:27.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:27 trial028 ceph-mon[40371]: from='osd.6 [v2:10.20.193.28:6818/1891043856,v1:10.20.193.28:6819/1891043856]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-24T09:15:27.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:27 trial028 ceph-mon[40371]: osdmap e52: 7 total, 6 up, 7 in 2026-02-24T09:15:27.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:27 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:15:27.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:27 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:15:27.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:27 trial028 ceph-mon[40371]: from='client.? 10.20.193.74:0/175836436' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "214b27ee-75f9-4a54-a59b-e8bfbb895903"} : dispatch 2026-02-24T09:15:27.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:27 trial028 ceph-mon[40371]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "214b27ee-75f9-4a54-a59b-e8bfbb895903"} : dispatch 2026-02-24T09:15:27.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:27 trial028 ceph-mon[40371]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "214b27ee-75f9-4a54-a59b-e8bfbb895903"}]': finished 2026-02-24T09:15:27.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:27 trial028 ceph-mon[40371]: osd.6 [v2:10.20.193.28:6818/1891043856,v1:10.20.193.28:6819/1891043856] boot 2026-02-24T09:15:27.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:27 trial028 ceph-mon[40371]: osdmap e53: 8 total, 7 up, 8 in 2026-02-24T09:15:27.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:27 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:15:27.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:27 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:15:27.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:27 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:27.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:27 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:27.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:27 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:27.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:27 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:27.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:27 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:27.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:27 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:27.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:27 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:27.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:27 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:27.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:27 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:27.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:27 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:27.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:27 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:27.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:27 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:15:27.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:27 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:27.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:27 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:15:27.612 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:27 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:15:27.612 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:27 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:27.612 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:27 trial028 ceph-mon[40371]: from='client.? 10.20.193.74:0/981600354' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:15:28.529 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:28 trial159 ceph-mon[44242]: purged_snaps scrub starts 2026-02-24T09:15:28.529 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:28 trial159 ceph-mon[44242]: purged_snaps scrub ok 2026-02-24T09:15:28.529 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:28 trial159 ceph-mon[44242]: Detected new or changed devices on trial028 2026-02-24T09:15:28.529 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:28 trial159 ceph-mon[44242]: Adjusting osd_memory_target on trial028 to 28017M 2026-02-24T09:15:28.529 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:28 trial159 ceph-mon[44242]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-24T09:15:28.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:28 trial028 ceph-mon[40371]: purged_snaps scrub starts 2026-02-24T09:15:28.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:28 trial028 ceph-mon[40371]: purged_snaps scrub ok 2026-02-24T09:15:28.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:28 trial028 ceph-mon[40371]: Detected new or changed devices on trial028 2026-02-24T09:15:28.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:28 trial028 ceph-mon[40371]: Adjusting osd_memory_target on trial028 to 28017M 2026-02-24T09:15:28.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:28 trial028 ceph-mon[40371]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-24T09:15:28.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:28 trial074 ceph-mon[44412]: purged_snaps scrub starts 2026-02-24T09:15:28.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:28 trial074 ceph-mon[44412]: purged_snaps scrub ok 2026-02-24T09:15:28.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:28 trial074 ceph-mon[44412]: Detected new or changed devices on trial028 2026-02-24T09:15:28.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:28 trial074 ceph-mon[44412]: Adjusting osd_memory_target on trial028 to 28017M 2026-02-24T09:15:28.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:28 trial074 ceph-mon[44412]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-24T09:15:29.368 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:29 trial074 ceph-mon[44412]: osdmap e54: 8 total, 7 up, 8 in 2026-02-24T09:15:29.368 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:29 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:15:29.529 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:29 trial159 ceph-mon[44242]: osdmap e54: 8 total, 7 up, 8 in 2026-02-24T09:15:29.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:29 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:15:29.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:29 trial028 ceph-mon[40371]: osdmap e54: 8 total, 7 up, 8 in 2026-02-24T09:15:29.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:29 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:15:30.276 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:30 trial074 ceph-mon[44412]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-24T09:15:30.529 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:30 trial159 ceph-mon[44242]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-24T09:15:30.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:30 trial028 ceph-mon[40371]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-24T09:15:31.529 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:31 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-24T09:15:31.529 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:31 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:31.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:31 trial159 ceph-mon[44242]: Deploying daemon osd.7 on trial074 2026-02-24T09:15:31.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:31 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-24T09:15:31.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:31 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:31.541 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:31 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-24T09:15:31.541 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:31 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:31.542 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:31 trial074 ceph-mon[44412]: Deploying daemon osd.7 on trial074 2026-02-24T09:15:31.542 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:31 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-24T09:15:31.542 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:31 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:31.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:31 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-24T09:15:31.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:31 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:31.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:31 trial028 ceph-mon[40371]: Deploying daemon osd.7 on trial074 2026-02-24T09:15:31.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:31 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-24T09:15:31.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:31 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:32.243 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:32 trial074 ceph-mon[44412]: Deploying daemon osd.7 on trial074 2026-02-24T09:15:32.243 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:32 trial074 ceph-mon[44412]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-24T09:15:32.529 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:32 trial159 ceph-mon[44242]: Deploying daemon osd.7 on trial074 2026-02-24T09:15:32.529 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:32 trial159 ceph-mon[44242]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-24T09:15:32.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:32 trial028 ceph-mon[40371]: Deploying daemon osd.7 on trial074 2026-02-24T09:15:32.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:32 trial028 ceph-mon[40371]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-24T09:15:34.522 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:34 trial074 ceph-mon[44412]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-24T09:15:34.522 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:34 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:34.522 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:34 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:34.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:34 trial028 ceph-mon[40371]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-24T09:15:34.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:34 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:34.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:34 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:34.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:34 trial159 ceph-mon[44242]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-24T09:15:34.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:34 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:34.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:34 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:35.343 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:35 trial074 ceph-mon[44412]: from='osd.7 [v2:10.20.193.74:6816/2665981158,v1:10.20.193.74:6817/2665981158]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-24T09:15:35.444 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:35.442+0000 7f710dc19640 1 -- 10.20.193.74:0/3152153163 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=52}) -- 0x7f70e8003560 con 0x7f710810f6c0 2026-02-24T09:15:35.444 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:35.442+0000 7f71057fa640 1 -- 10.20.193.74:0/3152153163 <== mon.2 v2:10.20.193.74:3300/0 7 ==== osd_map(52..55 src has 1..55) ==== 3551+0+0 (secure 0 0 0) 0x7f70f40adf10 con 0x7f710810f6c0 2026-02-24T09:15:35.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:35 trial028 ceph-mon[40371]: from='osd.7 [v2:10.20.193.74:6816/2665981158,v1:10.20.193.74:6817/2665981158]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-24T09:15:35.681 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:35 trial159 ceph-mon[44242]: from='osd.7 [v2:10.20.193.74:6816/2665981158,v1:10.20.193.74:6817/2665981158]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-24T09:15:36.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:36 trial028 ceph-mon[40371]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-24T09:15:36.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:36 trial028 ceph-mon[40371]: from='osd.7 [v2:10.20.193.74:6816/2665981158,v1:10.20.193.74:6817/2665981158]' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-24T09:15:36.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:36 trial028 ceph-mon[40371]: osdmap e55: 8 total, 7 up, 8 in 2026-02-24T09:15:36.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:36 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:15:36.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:36 trial074 ceph-mon[44412]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-24T09:15:36.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:36 trial074 ceph-mon[44412]: from='osd.7 [v2:10.20.193.74:6816/2665981158,v1:10.20.193.74:6817/2665981158]' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-24T09:15:36.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:36 trial074 ceph-mon[44412]: osdmap e55: 8 total, 7 up, 8 in 2026-02-24T09:15:36.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:36 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:15:36.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:36 trial159 ceph-mon[44242]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-24T09:15:36.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:36 trial159 ceph-mon[44242]: from='osd.7 [v2:10.20.193.74:6816/2665981158,v1:10.20.193.74:6817/2665981158]' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-24T09:15:36.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:36 trial159 ceph-mon[44242]: osdmap e55: 8 total, 7 up, 8 in 2026-02-24T09:15:36.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:36 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:15:37.338 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:37.336+0000 7f71057fa640 1 -- 10.20.193.74:0/3152153163 <== mgr.14223 v2:10.20.193.28:6800/906910473 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f71080f6bd0 con 0x7f70dc0b57a0 2026-02-24T09:15:37.339 INFO:teuthology.orchestra.run.trial074.stdout:Created osd(s) 7 on host 'trial074' 2026-02-24T09:15:37.342 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:37.340+0000 7f70daffd640 1 -- 10.20.193.74:0/3152153163 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f70dc0b57a0 msgr2=0x7f70dc0d5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:37.342 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:37.340+0000 7f70daffd640 1 --2- 10.20.193.74:0/3152153163 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f70dc0b57a0 0x7f70dc0d5c50 secure :-1 s=READY pgs=80 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70f80023d0 tx=0x7f70f8031040 comp rx=0 tx=0).stop 2026-02-24T09:15:37.342 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:37.340+0000 7f70daffd640 1 -- 10.20.193.74:0/3152153163 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f710810f6c0 msgr2=0x7f71080f5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:37.342 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:37.340+0000 7f70daffd640 1 --2- 10.20.193.74:0/3152153163 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f710810f6c0 0x7f71080f5a70 secure :-1 s=READY pgs=56 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70f4009480 tx=0x7f70f400ee60 comp rx=0 tx=0).stop 2026-02-24T09:15:37.343 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:37.340+0000 7f70daffd640 1 -- 10.20.193.74:0/3152153163 shutdown_connections 2026-02-24T09:15:37.343 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:37.340+0000 7f70daffd640 1 --2- 10.20.193.74:0/3152153163 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f70dc0b57a0 0x7f70dc0d5c50 unknown :-1 s=CLOSED pgs=80 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:37.343 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:37.340+0000 7f70daffd640 1 --2- 10.20.193.74:0/3152153163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71081158b0 0x7f71080f6170 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:37.343 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:37.340+0000 7f70daffd640 1 --2- 10.20.193.74:0/3152153163 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f71081100b0 0x7f7108176180 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:37.343 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:37.340+0000 7f70daffd640 1 --2- 10.20.193.74:0/3152153163 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f710810f6c0 0x7f71080f5a70 unknown :-1 s=CLOSED pgs=56 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:37.343 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:37.340+0000 7f70daffd640 1 -- 10.20.193.74:0/3152153163 >> 10.20.193.74:0/3152153163 conn(0x7f71080ecfd0 msgr2=0x7f7108112f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:37.343 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:37.340+0000 7f70daffd640 1 -- 10.20.193.74:0/3152153163 shutdown_connections 2026-02-24T09:15:37.343 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:15:37.340+0000 7f70daffd640 1 -- 10.20.193.74:0/3152153163 wait complete. 2026-02-24T09:15:37.447 DEBUG:teuthology.orchestra.run.trial074:osd.7> sudo journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.7.service 2026-02-24T09:15:37.452 INFO:tasks.cephadm:Deploying osd.8 on trial159 with /dev/vg_nvme/lv_2... 2026-02-24T09:15:37.452 DEBUG:teuthology.orchestra.run.trial159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-24T09:15:37.638 INFO:teuthology.orchestra.run.trial159.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.c/config 2026-02-24T09:15:37.761 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:37 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:37.763 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:37 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:37.763 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:37 trial159 ceph-mon[44242]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-24T09:15:37.763 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:37 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:37.763 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:37 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:37.763 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:37 trial159 ceph-mon[44242]: from='osd.7 [v2:10.20.193.74:6816/2328869739,v1:10.20.193.74:6817/2328869739]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-24T09:15:37.763 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:37 trial159 ceph-mon[44242]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-24T09:15:37.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:37 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:37.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:37 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:37.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:37 trial028 ceph-mon[40371]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-24T09:15:37.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:37 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:37.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:37 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:37.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:37 trial028 ceph-mon[40371]: from='osd.7 [v2:10.20.193.74:6816/2328869739,v1:10.20.193.74:6817/2328869739]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-24T09:15:37.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:37 trial028 ceph-mon[40371]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-24T09:15:37.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:37 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:37.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:37 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:37.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:37 trial074 ceph-mon[44412]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-24T09:15:37.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:37 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:37.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:37 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:37.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:37 trial074 ceph-mon[44412]: from='osd.7 [v2:10.20.193.74:6816/2328869739,v1:10.20.193.74:6817/2328869739]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-24T09:15:37.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:37 trial074 ceph-mon[44412]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-24T09:15:37.874 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:15:37 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7[76701]: 2026-02-24T09:15:37.598+0000 7f2dade74780 -1 osd.7 0 log_to_monitors true 2026-02-24T09:15:38.556 INFO:teuthology.orchestra.run.trial159.stdout: 2026-02-24T09:15:38.580 DEBUG:teuthology.orchestra.run.trial159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph orch daemon add osd trial159:vg_nvme/lv_2 --skip-validation 2026-02-24T09:15:38.764 INFO:teuthology.orchestra.run.trial159.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.c/config 2026-02-24T09:15:38.949 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.946+0000 7fc845a8d640 1 -- 10.20.193.159:0/3247278291 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc84010f6c0 msgr2=0x7fc84010fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:38.949 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.946+0000 7fc845a8d640 1 --2- 10.20.193.159:0/3247278291 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc84010f6c0 0x7fc84010fa90 secure :-1 s=READY pgs=47 gs=1 cs=0 l=1 c_cookie=11896047425943048022 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc82c009950 tx=0x7fc82c02f190 comp rx=0 tx=0).stop 2026-02-24T09:15:38.949 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.946+0000 7fc845a8d640 1 -- 10.20.193.159:0/3247278291 shutdown_connections 2026-02-24T09:15:38.950 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.946+0000 7fc845a8d640 1 --2- 10.20.193.159:0/3247278291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc8401158b0 0x7fc840176280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:38.950 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.946+0000 7fc845a8d640 1 --2- 10.20.193.159:0/3247278291 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc8401100b0 0x7fc840115100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:38.950 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.946+0000 7fc845a8d640 1 --2- 10.20.193.159:0/3247278291 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc84010f6c0 0x7fc84010fa90 unknown :-1 s=CLOSED pgs=47 gs=1 cs=0 l=1 c_cookie=11896047425943048022 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:38.950 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.946+0000 7fc845a8d640 1 -- 10.20.193.159:0/3247278291 >> 10.20.193.159:0/3247278291 conn(0x7fc8400ecfd0 msgr2=0x7fc84010d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:38.950 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.946+0000 7fc845a8d640 1 -- 10.20.193.159:0/3247278291 shutdown_connections 2026-02-24T09:15:38.950 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.946+0000 7fc845a8d640 1 -- 10.20.193.159:0/3247278291 wait complete. 2026-02-24T09:15:38.950 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.947+0000 7fc845a8d640 1 Processor -- start 2026-02-24T09:15:38.950 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.947+0000 7fc845a8d640 1 -- start start 2026-02-24T09:15:38.950 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.947+0000 7fc845a8d640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc84010f6c0 0x7fc8400f59d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:38.950 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.947+0000 7fc845a8d640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc8401100b0 0x7fc840176180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:38.950 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.947+0000 7fc845a8d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc8401158b0 0x7fc8400f60d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:38.951 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.947+0000 7fc845a8d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc8400fb2e0 con 0x7fc8401158b0 2026-02-24T09:15:38.951 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.947+0000 7fc845a8d640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fc8400fb450 con 0x7fc8401100b0 2026-02-24T09:15:38.951 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.947+0000 7fc845a8d640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc8400fb610 con 0x7fc84010f6c0 2026-02-24T09:15:38.951 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.947+0000 7fc83f7fe640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc84010f6c0 0x7fc8400f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:38.951 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.947+0000 7fc83f7fe640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc84010f6c0 0x7fc8400f59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.159:52500/0 (socket says 10.20.193.159:52500) 2026-02-24T09:15:38.951 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.947+0000 7fc83f7fe640 1 -- 10.20.193.159:0/2023879291 learned_addr learned my addr 10.20.193.159:0/2023879291 (peer_addr_for_me v2:10.20.193.159:0/0) 2026-02-24T09:15:38.951 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.948+0000 7fc83ffff640 1 --2- 10.20.193.159:0/2023879291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc8401158b0 0x7fc8400f60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:38.951 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.947+0000 7fc83effd640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc8401100b0 0x7fc840176180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:38.951 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.948+0000 7fc83f7fe640 1 -- 10.20.193.159:0/2023879291 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc8401100b0 msgr2=0x7fc840176180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:38.951 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.948+0000 7fc83f7fe640 1 --2- 10.20.193.159:0/2023879291 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc8401100b0 0x7fc840176180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:38.951 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.948+0000 7fc83f7fe640 1 -- 10.20.193.159:0/2023879291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc8401158b0 msgr2=0x7fc8400f60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:38.951 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.948+0000 7fc83f7fe640 1 --2- 10.20.193.159:0/2023879291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc8401158b0 0x7fc8400f60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:38.952 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.948+0000 7fc83f7fe640 1 -- 10.20.193.159:0/2023879291 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc82c009570 con 0x7fc84010f6c0 2026-02-24T09:15:38.952 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.948+0000 7fc83f7fe640 1 --2- 10.20.193.159:0/2023879291 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc84010f6c0 0x7fc8400f59d0 secure :-1 s=READY pgs=48 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc82c0098a0 tx=0x7fc82c0028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:38.952 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.948+0000 7fc83cff9640 1 -- 10.20.193.159:0/2023879291 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc82c03d070 con 0x7fc84010f6c0 2026-02-24T09:15:38.952 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.948+0000 7fc83cff9640 1 -- 10.20.193.159:0/2023879291 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc82c002a40 con 0x7fc84010f6c0 2026-02-24T09:15:38.952 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.948+0000 7fc83cff9640 1 -- 10.20.193.159:0/2023879291 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc82c041720 con 0x7fc84010f6c0 2026-02-24T09:15:38.952 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.948+0000 7fc845a8d640 1 -- 10.20.193.159:0/2023879291 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8400fb890 con 0x7fc84010f6c0 2026-02-24T09:15:38.952 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.948+0000 7fc845a8d640 1 -- 10.20.193.159:0/2023879291 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8400fbcb0 con 0x7fc84010f6c0 2026-02-24T09:15:38.953 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.949+0000 7fc845a8d640 1 -- 10.20.193.159:0/2023879291 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8401109a0 con 0x7fc84010f6c0 2026-02-24T09:15:38.953 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.951+0000 7fc83cff9640 1 -- 10.20.193.159:0/2023879291 <== mon.1 v2:10.20.193.159:3300/0 4 ==== mgrmap(e 19) ==== 157139+0+0 (secure 0 0 0) 0x7fc82c0386a0 con 0x7fc84010f6c0 2026-02-24T09:15:38.953 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.952+0000 7fc83cff9640 1 --2- 10.20.193.159:0/2023879291 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc8140b57a0 0x7fc8140d5c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:38.953 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.952+0000 7fc83cff9640 1 -- 10.20.193.159:0/2023879291 <== mon.1 v2:10.20.193.159:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5308+0+0 (secure 0 0 0) 0x7fc82c10a520 con 0x7fc84010f6c0 2026-02-24T09:15:38.953 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.952+0000 7fc83effd640 1 --2- 10.20.193.159:0/2023879291 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc8140b57a0 0x7fc8140d5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:38.954 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.953+0000 7fc83effd640 1 --2- 10.20.193.159:0/2023879291 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc8140b57a0 0x7fc8140d5c50 secure :-1 s=READY pgs=85 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8400fc370 tx=0x7fc830005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:38.954 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:38.953+0000 7fc83cff9640 1 -- 10.20.193.159:0/2023879291 <== mon.1 v2:10.20.193.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fc82c0cda40 con 0x7fc84010f6c0 2026-02-24T09:15:39.073 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:39.072+0000 7fc845a8d640 1 -- 10.20.193.159:0/2023879291 --> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial159:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fc8400f6b90 con 0x7fc8140b57a0 2026-02-24T09:15:39.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:39 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:39.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:39 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:39.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:39 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:15:39.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:39 trial159 ceph-mon[44242]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-24T09:15:39.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:39 trial159 ceph-mon[44242]: osdmap e56: 8 total, 7 up, 8 in 2026-02-24T09:15:39.281 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:39 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:15:39.281 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:39 trial159 ceph-mon[44242]: from='osd.7 [v2:10.20.193.74:6816/2328869739,v1:10.20.193.74:6817/2328869739]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial074", "root=default"]} : dispatch 2026-02-24T09:15:39.281 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:39 trial159 ceph-mon[44242]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial074", "root=default"]} : dispatch 2026-02-24T09:15:39.281 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:39 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:39.281 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:39 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:39.281 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:39 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:39.281 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:39 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:39.293 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:39 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:39.293 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:39 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:39.293 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:39 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:15:39.293 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:39 trial028 ceph-mon[40371]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-24T09:15:39.293 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:39 trial028 ceph-mon[40371]: osdmap e56: 8 total, 7 up, 8 in 2026-02-24T09:15:39.293 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:39 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:15:39.294 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:39 trial028 ceph-mon[40371]: from='osd.7 [v2:10.20.193.74:6816/2328869739,v1:10.20.193.74:6817/2328869739]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial074", "root=default"]} : dispatch 2026-02-24T09:15:39.294 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:39 trial028 ceph-mon[40371]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial074", "root=default"]} : dispatch 2026-02-24T09:15:39.294 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:39 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:39.294 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:39 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:39.294 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:39 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:39.294 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:39 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:39.294 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:39 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:39.295 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:39 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:39.295 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:39 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:15:39.295 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:39 trial074 ceph-mon[44412]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-24T09:15:39.295 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:39 trial074 ceph-mon[44412]: osdmap e56: 8 total, 7 up, 8 in 2026-02-24T09:15:39.295 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:39 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:15:39.295 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:39 trial074 ceph-mon[44412]: from='osd.7 [v2:10.20.193.74:6816/2328869739,v1:10.20.193.74:6817/2328869739]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial074", "root=default"]} : dispatch 2026-02-24T09:15:39.295 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:39 trial074 ceph-mon[44412]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial074", "root=default"]} : dispatch 2026-02-24T09:15:39.295 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:39 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:39.295 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:39 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:39.295 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:39 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:39.295 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:39 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:39.624 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:15:39 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7[76701]: 2026-02-24T09:15:39.344+0000 7f2da9df6640 -1 osd.7 0 waiting for initial osdmap 2026-02-24T09:15:39.624 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:15:39 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7[76701]: 2026-02-24T09:15:39.353+0000 7f2da5cbd640 -1 osd.7 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T09:15:40.333 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:40 trial028 ceph-mon[40371]: from='client.24529 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial159:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:15:40.333 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:40 trial028 ceph-mon[40371]: osd.default does not exist. Creating it now. 2026-02-24T09:15:40.333 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:40 trial028 ceph-mon[40371]: Creating OSDs with service ID: default on trial159:['vg_nvme/lv_2'] 2026-02-24T09:15:40.333 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:40.334 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:40 trial028 ceph-mon[40371]: Marking host: trial159 for OSDSpec preview refresh. 2026-02-24T09:15:40.334 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:40 trial028 ceph-mon[40371]: Saving service osd.default spec with placement trial159 2026-02-24T09:15:40.334 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:40.334 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:15:40.334 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:15:40.334 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:40.334 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:40 trial028 ceph-mon[40371]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-24T09:15:40.334 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:40 trial028 ceph-mon[40371]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial074", "root=default"]}]': finished 2026-02-24T09:15:40.334 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:40 trial028 ceph-mon[40371]: osdmap e57: 8 total, 7 up, 8 in 2026-02-24T09:15:40.334 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:15:40.334 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:15:40.338 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:40 trial074 ceph-mon[44412]: from='client.24529 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial159:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:15:40.338 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:40 trial074 ceph-mon[44412]: osd.default does not exist. Creating it now. 2026-02-24T09:15:40.338 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:40 trial074 ceph-mon[44412]: Creating OSDs with service ID: default on trial159:['vg_nvme/lv_2'] 2026-02-24T09:15:40.338 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:40.339 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:40 trial074 ceph-mon[44412]: Marking host: trial159 for OSDSpec preview refresh. 2026-02-24T09:15:40.339 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:40 trial074 ceph-mon[44412]: Saving service osd.default spec with placement trial159 2026-02-24T09:15:40.339 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:40.339 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:15:40.339 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:15:40.339 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:40.339 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:40 trial074 ceph-mon[44412]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-24T09:15:40.339 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:40 trial074 ceph-mon[44412]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial074", "root=default"]}]': finished 2026-02-24T09:15:40.339 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:40 trial074 ceph-mon[44412]: osdmap e57: 8 total, 7 up, 8 in 2026-02-24T09:15:40.339 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:15:40.339 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:15:40.381 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:40 trial159 ceph-mon[44242]: from='client.24529 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial159:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:15:40.381 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:40 trial159 ceph-mon[44242]: osd.default does not exist. Creating it now. 2026-02-24T09:15:40.381 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:40 trial159 ceph-mon[44242]: Creating OSDs with service ID: default on trial159:['vg_nvme/lv_2'] 2026-02-24T09:15:40.381 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:40.381 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:40 trial159 ceph-mon[44242]: Marking host: trial159 for OSDSpec preview refresh. 2026-02-24T09:15:40.381 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:40 trial159 ceph-mon[44242]: Saving service osd.default spec with placement trial159 2026-02-24T09:15:40.382 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:40.382 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:15:40.382 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:15:40.382 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:40.382 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:40 trial159 ceph-mon[44242]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-24T09:15:40.382 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:40 trial159 ceph-mon[44242]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial074", "root=default"]}]': finished 2026-02-24T09:15:40.382 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:40 trial159 ceph-mon[44242]: osdmap e57: 8 total, 7 up, 8 in 2026-02-24T09:15:40.382 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:15:40.382 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:15:41.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:41 trial028 ceph-mon[40371]: purged_snaps scrub starts 2026-02-24T09:15:41.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:41 trial028 ceph-mon[40371]: purged_snaps scrub ok 2026-02-24T09:15:41.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:41 trial028 ceph-mon[40371]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "76599c26-6778-4fa2-b85d-feea8baac7c3"} : dispatch 2026-02-24T09:15:41.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:41 trial028 ceph-mon[40371]: from='client.? 10.20.193.159:0/175031310' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "76599c26-6778-4fa2-b85d-feea8baac7c3"} : dispatch 2026-02-24T09:15:41.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:41 trial028 ceph-mon[40371]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "76599c26-6778-4fa2-b85d-feea8baac7c3"}]': finished 2026-02-24T09:15:41.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:41 trial028 ceph-mon[40371]: osd.7 [v2:10.20.193.74:6816/2328869739,v1:10.20.193.74:6817/2328869739] boot 2026-02-24T09:15:41.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:41 trial028 ceph-mon[40371]: osdmap e58: 9 total, 8 up, 9 in 2026-02-24T09:15:41.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:41 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:15:41.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:41 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:15:41.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:41 trial028 ceph-mon[40371]: Detected new or changed devices on trial074 2026-02-24T09:15:41.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:41 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:41.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:41 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:41.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:41 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:41.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:41 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:41.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:41 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:41.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:41 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:41.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:41 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:41.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:41 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:41.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:41 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:41.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:41 trial028 ceph-mon[40371]: Adjusting osd_memory_target on trial074 to 28017M 2026-02-24T09:15:41.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:41 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:41.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:41 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:41.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:41 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:15:41.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:41 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:41.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:41 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:15:41.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:41 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:15:41.363 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:41 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:41.363 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:41 trial028 ceph-mon[40371]: osdmap e59: 9 total, 8 up, 9 in 2026-02-24T09:15:41.363 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:41 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:15:41.363 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:41 trial028 ceph-mon[40371]: from='client.? 10.20.193.159:0/4231165185' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:15:41.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:41 trial074 ceph-mon[44412]: purged_snaps scrub starts 2026-02-24T09:15:41.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:41 trial074 ceph-mon[44412]: purged_snaps scrub ok 2026-02-24T09:15:41.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:41 trial074 ceph-mon[44412]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "76599c26-6778-4fa2-b85d-feea8baac7c3"} : dispatch 2026-02-24T09:15:41.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:41 trial074 ceph-mon[44412]: from='client.? 10.20.193.159:0/175031310' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "76599c26-6778-4fa2-b85d-feea8baac7c3"} : dispatch 2026-02-24T09:15:41.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:41 trial074 ceph-mon[44412]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "76599c26-6778-4fa2-b85d-feea8baac7c3"}]': finished 2026-02-24T09:15:41.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:41 trial074 ceph-mon[44412]: osd.7 [v2:10.20.193.74:6816/2328869739,v1:10.20.193.74:6817/2328869739] boot 2026-02-24T09:15:41.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:41 trial074 ceph-mon[44412]: osdmap e58: 9 total, 8 up, 9 in 2026-02-24T09:15:41.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:41 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:15:41.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:41 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:15:41.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:41 trial074 ceph-mon[44412]: Detected new or changed devices on trial074 2026-02-24T09:15:41.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:41 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:41.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:41 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:41.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:41 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:41.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:41 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:41.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:41 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:41.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:41 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:41.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:41 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:41.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:41 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:41.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:41 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:41.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:41 trial074 ceph-mon[44412]: Adjusting osd_memory_target on trial074 to 28017M 2026-02-24T09:15:41.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:41 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:41.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:41 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:41.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:41 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:15:41.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:41 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:41.376 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:41 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:15:41.376 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:41 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:15:41.376 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:41 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:41.376 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:41 trial074 ceph-mon[44412]: osdmap e59: 9 total, 8 up, 9 in 2026-02-24T09:15:41.376 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:41 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:15:41.376 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:41 trial074 ceph-mon[44412]: from='client.? 10.20.193.159:0/4231165185' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:15:41.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:41 trial159 ceph-mon[44242]: purged_snaps scrub starts 2026-02-24T09:15:41.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:41 trial159 ceph-mon[44242]: purged_snaps scrub ok 2026-02-24T09:15:41.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:41 trial159 ceph-mon[44242]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "76599c26-6778-4fa2-b85d-feea8baac7c3"} : dispatch 2026-02-24T09:15:41.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:41 trial159 ceph-mon[44242]: from='client.? 10.20.193.159:0/175031310' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "76599c26-6778-4fa2-b85d-feea8baac7c3"} : dispatch 2026-02-24T09:15:41.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:41 trial159 ceph-mon[44242]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "76599c26-6778-4fa2-b85d-feea8baac7c3"}]': finished 2026-02-24T09:15:41.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:41 trial159 ceph-mon[44242]: osd.7 [v2:10.20.193.74:6816/2328869739,v1:10.20.193.74:6817/2328869739] boot 2026-02-24T09:15:41.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:41 trial159 ceph-mon[44242]: osdmap e58: 9 total, 8 up, 9 in 2026-02-24T09:15:41.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:41 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:15:41.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:41 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:15:41.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:41 trial159 ceph-mon[44242]: Detected new or changed devices on trial074 2026-02-24T09:15:41.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:41 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:41.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:41 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:41.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:41 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:41.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:41 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:41.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:41 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:41.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:41 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:41.532 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:41 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:41.532 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:41 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:41.532 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:41 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:41.532 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:41 trial159 ceph-mon[44242]: Adjusting osd_memory_target on trial074 to 28017M 2026-02-24T09:15:41.532 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:41 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:41.532 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:41 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:41.532 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:41 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:15:41.532 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:41 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:41.532 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:41 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:15:41.532 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:41 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:15:41.532 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:41 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:41.533 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:41 trial159 ceph-mon[44242]: osdmap e59: 9 total, 8 up, 9 in 2026-02-24T09:15:41.533 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:41 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:15:41.533 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:41 trial159 ceph-mon[44242]: from='client.? 10.20.193.159:0/4231165185' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:15:42.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:42 trial028 ceph-mon[40371]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-24T09:15:42.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:42 trial028 ceph-mon[40371]: osdmap e60: 9 total, 8 up, 9 in 2026-02-24T09:15:42.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:42 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:15:42.365 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:42 trial159 ceph-mon[44242]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-24T09:15:42.365 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:42 trial159 ceph-mon[44242]: osdmap e60: 9 total, 8 up, 9 in 2026-02-24T09:15:42.365 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:42 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:15:42.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:42 trial074 ceph-mon[44412]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-24T09:15:42.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:42 trial074 ceph-mon[44412]: osdmap e60: 9 total, 8 up, 9 in 2026-02-24T09:15:42.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:42 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:15:43.772 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:43 trial159 ceph-mon[44242]: osdmap e61: 9 total, 8 up, 9 in 2026-02-24T09:15:43.772 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:43 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:15:43.772 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:43 trial159 ceph-mon[44242]: pgmap v111: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-24T09:15:43.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:43 trial028 ceph-mon[40371]: osdmap e61: 9 total, 8 up, 9 in 2026-02-24T09:15:43.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:43 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:15:43.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:43 trial028 ceph-mon[40371]: pgmap v111: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-24T09:15:43.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:43 trial074 ceph-mon[44412]: osdmap e61: 9 total, 8 up, 9 in 2026-02-24T09:15:43.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:43 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:15:43.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:43 trial074 ceph-mon[44412]: pgmap v111: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-24T09:15:44.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:44 trial028 ceph-mon[40371]: osdmap e62: 9 total, 8 up, 9 in 2026-02-24T09:15:44.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:44 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:15:44.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:44 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-24T09:15:44.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:44 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:44.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:44 trial028 ceph-mon[40371]: Deploying daemon osd.8 on trial159 2026-02-24T09:15:44.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:44 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-24T09:15:44.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:44 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:44.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:44 trial028 ceph-mon[40371]: Deploying daemon osd.8 on trial159 2026-02-24T09:15:44.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:44 trial074 ceph-mon[44412]: osdmap e62: 9 total, 8 up, 9 in 2026-02-24T09:15:44.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:44 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:15:44.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:44 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-24T09:15:44.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:44 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:44.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:44 trial074 ceph-mon[44412]: Deploying daemon osd.8 on trial159 2026-02-24T09:15:44.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:44 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-24T09:15:44.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:44 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:44.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:44 trial074 ceph-mon[44412]: Deploying daemon osd.8 on trial159 2026-02-24T09:15:44.952 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:44 trial159 ceph-mon[44242]: osdmap e62: 9 total, 8 up, 9 in 2026-02-24T09:15:44.952 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:44 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:15:44.952 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:44 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-24T09:15:44.952 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:44 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:44.952 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:44 trial159 ceph-mon[44242]: Deploying daemon osd.8 on trial159 2026-02-24T09:15:44.952 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:44 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-24T09:15:44.952 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:44 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:44.952 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:44 trial159 ceph-mon[44242]: Deploying daemon osd.8 on trial159 2026-02-24T09:15:45.649 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:45 trial159 ceph-mon[44242]: pgmap v113: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-24T09:15:45.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:45 trial028 ceph-mon[40371]: pgmap v113: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-24T09:15:45.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:45 trial074 ceph-mon[44412]: pgmap v113: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-24T09:15:47.861 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:47.861 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:47.861 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:47 trial159 ceph-mon[44242]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-24T09:15:48.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:48.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:48.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:47 trial028 ceph-mon[40371]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-24T09:15:48.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:48.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:48.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:47 trial074 ceph-mon[44412]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-24T09:15:48.914 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:48 trial159 ceph-mon[44242]: from='osd.8 [v2:10.20.193.159:6816/1114144561,v1:10.20.193.159:6817/1114144561]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-24T09:15:48.914 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:48 trial159 ceph-mon[44242]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-24T09:15:48.951 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:48.950+0000 7fc84528c640 1 -- 10.20.193.159:0/2023879291 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=57}) -- 0x7fc820003560 con 0x7fc84010f6c0 2026-02-24T09:15:48.951 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:48.950+0000 7fc83cff9640 1 -- 10.20.193.159:0/2023879291 <== mon.1 v2:10.20.193.159:3300/0 7 ==== osd_map(57..63 src has 1..63) ==== 4525+0+0 (secure 0 0 0) 0x7fc82c0d1df0 con 0x7fc84010f6c0 2026-02-24T09:15:49.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:48 trial028 ceph-mon[40371]: from='osd.8 [v2:10.20.193.159:6816/1114144561,v1:10.20.193.159:6817/1114144561]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-24T09:15:49.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:48 trial028 ceph-mon[40371]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-24T09:15:49.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:48 trial074 ceph-mon[44412]: from='osd.8 [v2:10.20.193.159:6816/1114144561,v1:10.20.193.159:6817/1114144561]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-24T09:15:49.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:48 trial074 ceph-mon[44412]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-24T09:15:50.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:49 trial159 ceph-mon[44242]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-24T09:15:50.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:49 trial159 ceph-mon[44242]: osdmap e63: 9 total, 8 up, 9 in 2026-02-24T09:15:50.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:49 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:15:50.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:49 trial159 ceph-mon[44242]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-24T09:15:50.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:49 trial028 ceph-mon[40371]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-24T09:15:50.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:49 trial028 ceph-mon[40371]: osdmap e63: 9 total, 8 up, 9 in 2026-02-24T09:15:50.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:49 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:15:50.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:49 trial028 ceph-mon[40371]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-24T09:15:50.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:49 trial074 ceph-mon[44412]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-24T09:15:50.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:49 trial074 ceph-mon[44412]: osdmap e63: 9 total, 8 up, 9 in 2026-02-24T09:15:50.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:49 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:15:50.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:49 trial074 ceph-mon[44412]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-24T09:15:50.666 INFO:teuthology.orchestra.run.trial159.stdout:Created osd(s) 8 on host 'trial159' 2026-02-24T09:15:50.667 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:50.665+0000 7fc83cff9640 1 -- 10.20.193.159:0/2023879291 <== mgr.14223 v2:10.20.193.28:6800/906910473 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fc8400f6b90 con 0x7fc8140b57a0 2026-02-24T09:15:50.669 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:50.668+0000 7fc845a8d640 1 -- 10.20.193.159:0/2023879291 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc8140b57a0 msgr2=0x7fc8140d5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:50.669 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:50.668+0000 7fc845a8d640 1 --2- 10.20.193.159:0/2023879291 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc8140b57a0 0x7fc8140d5c50 secure :-1 s=READY pgs=85 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8400fc370 tx=0x7fc830005f90 comp rx=0 tx=0).stop 2026-02-24T09:15:50.669 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:50.668+0000 7fc845a8d640 1 -- 10.20.193.159:0/2023879291 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc84010f6c0 msgr2=0x7fc8400f59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:50.669 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:50.668+0000 7fc845a8d640 1 --2- 10.20.193.159:0/2023879291 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc84010f6c0 0x7fc8400f59d0 secure :-1 s=READY pgs=48 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc82c0098a0 tx=0x7fc82c0028d0 comp rx=0 tx=0).stop 2026-02-24T09:15:50.670 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:50.668+0000 7fc845a8d640 1 -- 10.20.193.159:0/2023879291 shutdown_connections 2026-02-24T09:15:50.670 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:50.668+0000 7fc845a8d640 1 --2- 10.20.193.159:0/2023879291 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc8140b57a0 0x7fc8140d5c50 unknown :-1 s=CLOSED pgs=85 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:50.670 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:50.668+0000 7fc845a8d640 1 --2- 10.20.193.159:0/2023879291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc8401158b0 0x7fc8400f60d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:50.670 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:50.668+0000 7fc845a8d640 1 --2- 10.20.193.159:0/2023879291 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc8401100b0 0x7fc840176180 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:50.670 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:50.668+0000 7fc845a8d640 1 --2- 10.20.193.159:0/2023879291 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc84010f6c0 0x7fc8400f59d0 unknown :-1 s=CLOSED pgs=48 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:50.670 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:50.668+0000 7fc845a8d640 1 -- 10.20.193.159:0/2023879291 >> 10.20.193.159:0/2023879291 conn(0x7fc8400ecfd0 msgr2=0x7fc840111b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:50.670 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:50.668+0000 7fc845a8d640 1 -- 10.20.193.159:0/2023879291 shutdown_connections 2026-02-24T09:15:50.670 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:15:50.668+0000 7fc845a8d640 1 -- 10.20.193.159:0/2023879291 wait complete. 2026-02-24T09:15:50.780 DEBUG:teuthology.orchestra.run.trial159:osd.8> sudo journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.8.service 2026-02-24T09:15:50.784 INFO:tasks.cephadm:Deploying osd.9 on trial028 with /dev/vg_nvme/lv_1... 2026-02-24T09:15:50.784 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-24T09:15:50.974 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:15:51.107 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:50 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:51.107 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:50 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:51.107 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:50 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:51.107 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:50 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:51.107 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:50 trial028 ceph-mon[40371]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-24T09:15:51.107 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:50 trial028 ceph-mon[40371]: from='osd.8 [v2:10.20.193.159:6816/3877834753,v1:10.20.193.159:6817/3877834753]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-24T09:15:51.271 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:15:50 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:15:50.898+0000 7f044c7f2780 -1 osd.8 0 log_to_monitors true 2026-02-24T09:15:51.272 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:50 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:51.272 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:50 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:51.272 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:50 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:51.272 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:50 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:51.272 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:50 trial159 ceph-mon[44242]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-24T09:15:51.272 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:50 trial159 ceph-mon[44242]: from='osd.8 [v2:10.20.193.159:6816/3877834753,v1:10.20.193.159:6817/3877834753]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-24T09:15:51.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:50 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:51.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:50 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:51.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:50 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:51.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:50 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:51.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:50 trial074 ceph-mon[44412]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-24T09:15:51.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:50 trial074 ceph-mon[44412]: from='osd.8 [v2:10.20.193.159:6816/3877834753,v1:10.20.193.159:6817/3877834753]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-24T09:15:51.935 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:15:51.959 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph orch daemon add osd trial028:vg_nvme/lv_1 --skip-validation 2026-02-24T09:15:52.147 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:15:52.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.336+0000 7f8e489f8640 1 -- 10.20.193.28:0/3498298429 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e4410b2d0 msgr2=0x7f8e4410b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:52.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.336+0000 7f8e489f8640 1 --2- 10.20.193.28:0/3498298429 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e4410b2d0 0x7f8e4410b6a0 secure :-1 s=READY pgs=189 gs=1 cs=0 l=1 c_cookie=13142993151733777510 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e30009950 tx=0x7f8e3002f190 comp rx=0 tx=0).stop 2026-02-24T09:15:52.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.336+0000 7f8e489f8640 1 -- 10.20.193.28:0/3498298429 shutdown_connections 2026-02-24T09:15:52.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.336+0000 7f8e489f8640 1 --2- 10.20.193.28:0/3498298429 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8e441112e0 0x7f8e44111cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:52.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.336+0000 7f8e489f8640 1 --2- 10.20.193.28:0/3498298429 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8e4410bcc0 0x7f8e44110b50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:52.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.336+0000 7f8e489f8640 1 --2- 10.20.193.28:0/3498298429 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e4410b2d0 0x7f8e4410b6a0 unknown :-1 s=CLOSED pgs=189 gs=1 cs=0 l=1 c_cookie=13142993151733777510 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:52.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.336+0000 7f8e489f8640 1 -- 10.20.193.28:0/3498298429 >> 10.20.193.28:0/3498298429 conn(0x7f8e440e8e40 msgr2=0x7f8e44109250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:52.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.336+0000 7f8e489f8640 1 -- 10.20.193.28:0/3498298429 shutdown_connections 2026-02-24T09:15:52.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.336+0000 7f8e489f8640 1 -- 10.20.193.28:0/3498298429 wait complete. 2026-02-24T09:15:52.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.337+0000 7f8e489f8640 1 Processor -- start 2026-02-24T09:15:52.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.337+0000 7f8e489f8640 1 -- start start 2026-02-24T09:15:52.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.337+0000 7f8e489f8640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8e4410b2d0 0x7f8e441236a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:52.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.337+0000 7f8e489f8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e4410bcc0 0x7f8e44123be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:52.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.337+0000 7f8e489f8640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8e441112e0 0x7f8e44128f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:52.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.337+0000 7f8e489f8640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8e44129580 con 0x7f8e4410bcc0 2026-02-24T09:15:52.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.337+0000 7f8e489f8640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f8e441296f0 con 0x7f8e441112e0 2026-02-24T09:15:52.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.337+0000 7f8e489f8640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8e441298b0 con 0x7f8e4410b2d0 2026-02-24T09:15:52.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.338+0000 7f8e42ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e4410bcc0 0x7f8e44123be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:52.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.338+0000 7f8e42ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e4410bcc0 0x7f8e44123be0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52464/0 (socket says 10.20.193.28:52464) 2026-02-24T09:15:52.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.338+0000 7f8e42ffd640 1 -- 10.20.193.28:0/2673281585 learned_addr learned my addr 10.20.193.28:0/2673281585 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:15:52.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.338+0000 7f8e437fe640 1 --2- 10.20.193.28:0/2673281585 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8e4410b2d0 0x7f8e441236a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:52.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.338+0000 7f8e43fff640 1 --2- 10.20.193.28:0/2673281585 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8e441112e0 0x7f8e44128f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:52.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.338+0000 7f8e42ffd640 1 -- 10.20.193.28:0/2673281585 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8e4410b2d0 msgr2=0x7f8e441236a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:52.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.338+0000 7f8e42ffd640 1 --2- 10.20.193.28:0/2673281585 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8e4410b2d0 0x7f8e441236a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:52.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.338+0000 7f8e42ffd640 1 -- 10.20.193.28:0/2673281585 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8e441112e0 msgr2=0x7f8e44128f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:52.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.338+0000 7f8e42ffd640 1 --2- 10.20.193.28:0/2673281585 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8e441112e0 0x7f8e44128f60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:52.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.338+0000 7f8e42ffd640 1 -- 10.20.193.28:0/2673281585 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e30009570 con 0x7f8e4410bcc0 2026-02-24T09:15:52.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.338+0000 7f8e42ffd640 1 --2- 10.20.193.28:0/2673281585 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e4410bcc0 0x7f8e44123be0 secure :-1 s=READY pgs=190 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e3400d950 tx=0x7f8e3400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:52.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.338+0000 7f8e40ff9640 1 -- 10.20.193.28:0/2673281585 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e34004500 con 0x7f8e4410bcc0 2026-02-24T09:15:52.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.338+0000 7f8e40ff9640 1 -- 10.20.193.28:0/2673281585 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8e34004d10 con 0x7f8e4410bcc0 2026-02-24T09:15:52.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.338+0000 7f8e40ff9640 1 -- 10.20.193.28:0/2673281585 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e34005280 con 0x7f8e4410bcc0 2026-02-24T09:15:52.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.338+0000 7f8e489f8640 1 -- 10.20.193.28:0/2673281585 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e44129b90 con 0x7f8e4410bcc0 2026-02-24T09:15:52.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.338+0000 7f8e489f8640 1 -- 10.20.193.28:0/2673281585 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e4416a290 con 0x7f8e4410bcc0 2026-02-24T09:15:52.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.339+0000 7f8e1e7fc640 1 -- 10.20.193.28:0/2673281585 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e44129db0 con 0x7f8e4410bcc0 2026-02-24T09:15:52.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.341+0000 7f8e40ff9640 1 -- 10.20.193.28:0/2673281585 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 19) ==== 157139+0+0 (secure 0 0 0) 0x7f8e34005410 con 0x7f8e4410bcc0 2026-02-24T09:15:52.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.343+0000 7f8e40ff9640 1 --2- 10.20.193.28:0/2673281585 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8e180b57b0 0x7f8e180d5c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:52.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.343+0000 7f8e40ff9640 1 -- 10.20.193.28:0/2673281585 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5740+0+0 (secure 0 0 0) 0x7f8e340e5f50 con 0x7f8e4410bcc0 2026-02-24T09:15:52.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.343+0000 7f8e40ff9640 1 -- 10.20.193.28:0/2673281585 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f8e340e63d0 con 0x7f8e4410bcc0 2026-02-24T09:15:52.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.344+0000 7f8e437fe640 1 --2- 10.20.193.28:0/2673281585 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8e180b57b0 0x7f8e180d5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:52.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.346+0000 7f8e437fe640 1 --2- 10.20.193.28:0/2673281585 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8e180b57b0 0x7f8e180d5c60 secure :-1 s=READY pgs=90 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e30005b30 tx=0x7f8e3003a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:52.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:15:52.463+0000 7f8e1e7fc640 1 -- 10.20.193.28:0/2673281585 --> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f8e441247b0 con 0x7f8e180b57b0 2026-02-24T09:15:52.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:52 trial028 ceph-mon[40371]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-24T09:15:52.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:52 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:52.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:52 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:52.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:52 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:15:52.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:52 trial028 ceph-mon[40371]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-24T09:15:52.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:52 trial028 ceph-mon[40371]: osdmap e64: 9 total, 8 up, 9 in 2026-02-24T09:15:52.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:52 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:15:52.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:52 trial028 ceph-mon[40371]: from='osd.8 [v2:10.20.193.159:6816/3877834753,v1:10.20.193.159:6817/3877834753]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial159", "root=default"]} : dispatch 2026-02-24T09:15:52.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:52 trial028 ceph-mon[40371]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial159", "root=default"]} : dispatch 2026-02-24T09:15:52.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:52 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:52.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:52 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:52.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:52 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:52.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:52 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:52.674 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:52 trial159 ceph-mon[44242]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-24T09:15:52.674 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:52 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:52.674 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:52 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:52.674 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:52 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:15:52.674 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:52 trial159 ceph-mon[44242]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-24T09:15:52.674 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:52 trial159 ceph-mon[44242]: osdmap e64: 9 total, 8 up, 9 in 2026-02-24T09:15:52.675 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:52 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:15:52.675 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:52 trial159 ceph-mon[44242]: from='osd.8 [v2:10.20.193.159:6816/3877834753,v1:10.20.193.159:6817/3877834753]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial159", "root=default"]} : dispatch 2026-02-24T09:15:52.675 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:52 trial159 ceph-mon[44242]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial159", "root=default"]} : dispatch 2026-02-24T09:15:52.675 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:52 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:52.675 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:52 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:52.675 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:52 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:52.675 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:52 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:52.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:52 trial074 ceph-mon[44412]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-24T09:15:52.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:52 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:52.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:52 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:52.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:52 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:15:52.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:52 trial074 ceph-mon[44412]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-24T09:15:52.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:52 trial074 ceph-mon[44412]: osdmap e64: 9 total, 8 up, 9 in 2026-02-24T09:15:52.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:52 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:15:52.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:52 trial074 ceph-mon[44412]: from='osd.8 [v2:10.20.193.159:6816/3877834753,v1:10.20.193.159:6817/3877834753]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial159", "root=default"]} : dispatch 2026-02-24T09:15:52.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:52 trial074 ceph-mon[44412]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial159", "root=default"]} : dispatch 2026-02-24T09:15:52.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:52 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:52.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:52 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:52.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:52 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:52.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:52 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:53.029 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:15:52 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:15:52.673+0000 7f0448774640 -1 osd.8 0 waiting for initial osdmap 2026-02-24T09:15:53.029 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:15:52 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:15:52.682+0000 7f044463b640 -1 osd.8 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T09:15:53.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:53 trial159 ceph-mon[44242]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:15:53.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:53 trial159 ceph-mon[44242]: osd.default does not exist. Creating it now. 2026-02-24T09:15:53.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:53 trial159 ceph-mon[44242]: Creating OSDs with service ID: default on trial028:['vg_nvme/lv_1'] 2026-02-24T09:15:53.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:53 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:53.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:53 trial159 ceph-mon[44242]: Marking host: trial028 for OSDSpec preview refresh. 2026-02-24T09:15:53.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:53 trial159 ceph-mon[44242]: Saving service osd.default spec with placement trial028 2026-02-24T09:15:53.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:53 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:53.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:53 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:15:53.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:53 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:15:53.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:53 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:53.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:53 trial159 ceph-mon[44242]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial159", "root=default"]}]': finished 2026-02-24T09:15:53.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:53 trial159 ceph-mon[44242]: osdmap e65: 9 total, 8 up, 9 in 2026-02-24T09:15:53.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:53 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:15:53.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:53 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:15:53.802 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:53 trial028 ceph-mon[40371]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:15:53.802 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:53 trial028 ceph-mon[40371]: osd.default does not exist. Creating it now. 2026-02-24T09:15:53.802 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:53 trial028 ceph-mon[40371]: Creating OSDs with service ID: default on trial028:['vg_nvme/lv_1'] 2026-02-24T09:15:53.802 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:53 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:53.802 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:53 trial028 ceph-mon[40371]: Marking host: trial028 for OSDSpec preview refresh. 2026-02-24T09:15:53.802 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:53 trial028 ceph-mon[40371]: Saving service osd.default spec with placement trial028 2026-02-24T09:15:53.802 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:53 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:53.802 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:53 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:15:53.802 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:53 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:15:53.803 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:53 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:53.803 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:53 trial028 ceph-mon[40371]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial159", "root=default"]}]': finished 2026-02-24T09:15:53.803 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:53 trial028 ceph-mon[40371]: osdmap e65: 9 total, 8 up, 9 in 2026-02-24T09:15:53.803 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:53 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:15:53.803 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:53 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:15:53.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:53 trial074 ceph-mon[44412]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:15:53.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:53 trial074 ceph-mon[44412]: osd.default does not exist. Creating it now. 2026-02-24T09:15:53.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:53 trial074 ceph-mon[44412]: Creating OSDs with service ID: default on trial028:['vg_nvme/lv_1'] 2026-02-24T09:15:53.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:53 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:53.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:53 trial074 ceph-mon[44412]: Marking host: trial028 for OSDSpec preview refresh. 2026-02-24T09:15:53.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:53 trial074 ceph-mon[44412]: Saving service osd.default spec with placement trial028 2026-02-24T09:15:53.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:53 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:53.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:53 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:15:53.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:53 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:15:53.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:53 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:53.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:53 trial074 ceph-mon[44412]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial159", "root=default"]}]': finished 2026-02-24T09:15:53.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:53 trial074 ceph-mon[44412]: osdmap e65: 9 total, 8 up, 9 in 2026-02-24T09:15:53.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:53 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:15:53.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:53 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:15:54.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:54 trial159 ceph-mon[44242]: purged_snaps scrub starts 2026-02-24T09:15:54.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:54 trial159 ceph-mon[44242]: purged_snaps scrub ok 2026-02-24T09:15:54.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:54 trial159 ceph-mon[44242]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-24T09:15:54.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:54 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/1107991292' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "52b52b35-2d65-4e53-b7d8-fd7385d5ae88"} : dispatch 2026-02-24T09:15:54.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:54 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/1107991292' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "52b52b35-2d65-4e53-b7d8-fd7385d5ae88"}]': finished 2026-02-24T09:15:54.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:54 trial159 ceph-mon[44242]: osd.8 [v2:10.20.193.159:6816/3877834753,v1:10.20.193.159:6817/3877834753] boot 2026-02-24T09:15:54.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:54 trial159 ceph-mon[44242]: osdmap e66: 10 total, 9 up, 10 in 2026-02-24T09:15:54.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:54 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:15:54.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:54 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:15:54.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:54 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/748247493' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:15:54.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:54 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:54.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:54 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:54.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:54 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:54.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:54 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:54.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:54 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:54.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:54 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:54.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:54 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:54.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:54 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:54.532 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:54 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:54.532 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:54 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:54.532 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:54 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:54.532 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:54 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:15:54.532 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:54 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:54.532 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:54 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:15:54.532 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:54 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:15:54.532 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:54 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:54.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:54 trial074 ceph-mon[44412]: purged_snaps scrub starts 2026-02-24T09:15:54.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:54 trial074 ceph-mon[44412]: purged_snaps scrub ok 2026-02-24T09:15:54.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:54 trial074 ceph-mon[44412]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-24T09:15:54.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:54 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/1107991292' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "52b52b35-2d65-4e53-b7d8-fd7385d5ae88"} : dispatch 2026-02-24T09:15:54.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:54 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/1107991292' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "52b52b35-2d65-4e53-b7d8-fd7385d5ae88"}]': finished 2026-02-24T09:15:54.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:54 trial074 ceph-mon[44412]: osd.8 [v2:10.20.193.159:6816/3877834753,v1:10.20.193.159:6817/3877834753] boot 2026-02-24T09:15:54.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:54 trial074 ceph-mon[44412]: osdmap e66: 10 total, 9 up, 10 in 2026-02-24T09:15:54.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:54 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:15:54.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:54 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:15:54.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:54 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/748247493' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:15:54.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:54 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:54.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:54 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:54.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:54 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:54.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:54 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:54.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:54 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:54.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:54 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:54.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:54 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:54.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:54 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:54.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:54 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:54.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:54 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:54.626 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:54 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:54.626 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:54 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:15:54.626 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:54 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:54.626 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:54 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:15:54.626 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:54 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:15:54.626 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:54 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:54.737 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:54 trial028 ceph-mon[40371]: purged_snaps scrub starts 2026-02-24T09:15:54.737 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:54 trial028 ceph-mon[40371]: purged_snaps scrub ok 2026-02-24T09:15:54.737 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:54 trial028 ceph-mon[40371]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-24T09:15:54.738 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:54 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/1107991292' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "52b52b35-2d65-4e53-b7d8-fd7385d5ae88"} : dispatch 2026-02-24T09:15:54.738 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:54 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/1107991292' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "52b52b35-2d65-4e53-b7d8-fd7385d5ae88"}]': finished 2026-02-24T09:15:54.738 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:54 trial028 ceph-mon[40371]: osd.8 [v2:10.20.193.159:6816/3877834753,v1:10.20.193.159:6817/3877834753] boot 2026-02-24T09:15:54.738 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:54 trial028 ceph-mon[40371]: osdmap e66: 10 total, 9 up, 10 in 2026-02-24T09:15:54.738 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:54 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:15:54.738 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:54 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:15:54.738 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:54 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/748247493' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:15:54.738 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:54 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:54.738 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:54 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:54.738 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:54 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:54.738 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:54 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:54.738 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:54 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:54.739 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:54 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:54.739 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:54 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-24T09:15:54.739 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:54 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:54.739 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:54 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:54.739 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:54 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:54.739 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:54 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:54.739 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:54 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:15:54.739 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:54 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:15:54.739 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:54 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:15:54.739 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:54 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:15:54.739 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:54 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:55.755 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:55 trial028 ceph-mon[40371]: Detected new or changed devices on trial159 2026-02-24T09:15:55.756 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:55 trial028 ceph-mon[40371]: Adjusting osd_memory_target on trial159 to 28017M 2026-02-24T09:15:55.756 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:55 trial028 ceph-mon[40371]: osdmap e67: 10 total, 9 up, 10 in 2026-02-24T09:15:55.756 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:55 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:15:55.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:55 trial159 ceph-mon[44242]: Detected new or changed devices on trial159 2026-02-24T09:15:55.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:55 trial159 ceph-mon[44242]: Adjusting osd_memory_target on trial159 to 28017M 2026-02-24T09:15:55.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:55 trial159 ceph-mon[44242]: osdmap e67: 10 total, 9 up, 10 in 2026-02-24T09:15:55.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:55 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:15:55.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:55 trial074 ceph-mon[44412]: Detected new or changed devices on trial159 2026-02-24T09:15:55.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:55 trial074 ceph-mon[44412]: Adjusting osd_memory_target on trial159 to 28017M 2026-02-24T09:15:55.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:55 trial074 ceph-mon[44412]: osdmap e67: 10 total, 9 up, 10 in 2026-02-24T09:15:55.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:55 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:15:56.708 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:56 trial028 ceph-mon[40371]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-24T09:15:56.708 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:56 trial028 ceph-mon[40371]: osdmap e68: 10 total, 9 up, 10 in 2026-02-24T09:15:56.708 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:56 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:15:56.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:56 trial159 ceph-mon[44242]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-24T09:15:56.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:56 trial159 ceph-mon[44242]: osdmap e68: 10 total, 9 up, 10 in 2026-02-24T09:15:56.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:56 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:15:56.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:56 trial074 ceph-mon[44412]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-24T09:15:56.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:56 trial074 ceph-mon[44412]: osdmap e68: 10 total, 9 up, 10 in 2026-02-24T09:15:56.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:56 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:15:57.782 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:57 trial028 ceph-mon[40371]: osdmap e69: 10 total, 9 up, 10 in 2026-02-24T09:15:57.782 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:57 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:15:57.782 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:57 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-24T09:15:57.783 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:57 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:57.783 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:57 trial028 ceph-mon[40371]: Deploying daemon osd.9 on trial028 2026-02-24T09:15:57.783 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:57 trial028 ceph-mon[40371]: pgmap v126: 1 pgs: 1 remapped+peering; 577 KiB data, 245 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-24T09:15:57.783 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:57 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-24T09:15:57.783 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:57 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:58.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:57 trial159 ceph-mon[44242]: osdmap e69: 10 total, 9 up, 10 in 2026-02-24T09:15:58.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:57 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:15:58.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:57 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-24T09:15:58.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:57 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:58.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:57 trial159 ceph-mon[44242]: Deploying daemon osd.9 on trial028 2026-02-24T09:15:58.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:57 trial159 ceph-mon[44242]: pgmap v126: 1 pgs: 1 remapped+peering; 577 KiB data, 245 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-24T09:15:58.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:57 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-24T09:15:58.031 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:57 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:58.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:57 trial074 ceph-mon[44412]: osdmap e69: 10 total, 9 up, 10 in 2026-02-24T09:15:58.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:57 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:15:58.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:57 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-24T09:15:58.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:57 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:58.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:57 trial074 ceph-mon[44412]: Deploying daemon osd.9 on trial028 2026-02-24T09:15:58.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:57 trial074 ceph-mon[44412]: pgmap v126: 1 pgs: 1 remapped+peering; 577 KiB data, 245 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-24T09:15:58.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:57 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-24T09:15:58.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:57 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:58.797 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:58 trial028 ceph-mon[40371]: Deploying daemon osd.9 on trial028 2026-02-24T09:15:58.797 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:58 trial028 ceph-mon[40371]: osdmap e70: 10 total, 9 up, 10 in 2026-02-24T09:15:58.797 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:58 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:15:59.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:58 trial159 ceph-mon[44242]: Deploying daemon osd.9 on trial028 2026-02-24T09:15:59.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:58 trial159 ceph-mon[44242]: osdmap e70: 10 total, 9 up, 10 in 2026-02-24T09:15:59.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:58 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:15:59.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:58 trial074 ceph-mon[44412]: Deploying daemon osd.9 on trial028 2026-02-24T09:15:59.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:58 trial074 ceph-mon[44412]: osdmap e70: 10 total, 9 up, 10 in 2026-02-24T09:15:59.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:58 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:15:59.898 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:15:59 trial028 ceph-mon[40371]: pgmap v128: 1 pgs: 1 remapped+peering; 577 KiB data, 245 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-24T09:16:00.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:15:59 trial159 ceph-mon[44242]: pgmap v128: 1 pgs: 1 remapped+peering; 577 KiB data, 245 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-24T09:16:00.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:15:59 trial074 ceph-mon[44412]: pgmap v128: 1 pgs: 1 remapped+peering; 577 KiB data, 245 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-24T09:16:01.414 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:01 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:01.414 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:01 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:01.529 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:01 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:01.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:01 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:01.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:01 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:01.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:01 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:02.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:02.340+0000 7f8e49480640 1 -- 10.20.193.28:0/2673281585 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=65}) -- 0x7f8e24003560 con 0x7f8e4410bcc0 2026-02-24T09:16:02.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:02.340+0000 7f8e40ff9640 1 -- 10.20.193.28:0/2673281585 <== mon.0 v2:10.20.193.28:3300/0 7 ==== osd_map(65..71 src has 1..71) ==== 4599+0+0 (secure 0 0 0) 0x7f8e340ad670 con 0x7f8e4410bcc0 2026-02-24T09:16:02.468 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:02 trial028 ceph-mon[40371]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 6.2 TiB / 6.2 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-24T09:16:02.468 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:02 trial028 ceph-mon[40371]: from='osd.9 [v2:10.20.193.28:6826/744408349,v1:10.20.193.28:6827/744408349]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-24T09:16:02.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:02 trial159 ceph-mon[44242]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 6.2 TiB / 6.2 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-24T09:16:02.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:02 trial159 ceph-mon[44242]: from='osd.9 [v2:10.20.193.28:6826/744408349,v1:10.20.193.28:6827/744408349]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-24T09:16:02.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:02 trial074 ceph-mon[44412]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 6.2 TiB / 6.2 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-24T09:16:02.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:02 trial074 ceph-mon[44412]: from='osd.9 [v2:10.20.193.28:6826/744408349,v1:10.20.193.28:6827/744408349]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-24T09:16:03.520 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:03 trial028 ceph-mon[40371]: from='osd.9 [v2:10.20.193.28:6826/744408349,v1:10.20.193.28:6827/744408349]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-24T09:16:03.520 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:03 trial028 ceph-mon[40371]: osdmap e71: 10 total, 9 up, 10 in 2026-02-24T09:16:03.520 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:03 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:16:03.524 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:03 trial074 ceph-mon[44412]: from='osd.9 [v2:10.20.193.28:6826/744408349,v1:10.20.193.28:6827/744408349]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-24T09:16:03.524 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:03 trial074 ceph-mon[44412]: osdmap e71: 10 total, 9 up, 10 in 2026-02-24T09:16:03.525 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:03 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:16:03.529 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:03 trial159 ceph-mon[44242]: from='osd.9 [v2:10.20.193.28:6826/744408349,v1:10.20.193.28:6827/744408349]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-24T09:16:03.529 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:03 trial159 ceph-mon[44242]: osdmap e71: 10 total, 9 up, 10 in 2026-02-24T09:16:03.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:03 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:16:04.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:04.083+0000 7f8e40ff9640 1 -- 10.20.193.28:0/2673281585 <== mgr.14223 v2:10.20.193.28:6800/906910473 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f8e441247b0 con 0x7f8e180b57b0 2026-02-24T09:16:04.086 INFO:teuthology.orchestra.run.trial028.stdout:Created osd(s) 9 on host 'trial028' 2026-02-24T09:16:04.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:04.086+0000 7f8e1e7fc640 1 -- 10.20.193.28:0/2673281585 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8e180b57b0 msgr2=0x7f8e180d5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:04.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:04.086+0000 7f8e1e7fc640 1 --2- 10.20.193.28:0/2673281585 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8e180b57b0 0x7f8e180d5c60 secure :-1 s=READY pgs=90 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e30005b30 tx=0x7f8e3003a040 comp rx=0 tx=0).stop 2026-02-24T09:16:04.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:04.086+0000 7f8e1e7fc640 1 -- 10.20.193.28:0/2673281585 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e4410bcc0 msgr2=0x7f8e44123be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:04.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:04.086+0000 7f8e1e7fc640 1 --2- 10.20.193.28:0/2673281585 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e4410bcc0 0x7f8e44123be0 secure :-1 s=READY pgs=190 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e3400d950 tx=0x7f8e3400de20 comp rx=0 tx=0).stop 2026-02-24T09:16:04.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:04.086+0000 7f8e1e7fc640 1 -- 10.20.193.28:0/2673281585 shutdown_connections 2026-02-24T09:16:04.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:04.086+0000 7f8e1e7fc640 1 --2- 10.20.193.28:0/2673281585 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8e180b57b0 0x7f8e180d5c60 unknown :-1 s=CLOSED pgs=90 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:04.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:04.086+0000 7f8e1e7fc640 1 --2- 10.20.193.28:0/2673281585 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8e441112e0 0x7f8e44128f60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:04.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:04.086+0000 7f8e1e7fc640 1 --2- 10.20.193.28:0/2673281585 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e4410bcc0 0x7f8e44123be0 unknown :-1 s=CLOSED pgs=190 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:04.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:04.086+0000 7f8e1e7fc640 1 --2- 10.20.193.28:0/2673281585 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8e4410b2d0 0x7f8e441236a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:04.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:04.086+0000 7f8e1e7fc640 1 -- 10.20.193.28:0/2673281585 >> 10.20.193.28:0/2673281585 conn(0x7f8e440e8e40 msgr2=0x7f8e44109220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:04.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:04.086+0000 7f8e1e7fc640 1 -- 10.20.193.28:0/2673281585 shutdown_connections 2026-02-24T09:16:04.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:04.086+0000 7f8e1e7fc640 1 -- 10.20.193.28:0/2673281585 wait complete. 2026-02-24T09:16:04.225 DEBUG:teuthology.orchestra.run.trial028:osd.9> sudo journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.9.service 2026-02-24T09:16:04.229 INFO:tasks.cephadm:Deploying osd.10 on trial074 with /dev/vg_nvme/lv_1... 2026-02-24T09:16:04.229 DEBUG:teuthology.orchestra.run.trial074:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-24T09:16:04.416 INFO:teuthology.orchestra.run.trial074.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.b/config 2026-02-24T09:16:04.543 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:04 trial074 ceph-mon[44412]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 6.2 TiB / 6.2 TiB avail; 87 KiB/s, 0 objects/s recovering 2026-02-24T09:16:04.543 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:04 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:04.543 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:04 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:04.543 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:04 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:04.543 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:04 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:04.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:04 trial028 ceph-mon[40371]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 6.2 TiB / 6.2 TiB avail; 87 KiB/s, 0 objects/s recovering 2026-02-24T09:16:04.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:04 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:04.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:04 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:04.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:04 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:04.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:04 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:04.611 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:16:04 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:16:04.415+0000 7f20bba08780 -1 osd.9 0 log_to_monitors true 2026-02-24T09:16:04.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:04 trial159 ceph-mon[44242]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 6.2 TiB / 6.2 TiB avail; 87 KiB/s, 0 objects/s recovering 2026-02-24T09:16:04.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:04 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:04.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:04 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:04.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:04 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:04.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:04 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:05.342 INFO:teuthology.orchestra.run.trial074.stdout: 2026-02-24T09:16:05.365 DEBUG:teuthology.orchestra.run.trial074:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph orch daemon add osd trial074:vg_nvme/lv_1 --skip-validation 2026-02-24T09:16:05.551 INFO:teuthology.orchestra.run.trial074.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.b/config 2026-02-24T09:16:05.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:05 trial028 ceph-mon[40371]: from='osd.9 [v2:10.20.193.28:6826/4207785690,v1:10.20.193.28:6827/4207785690]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-24T09:16:05.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:05 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:05.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:05 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:05.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:05 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:16:05.681 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:05 trial159 ceph-mon[44242]: from='osd.9 [v2:10.20.193.28:6826/4207785690,v1:10.20.193.28:6827/4207785690]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-24T09:16:05.681 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:05 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:05.681 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:05 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:05.681 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:05 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:16:05.682 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:05 trial074 ceph-mon[44412]: from='osd.9 [v2:10.20.193.28:6826/4207785690,v1:10.20.193.28:6827/4207785690]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-24T09:16:05.682 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:05 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:05.682 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:05 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:05.682 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:05 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:16:05.733 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.729+0000 7f3a213e1640 1 -- 10.20.193.74:0/3004752586 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3a1c061570 msgr2=0x7f3a1c0619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:05.733 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.729+0000 7f3a213e1640 1 --2- 10.20.193.74:0/3004752586 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3a1c061570 0x7f3a1c0619a0 secure :-1 s=READY pgs=65 gs=1 cs=0 l=1 c_cookie=10432157409743664537 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a0c009950 tx=0x7f3a0c02f190 comp rx=0 tx=0).stop 2026-02-24T09:16:05.734 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.729+0000 7f3a213e1640 1 -- 10.20.193.74:0/3004752586 shutdown_connections 2026-02-24T09:16:05.734 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.729+0000 7f3a213e1640 1 --2- 10.20.193.74:0/3004752586 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a1c159ec0 0x7f3a1c17a2a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:05.734 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.729+0000 7f3a213e1640 1 --2- 10.20.193.74:0/3004752586 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3a1c061570 0x7f3a1c0619a0 unknown :-1 s=CLOSED pgs=65 gs=1 cs=0 l=1 c_cookie=10432157409743664537 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:05.734 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.729+0000 7f3a213e1640 1 --2- 10.20.193.74:0/3004752586 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3a1c062b60 0x7f3a1c061030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:05.734 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.729+0000 7f3a213e1640 1 -- 10.20.193.74:0/3004752586 >> 10.20.193.74:0/3004752586 conn(0x7f3a1c0eac60 msgr2=0x7f3a1c10b070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:05.734 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.729+0000 7f3a213e1640 1 -- 10.20.193.74:0/3004752586 shutdown_connections 2026-02-24T09:16:05.734 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.729+0000 7f3a213e1640 1 -- 10.20.193.74:0/3004752586 wait complete. 2026-02-24T09:16:05.734 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.730+0000 7f3a213e1640 1 Processor -- start 2026-02-24T09:16:05.734 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.730+0000 7f3a213e1640 1 -- start start 2026-02-24T09:16:05.734 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.730+0000 7f3a213e1640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3a1c061570 0x7f3a1c0f3070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:05.735 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.730+0000 7f3a213e1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a1c062b60 0x7f3a1c0f35b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:05.735 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.730+0000 7f3a213e1640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3a1c159ec0 0x7f3a1c0f8980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:05.735 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.730+0000 7f3a213e1640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1c0f8fa0 con 0x7f3a1c062b60 2026-02-24T09:16:05.735 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.730+0000 7f3a213e1640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1c0f9110 con 0x7f3a1c061570 2026-02-24T09:16:05.735 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.730+0000 7f3a213e1640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1c0f92d0 con 0x7f3a1c159ec0 2026-02-24T09:16:05.735 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.730+0000 7f3a1bfff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3a1c061570 0x7f3a1c0f3070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:05.735 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.730+0000 7f3a1bfff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3a1c061570 0x7f3a1c0f3070 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.74:54832/0 (socket says 10.20.193.74:54832) 2026-02-24T09:16:05.735 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.730+0000 7f3a1bfff640 1 -- 10.20.193.74:0/3278798347 learned_addr learned my addr 10.20.193.74:0/3278798347 (peer_addr_for_me v2:10.20.193.74:0/0) 2026-02-24T09:16:05.735 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.730+0000 7f3a1b7fe640 1 --2- 10.20.193.74:0/3278798347 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a1c062b60 0x7f3a1c0f35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:05.735 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.730+0000 7f3a1bfff640 1 -- 10.20.193.74:0/3278798347 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3a1c159ec0 msgr2=0x7f3a1c0f8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:05.736 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.730+0000 7f3a1bfff640 1 --2- 10.20.193.74:0/3278798347 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3a1c159ec0 0x7f3a1c0f8980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:05.736 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.730+0000 7f3a1bfff640 1 -- 10.20.193.74:0/3278798347 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a1c062b60 msgr2=0x7f3a1c0f35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:05.736 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.730+0000 7f3a1bfff640 1 --2- 10.20.193.74:0/3278798347 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a1c062b60 0x7f3a1c0f35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:05.736 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.730+0000 7f3a1bfff640 1 -- 10.20.193.74:0/3278798347 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a0c009570 con 0x7f3a1c061570 2026-02-24T09:16:05.736 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.731+0000 7f3a1bfff640 1 --2- 10.20.193.74:0/3278798347 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3a1c061570 0x7f3a1c0f3070 secure :-1 s=READY pgs=66 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a08009480 tx=0x7f3a0800ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:05.736 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.731+0000 7f3a197fa640 1 -- 10.20.193.74:0/3278798347 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a0800cd40 con 0x7f3a1c061570 2026-02-24T09:16:05.736 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.731+0000 7f3a197fa640 1 -- 10.20.193.74:0/3278798347 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3a08004d10 con 0x7f3a1c061570 2026-02-24T09:16:05.736 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.731+0000 7f3a197fa640 1 -- 10.20.193.74:0/3278798347 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a080106b0 con 0x7f3a1c061570 2026-02-24T09:16:05.739 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.731+0000 7f3a213e1640 1 -- 10.20.193.74:0/3278798347 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a1c0f95b0 con 0x7f3a1c061570 2026-02-24T09:16:05.739 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.731+0000 7f3a213e1640 1 -- 10.20.193.74:0/3278798347 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a1c0f9c90 con 0x7f3a1c061570 2026-02-24T09:16:05.741 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.732+0000 7f3a213e1640 1 -- 10.20.193.74:0/3278798347 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a1c0f97d0 con 0x7f3a1c061570 2026-02-24T09:16:05.742 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.734+0000 7f3a197fa640 1 -- 10.20.193.74:0/3278798347 <== mon.2 v2:10.20.193.74:3300/0 4 ==== mgrmap(e 19) ==== 157139+0+0 (secure 0 0 0) 0x7f3a0801f060 con 0x7f3a1c061570 2026-02-24T09:16:05.742 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.735+0000 7f3a197fa640 1 --2- 10.20.193.74:0/3278798347 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f39f00b57b0 0x7f39f00d5c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:05.742 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.735+0000 7f3a197fa640 1 -- 10.20.193.74:0/3278798347 <== mon.2 v2:10.20.193.74:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6172+0+0 (secure 0 0 0) 0x7f3a08014070 con 0x7f3a1c061570 2026-02-24T09:16:05.742 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.736+0000 7f3a197fa640 1 -- 10.20.193.74:0/3278798347 <== mon.2 v2:10.20.193.74:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f3a080a9900 con 0x7f3a1c061570 2026-02-24T09:16:05.742 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.736+0000 7f3a1b7fe640 1 --2- 10.20.193.74:0/3278798347 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f39f00b57b0 0x7f39f00d5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:05.742 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.736+0000 7f3a1b7fe640 1 --2- 10.20.193.74:0/3278798347 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f39f00b57b0 0x7f39f00d5c60 secure :-1 s=READY pgs=95 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a0c0023d0 tx=0x7f3a0c031040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:05.857 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:05.855+0000 7f3a213e1640 1 -- 10.20.193.74:0/3278798347 --> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial074:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f3a1c0f41d0 con 0x7f39f00b57b0 2026-02-24T09:16:06.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:06 trial159 ceph-mon[44242]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 6.2 TiB / 6.2 TiB avail; 72 KiB/s, 0 objects/s recovering 2026-02-24T09:16:06.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:06 trial159 ceph-mon[44242]: from='osd.9 [v2:10.20.193.28:6826/4207785690,v1:10.20.193.28:6827/4207785690]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-24T09:16:06.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:06 trial159 ceph-mon[44242]: osdmap e72: 10 total, 9 up, 10 in 2026-02-24T09:16:06.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:06 trial159 ceph-mon[44242]: from='osd.9 [v2:10.20.193.28:6826/4207785690,v1:10.20.193.28:6827/4207785690]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-24T09:16:06.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:06 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:16:06.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:06 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:06.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:06 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:06.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:06 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:06.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:06 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:06.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:06 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:06.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:06 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:06.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:06 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:16:06.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:06 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:16:06.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:06 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:06.610 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:16:06 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:16:06.426+0000 7f20b798a640 -1 osd.9 0 waiting for initial osdmap 2026-02-24T09:16:06.610 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:16:06 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:16:06.435+0000 7f20b3851640 -1 osd.9 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T09:16:06.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:06 trial028 ceph-mon[40371]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 6.2 TiB / 6.2 TiB avail; 72 KiB/s, 0 objects/s recovering 2026-02-24T09:16:06.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:06 trial028 ceph-mon[40371]: from='osd.9 [v2:10.20.193.28:6826/4207785690,v1:10.20.193.28:6827/4207785690]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-24T09:16:06.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:06 trial028 ceph-mon[40371]: osdmap e72: 10 total, 9 up, 10 in 2026-02-24T09:16:06.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:06 trial028 ceph-mon[40371]: from='osd.9 [v2:10.20.193.28:6826/4207785690,v1:10.20.193.28:6827/4207785690]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-24T09:16:06.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:06 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:16:06.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:06 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:06.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:06 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:06.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:06 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:06.612 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:06 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:06.612 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:06 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:06.612 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:06 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:06.612 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:06 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:16:06.612 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:06 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:16:06.612 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:06 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:06.823 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:06 trial074 ceph-mon[44412]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 6.2 TiB / 6.2 TiB avail; 72 KiB/s, 0 objects/s recovering 2026-02-24T09:16:06.823 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:06 trial074 ceph-mon[44412]: from='osd.9 [v2:10.20.193.28:6826/4207785690,v1:10.20.193.28:6827/4207785690]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-24T09:16:06.823 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:06 trial074 ceph-mon[44412]: osdmap e72: 10 total, 9 up, 10 in 2026-02-24T09:16:06.823 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:06 trial074 ceph-mon[44412]: from='osd.9 [v2:10.20.193.28:6826/4207785690,v1:10.20.193.28:6827/4207785690]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-24T09:16:06.824 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:06 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:16:06.824 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:06 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:06.824 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:06 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:06.824 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:06 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:06.824 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:06 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:06.824 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:06 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:06.824 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:06 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:06.824 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:06 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:16:06.824 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:06 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:16:06.824 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:06 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:07.461 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: purged_snaps scrub starts 2026-02-24T09:16:07.461 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: purged_snaps scrub ok 2026-02-24T09:16:07.461 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: from='client.24602 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial074:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:16:07.461 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: osd.default does not exist. Creating it now. 2026-02-24T09:16:07.461 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: Creating OSDs with service ID: default on trial074:['vg_nvme/lv_1'] 2026-02-24T09:16:07.461 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: Marking host: trial074 for OSDSpec preview refresh. 2026-02-24T09:16:07.461 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: Saving service osd.default spec with placement trial074 2026-02-24T09:16:07.462 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: from='osd.9 [v2:10.20.193.28:6826/4207785690,v1:10.20.193.28:6827/4207785690]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-24T09:16:07.462 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: osdmap e73: 10 total, 9 up, 10 in 2026-02-24T09:16:07.462 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:16:07.462 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:16:07.462 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: from='client.? 10.20.193.74:0/1290538476' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "65c8e576-a1c7-4c03-bbf6-57c775f2860f"} : dispatch 2026-02-24T09:16:07.462 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "65c8e576-a1c7-4c03-bbf6-57c775f2860f"} : dispatch 2026-02-24T09:16:07.462 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65c8e576-a1c7-4c03-bbf6-57c775f2860f"}]': finished 2026-02-24T09:16:07.462 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: osd.9 [v2:10.20.193.28:6826/4207785690,v1:10.20.193.28:6827/4207785690] boot 2026-02-24T09:16:07.462 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: osdmap e74: 11 total, 10 up, 11 in 2026-02-24T09:16:07.462 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:16:07.462 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:16:07.462 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:07.462 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:07.462 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:07.462 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:07.463 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:07.463 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:07.463 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:07.463 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:07.463 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:07.463 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:07.463 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:07.463 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:07.463 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:16:07.463 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:07.463 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:16:07.463 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:16:07.463 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:07 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:07.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: purged_snaps scrub starts 2026-02-24T09:16:07.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: purged_snaps scrub ok 2026-02-24T09:16:07.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: from='client.24602 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial074:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:16:07.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: osd.default does not exist. Creating it now. 2026-02-24T09:16:07.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: Creating OSDs with service ID: default on trial074:['vg_nvme/lv_1'] 2026-02-24T09:16:07.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: Marking host: trial074 for OSDSpec preview refresh. 2026-02-24T09:16:07.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: Saving service osd.default spec with placement trial074 2026-02-24T09:16:07.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: from='osd.9 [v2:10.20.193.28:6826/4207785690,v1:10.20.193.28:6827/4207785690]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-24T09:16:07.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: osdmap e73: 10 total, 9 up, 10 in 2026-02-24T09:16:07.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:16:07.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:16:07.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: from='client.? 10.20.193.74:0/1290538476' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "65c8e576-a1c7-4c03-bbf6-57c775f2860f"} : dispatch 2026-02-24T09:16:07.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "65c8e576-a1c7-4c03-bbf6-57c775f2860f"} : dispatch 2026-02-24T09:16:07.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65c8e576-a1c7-4c03-bbf6-57c775f2860f"}]': finished 2026-02-24T09:16:07.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: osd.9 [v2:10.20.193.28:6826/4207785690,v1:10.20.193.28:6827/4207785690] boot 2026-02-24T09:16:07.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: osdmap e74: 11 total, 10 up, 11 in 2026-02-24T09:16:07.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:16:07.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:16:07.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:07.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:07.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:07.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:07.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:07.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:07.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:07.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:07.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:07.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:07.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:07.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:07.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:16:07.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:07.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:16:07.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:16:07.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:07 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:07.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: purged_snaps scrub starts 2026-02-24T09:16:07.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: purged_snaps scrub ok 2026-02-24T09:16:07.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: from='client.24602 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial074:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:16:07.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: osd.default does not exist. Creating it now. 2026-02-24T09:16:07.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: Creating OSDs with service ID: default on trial074:['vg_nvme/lv_1'] 2026-02-24T09:16:07.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: Marking host: trial074 for OSDSpec preview refresh. 2026-02-24T09:16:07.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: Saving service osd.default spec with placement trial074 2026-02-24T09:16:07.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: from='osd.9 [v2:10.20.193.28:6826/4207785690,v1:10.20.193.28:6827/4207785690]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-24T09:16:07.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: osdmap e73: 10 total, 9 up, 10 in 2026-02-24T09:16:07.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:16:07.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:16:07.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: from='client.? 10.20.193.74:0/1290538476' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "65c8e576-a1c7-4c03-bbf6-57c775f2860f"} : dispatch 2026-02-24T09:16:07.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "65c8e576-a1c7-4c03-bbf6-57c775f2860f"} : dispatch 2026-02-24T09:16:07.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65c8e576-a1c7-4c03-bbf6-57c775f2860f"}]': finished 2026-02-24T09:16:07.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: osd.9 [v2:10.20.193.28:6826/4207785690,v1:10.20.193.28:6827/4207785690] boot 2026-02-24T09:16:07.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: osdmap e74: 11 total, 10 up, 11 in 2026-02-24T09:16:07.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:16:07.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:16:07.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:07.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:07.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:07.863 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:07.863 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:07.863 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:07.863 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:07.863 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:07.863 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:07.863 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:07.863 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:07.863 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:07.863 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:16:07.863 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:07.863 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:16:07.863 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:16:07.864 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:07 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:08.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:08 trial159 ceph-mon[44242]: Detected new or changed devices on trial028 2026-02-24T09:16:08.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:08 trial159 ceph-mon[44242]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-24T09:16:08.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:08 trial159 ceph-mon[44242]: Adjusting osd_memory_target on trial028 to 21013M 2026-02-24T09:16:08.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:08 trial159 ceph-mon[44242]: from='client.? 10.20.193.74:0/522315900' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:16:08.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:08 trial028 ceph-mon[40371]: Detected new or changed devices on trial028 2026-02-24T09:16:08.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:08 trial028 ceph-mon[40371]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-24T09:16:08.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:08 trial028 ceph-mon[40371]: Adjusting osd_memory_target on trial028 to 21013M 2026-02-24T09:16:08.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:08 trial028 ceph-mon[40371]: from='client.? 10.20.193.74:0/522315900' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:16:08.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:08 trial074 ceph-mon[44412]: Detected new or changed devices on trial028 2026-02-24T09:16:08.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:08 trial074 ceph-mon[44412]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-24T09:16:08.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:08 trial074 ceph-mon[44412]: Adjusting osd_memory_target on trial028 to 21013M 2026-02-24T09:16:08.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:08 trial074 ceph-mon[44412]: from='client.? 10.20.193.74:0/522315900' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:16:09.704 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:09 trial074 ceph-mon[44412]: osdmap e75: 11 total, 10 up, 11 in 2026-02-24T09:16:09.704 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:09 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:16:09.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:09 trial159 ceph-mon[44242]: osdmap e75: 11 total, 10 up, 11 in 2026-02-24T09:16:09.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:09 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:16:09.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:09 trial028 ceph-mon[40371]: osdmap e75: 11 total, 10 up, 11 in 2026-02-24T09:16:09.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:09 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:16:10.602 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:10 trial074 ceph-mon[44412]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-24T09:16:10.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:10 trial159 ceph-mon[44242]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-24T09:16:10.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:10 trial028 ceph-mon[40371]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-24T09:16:11.700 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:11 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-24T09:16:11.701 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:11 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:11.701 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:11 trial074 ceph-mon[44412]: Deploying daemon osd.10 on trial074 2026-02-24T09:16:11.701 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:11 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-24T09:16:11.701 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:11 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:11.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:11 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-24T09:16:11.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:11 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:11.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:11 trial159 ceph-mon[44242]: Deploying daemon osd.10 on trial074 2026-02-24T09:16:11.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:11 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-24T09:16:11.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:11 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:11.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:11 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-24T09:16:11.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:11 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:11.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:11 trial028 ceph-mon[40371]: Deploying daemon osd.10 on trial074 2026-02-24T09:16:11.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:11 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-24T09:16:11.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:11 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:12.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:12 trial159 ceph-mon[44242]: Deploying daemon osd.10 on trial074 2026-02-24T09:16:12.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:12 trial159 ceph-mon[44242]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-24T09:16:12.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:12 trial028 ceph-mon[40371]: Deploying daemon osd.10 on trial074 2026-02-24T09:16:12.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:12 trial028 ceph-mon[40371]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-24T09:16:12.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:12 trial074 ceph-mon[44412]: Deploying daemon osd.10 on trial074 2026-02-24T09:16:12.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:12 trial074 ceph-mon[44412]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-24T09:16:14.763 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:14 trial074 ceph-mon[44412]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-24T09:16:14.764 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:14 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:14.764 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:14 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:14.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:14 trial159 ceph-mon[44242]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-24T09:16:14.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:14 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:14.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:14 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:14.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:14 trial028 ceph-mon[40371]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-24T09:16:14.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:14 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:14.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:14 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:15.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:15 trial074 ceph-mon[44412]: from='osd.10 [v2:10.20.193.74:6824/279530552,v1:10.20.193.74:6825/279530552]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-24T09:16:15.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:15 trial074 ceph-mon[44412]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-24T09:16:15.736 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:15.733+0000 7f3a21e69640 1 -- 10.20.193.74:0/3278798347 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=73}) -- 0x7f39fc003560 con 0x7f3a1c061570 2026-02-24T09:16:15.736 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:15.733+0000 7f3a197fa640 1 -- 10.20.193.74:0/3278798347 <== mon.2 v2:10.20.193.74:3300/0 7 ==== osd_map(73..76 src has 1..76) ==== 3774+0+0 (secure 0 0 0) 0x7f3a08005140 con 0x7f3a1c061570 2026-02-24T09:16:15.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:15 trial159 ceph-mon[44242]: from='osd.10 [v2:10.20.193.74:6824/279530552,v1:10.20.193.74:6825/279530552]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-24T09:16:15.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:15 trial159 ceph-mon[44242]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-24T09:16:15.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:15 trial028 ceph-mon[40371]: from='osd.10 [v2:10.20.193.74:6824/279530552,v1:10.20.193.74:6825/279530552]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-24T09:16:15.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:15 trial028 ceph-mon[40371]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-24T09:16:16.642 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:16 trial074 ceph-mon[44412]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-24T09:16:16.642 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:16 trial074 ceph-mon[44412]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-24T09:16:16.642 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:16 trial074 ceph-mon[44412]: osdmap e76: 11 total, 10 up, 11 in 2026-02-24T09:16:16.642 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:16 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:16:16.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:16 trial159 ceph-mon[44242]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-24T09:16:16.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:16 trial159 ceph-mon[44242]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-24T09:16:16.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:16 trial159 ceph-mon[44242]: osdmap e76: 11 total, 10 up, 11 in 2026-02-24T09:16:16.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:16 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:16:16.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:16 trial028 ceph-mon[40371]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-24T09:16:16.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:16 trial028 ceph-mon[40371]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-24T09:16:16.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:16 trial028 ceph-mon[40371]: osdmap e76: 11 total, 10 up, 11 in 2026-02-24T09:16:16.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:16 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:16:17.572 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:17.569+0000 7f3a197fa640 1 -- 10.20.193.74:0/3278798347 <== mgr.14223 v2:10.20.193.28:6800/906910473 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3a1c0f41d0 con 0x7f39f00b57b0 2026-02-24T09:16:17.572 INFO:teuthology.orchestra.run.trial074.stdout:Created osd(s) 10 on host 'trial074' 2026-02-24T09:16:17.575 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:17.572+0000 7f3a213e1640 1 -- 10.20.193.74:0/3278798347 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f39f00b57b0 msgr2=0x7f39f00d5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:17.575 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:17.572+0000 7f3a213e1640 1 --2- 10.20.193.74:0/3278798347 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f39f00b57b0 0x7f39f00d5c60 secure :-1 s=READY pgs=95 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a0c0023d0 tx=0x7f3a0c031040 comp rx=0 tx=0).stop 2026-02-24T09:16:17.575 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:17.572+0000 7f3a213e1640 1 -- 10.20.193.74:0/3278798347 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3a1c061570 msgr2=0x7f3a1c0f3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:17.575 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:17.572+0000 7f3a213e1640 1 --2- 10.20.193.74:0/3278798347 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3a1c061570 0x7f3a1c0f3070 secure :-1 s=READY pgs=66 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a08009480 tx=0x7f3a0800ee60 comp rx=0 tx=0).stop 2026-02-24T09:16:17.575 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:17.572+0000 7f3a213e1640 1 -- 10.20.193.74:0/3278798347 shutdown_connections 2026-02-24T09:16:17.575 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:17.572+0000 7f3a213e1640 1 --2- 10.20.193.74:0/3278798347 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f39f00b57b0 0x7f39f00d5c60 unknown :-1 s=CLOSED pgs=95 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:17.575 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:17.572+0000 7f3a213e1640 1 --2- 10.20.193.74:0/3278798347 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3a1c159ec0 0x7f3a1c0f8980 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:17.575 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:17.572+0000 7f3a213e1640 1 --2- 10.20.193.74:0/3278798347 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a1c062b60 0x7f3a1c0f35b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:17.576 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:17.572+0000 7f3a213e1640 1 --2- 10.20.193.74:0/3278798347 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3a1c061570 0x7f3a1c0f3070 unknown :-1 s=CLOSED pgs=66 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:17.576 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:17.572+0000 7f3a213e1640 1 -- 10.20.193.74:0/3278798347 >> 10.20.193.74:0/3278798347 conn(0x7f3a1c0eac60 msgr2=0x7f3a1c10e660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:17.576 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:17.572+0000 7f3a213e1640 1 -- 10.20.193.74:0/3278798347 shutdown_connections 2026-02-24T09:16:17.576 INFO:teuthology.orchestra.run.trial074.stderr:2026-02-24T09:16:17.573+0000 7f3a213e1640 1 -- 10.20.193.74:0/3278798347 wait complete. 2026-02-24T09:16:17.678 DEBUG:teuthology.orchestra.run.trial074:osd.10> sudo journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.10.service 2026-02-24T09:16:17.682 INFO:tasks.cephadm:Deploying osd.11 on trial159 with /dev/vg_nvme/lv_1... 2026-02-24T09:16:17.682 DEBUG:teuthology.orchestra.run.trial159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-24T09:16:17.870 INFO:teuthology.orchestra.run.trial159.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.c/config 2026-02-24T09:16:18.000 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:17 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:18.000 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:17 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:18.000 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:17 trial159 ceph-mon[44242]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-24T09:16:18.001 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:17 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:18.001 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:17 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:18.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:17 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:18.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:17 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:18.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:17 trial074 ceph-mon[44412]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-24T09:16:18.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:17 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:18.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:17 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:18.124 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:16:17 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:16:17.941+0000 7fb5eb805780 -1 osd.10 0 log_to_monitors true 2026-02-24T09:16:18.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:17 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:18.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:17 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:18.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:17 trial028 ceph-mon[40371]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-24T09:16:18.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:17 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:18.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:17 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:18.821 INFO:teuthology.orchestra.run.trial159.stdout: 2026-02-24T09:16:18.844 DEBUG:teuthology.orchestra.run.trial159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph orch daemon add osd trial159:vg_nvme/lv_1 --skip-validation 2026-02-24T09:16:19.029 INFO:teuthology.orchestra.run.trial159.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.c/config 2026-02-24T09:16:19.102 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:18 trial159 ceph-mon[44242]: from='osd.10 [v2:10.20.193.74:6824/2590408209,v1:10.20.193.74:6825/2590408209]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-24T09:16:19.102 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:18 trial159 ceph-mon[44242]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-24T09:16:19.102 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:18 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:19.102 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:18 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:19.102 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:18 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:16:19.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:18 trial028 ceph-mon[40371]: from='osd.10 [v2:10.20.193.74:6824/2590408209,v1:10.20.193.74:6825/2590408209]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-24T09:16:19.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:18 trial028 ceph-mon[40371]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-24T09:16:19.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:18 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:19.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:18 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:19.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:18 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:16:19.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:18 trial074 ceph-mon[44412]: from='osd.10 [v2:10.20.193.74:6824/2590408209,v1:10.20.193.74:6825/2590408209]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-24T09:16:19.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:18 trial074 ceph-mon[44412]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-24T09:16:19.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:18 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:19.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:18 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:19.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:18 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:16:19.222 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.222+0000 7fe12b38d640 1 -- 10.20.193.159:0/1617990195 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe12410c830 msgr2=0x7fe124155710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:19.222 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.222+0000 7fe12b38d640 1 --2- 10.20.193.159:0/1617990195 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe12410c830 0x7fe124155710 secure :-1 s=READY pgs=57 gs=1 cs=0 l=1 c_cookie=14813442807580624695 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe118009950 tx=0x7fe11802f190 comp rx=0 tx=0).stop 2026-02-24T09:16:19.222 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.222+0000 7fe12b38d640 1 -- 10.20.193.159:0/1617990195 shutdown_connections 2026-02-24T09:16:19.222 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.222+0000 7fe12b38d640 1 --2- 10.20.193.159:0/1617990195 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fe124155c50 0x7fe124176030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:19.223 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.222+0000 7fe12b38d640 1 --2- 10.20.193.159:0/1617990195 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe12410c830 0x7fe124155710 unknown :-1 s=CLOSED pgs=57 gs=1 cs=0 l=1 c_cookie=14813442807580624695 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:19.223 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.222+0000 7fe12b38d640 1 --2- 10.20.193.159:0/1617990195 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe12410bf20 0x7fe12410c2f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:19.223 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.222+0000 7fe12b38d640 1 -- 10.20.193.159:0/1617990195 >> 10.20.193.159:0/1617990195 conn(0x7fe1240e9bc0 msgr2=0x7fe124109fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:19.223 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.222+0000 7fe12b38d640 1 -- 10.20.193.159:0/1617990195 shutdown_connections 2026-02-24T09:16:19.223 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.222+0000 7fe12b38d640 1 -- 10.20.193.159:0/1617990195 wait complete. 2026-02-24T09:16:19.223 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.222+0000 7fe12b38d640 1 Processor -- start 2026-02-24T09:16:19.223 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.222+0000 7fe12b38d640 1 -- start start 2026-02-24T09:16:19.224 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.223+0000 7fe12b38d640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe12410bf20 0x7fe124161350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:19.225 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.223+0000 7fe12b38d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe12410c830 0x7fe124161890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:19.225 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.223+0000 7fe12b38d640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fe124155c50 0x7fe124166c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:19.225 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.223+0000 7fe12b38d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe124167280 con 0x7fe12410c830 2026-02-24T09:16:19.225 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.223+0000 7fe12b38d640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fe1241673f0 con 0x7fe124155c50 2026-02-24T09:16:19.225 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.223+0000 7fe12b38d640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe1241675b0 con 0x7fe12410bf20 2026-02-24T09:16:19.225 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.223+0000 7fe12a38b640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe12410bf20 0x7fe124161350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:19.225 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.223+0000 7fe12a38b640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe12410bf20 0x7fe124161350 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.159:34930/0 (socket says 10.20.193.159:34930) 2026-02-24T09:16:19.225 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.223+0000 7fe12a38b640 1 -- 10.20.193.159:0/2292970744 learned_addr learned my addr 10.20.193.159:0/2292970744 (peer_addr_for_me v2:10.20.193.159:0/0) 2026-02-24T09:16:19.225 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.223+0000 7fe129b8a640 1 --2- 10.20.193.159:0/2292970744 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe12410c830 0x7fe124161890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:19.225 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.223+0000 7fe12ab8c640 1 --2- 10.20.193.159:0/2292970744 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fe124155c50 0x7fe124166c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:19.225 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.223+0000 7fe12a38b640 1 -- 10.20.193.159:0/2292970744 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fe124155c50 msgr2=0x7fe124166c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:19.225 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.223+0000 7fe12a38b640 1 --2- 10.20.193.159:0/2292970744 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fe124155c50 0x7fe124166c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:19.226 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.223+0000 7fe12a38b640 1 -- 10.20.193.159:0/2292970744 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe12410c830 msgr2=0x7fe124161890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:19.226 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.223+0000 7fe12a38b640 1 --2- 10.20.193.159:0/2292970744 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe12410c830 0x7fe124161890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:19.226 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.223+0000 7fe12a38b640 1 -- 10.20.193.159:0/2292970744 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe118009570 con 0x7fe12410bf20 2026-02-24T09:16:19.226 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.223+0000 7fe12ab8c640 1 --2- 10.20.193.159:0/2292970744 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fe124155c50 0x7fe124166c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:16:19.226 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.223+0000 7fe12a38b640 1 --2- 10.20.193.159:0/2292970744 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe12410bf20 0x7fe124161350 secure :-1 s=READY pgs=58 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe11400d950 tx=0x7fe11400de20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:19.226 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.224+0000 7fe10b7fe640 1 -- 10.20.193.159:0/2292970744 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe114004540 con 0x7fe12410bf20 2026-02-24T09:16:19.226 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.224+0000 7fe10b7fe640 1 -- 10.20.193.159:0/2292970744 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fe114009ce0 con 0x7fe12410bf20 2026-02-24T09:16:19.226 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.224+0000 7fe10b7fe640 1 -- 10.20.193.159:0/2292970744 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe1140106e0 con 0x7fe12410bf20 2026-02-24T09:16:19.226 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.224+0000 7fe12b38d640 1 -- 10.20.193.159:0/2292970744 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe124167890 con 0x7fe12410bf20 2026-02-24T09:16:19.226 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.224+0000 7fe12b38d640 1 -- 10.20.193.159:0/2292970744 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe124152880 con 0x7fe12410bf20 2026-02-24T09:16:19.226 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.224+0000 7fe12b38d640 1 -- 10.20.193.159:0/2292970744 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1240603a0 con 0x7fe12410bf20 2026-02-24T09:16:19.227 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.226+0000 7fe10b7fe640 1 -- 10.20.193.159:0/2292970744 <== mon.1 v2:10.20.193.159:3300/0 4 ==== mgrmap(e 19) ==== 157139+0+0 (secure 0 0 0) 0x7fe1140097c0 con 0x7fe12410bf20 2026-02-24T09:16:19.228 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.228+0000 7fe10b7fe640 1 --2- 10.20.193.159:0/2292970744 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe1000b57b0 0x7fe1000d5c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:19.229 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.228+0000 7fe10b7fe640 1 -- 10.20.193.159:0/2292970744 <== mon.1 v2:10.20.193.159:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6605+0+0 (secure 0 0 0) 0x7fe1140e6cd0 con 0x7fe12410bf20 2026-02-24T09:16:19.229 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.228+0000 7fe10b7fe640 1 -- 10.20.193.159:0/2292970744 <== mon.1 v2:10.20.193.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fe1140e7150 con 0x7fe12410bf20 2026-02-24T09:16:19.229 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.228+0000 7fe129b8a640 1 --2- 10.20.193.159:0/2292970744 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe1000b57b0 0x7fe1000d5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:19.229 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.229+0000 7fe129b8a640 1 --2- 10.20.193.159:0/2292970744 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe1000b57b0 0x7fe1000d5c60 secure :-1 s=READY pgs=100 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1180023d0 tx=0x7fe118031040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:19.348 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:19.348+0000 7fe12b38d640 1 -- 10.20.193.159:0/2292970744 --> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial159:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fe1241624b0 con 0x7fe1000b57b0 2026-02-24T09:16:20.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:19 trial028 ceph-mon[40371]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-24T09:16:20.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:19 trial028 ceph-mon[40371]: from='osd.10 [v2:10.20.193.74:6824/2590408209,v1:10.20.193.74:6825/2590408209]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial074", "root=default"]} : dispatch 2026-02-24T09:16:20.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:19 trial028 ceph-mon[40371]: osdmap e77: 11 total, 10 up, 11 in 2026-02-24T09:16:20.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:19 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:16:20.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:19 trial028 ceph-mon[40371]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial074", "root=default"]} : dispatch 2026-02-24T09:16:20.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:19 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:20.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:19 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:20.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:19 trial028 ceph-mon[40371]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-24T09:16:20.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:19 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:20.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:19 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:20.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:19 trial028 ceph-mon[40371]: from='client.24622 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial159:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:16:20.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:19 trial028 ceph-mon[40371]: osd.default does not exist. Creating it now. 2026-02-24T09:16:20.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:19 trial028 ceph-mon[40371]: Creating OSDs with service ID: default on trial159:['vg_nvme/lv_1'] 2026-02-24T09:16:20.112 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:19 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:20.112 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:19 trial028 ceph-mon[40371]: Marking host: trial159 for OSDSpec preview refresh. 2026-02-24T09:16:20.112 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:19 trial028 ceph-mon[40371]: Saving service osd.default spec with placement trial159 2026-02-24T09:16:20.112 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:19 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:20.112 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:19 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:16:20.112 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:19 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:16:20.112 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:19 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:20.123 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:16:19 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:16:19.922+0000 7fb5e7787640 -1 osd.10 0 waiting for initial osdmap 2026-02-24T09:16:20.123 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:16:19 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:16:19.933+0000 7fb5df646640 -1 osd.10 78 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T09:16:20.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:19 trial074 ceph-mon[44412]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-24T09:16:20.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:19 trial074 ceph-mon[44412]: from='osd.10 [v2:10.20.193.74:6824/2590408209,v1:10.20.193.74:6825/2590408209]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial074", "root=default"]} : dispatch 2026-02-24T09:16:20.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:19 trial074 ceph-mon[44412]: osdmap e77: 11 total, 10 up, 11 in 2026-02-24T09:16:20.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:19 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:16:20.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:19 trial074 ceph-mon[44412]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial074", "root=default"]} : dispatch 2026-02-24T09:16:20.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:19 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:20.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:19 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:20.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:19 trial074 ceph-mon[44412]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-24T09:16:20.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:19 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:20.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:19 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:20.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:19 trial074 ceph-mon[44412]: from='client.24622 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial159:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:16:20.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:19 trial074 ceph-mon[44412]: osd.default does not exist. Creating it now. 2026-02-24T09:16:20.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:19 trial074 ceph-mon[44412]: Creating OSDs with service ID: default on trial159:['vg_nvme/lv_1'] 2026-02-24T09:16:20.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:19 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:20.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:19 trial074 ceph-mon[44412]: Marking host: trial159 for OSDSpec preview refresh. 2026-02-24T09:16:20.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:19 trial074 ceph-mon[44412]: Saving service osd.default spec with placement trial159 2026-02-24T09:16:20.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:19 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:20.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:19 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:16:20.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:19 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:16:20.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:19 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:20.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:19 trial159 ceph-mon[44242]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-24T09:16:20.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:19 trial159 ceph-mon[44242]: from='osd.10 [v2:10.20.193.74:6824/2590408209,v1:10.20.193.74:6825/2590408209]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial074", "root=default"]} : dispatch 2026-02-24T09:16:20.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:19 trial159 ceph-mon[44242]: osdmap e77: 11 total, 10 up, 11 in 2026-02-24T09:16:20.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:19 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:16:20.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:19 trial159 ceph-mon[44242]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial074", "root=default"]} : dispatch 2026-02-24T09:16:20.281 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:19 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:20.281 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:19 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:20.281 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:19 trial159 ceph-mon[44242]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-24T09:16:20.281 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:19 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:20.281 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:19 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:20.281 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:19 trial159 ceph-mon[44242]: from='client.24622 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial159:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:16:20.281 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:19 trial159 ceph-mon[44242]: osd.default does not exist. Creating it now. 2026-02-24T09:16:20.281 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:19 trial159 ceph-mon[44242]: Creating OSDs with service ID: default on trial159:['vg_nvme/lv_1'] 2026-02-24T09:16:20.281 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:19 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:20.281 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:19 trial159 ceph-mon[44242]: Marking host: trial159 for OSDSpec preview refresh. 2026-02-24T09:16:20.281 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:19 trial159 ceph-mon[44242]: Saving service osd.default spec with placement trial159 2026-02-24T09:16:20.282 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:19 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:20.282 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:19 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:16:20.282 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:19 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:16:20.282 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:19 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:20.931 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:20 trial159 ceph-mon[44242]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial074", "root=default"]}]': finished 2026-02-24T09:16:20.932 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:20 trial159 ceph-mon[44242]: osdmap e78: 11 total, 10 up, 11 in 2026-02-24T09:16:20.932 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:20 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:16:20.932 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:20 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:16:20.932 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:20 trial159 ceph-mon[44242]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e2305377-fadb-4cf0-8384-87387f116255"} : dispatch 2026-02-24T09:16:20.932 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:20 trial159 ceph-mon[44242]: from='client.? 10.20.193.159:0/1002245316' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e2305377-fadb-4cf0-8384-87387f116255"} : dispatch 2026-02-24T09:16:20.932 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:20 trial159 ceph-mon[44242]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e2305377-fadb-4cf0-8384-87387f116255"}]': finished 2026-02-24T09:16:20.932 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:20 trial159 ceph-mon[44242]: osd.10 [v2:10.20.193.74:6824/2590408209,v1:10.20.193.74:6825/2590408209] boot 2026-02-24T09:16:20.932 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:20 trial159 ceph-mon[44242]: osdmap e79: 12 total, 11 up, 12 in 2026-02-24T09:16:20.933 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:20 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:16:20.933 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:20 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:16:20.933 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:20 trial159 ceph-mon[44242]: osdmap e80: 12 total, 11 up, 12 in 2026-02-24T09:16:20.933 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:20 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:16:20.933 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:20 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:20.933 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:20 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:20.933 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:20 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:20.933 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:20 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:20.933 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:20 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:20.933 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:20 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:20.933 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:20 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:20.933 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:20 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:21.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:20 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:21.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:20 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:21.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:20 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:21.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:20 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:21.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:20 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:16:21.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:20 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:21.281 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:20 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:16:21.281 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:20 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:16:21.281 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:20 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:21.281 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:20 trial159 ceph-mon[44242]: from='client.? 10.20.193.159:0/708903083' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:16:21.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:20 trial028 ceph-mon[40371]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial074", "root=default"]}]': finished 2026-02-24T09:16:21.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:20 trial028 ceph-mon[40371]: osdmap e78: 11 total, 10 up, 11 in 2026-02-24T09:16:21.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:20 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:16:21.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:20 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:16:21.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:20 trial028 ceph-mon[40371]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e2305377-fadb-4cf0-8384-87387f116255"} : dispatch 2026-02-24T09:16:21.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:20 trial028 ceph-mon[40371]: from='client.? 10.20.193.159:0/1002245316' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e2305377-fadb-4cf0-8384-87387f116255"} : dispatch 2026-02-24T09:16:21.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:20 trial028 ceph-mon[40371]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e2305377-fadb-4cf0-8384-87387f116255"}]': finished 2026-02-24T09:16:21.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:20 trial028 ceph-mon[40371]: osd.10 [v2:10.20.193.74:6824/2590408209,v1:10.20.193.74:6825/2590408209] boot 2026-02-24T09:16:21.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:20 trial028 ceph-mon[40371]: osdmap e79: 12 total, 11 up, 12 in 2026-02-24T09:16:21.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:20 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:16:21.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:20 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:16:21.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:20 trial028 ceph-mon[40371]: osdmap e80: 12 total, 11 up, 12 in 2026-02-24T09:16:21.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:20 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:16:21.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:20 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:21.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:20 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:21.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:20 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:21.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:20 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:21.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:20 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:21.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:20 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:21.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:20 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:21.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:20 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:21.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:20 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:21.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:20 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:21.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:20 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:21.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:20 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:21.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:20 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:16:21.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:20 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:21.363 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:20 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:16:21.363 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:20 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:16:21.363 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:20 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:21.363 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:20 trial028 ceph-mon[40371]: from='client.? 10.20.193.159:0/708903083' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:16:21.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:20 trial074 ceph-mon[44412]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial074", "root=default"]}]': finished 2026-02-24T09:16:21.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:20 trial074 ceph-mon[44412]: osdmap e78: 11 total, 10 up, 11 in 2026-02-24T09:16:21.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:20 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:16:21.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:20 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:16:21.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:20 trial074 ceph-mon[44412]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e2305377-fadb-4cf0-8384-87387f116255"} : dispatch 2026-02-24T09:16:21.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:20 trial074 ceph-mon[44412]: from='client.? 10.20.193.159:0/1002245316' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e2305377-fadb-4cf0-8384-87387f116255"} : dispatch 2026-02-24T09:16:21.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:20 trial074 ceph-mon[44412]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e2305377-fadb-4cf0-8384-87387f116255"}]': finished 2026-02-24T09:16:21.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:20 trial074 ceph-mon[44412]: osd.10 [v2:10.20.193.74:6824/2590408209,v1:10.20.193.74:6825/2590408209] boot 2026-02-24T09:16:21.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:20 trial074 ceph-mon[44412]: osdmap e79: 12 total, 11 up, 12 in 2026-02-24T09:16:21.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:20 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:16:21.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:20 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:16:21.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:20 trial074 ceph-mon[44412]: osdmap e80: 12 total, 11 up, 12 in 2026-02-24T09:16:21.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:20 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:16:21.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:20 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:21.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:20 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:21.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:20 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:21.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:20 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:21.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:20 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:21.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:20 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:21.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:20 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:21.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:20 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:21.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:20 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:21.376 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:20 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:21.376 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:20 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:21.376 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:20 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:21.376 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:20 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:16:21.376 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:20 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:21.376 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:20 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:16:21.376 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:20 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:16:21.376 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:20 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:21.376 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:20 trial074 ceph-mon[44412]: from='client.? 10.20.193.159:0/708903083' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:16:22.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:21 trial159 ceph-mon[44242]: purged_snaps scrub starts 2026-02-24T09:16:22.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:21 trial159 ceph-mon[44242]: purged_snaps scrub ok 2026-02-24T09:16:22.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:21 trial159 ceph-mon[44242]: Detected new or changed devices on trial074 2026-02-24T09:16:22.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:21 trial159 ceph-mon[44242]: Adjusting osd_memory_target on trial074 to 21013M 2026-02-24T09:16:22.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:21 trial159 ceph-mon[44242]: pgmap v149: 1 pgs: 1 peering; 577 KiB data, 301 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-24T09:16:22.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:21 trial159 ceph-mon[44242]: osdmap e81: 12 total, 11 up, 12 in 2026-02-24T09:16:22.281 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:21 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:16:22.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:21 trial028 ceph-mon[40371]: purged_snaps scrub starts 2026-02-24T09:16:22.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:21 trial028 ceph-mon[40371]: purged_snaps scrub ok 2026-02-24T09:16:22.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:21 trial028 ceph-mon[40371]: Detected new or changed devices on trial074 2026-02-24T09:16:22.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:21 trial028 ceph-mon[40371]: Adjusting osd_memory_target on trial074 to 21013M 2026-02-24T09:16:22.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:21 trial028 ceph-mon[40371]: pgmap v149: 1 pgs: 1 peering; 577 KiB data, 301 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-24T09:16:22.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:21 trial028 ceph-mon[40371]: osdmap e81: 12 total, 11 up, 12 in 2026-02-24T09:16:22.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:21 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:16:22.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:21 trial074 ceph-mon[44412]: purged_snaps scrub starts 2026-02-24T09:16:22.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:21 trial074 ceph-mon[44412]: purged_snaps scrub ok 2026-02-24T09:16:22.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:21 trial074 ceph-mon[44412]: Detected new or changed devices on trial074 2026-02-24T09:16:22.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:21 trial074 ceph-mon[44412]: Adjusting osd_memory_target on trial074 to 21013M 2026-02-24T09:16:22.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:21 trial074 ceph-mon[44412]: pgmap v149: 1 pgs: 1 peering; 577 KiB data, 301 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-24T09:16:22.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:21 trial074 ceph-mon[44412]: osdmap e81: 12 total, 11 up, 12 in 2026-02-24T09:16:22.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:21 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:16:23.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:23 trial159 ceph-mon[44242]: osdmap e82: 12 total, 11 up, 12 in 2026-02-24T09:16:23.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:23 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:16:23.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:23 trial159 ceph-mon[44242]: pgmap v152: 1 pgs: 1 peering; 577 KiB data, 301 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-24T09:16:23.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:23 trial028 ceph-mon[40371]: osdmap e82: 12 total, 11 up, 12 in 2026-02-24T09:16:23.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:23 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:16:23.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:23 trial028 ceph-mon[40371]: pgmap v152: 1 pgs: 1 peering; 577 KiB data, 301 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-24T09:16:23.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:23 trial074 ceph-mon[44412]: osdmap e82: 12 total, 11 up, 12 in 2026-02-24T09:16:23.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:23 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:16:23.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:23 trial074 ceph-mon[44412]: pgmap v152: 1 pgs: 1 peering; 577 KiB data, 301 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-24T09:16:24.587 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:24 trial159 ceph-mon[44242]: osdmap e83: 12 total, 11 up, 12 in 2026-02-24T09:16:24.587 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:24 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:16:24.587 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:24 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-24T09:16:24.587 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:24 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:24.587 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:24 trial159 ceph-mon[44242]: Deploying daemon osd.11 on trial159 2026-02-24T09:16:24.587 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:24 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-24T09:16:24.587 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:24 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:24.587 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:24 trial159 ceph-mon[44242]: Deploying daemon osd.11 on trial159 2026-02-24T09:16:24.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:24 trial028 ceph-mon[40371]: osdmap e83: 12 total, 11 up, 12 in 2026-02-24T09:16:24.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:24 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:16:24.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:24 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-24T09:16:24.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:24 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:24.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:24 trial028 ceph-mon[40371]: Deploying daemon osd.11 on trial159 2026-02-24T09:16:24.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:24 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-24T09:16:24.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:24 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:24.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:24 trial028 ceph-mon[40371]: Deploying daemon osd.11 on trial159 2026-02-24T09:16:24.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:24 trial074 ceph-mon[44412]: osdmap e83: 12 total, 11 up, 12 in 2026-02-24T09:16:24.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:24 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:16:24.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:24 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-24T09:16:24.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:24 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:24.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:24 trial074 ceph-mon[44412]: Deploying daemon osd.11 on trial159 2026-02-24T09:16:24.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:24 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-24T09:16:24.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:24 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:24.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:24 trial074 ceph-mon[44412]: Deploying daemon osd.11 on trial159 2026-02-24T09:16:25.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:25 trial028 ceph-mon[40371]: pgmap v154: 1 pgs: 1 peering; 577 KiB data, 301 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-24T09:16:25.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:25 trial074 ceph-mon[44412]: pgmap v154: 1 pgs: 1 peering; 577 KiB data, 301 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-24T09:16:25.934 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:25 trial159 ceph-mon[44242]: pgmap v154: 1 pgs: 1 peering; 577 KiB data, 301 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-24T09:16:28.188 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:27 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:28.188 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:27 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:28.189 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:27 trial159 ceph-mon[44242]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 7.5 TiB / 7.5 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-24T09:16:28.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:27 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:28.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:27 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:28.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:27 trial028 ceph-mon[40371]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 7.5 TiB / 7.5 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-24T09:16:28.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:27 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:28.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:27 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:28.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:27 trial074 ceph-mon[44412]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 7.5 TiB / 7.5 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-24T09:16:29.015 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:28 trial159 ceph-mon[44242]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-24T09:16:29.015 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:28 trial159 ceph-mon[44242]: from='osd.11 [v2:10.20.193.159:6824/678343435,v1:10.20.193.159:6825/678343435]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-24T09:16:29.226 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:29.226+0000 7fe12be15640 1 -- 10.20.193.159:0/2292970744 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=78}) -- 0x7fe0fc003560 con 0x7fe12410bf20 2026-02-24T09:16:29.227 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:29.226+0000 7fe10b7fe640 1 -- 10.20.193.159:0/2292970744 <== mon.1 v2:10.20.193.159:3300/0 7 ==== osd_map(78..84 src has 1..84) ==== 4750+0+0 (secure 0 0 0) 0x7fe11400f3c0 con 0x7fe12410bf20 2026-02-24T09:16:29.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:28 trial028 ceph-mon[40371]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-24T09:16:29.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:28 trial028 ceph-mon[40371]: from='osd.11 [v2:10.20.193.159:6824/678343435,v1:10.20.193.159:6825/678343435]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-24T09:16:29.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:28 trial074 ceph-mon[44412]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-24T09:16:29.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:28 trial074 ceph-mon[44412]: from='osd.11 [v2:10.20.193.159:6824/678343435,v1:10.20.193.159:6825/678343435]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-24T09:16:30.279 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:29 trial159 ceph-mon[44242]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-24T09:16:30.279 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:29 trial159 ceph-mon[44242]: osdmap e84: 12 total, 11 up, 12 in 2026-02-24T09:16:30.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:29 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:16:30.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:29 trial159 ceph-mon[44242]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 7.5 TiB / 7.5 TiB avail; 86 KiB/s, 0 objects/s recovering 2026-02-24T09:16:30.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:29 trial028 ceph-mon[40371]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-24T09:16:30.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:29 trial028 ceph-mon[40371]: osdmap e84: 12 total, 11 up, 12 in 2026-02-24T09:16:30.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:29 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:16:30.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:29 trial028 ceph-mon[40371]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 7.5 TiB / 7.5 TiB avail; 86 KiB/s, 0 objects/s recovering 2026-02-24T09:16:30.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:29 trial074 ceph-mon[44412]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-24T09:16:30.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:29 trial074 ceph-mon[44412]: osdmap e84: 12 total, 11 up, 12 in 2026-02-24T09:16:30.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:29 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:16:30.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:29 trial074 ceph-mon[44412]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 7.5 TiB / 7.5 TiB avail; 86 KiB/s, 0 objects/s recovering 2026-02-24T09:16:30.913 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:30.912+0000 7fe10b7fe640 1 -- 10.20.193.159:0/2292970744 <== mgr.14223 v2:10.20.193.28:6800/906910473 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe1241624b0 con 0x7fe1000b57b0 2026-02-24T09:16:30.913 INFO:teuthology.orchestra.run.trial159.stdout:Created osd(s) 11 on host 'trial159' 2026-02-24T09:16:30.916 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:30.915+0000 7fe12b38d640 1 -- 10.20.193.159:0/2292970744 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe1000b57b0 msgr2=0x7fe1000d5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:30.916 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:30.915+0000 7fe12b38d640 1 --2- 10.20.193.159:0/2292970744 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe1000b57b0 0x7fe1000d5c60 secure :-1 s=READY pgs=100 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1180023d0 tx=0x7fe118031040 comp rx=0 tx=0).stop 2026-02-24T09:16:30.916 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:30.915+0000 7fe12b38d640 1 -- 10.20.193.159:0/2292970744 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe12410bf20 msgr2=0x7fe124161350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:30.916 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:30.915+0000 7fe12b38d640 1 --2- 10.20.193.159:0/2292970744 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe12410bf20 0x7fe124161350 secure :-1 s=READY pgs=58 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe11400d950 tx=0x7fe11400de20 comp rx=0 tx=0).stop 2026-02-24T09:16:30.916 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:30.915+0000 7fe12b38d640 1 -- 10.20.193.159:0/2292970744 shutdown_connections 2026-02-24T09:16:30.917 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:30.915+0000 7fe12b38d640 1 --2- 10.20.193.159:0/2292970744 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe1000b57b0 0x7fe1000d5c60 unknown :-1 s=CLOSED pgs=100 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:30.917 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:30.915+0000 7fe12b38d640 1 --2- 10.20.193.159:0/2292970744 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fe124155c50 0x7fe124166c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:30.917 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:30.915+0000 7fe12b38d640 1 --2- 10.20.193.159:0/2292970744 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe12410c830 0x7fe124161890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:30.917 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:30.915+0000 7fe12b38d640 1 --2- 10.20.193.159:0/2292970744 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe12410bf20 0x7fe124161350 unknown :-1 s=CLOSED pgs=58 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:30.917 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:30.915+0000 7fe12b38d640 1 -- 10.20.193.159:0/2292970744 >> 10.20.193.159:0/2292970744 conn(0x7fe1240e9bc0 msgr2=0x7fe124109fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:30.917 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:30.916+0000 7fe12b38d640 1 -- 10.20.193.159:0/2292970744 shutdown_connections 2026-02-24T09:16:30.917 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:30.916+0000 7fe12b38d640 1 -- 10.20.193.159:0/2292970744 wait complete. 2026-02-24T09:16:31.014 DEBUG:teuthology.orchestra.run.trial159:osd.11> sudo journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.11.service 2026-02-24T09:16:31.019 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2026-02-24T09:16:31.019 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd stat -f json 2026-02-24T09:16:31.210 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:16:31.341 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:31 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:31.341 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:31 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:31.341 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:31 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:31.341 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:31 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:31.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.384+0000 7f9fba20a640 1 -- 10.20.193.28:0/2781119168 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9fb410c780 msgr2=0x7f9fb4155660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:31.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.384+0000 7f9fba20a640 1 --2- 10.20.193.28:0/2781119168 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9fb410c780 0x7f9fb4155660 secure :-1 s=READY pgs=201 gs=1 cs=0 l=1 c_cookie=6533596782416135120 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fa8009950 tx=0x7f9fa802f190 comp rx=0 tx=0).stop 2026-02-24T09:16:31.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.384+0000 7f9fba20a640 1 -- 10.20.193.28:0/2781119168 shutdown_connections 2026-02-24T09:16:31.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.384+0000 7f9fba20a640 1 --2- 10.20.193.28:0/2781119168 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f9fb4155ba0 0x7f9fb4175f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:31.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.384+0000 7f9fba20a640 1 --2- 10.20.193.28:0/2781119168 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9fb410c780 0x7f9fb4155660 unknown :-1 s=CLOSED pgs=201 gs=1 cs=0 l=1 c_cookie=6533596782416135120 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:31.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.384+0000 7f9fba20a640 1 --2- 10.20.193.28:0/2781119168 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f9fb410be70 0x7f9fb410c240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:31.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.384+0000 7f9fba20a640 1 -- 10.20.193.28:0/2781119168 >> 10.20.193.28:0/2781119168 conn(0x7f9fb40e9b70 msgr2=0x7f9fb4109f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:31.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.384+0000 7f9fba20a640 1 -- 10.20.193.28:0/2781119168 shutdown_connections 2026-02-24T09:16:31.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.384+0000 7f9fba20a640 1 -- 10.20.193.28:0/2781119168 wait complete. 2026-02-24T09:16:31.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.385+0000 7f9fba20a640 1 Processor -- start 2026-02-24T09:16:31.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.385+0000 7f9fba20a640 1 -- start start 2026-02-24T09:16:31.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.385+0000 7f9fba20a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9fb410be70 0x7f9fb41612b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:31.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.385+0000 7f9fba20a640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f9fb410c780 0x7f9fb41617f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:31.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.385+0000 7f9fba20a640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f9fb4155ba0 0x7f9fb4166bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:31.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.385+0000 7f9fba20a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb41671e0 con 0x7f9fb410be70 2026-02-24T09:16:31.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.385+0000 7f9fba20a640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb4167350 con 0x7f9fb4155ba0 2026-02-24T09:16:31.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.385+0000 7f9fba20a640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb4167510 con 0x7f9fb410c780 2026-02-24T09:16:31.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.385+0000 7f9fb9208640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9fb410be70 0x7f9fb41612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:31.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.386+0000 7f9fb9208640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9fb410be70 0x7f9fb41612b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58616/0 (socket says 10.20.193.28:58616) 2026-02-24T09:16:31.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.386+0000 7f9fb9208640 1 -- 10.20.193.28:0/1525111729 learned_addr learned my addr 10.20.193.28:0/1525111729 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:16:31.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.386+0000 7f9fb8a07640 1 --2- 10.20.193.28:0/1525111729 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f9fb410c780 0x7f9fb41617f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:31.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.386+0000 7f9fb9208640 1 -- 10.20.193.28:0/1525111729 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f9fb410c780 msgr2=0x7f9fb41617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:31.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.386+0000 7f9fb9208640 1 --2- 10.20.193.28:0/1525111729 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f9fb410c780 0x7f9fb41617f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:31.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.386+0000 7f9fb9208640 1 -- 10.20.193.28:0/1525111729 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f9fb4155ba0 msgr2=0x7f9fb4166bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:31.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.386+0000 7f9fb9208640 1 --2- 10.20.193.28:0/1525111729 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f9fb4155ba0 0x7f9fb4166bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:31.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.386+0000 7f9fb9208640 1 -- 10.20.193.28:0/1525111729 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa8009570 con 0x7f9fb410be70 2026-02-24T09:16:31.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.386+0000 7f9fb9208640 1 --2- 10.20.193.28:0/1525111729 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9fb410be70 0x7f9fb41612b0 secure :-1 s=READY pgs=202 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fa400d950 tx=0x7f9fa400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:31.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.386+0000 7f9fa27fc640 1 -- 10.20.193.28:0/1525111729 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9fa4004540 con 0x7f9fb410be70 2026-02-24T09:16:31.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.386+0000 7f9fa27fc640 1 -- 10.20.193.28:0/1525111729 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f9fa4009ce0 con 0x7f9fb410be70 2026-02-24T09:16:31.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.386+0000 7f9fa27fc640 1 -- 10.20.193.28:0/1525111729 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9fa40106e0 con 0x7f9fb410be70 2026-02-24T09:16:31.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.386+0000 7f9fba20a640 1 -- 10.20.193.28:0/1525111729 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fb41677f0 con 0x7f9fb410be70 2026-02-24T09:16:31.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.386+0000 7f9fba20a640 1 -- 10.20.193.28:0/1525111729 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fb41527d0 con 0x7f9fb410be70 2026-02-24T09:16:31.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.387+0000 7f9fba20a640 1 -- 10.20.193.28:0/1525111729 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fb4167a10 con 0x7f9fb410be70 2026-02-24T09:16:31.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.389+0000 7f9fa27fc640 1 -- 10.20.193.28:0/1525111729 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 19) ==== 157139+0+0 (secure 0 0 0) 0x7f9fa40097c0 con 0x7f9fb410be70 2026-02-24T09:16:31.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.390+0000 7f9fa27fc640 1 --2- 10.20.193.28:0/1525111729 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f9f900b57b0 0x7f9f900d5c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:31.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.390+0000 7f9fa27fc640 1 -- 10.20.193.28:0/1525111729 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7038+0+0 (secure 0 0 0) 0x7f9fa40e6eb0 con 0x7f9fb410be70 2026-02-24T09:16:31.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.391+0000 7f9fa27fc640 1 -- 10.20.193.28:0/1525111729 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f9fa40e7330 con 0x7f9fb410be70 2026-02-24T09:16:31.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.391+0000 7f9fb8a07640 1 --2- 10.20.193.28:0/1525111729 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f9f900b57b0 0x7f9f900d5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:31.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.391+0000 7f9fb8a07640 1 --2- 10.20.193.28:0/1525111729 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f9f900b57b0 0x7f9f900d5c60 secure :-1 s=READY pgs=105 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fa80023d0 tx=0x7f9fa8031040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:31.496 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:31 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:31.496 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:31 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:31.496 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:31 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:31.496 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:31 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:31.497 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:16:31 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:16:31.312+0000 7f1b05ec6780 -1 osd.11 0 log_to_monitors true 2026-02-24T09:16:31.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.506+0000 7f9fba20a640 1 -- 10.20.193.28:0/1525111729 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f9fb4162410 con 0x7f9fb410be70 2026-02-24T09:16:31.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.507+0000 7f9fa27fc640 1 -- 10.20.193.28:0/1525111729 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v84) ==== 74+0+133 (secure 0 0 0) 0x7f9fa40a9d10 con 0x7f9fb410be70 2026-02-24T09:16:31.508 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:16:31.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.508+0000 7f9fba20a640 1 -- 10.20.193.28:0/1525111729 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f9f900b57b0 msgr2=0x7f9f900d5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:31.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.508+0000 7f9fba20a640 1 --2- 10.20.193.28:0/1525111729 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f9f900b57b0 0x7f9f900d5c60 secure :-1 s=READY pgs=105 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fa80023d0 tx=0x7f9fa8031040 comp rx=0 tx=0).stop 2026-02-24T09:16:31.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.508+0000 7f9fba20a640 1 -- 10.20.193.28:0/1525111729 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9fb410be70 msgr2=0x7f9fb41612b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:31.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.508+0000 7f9fba20a640 1 --2- 10.20.193.28:0/1525111729 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9fb410be70 0x7f9fb41612b0 secure :-1 s=READY pgs=202 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fa400d950 tx=0x7f9fa400de20 comp rx=0 tx=0).stop 2026-02-24T09:16:31.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.509+0000 7f9fba20a640 1 -- 10.20.193.28:0/1525111729 shutdown_connections 2026-02-24T09:16:31.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.509+0000 7f9fba20a640 1 --2- 10.20.193.28:0/1525111729 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f9f900b57b0 0x7f9f900d5c60 unknown :-1 s=CLOSED pgs=105 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:31.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.509+0000 7f9fba20a640 1 --2- 10.20.193.28:0/1525111729 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f9fb4155ba0 0x7f9fb4166bc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:31.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.509+0000 7f9fba20a640 1 --2- 10.20.193.28:0/1525111729 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f9fb410c780 0x7f9fb41617f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:31.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.509+0000 7f9fba20a640 1 --2- 10.20.193.28:0/1525111729 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9fb410be70 0x7f9fb41612b0 unknown :-1 s=CLOSED pgs=202 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:31.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.509+0000 7f9fba20a640 1 -- 10.20.193.28:0/1525111729 >> 10.20.193.28:0/1525111729 conn(0x7f9fb40e9b70 msgr2=0x7f9fb4109f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:31.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.509+0000 7f9fba20a640 1 -- 10.20.193.28:0/1525111729 shutdown_connections 2026-02-24T09:16:31.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:31.509+0000 7f9fba20a640 1 -- 10.20.193.28:0/1525111729 wait complete. 2026-02-24T09:16:31.611 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":84,"num_osds":12,"num_up_osds":11,"osd_up_since":1771924580,"num_in_osds":12,"osd_in_since":1771924580,"num_remapped_pgs":0} 2026-02-24T09:16:31.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:31 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:31.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:31 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:31.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:31 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:31.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:31 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:32.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:32 trial074 ceph-mon[44412]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 7.5 TiB / 7.5 TiB avail; 72 KiB/s, 0 objects/s recovering 2026-02-24T09:16:32.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:32 trial074 ceph-mon[44412]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-24T09:16:32.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:32 trial074 ceph-mon[44412]: from='osd.11 [v2:10.20.193.159:6824/709820718,v1:10.20.193.159:6825/709820718]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-24T09:16:32.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:32 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/1525111729' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-24T09:16:32.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:32 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:32.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:32 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:32.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:32 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:16:32.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:32 trial159 ceph-mon[44242]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 7.5 TiB / 7.5 TiB avail; 72 KiB/s, 0 objects/s recovering 2026-02-24T09:16:32.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:32 trial159 ceph-mon[44242]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-24T09:16:32.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:32 trial159 ceph-mon[44242]: from='osd.11 [v2:10.20.193.159:6824/709820718,v1:10.20.193.159:6825/709820718]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-24T09:16:32.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:32 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/1525111729' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-24T09:16:32.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:32 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:32.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:32 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:32.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:32 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:16:32.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:32 trial028 ceph-mon[40371]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 7.5 TiB / 7.5 TiB avail; 72 KiB/s, 0 objects/s recovering 2026-02-24T09:16:32.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:32 trial028 ceph-mon[40371]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-24T09:16:32.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:32 trial028 ceph-mon[40371]: from='osd.11 [v2:10.20.193.159:6824/709820718,v1:10.20.193.159:6825/709820718]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-24T09:16:32.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:32 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/1525111729' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-24T09:16:32.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:32 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:32.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:32 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:32.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:32 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:16:32.612 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd stat -f json 2026-02-24T09:16:32.796 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:16:32.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.982+0000 7ff5ee88b640 1 -- 10.20.193.28:0/1780496252 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff5e810d2d0 msgr2=0x7ff5e8111c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:32.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.982+0000 7ff5ee88b640 1 --2- 10.20.193.28:0/1780496252 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff5e810d2d0 0x7ff5e8111c10 secure :-1 s=READY pgs=203 gs=1 cs=0 l=1 c_cookie=12177651836147745416 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5dc009950 tx=0x7ff5dc02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:16:32.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.983+0000 7ff5ee88b640 1 -- 10.20.193.28:0/1780496252 shutdown_connections 2026-02-24T09:16:32.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.983+0000 7ff5ee88b640 1 --2- 10.20.193.28:0/1780496252 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff5e81123c0 0x7ff5e8172d90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:32.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.983+0000 7ff5ee88b640 1 --2- 10.20.193.28:0/1780496252 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff5e810d2d0 0x7ff5e8111c10 unknown :-1 s=CLOSED pgs=203 gs=1 cs=0 l=1 c_cookie=12177651836147745416 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:32.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.983+0000 7ff5ee88b640 1 --2- 10.20.193.28:0/1780496252 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff5e810c8e0 0x7ff5e810ccb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:32.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.983+0000 7ff5ee88b640 1 -- 10.20.193.28:0/1780496252 >> 10.20.193.28:0/1780496252 conn(0x7ff5e80e9260 msgr2=0x7ff5e8109670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:32.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.983+0000 7ff5ee88b640 1 -- 10.20.193.28:0/1780496252 shutdown_connections 2026-02-24T09:16:32.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.983+0000 7ff5ee88b640 1 -- 10.20.193.28:0/1780496252 wait complete. 2026-02-24T09:16:32.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.984+0000 7ff5ee88b640 1 Processor -- start 2026-02-24T09:16:32.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.984+0000 7ff5ee88b640 1 -- start start 2026-02-24T09:16:32.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.984+0000 7ff5ee88b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff5e810c8e0 0x7ff5e80f3ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:32.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.984+0000 7ff5ee88b640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff5e810d2d0 0x7ff5e8172c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:32.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.984+0000 7ff5ee88b640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff5e81123c0 0x7ff5e80f45f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:32.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.984+0000 7ff5ee88b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e80f9800 con 0x7ff5e810c8e0 2026-02-24T09:16:32.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.984+0000 7ff5ee88b640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e80f9970 con 0x7ff5e810d2d0 2026-02-24T09:16:32.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.984+0000 7ff5ee88b640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e80f9b30 con 0x7ff5e81123c0 2026-02-24T09:16:32.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.984+0000 7ff5ed889640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff5e810c8e0 0x7ff5e80f3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:32.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.984+0000 7ff5ed889640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff5e810c8e0 0x7ff5e80f3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58640/0 (socket says 10.20.193.28:58640) 2026-02-24T09:16:32.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.984+0000 7ff5ed889640 1 -- 10.20.193.28:0/3539693934 learned_addr learned my addr 10.20.193.28:0/3539693934 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:16:32.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.985+0000 7ff5ed088640 1 --2- 10.20.193.28:0/3539693934 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff5e810d2d0 0x7ff5e8172c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:32.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.985+0000 7ff5ee08a640 1 --2- 10.20.193.28:0/3539693934 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff5e81123c0 0x7ff5e80f45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:32.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.985+0000 7ff5ed889640 1 -- 10.20.193.28:0/3539693934 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff5e81123c0 msgr2=0x7ff5e80f45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:32.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.985+0000 7ff5ed889640 1 --2- 10.20.193.28:0/3539693934 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff5e81123c0 0x7ff5e80f45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:32.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.985+0000 7ff5ed889640 1 -- 10.20.193.28:0/3539693934 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff5e810d2d0 msgr2=0x7ff5e8172c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:32.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.985+0000 7ff5ed889640 1 --2- 10.20.193.28:0/3539693934 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff5e810d2d0 0x7ff5e8172c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:32.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.985+0000 7ff5ed889640 1 -- 10.20.193.28:0/3539693934 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5dc009570 con 0x7ff5e810c8e0 2026-02-24T09:16:32.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.985+0000 7ff5ed889640 1 --2- 10.20.193.28:0/3539693934 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff5e810c8e0 0x7ff5e80f3ef0 secure :-1 s=READY pgs=204 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5d800d950 tx=0x7ff5d800de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:32.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.985+0000 7ff5d6ffd640 1 -- 10.20.193.28:0/3539693934 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff5d8004540 con 0x7ff5e810c8e0 2026-02-24T09:16:32.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.985+0000 7ff5d6ffd640 1 -- 10.20.193.28:0/3539693934 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff5d8009ce0 con 0x7ff5e810c8e0 2026-02-24T09:16:32.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.985+0000 7ff5d6ffd640 1 -- 10.20.193.28:0/3539693934 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff5d80106e0 con 0x7ff5e810c8e0 2026-02-24T09:16:32.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.985+0000 7ff5ee88b640 1 -- 10.20.193.28:0/3539693934 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5e80f9e10 con 0x7ff5e810c8e0 2026-02-24T09:16:32.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.985+0000 7ff5ee88b640 1 -- 10.20.193.28:0/3539693934 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5e80fa290 con 0x7ff5e810c8e0 2026-02-24T09:16:32.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.986+0000 7ff5ee88b640 1 -- 10.20.193.28:0/3539693934 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5e805fb10 con 0x7ff5e810c8e0 2026-02-24T09:16:32.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.988+0000 7ff5d6ffd640 1 -- 10.20.193.28:0/3539693934 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 19) ==== 157139+0+0 (secure 0 0 0) 0x7ff5d80097c0 con 0x7ff5e810c8e0 2026-02-24T09:16:32.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.989+0000 7ff5d6ffd640 1 --2- 10.20.193.28:0/3539693934 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff5c40b5720 0x7ff5c40d5bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:32.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.989+0000 7ff5d6ffd640 1 -- 10.20.193.28:0/3539693934 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7038+0+0 (secure 0 0 0) 0x7ff5d80e6f70 con 0x7ff5e810c8e0 2026-02-24T09:16:32.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.990+0000 7ff5d6ffd640 1 -- 10.20.193.28:0/3539693934 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7ff5d80e73f0 con 0x7ff5e810c8e0 2026-02-24T09:16:32.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.990+0000 7ff5ed088640 1 --2- 10.20.193.28:0/3539693934 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff5c40b5720 0x7ff5c40d5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:32.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:32.990+0000 7ff5ed088640 1 --2- 10.20.193.28:0/3539693934 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff5c40b5720 0x7ff5c40d5bd0 secure :-1 s=READY pgs=106 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5dc0023d0 tx=0x7ff5dc031040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:33.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:33.104+0000 7ff5ee88b640 1 -- 10.20.193.28:0/3539693934 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7ff5e80f5050 con 0x7ff5e810c8e0 2026-02-24T09:16:33.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:33.105+0000 7ff5d6ffd640 1 -- 10.20.193.28:0/3539693934 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v85) ==== 74+0+133 (secure 0 0 0) 0x7ff5d80a9dd0 con 0x7ff5e810c8e0 2026-02-24T09:16:33.106 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:16:33.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:33.106+0000 7ff5ee88b640 1 -- 10.20.193.28:0/3539693934 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff5c40b5720 msgr2=0x7ff5c40d5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:33.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:33.106+0000 7ff5ee88b640 1 --2- 10.20.193.28:0/3539693934 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff5c40b5720 0x7ff5c40d5bd0 secure :-1 s=READY pgs=106 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5dc0023d0 tx=0x7ff5dc031040 comp rx=0 tx=0).stop 2026-02-24T09:16:33.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:33.106+0000 7ff5ee88b640 1 -- 10.20.193.28:0/3539693934 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff5e810c8e0 msgr2=0x7ff5e80f3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:33.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:33.106+0000 7ff5ee88b640 1 --2- 10.20.193.28:0/3539693934 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff5e810c8e0 0x7ff5e80f3ef0 secure :-1 s=READY pgs=204 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5d800d950 tx=0x7ff5d800de20 comp rx=0 tx=0).stop 2026-02-24T09:16:33.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:33.106+0000 7ff5ee88b640 1 -- 10.20.193.28:0/3539693934 shutdown_connections 2026-02-24T09:16:33.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:33.106+0000 7ff5ee88b640 1 --2- 10.20.193.28:0/3539693934 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff5c40b5720 0x7ff5c40d5bd0 unknown :-1 s=CLOSED pgs=106 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:33.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:33.106+0000 7ff5ee88b640 1 --2- 10.20.193.28:0/3539693934 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff5e81123c0 0x7ff5e80f45f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:33.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:33.106+0000 7ff5ee88b640 1 --2- 10.20.193.28:0/3539693934 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff5e810d2d0 0x7ff5e8172c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:33.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:33.106+0000 7ff5ee88b640 1 --2- 10.20.193.28:0/3539693934 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff5e810c8e0 0x7ff5e80f3ef0 unknown :-1 s=CLOSED pgs=204 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:33.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:33.106+0000 7ff5ee88b640 1 -- 10.20.193.28:0/3539693934 >> 10.20.193.28:0/3539693934 conn(0x7ff5e80e9260 msgr2=0x7ff5e8109e20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:33.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:33.106+0000 7ff5ee88b640 1 -- 10.20.193.28:0/3539693934 shutdown_connections 2026-02-24T09:16:33.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:33.106+0000 7ff5ee88b640 1 -- 10.20.193.28:0/3539693934 wait complete. 2026-02-24T09:16:33.209 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":85,"num_osds":12,"num_up_osds":11,"osd_up_since":1771924580,"num_in_osds":12,"osd_in_since":1771924580,"num_remapped_pgs":0} 2026-02-24T09:16:33.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:33 trial074 ceph-mon[44412]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-24T09:16:33.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:33 trial074 ceph-mon[44412]: osdmap e85: 12 total, 11 up, 12 in 2026-02-24T09:16:33.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:33 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:16:33.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:33 trial074 ceph-mon[44412]: from='osd.11 [v2:10.20.193.159:6824/709820718,v1:10.20.193.159:6825/709820718]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial159", "root=default"]} : dispatch 2026-02-24T09:16:33.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:33 trial074 ceph-mon[44412]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial159", "root=default"]} : dispatch 2026-02-24T09:16:33.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:33 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:33.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:33 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:33.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:33 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:33.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:33 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:33.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:33 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/3539693934' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-24T09:16:33.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:33 trial159 ceph-mon[44242]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-24T09:16:33.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:33 trial159 ceph-mon[44242]: osdmap e85: 12 total, 11 up, 12 in 2026-02-24T09:16:33.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:33 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:16:33.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:33 trial159 ceph-mon[44242]: from='osd.11 [v2:10.20.193.159:6824/709820718,v1:10.20.193.159:6825/709820718]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial159", "root=default"]} : dispatch 2026-02-24T09:16:33.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:33 trial159 ceph-mon[44242]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial159", "root=default"]} : dispatch 2026-02-24T09:16:33.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:33 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:33.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:33 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:33.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:33 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:33.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:33 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:33.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:33 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/3539693934' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-24T09:16:33.531 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:16:33 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:16:33.229+0000 7f1b01e48640 -1 osd.11 0 waiting for initial osdmap 2026-02-24T09:16:33.532 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:16:33 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:16:33.242+0000 7f1af9d07640 -1 osd.11 86 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T09:16:33.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:33 trial028 ceph-mon[40371]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-24T09:16:33.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:33 trial028 ceph-mon[40371]: osdmap e85: 12 total, 11 up, 12 in 2026-02-24T09:16:33.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:33 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:16:33.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:33 trial028 ceph-mon[40371]: from='osd.11 [v2:10.20.193.159:6824/709820718,v1:10.20.193.159:6825/709820718]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial159", "root=default"]} : dispatch 2026-02-24T09:16:33.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:33 trial028 ceph-mon[40371]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial159", "root=default"]} : dispatch 2026-02-24T09:16:33.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:33 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:33.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:33 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:33.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:33 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:33.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:33 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:33.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:33 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/3539693934' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-24T09:16:34.210 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd stat -f json 2026-02-24T09:16:34.394 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:16:34.432 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:34 trial159 ceph-mon[44242]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial159", "root=default"]}]': finished 2026-02-24T09:16:34.432 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:34 trial159 ceph-mon[44242]: osdmap e86: 12 total, 11 up, 12 in 2026-02-24T09:16:34.432 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:34 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:16:34.432 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:34 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:16:34.432 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:34 trial159 ceph-mon[44242]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-24T09:16:34.432 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:34 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:34.433 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:34 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:34.433 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:34 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:34.433 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:34 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:34.433 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:34 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:34.433 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:34 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:34.433 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:34 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:34.433 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:34 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:34.433 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:34 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:34.433 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:34 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:34.433 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:34 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:34.433 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:34 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:34.433 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:34 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:16:34.434 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:34 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:34.434 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:34 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:16:34.434 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:34 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:16:34.434 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:34 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:34.477 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:34 trial028 ceph-mon[40371]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial159", "root=default"]}]': finished 2026-02-24T09:16:34.477 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:34 trial028 ceph-mon[40371]: osdmap e86: 12 total, 11 up, 12 in 2026-02-24T09:16:34.477 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:34 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:16:34.477 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:34 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:16:34.477 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:34 trial028 ceph-mon[40371]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-24T09:16:34.477 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:34 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:34.478 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:34 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:34.478 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:34 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:34.478 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:34 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:34.478 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:34 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:34.478 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:34 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:34.478 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:34 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:34.478 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:34 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:34.478 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:34 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:34.478 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:34 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:34.478 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:34 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:34.478 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:34 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:34.478 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:34 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:16:34.478 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:34 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:34.478 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:34 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:16:34.478 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:34 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:16:34.478 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:34 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:34.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.570+0000 7f742bfff640 1 -- 10.20.193.28:0/3929655016 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f742c10b2d0 msgr2=0x7f742c10b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:34.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.570+0000 7f742bfff640 1 --2- 10.20.193.28:0/3929655016 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f742c10b2d0 0x7f742c10b6a0 secure :-1 s=READY pgs=205 gs=1 cs=0 l=1 c_cookie=16868947865348241814 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7420009950 tx=0x7f742002f190 comp rx=0 tx=0).stop 2026-02-24T09:16:34.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.570+0000 7f742bfff640 1 -- 10.20.193.28:0/3929655016 shutdown_connections 2026-02-24T09:16:34.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.570+0000 7f742bfff640 1 --2- 10.20.193.28:0/3929655016 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f742c1112e0 0x7f742c111cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:34.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.570+0000 7f742bfff640 1 --2- 10.20.193.28:0/3929655016 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f742c10bcc0 0x7f742c110b50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:34.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.570+0000 7f742bfff640 1 --2- 10.20.193.28:0/3929655016 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f742c10b2d0 0x7f742c10b6a0 unknown :-1 s=CLOSED pgs=205 gs=1 cs=0 l=1 c_cookie=16868947865348241814 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:34.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.570+0000 7f742bfff640 1 -- 10.20.193.28:0/3929655016 >> 10.20.193.28:0/3929655016 conn(0x7f742c0e8e40 msgr2=0x7f742c109250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:34.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.570+0000 7f742bfff640 1 -- 10.20.193.28:0/3929655016 shutdown_connections 2026-02-24T09:16:34.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.571+0000 7f742bfff640 1 -- 10.20.193.28:0/3929655016 wait complete. 2026-02-24T09:16:34.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.571+0000 7f742bfff640 1 Processor -- start 2026-02-24T09:16:34.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.571+0000 7f742bfff640 1 -- start start 2026-02-24T09:16:34.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.572+0000 7f742bfff640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f742c10b2d0 0x7f742c123510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:34.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.572+0000 7f742bfff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f742c10bcc0 0x7f742c123a50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:34.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.572+0000 7f742bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f742c1112e0 0x7f742c128e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:34.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.572+0000 7f742bfff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f742c129440 con 0x7f742c1112e0 2026-02-24T09:16:34.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.572+0000 7f742bfff640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f742c1295b0 con 0x7f742c10bcc0 2026-02-24T09:16:34.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.572+0000 7f742bfff640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f742c129770 con 0x7f742c10b2d0 2026-02-24T09:16:34.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.572+0000 7f742b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f742c1112e0 0x7f742c128e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:34.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.572+0000 7f742b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f742c1112e0 0x7f742c128e20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58662/0 (socket says 10.20.193.28:58662) 2026-02-24T09:16:34.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.572+0000 7f742b7fe640 1 -- 10.20.193.28:0/2509012334 learned_addr learned my addr 10.20.193.28:0/2509012334 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:16:34.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.572+0000 7f742affd640 1 --2- 10.20.193.28:0/2509012334 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f742c10b2d0 0x7f742c123510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:34.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.572+0000 7f742b7fe640 1 -- 10.20.193.28:0/2509012334 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f742c10b2d0 msgr2=0x7f742c123510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:34.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.572+0000 7f742b7fe640 1 --2- 10.20.193.28:0/2509012334 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f742c10b2d0 0x7f742c123510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:34.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.572+0000 7f742b7fe640 1 -- 10.20.193.28:0/2509012334 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f742c10bcc0 msgr2=0x7f742c123a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:34.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.572+0000 7f742b7fe640 1 --2- 10.20.193.28:0/2509012334 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f742c10bcc0 0x7f742c123a50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:34.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.572+0000 7f742b7fe640 1 -- 10.20.193.28:0/2509012334 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7420009570 con 0x7f742c1112e0 2026-02-24T09:16:34.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.572+0000 7f742b7fe640 1 --2- 10.20.193.28:0/2509012334 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f742c1112e0 0x7f742c128e20 secure :-1 s=READY pgs=206 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f741c00c750 tx=0x7f741c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:34.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.572+0000 7f740bfff640 1 -- 10.20.193.28:0/2509012334 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f741c005500 con 0x7f742c1112e0 2026-02-24T09:16:34.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.572+0000 7f740bfff640 1 -- 10.20.193.28:0/2509012334 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f741c003c40 con 0x7f742c1112e0 2026-02-24T09:16:34.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.572+0000 7f740bfff640 1 -- 10.20.193.28:0/2509012334 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f741c00dd40 con 0x7f742c1112e0 2026-02-24T09:16:34.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.572+0000 7f742bfff640 1 -- 10.20.193.28:0/2509012334 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f742c129a50 con 0x7f742c1112e0 2026-02-24T09:16:34.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.573+0000 7f742bfff640 1 -- 10.20.193.28:0/2509012334 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f742c16a150 con 0x7f742c1112e0 2026-02-24T09:16:34.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.573+0000 7f7409ffb640 1 -- 10.20.193.28:0/2509012334 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f742c129c70 con 0x7f742c1112e0 2026-02-24T09:16:34.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.576+0000 7f740bfff640 1 -- 10.20.193.28:0/2509012334 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 19) ==== 157139+0+0 (secure 0 0 0) 0x7f741c003780 con 0x7f742c1112e0 2026-02-24T09:16:34.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.577+0000 7f740bfff640 1 --2- 10.20.193.28:0/2509012334 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f74000b57b0 0x7f74000d5c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:34.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.577+0000 7f740bfff640 1 -- 10.20.193.28:0/2509012334 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 7334+0+0 (secure 0 0 0) 0x7f741c0e6c60 con 0x7f742c1112e0 2026-02-24T09:16:34.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.577+0000 7f742affd640 1 --2- 10.20.193.28:0/2509012334 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f74000b57b0 0x7f74000d5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:34.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.577+0000 7f740bfff640 1 -- 10.20.193.28:0/2509012334 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f741c0e7150 con 0x7f742c1112e0 2026-02-24T09:16:34.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.578+0000 7f742affd640 1 --2- 10.20.193.28:0/2509012334 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f74000b57b0 0x7f74000d5c60 secure :-1 s=READY pgs=109 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74200023d0 tx=0x7f7420031040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:34.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:34 trial074 ceph-mon[44412]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial159", "root=default"]}]': finished 2026-02-24T09:16:34.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:34 trial074 ceph-mon[44412]: osdmap e86: 12 total, 11 up, 12 in 2026-02-24T09:16:34.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:34 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:16:34.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:34 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:16:34.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:34 trial074 ceph-mon[44412]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-24T09:16:34.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:34 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:34.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:34 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:34.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:34 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:34.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:34 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:34.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:34 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:34.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:34 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:34.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:34 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:34.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:34 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:34.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:34 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:34.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:34 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-24T09:16:34.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:34 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:34.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:34 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:34.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:34 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:16:34.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:34 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:34.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:34 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:16:34.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:34 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:16:34.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:34 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:34.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.692+0000 7f7409ffb640 1 -- 10.20.193.28:0/2509012334 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f742c10c3f0 con 0x7f742c1112e0 2026-02-24T09:16:34.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.693+0000 7f740bfff640 1 -- 10.20.193.28:0/2509012334 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v87) ==== 74+0+133 (secure 0 0 0) 0x7f741c0a99d0 con 0x7f742c1112e0 2026-02-24T09:16:34.694 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:16:34.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.694+0000 7f7409ffb640 1 -- 10.20.193.28:0/2509012334 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f74000b57b0 msgr2=0x7f74000d5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:34.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.694+0000 7f7409ffb640 1 --2- 10.20.193.28:0/2509012334 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f74000b57b0 0x7f74000d5c60 secure :-1 s=READY pgs=109 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74200023d0 tx=0x7f7420031040 comp rx=0 tx=0).stop 2026-02-24T09:16:34.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.694+0000 7f7409ffb640 1 -- 10.20.193.28:0/2509012334 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f742c1112e0 msgr2=0x7f742c128e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:34.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.694+0000 7f7409ffb640 1 --2- 10.20.193.28:0/2509012334 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f742c1112e0 0x7f742c128e20 secure :-1 s=READY pgs=206 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f741c00c750 tx=0x7f741c00cc20 comp rx=0 tx=0).stop 2026-02-24T09:16:34.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.694+0000 7f7409ffb640 1 -- 10.20.193.28:0/2509012334 shutdown_connections 2026-02-24T09:16:34.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.694+0000 7f7409ffb640 1 --2- 10.20.193.28:0/2509012334 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f74000b57b0 0x7f74000d5c60 unknown :-1 s=CLOSED pgs=109 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:34.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.694+0000 7f7409ffb640 1 --2- 10.20.193.28:0/2509012334 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f742c1112e0 0x7f742c128e20 unknown :-1 s=CLOSED pgs=206 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:34.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.694+0000 7f7409ffb640 1 --2- 10.20.193.28:0/2509012334 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f742c10bcc0 0x7f742c123a50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:34.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.694+0000 7f7409ffb640 1 --2- 10.20.193.28:0/2509012334 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f742c10b2d0 0x7f742c123510 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:34.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.694+0000 7f7409ffb640 1 -- 10.20.193.28:0/2509012334 >> 10.20.193.28:0/2509012334 conn(0x7f742c0e8e40 msgr2=0x7f742c109220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:34.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.694+0000 7f7409ffb640 1 -- 10.20.193.28:0/2509012334 shutdown_connections 2026-02-24T09:16:34.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:34.694+0000 7f7409ffb640 1 -- 10.20.193.28:0/2509012334 wait complete. 2026-02-24T09:16:34.792 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":87,"num_osds":12,"num_up_osds":12,"osd_up_since":1771924594,"num_in_osds":12,"osd_in_since":1771924580,"num_remapped_pgs":0} 2026-02-24T09:16:34.793 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T09:16:34.976 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:16:35.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.142+0000 7f5629d0b640 1 -- 10.20.193.28:0/1043539271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56241158b0 msgr2=0x7f5624176280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:35.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.142+0000 7f5629d0b640 1 --2- 10.20.193.28:0/1043539271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56241158b0 0x7f5624176280 secure :-1 s=READY pgs=207 gs=1 cs=0 l=1 c_cookie=14490088046491432179 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f561800aa30 tx=0x7f5618030270 comp rx=0 tx=0).stop 2026-02-24T09:16:35.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.142+0000 7f5629d0b640 1 -- 10.20.193.28:0/1043539271 shutdown_connections 2026-02-24T09:16:35.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.142+0000 7f5629d0b640 1 --2- 10.20.193.28:0/1043539271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56241158b0 0x7f5624176280 unknown :-1 s=CLOSED pgs=207 gs=1 cs=0 l=1 c_cookie=14490088046491432179 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:35.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.142+0000 7f5629d0b640 1 --2- 10.20.193.28:0/1043539271 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f56241100b0 0x7f5624115100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:35.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.142+0000 7f5629d0b640 1 --2- 10.20.193.28:0/1043539271 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f562410f6c0 0x7f562410fa90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:35.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.142+0000 7f5629d0b640 1 -- 10.20.193.28:0/1043539271 >> 10.20.193.28:0/1043539271 conn(0x7f56240ecfd0 msgr2=0x7f562410d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:35.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.142+0000 7f5629d0b640 1 -- 10.20.193.28:0/1043539271 shutdown_connections 2026-02-24T09:16:35.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.142+0000 7f5629d0b640 1 -- 10.20.193.28:0/1043539271 wait complete. 2026-02-24T09:16:35.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.143+0000 7f5629d0b640 1 Processor -- start 2026-02-24T09:16:35.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.143+0000 7f5629d0b640 1 -- start start 2026-02-24T09:16:35.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.143+0000 7f5629d0b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f562410f6c0 0x7f56240f59f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:35.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.143+0000 7f5629d0b640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f56241100b0 0x7f5624176180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:35.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.143+0000 7f5629d0b640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f56241158b0 0x7f56240f60f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:35.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.143+0000 7f5629d0b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f56240fb300 con 0x7f562410f6c0 2026-02-24T09:16:35.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.143+0000 7f5629d0b640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f56240fb470 con 0x7f56241100b0 2026-02-24T09:16:35.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.143+0000 7f5629d0b640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f56240fb630 con 0x7f56241158b0 2026-02-24T09:16:35.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.143+0000 7f56237fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f562410f6c0 0x7f56240f59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:35.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.143+0000 7f56237fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f562410f6c0 0x7f56240f59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58676/0 (socket says 10.20.193.28:58676) 2026-02-24T09:16:35.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.143+0000 7f56237fe640 1 -- 10.20.193.28:0/567485245 learned_addr learned my addr 10.20.193.28:0/567485245 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:16:35.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.143+0000 7f5622ffd640 1 --2- 10.20.193.28:0/567485245 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f56241100b0 0x7f5624176180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:35.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.143+0000 7f5623fff640 1 --2- 10.20.193.28:0/567485245 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f56241158b0 0x7f56240f60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:35.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.144+0000 7f56237fe640 1 -- 10.20.193.28:0/567485245 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f56241158b0 msgr2=0x7f56240f60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:35.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.144+0000 7f56237fe640 1 --2- 10.20.193.28:0/567485245 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f56241158b0 0x7f56240f60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:35.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.144+0000 7f56237fe640 1 -- 10.20.193.28:0/567485245 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f56241100b0 msgr2=0x7f5624176180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:35.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.144+0000 7f56237fe640 1 --2- 10.20.193.28:0/567485245 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f56241100b0 0x7f5624176180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:35.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.144+0000 7f56237fe640 1 -- 10.20.193.28:0/567485245 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f561800a650 con 0x7f562410f6c0 2026-02-24T09:16:35.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.144+0000 7f56237fe640 1 --2- 10.20.193.28:0/567485245 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f562410f6c0 0x7f56240f59f0 secure :-1 s=READY pgs=208 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f561000d950 tx=0x7f561000de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:35.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.144+0000 7f5620ff9640 1 -- 10.20.193.28:0/567485245 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5610004540 con 0x7f562410f6c0 2026-02-24T09:16:35.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.144+0000 7f5620ff9640 1 -- 10.20.193.28:0/567485245 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f5610009ce0 con 0x7f562410f6c0 2026-02-24T09:16:35.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.144+0000 7f5620ff9640 1 -- 10.20.193.28:0/567485245 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56100106e0 con 0x7f562410f6c0 2026-02-24T09:16:35.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.144+0000 7f5629d0b640 1 -- 10.20.193.28:0/567485245 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56240fb910 con 0x7f562410f6c0 2026-02-24T09:16:35.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.144+0000 7f5629d0b640 1 -- 10.20.193.28:0/567485245 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56240fbd90 con 0x7f562410f6c0 2026-02-24T09:16:35.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.145+0000 7f5629d0b640 1 -- 10.20.193.28:0/567485245 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55ec005300 con 0x7f562410f6c0 2026-02-24T09:16:35.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.147+0000 7f5620ff9640 1 -- 10.20.193.28:0/567485245 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 19) ==== 157139+0+0 (secure 0 0 0) 0x7f56100097c0 con 0x7f562410f6c0 2026-02-24T09:16:35.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.149+0000 7f5620ff9640 1 --2- 10.20.193.28:0/567485245 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f55f80b57b0 0x7f55f80d5c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:35.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.149+0000 7f5620ff9640 1 -- 10.20.193.28:0/567485245 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 7334+0+0 (secure 0 0 0) 0x7f56100e6f30 con 0x7f562410f6c0 2026-02-24T09:16:35.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.149+0000 7f5620ff9640 1 -- 10.20.193.28:0/567485245 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f56100e7420 con 0x7f562410f6c0 2026-02-24T09:16:35.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.149+0000 7f5622ffd640 1 --2- 10.20.193.28:0/567485245 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f55f80b57b0 0x7f55f80d5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:35.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.149+0000 7f5622ffd640 1 --2- 10.20.193.28:0/567485245 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f55f80b57b0 0x7f55f80d5c60 secure :-1 s=READY pgs=110 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56240fc390 tx=0x7f5614005f70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:35.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.264+0000 7f5629d0b640 1 -- 10.20.193.28:0/567485245 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f55ec005880 con 0x7f562410f6c0 2026-02-24T09:16:35.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.265+0000 7f5620ff9640 1 -- 10.20.193.28:0/567485245 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+18771 (secure 0 0 0) 0x7f56100a9ca0 con 0x7f562410f6c0 2026-02-24T09:16:35.266 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:16:35.267 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":88,"fsid":"e9ad50af-1160-11f1-800e-d404e6e7d460","created":"2026-02-24T09:12:33.966733+0000","modified":"2026-02-24T09:16:35.225652+0000","last_up_change":"2026-02-24T09:16:34.222008+0000","last_in_change":"2026-02-24T09:16:20.530109+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":38,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T09:14:33.468078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7836f68-f25a-4aea-830a-3c2ce8ac79e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6803","nonce":2124354447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6805","nonce":2124354447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6809","nonce":2124354447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6807","nonce":2124354447}]},"public_addr":"10.20.193.28:6803/2124354447","cluster_addr":"10.20.193.28:6805/2124354447","heartbeat_back_addr":"10.20.193.28:6809/2124354447","heartbeat_front_addr":"10.20.193.28:6807/2124354447","state":["exists","up"]},{"osd":1,"uuid":"04273ff8-91e3-4e70-8041-cc8c205b9a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6800","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6801","nonce":267363486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6802","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6803","nonce":267363486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6806","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6807","nonce":267363486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6804","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6805","nonce":267363486}]},"public_addr":"10.20.193.74:6801/267363486","cluster_addr":"10.20.193.74:6803/267363486","heartbeat_back_addr":"10.20.193.74:6807/267363486","heartbeat_front_addr":"10.20.193.74:6805/267363486","state":["exists","up"]},{"osd":2,"uuid":"dea96db1-588b-4d08-8e52-52c4c995bdc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6800","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6801","nonce":3320466721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6802","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6803","nonce":3320466721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6806","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6807","nonce":3320466721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6804","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6805","nonce":3320466721}]},"public_addr":"10.20.193.159:6801/3320466721","cluster_addr":"10.20.193.159:6803/3320466721","heartbeat_back_addr":"10.20.193.159:6807/3320466721","heartbeat_front_addr":"10.20.193.159:6805/3320466721","state":["exists","up"]},{"osd":3,"uuid":"c785c244-eb3f-4af5-83c6-cd492459f75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6811","nonce":1790609615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6813","nonce":1790609615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6817","nonce":1790609615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6815","nonce":1790609615}]},"public_addr":"10.20.193.28:6811/1790609615","cluster_addr":"10.20.193.28:6813/1790609615","heartbeat_back_addr":"10.20.193.28:6817/1790609615","heartbeat_front_addr":"10.20.193.28:6815/1790609615","state":["exists","up"]},{"osd":4,"uuid":"041239c2-6187-4154-9557-b1b5846f9e0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6808","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6809","nonce":610990618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6810","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6811","nonce":610990618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6814","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6815","nonce":610990618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6812","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6813","nonce":610990618}]},"public_addr":"10.20.193.74:6809/610990618","cluster_addr":"10.20.193.74:6811/610990618","heartbeat_back_addr":"10.20.193.74:6815/610990618","heartbeat_front_addr":"10.20.193.74:6813/610990618","state":["exists","up"]},{"osd":5,"uuid":"ffeeb021-0924-4421-aecf-bac2e74364a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6808","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6809","nonce":1653417923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6810","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6811","nonce":1653417923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6814","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6815","nonce":1653417923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6812","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6813","nonce":1653417923}]},"public_addr":"10.20.193.159:6809/1653417923","cluster_addr":"10.20.193.159:6811/1653417923","heartbeat_back_addr":"10.20.193.159:6815/1653417923","heartbeat_front_addr":"10.20.193.159:6813/1653417923","state":["exists","up"]},{"osd":6,"uuid":"f3736156-4951-4901-9323-7930fb73b8dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6819","nonce":1891043856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6821","nonce":1891043856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6825","nonce":1891043856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6823","nonce":1891043856}]},"public_addr":"10.20.193.28:6819/1891043856","cluster_addr":"10.20.193.28:6821/1891043856","heartbeat_back_addr":"10.20.193.28:6825/1891043856","heartbeat_front_addr":"10.20.193.28:6823/1891043856","state":["exists","up"]},{"osd":7,"uuid":"214b27ee-75f9-4a54-a59b-e8bfbb895903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6816","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6817","nonce":2328869739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6818","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6819","nonce":2328869739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6822","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6823","nonce":2328869739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6820","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6821","nonce":2328869739}]},"public_addr":"10.20.193.74:6817/2328869739","cluster_addr":"10.20.193.74:6819/2328869739","heartbeat_back_addr":"10.20.193.74:6823/2328869739","heartbeat_front_addr":"10.20.193.74:6821/2328869739","state":["exists","up"]},{"osd":8,"uuid":"76599c26-6778-4fa2-b85d-feea8baac7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6816","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6817","nonce":3877834753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6818","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6819","nonce":3877834753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6822","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6823","nonce":3877834753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6820","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6821","nonce":3877834753}]},"public_addr":"10.20.193.159:6817/3877834753","cluster_addr":"10.20.193.159:6819/3877834753","heartbeat_back_addr":"10.20.193.159:6823/3877834753","heartbeat_front_addr":"10.20.193.159:6821/3877834753","state":["exists","up"]},{"osd":9,"uuid":"52b52b35-2d65-4e53-b7d8-fd7385d5ae88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6827","nonce":4207785690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6829","nonce":4207785690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6833","nonce":4207785690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6831","nonce":4207785690}]},"public_addr":"10.20.193.28:6827/4207785690","cluster_addr":"10.20.193.28:6829/4207785690","heartbeat_back_addr":"10.20.193.28:6833/4207785690","heartbeat_front_addr":"10.20.193.28:6831/4207785690","state":["exists","up"]},{"osd":10,"uuid":"65c8e576-a1c7-4c03-bbf6-57c775f2860f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6824","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6825","nonce":2590408209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6826","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6827","nonce":2590408209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6830","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6831","nonce":2590408209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6828","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6829","nonce":2590408209}]},"public_addr":"10.20.193.74:6825/2590408209","cluster_addr":"10.20.193.74:6827/2590408209","heartbeat_back_addr":"10.20.193.74:6831/2590408209","heartbeat_front_addr":"10.20.193.74:6829/2590408209","state":["exists","up"]},{"osd":11,"uuid":"e2305377-fadb-4cf0-8384-87387f116255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":87,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6824","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6825","nonce":709820718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6826","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6827","nonce":709820718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6830","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6831","nonce":709820718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6828","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6829","nonce":709820718}]},"public_addr":"10.20.193.159:6825/709820718","cluster_addr":"10.20.193.159:6827/709820718","heartbeat_back_addr":"10.20.193.159:6831/709820718","heartbeat_front_addr":"10.20.193.159:6829/709820718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:02.414561+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:16.784172+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:30.639920+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:44.510387+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:58.186053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:11.714819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:25.188981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:38.602303+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:51.899864+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:16:05.444224+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:16:18.900719+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:16:32.290361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:0/3696280830":"2026-02-25T09:13:39.242729+0000","10.20.193.28:6801/3539300247":"2026-02-25T09:13:39.242729+0000","10.20.193.28:0/3799405177":"2026-02-25T09:12:46.171932+0000","10.20.193.28:0/1189576634":"2026-02-25T09:12:46.171932+0000","10.20.193.28:6800/1682009277":"2026-02-25T09:12:46.171932+0000","10.20.193.28:6800/3539300247":"2026-02-25T09:13:39.242729+0000","10.20.193.28:6801/1682009277":"2026-02-25T09:12:46.171932+0000","10.20.193.28:0/673213915":"2026-02-25T09:12:59.028609+0000","10.20.193.28:0/857248143":"2026-02-25T09:13:39.242729+0000","10.20.193.28:0/1541006046":"2026-02-25T09:12:46.171932+0000","10.20.193.28:0/264576041":"2026-02-25T09:12:59.028609+0000","10.20.193.28:6800/2303472235":"2026-02-25T09:12:59.028609+0000","10.20.193.28:6801/2303472235":"2026-02-25T09:12:59.028609+0000","10.20.193.28:0/2622827224":"2026-02-25T09:12:59.028609+0000","10.20.193.28:0/3614117448":"2026-02-25T09:13:39.242729+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T09:16:35.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.266+0000 7f5629d0b640 1 -- 10.20.193.28:0/567485245 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f55f80b57b0 msgr2=0x7f55f80d5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:35.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.266+0000 7f5629d0b640 1 --2- 10.20.193.28:0/567485245 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f55f80b57b0 0x7f55f80d5c60 secure :-1 s=READY pgs=110 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56240fc390 tx=0x7f5614005f70 comp rx=0 tx=0).stop 2026-02-24T09:16:35.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.266+0000 7f5629d0b640 1 -- 10.20.193.28:0/567485245 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f562410f6c0 msgr2=0x7f56240f59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:35.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.266+0000 7f5629d0b640 1 --2- 10.20.193.28:0/567485245 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f562410f6c0 0x7f56240f59f0 secure :-1 s=READY pgs=208 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f561000d950 tx=0x7f561000de20 comp rx=0 tx=0).stop 2026-02-24T09:16:35.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.266+0000 7f5629d0b640 1 -- 10.20.193.28:0/567485245 shutdown_connections 2026-02-24T09:16:35.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.266+0000 7f5629d0b640 1 --2- 10.20.193.28:0/567485245 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f55f80b57b0 0x7f55f80d5c60 unknown :-1 s=CLOSED pgs=110 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:35.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.266+0000 7f5629d0b640 1 --2- 10.20.193.28:0/567485245 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f56241158b0 0x7f56240f60f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:35.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.266+0000 7f5629d0b640 1 --2- 10.20.193.28:0/567485245 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f56241100b0 0x7f5624176180 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:35.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.266+0000 7f5629d0b640 1 --2- 10.20.193.28:0/567485245 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f562410f6c0 0x7f56240f59f0 unknown :-1 s=CLOSED pgs=208 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:35.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.266+0000 7f5629d0b640 1 -- 10.20.193.28:0/567485245 >> 10.20.193.28:0/567485245 conn(0x7f56240ecfd0 msgr2=0x7f562410db90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:35.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.266+0000 7f5629d0b640 1 -- 10.20.193.28:0/567485245 shutdown_connections 2026-02-24T09:16:35.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.266+0000 7f5629d0b640 1 -- 10.20.193.28:0/567485245 wait complete. 2026-02-24T09:16:35.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:35 trial028 ceph-mon[40371]: purged_snaps scrub starts 2026-02-24T09:16:35.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:35 trial028 ceph-mon[40371]: purged_snaps scrub ok 2026-02-24T09:16:35.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:35 trial028 ceph-mon[40371]: Detected new or changed devices on trial159 2026-02-24T09:16:35.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:35 trial028 ceph-mon[40371]: Adjusting osd_memory_target on trial159 to 21013M 2026-02-24T09:16:35.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:35 trial028 ceph-mon[40371]: osd.11 [v2:10.20.193.159:6824/709820718,v1:10.20.193.159:6825/709820718] boot 2026-02-24T09:16:35.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:35 trial028 ceph-mon[40371]: osdmap e87: 12 total, 12 up, 12 in 2026-02-24T09:16:35.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:35 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:16:35.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:35 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/2509012334' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-24T09:16:35.326 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:35 trial159 ceph-mon[44242]: purged_snaps scrub starts 2026-02-24T09:16:35.326 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:35 trial159 ceph-mon[44242]: purged_snaps scrub ok 2026-02-24T09:16:35.326 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:35 trial159 ceph-mon[44242]: Detected new or changed devices on trial159 2026-02-24T09:16:35.326 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:35 trial159 ceph-mon[44242]: Adjusting osd_memory_target on trial159 to 21013M 2026-02-24T09:16:35.326 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:35 trial159 ceph-mon[44242]: osd.11 [v2:10.20.193.159:6824/709820718,v1:10.20.193.159:6825/709820718] boot 2026-02-24T09:16:35.326 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:35 trial159 ceph-mon[44242]: osdmap e87: 12 total, 12 up, 12 in 2026-02-24T09:16:35.327 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:35 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:16:35.327 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:35 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/2509012334' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-24T09:16:35.367 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-24T09:14:33.468078+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-24T09:16:35.368 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd pool get .mgr pg_num 2026-02-24T09:16:35.546 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:16:35.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:35 trial074 ceph-mon[44412]: purged_snaps scrub starts 2026-02-24T09:16:35.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:35 trial074 ceph-mon[44412]: purged_snaps scrub ok 2026-02-24T09:16:35.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:35 trial074 ceph-mon[44412]: Detected new or changed devices on trial159 2026-02-24T09:16:35.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:35 trial074 ceph-mon[44412]: Adjusting osd_memory_target on trial159 to 21013M 2026-02-24T09:16:35.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:35 trial074 ceph-mon[44412]: osd.11 [v2:10.20.193.159:6824/709820718,v1:10.20.193.159:6825/709820718] boot 2026-02-24T09:16:35.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:35 trial074 ceph-mon[44412]: osdmap e87: 12 total, 12 up, 12 in 2026-02-24T09:16:35.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:35 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:16:35.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:35 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/2509012334' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-24T09:16:35.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.731+0000 7faf836ca640 1 -- 10.20.193.28:0/3179917452 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf7c115930 msgr2=0x7faf7c176300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:35.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.731+0000 7faf836ca640 1 --2- 10.20.193.28:0/3179917452 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf7c115930 0x7faf7c176300 secure :-1 s=READY pgs=209 gs=1 cs=0 l=1 c_cookie=13553844303327591385 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf7800aa30 tx=0x7faf78030270 comp rx=0 tx=0).stop 2026-02-24T09:16:35.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.731+0000 7faf836ca640 1 -- 10.20.193.28:0/3179917452 shutdown_connections 2026-02-24T09:16:35.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.731+0000 7faf836ca640 1 --2- 10.20.193.28:0/3179917452 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf7c115930 0x7faf7c176300 unknown :-1 s=CLOSED pgs=209 gs=1 cs=0 l=1 c_cookie=13553844303327591385 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:35.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.731+0000 7faf836ca640 1 --2- 10.20.193.28:0/3179917452 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7faf7c110130 0x7faf7c115180 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:35.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.731+0000 7faf836ca640 1 --2- 10.20.193.28:0/3179917452 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7faf7c10f740 0x7faf7c10fb10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:35.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.731+0000 7faf836ca640 1 -- 10.20.193.28:0/3179917452 >> 10.20.193.28:0/3179917452 conn(0x7faf7c0ed050 msgr2=0x7faf7c10d460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:35.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.731+0000 7faf836ca640 1 -- 10.20.193.28:0/3179917452 shutdown_connections 2026-02-24T09:16:35.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.731+0000 7faf836ca640 1 -- 10.20.193.28:0/3179917452 wait complete. 2026-02-24T09:16:35.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.732+0000 7faf836ca640 1 Processor -- start 2026-02-24T09:16:35.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.732+0000 7faf836ca640 1 -- start start 2026-02-24T09:16:35.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.732+0000 7faf836ca640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7faf7c10f740 0x7faf7c11e0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:35.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.732+0000 7faf836ca640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7faf7c110130 0x7faf7c11e5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:35.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.732+0000 7faf836ca640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf7c115930 0x7faf7c1239b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:35.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.733+0000 7faf836ca640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7faf7c123fd0 con 0x7faf7c115930 2026-02-24T09:16:35.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.733+0000 7faf836ca640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7faf7c124140 con 0x7faf7c10f740 2026-02-24T09:16:35.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.733+0000 7faf836ca640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7faf7c124300 con 0x7faf7c110130 2026-02-24T09:16:35.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.733+0000 7faf81c40640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf7c115930 0x7faf7c1239b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:35.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.733+0000 7faf81c40640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf7c115930 0x7faf7c1239b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58686/0 (socket says 10.20.193.28:58686) 2026-02-24T09:16:35.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.733+0000 7faf81c40640 1 -- 10.20.193.28:0/1203472529 learned_addr learned my addr 10.20.193.28:0/1203472529 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:16:35.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.733+0000 7faf80c3e640 1 --2- 10.20.193.28:0/1203472529 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7faf7c110130 0x7faf7c11e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:35.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.733+0000 7faf8143f640 1 --2- 10.20.193.28:0/1203472529 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7faf7c10f740 0x7faf7c11e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:35.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.733+0000 7faf81c40640 1 -- 10.20.193.28:0/1203472529 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7faf7c110130 msgr2=0x7faf7c11e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:35.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.733+0000 7faf81c40640 1 --2- 10.20.193.28:0/1203472529 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7faf7c110130 0x7faf7c11e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:35.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.733+0000 7faf81c40640 1 -- 10.20.193.28:0/1203472529 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7faf7c10f740 msgr2=0x7faf7c11e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:35.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.733+0000 7faf81c40640 1 --2- 10.20.193.28:0/1203472529 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7faf7c10f740 0x7faf7c11e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:35.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.733+0000 7faf81c40640 1 -- 10.20.193.28:0/1203472529 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf7800a650 con 0x7faf7c115930 2026-02-24T09:16:35.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.733+0000 7faf80c3e640 1 --2- 10.20.193.28:0/1203472529 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7faf7c110130 0x7faf7c11e5e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:16:35.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.733+0000 7faf81c40640 1 --2- 10.20.193.28:0/1203472529 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf7c115930 0x7faf7c1239b0 secure :-1 s=READY pgs=210 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf78032fe0 tx=0x7faf78003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:35.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.734+0000 7faf6a7fc640 1 -- 10.20.193.28:0/1203472529 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faf7803e070 con 0x7faf7c115930 2026-02-24T09:16:35.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.734+0000 7faf6a7fc640 1 -- 10.20.193.28:0/1203472529 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7faf780050c0 con 0x7faf7c115930 2026-02-24T09:16:35.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.734+0000 7faf6a7fc640 1 -- 10.20.193.28:0/1203472529 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faf780429c0 con 0x7faf7c115930 2026-02-24T09:16:35.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.734+0000 7faf836ca640 1 -- 10.20.193.28:0/1203472529 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf7c124580 con 0x7faf7c115930 2026-02-24T09:16:35.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.734+0000 7faf836ca640 1 -- 10.20.193.28:0/1203472529 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf7c164b40 con 0x7faf7c115930 2026-02-24T09:16:35.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.734+0000 7faf836ca640 1 -- 10.20.193.28:0/1203472529 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf7c110a20 con 0x7faf7c115930 2026-02-24T09:16:35.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.736+0000 7faf6a7fc640 1 -- 10.20.193.28:0/1203472529 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 19) ==== 157139+0+0 (secure 0 0 0) 0x7faf78005230 con 0x7faf7c115930 2026-02-24T09:16:35.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.738+0000 7faf6a7fc640 1 --2- 10.20.193.28:0/1203472529 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7faf580b57b0 0x7faf580d5c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:35.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.738+0000 7faf6a7fc640 1 -- 10.20.193.28:0/1203472529 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7334+0+0 (secure 0 0 0) 0x7faf7810c7b0 con 0x7faf7c115930 2026-02-24T09:16:35.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.738+0000 7faf8143f640 1 --2- 10.20.193.28:0/1203472529 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7faf580b57b0 0x7faf580d5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:35.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.738+0000 7faf6a7fc640 1 -- 10.20.193.28:0/1203472529 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7faf7810cc30 con 0x7faf7c115930 2026-02-24T09:16:35.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.739+0000 7faf8143f640 1 --2- 10.20.193.28:0/1203472529 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7faf580b57b0 0x7faf580d5c60 secure :-1 s=READY pgs=111 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf6c006fd0 tx=0x7faf6c008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:35.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.851+0000 7faf836ca640 1 -- 10.20.193.28:0/1203472529 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7faf7c11f200 con 0x7faf7c115930 2026-02-24T09:16:35.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.852+0000 7faf6a7fc640 1 -- 10.20.193.28:0/1203472529 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7faf780cf4e0 con 0x7faf7c115930 2026-02-24T09:16:35.853 INFO:teuthology.orchestra.run.trial028.stdout:pg_num: 1 2026-02-24T09:16:35.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.853+0000 7faf836ca640 1 -- 10.20.193.28:0/1203472529 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7faf580b57b0 msgr2=0x7faf580d5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:35.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.853+0000 7faf836ca640 1 --2- 10.20.193.28:0/1203472529 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7faf580b57b0 0x7faf580d5c60 secure :-1 s=READY pgs=111 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf6c006fd0 tx=0x7faf6c008040 comp rx=0 tx=0).stop 2026-02-24T09:16:35.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.853+0000 7faf836ca640 1 -- 10.20.193.28:0/1203472529 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf7c115930 msgr2=0x7faf7c1239b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:35.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.853+0000 7faf836ca640 1 --2- 10.20.193.28:0/1203472529 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf7c115930 0x7faf7c1239b0 secure :-1 s=READY pgs=210 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf78032fe0 tx=0x7faf78003f60 comp rx=0 tx=0).stop 2026-02-24T09:16:35.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.854+0000 7faf836ca640 1 -- 10.20.193.28:0/1203472529 shutdown_connections 2026-02-24T09:16:35.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.854+0000 7faf836ca640 1 --2- 10.20.193.28:0/1203472529 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7faf580b57b0 0x7faf580d5c60 unknown :-1 s=CLOSED pgs=111 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:35.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.854+0000 7faf836ca640 1 --2- 10.20.193.28:0/1203472529 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf7c115930 0x7faf7c1239b0 unknown :-1 s=CLOSED pgs=210 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:35.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.854+0000 7faf836ca640 1 --2- 10.20.193.28:0/1203472529 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7faf7c110130 0x7faf7c11e5e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:35.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.854+0000 7faf836ca640 1 --2- 10.20.193.28:0/1203472529 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7faf7c10f740 0x7faf7c11e0a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:35.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.854+0000 7faf836ca640 1 -- 10.20.193.28:0/1203472529 >> 10.20.193.28:0/1203472529 conn(0x7faf7c0ed050 msgr2=0x7faf7c10d430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:35.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.854+0000 7faf836ca640 1 -- 10.20.193.28:0/1203472529 shutdown_connections 2026-02-24T09:16:35.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:35.854+0000 7faf836ca640 1 -- 10.20.193.28:0/1203472529 wait complete. 2026-02-24T09:16:35.950 INFO:tasks.cephadm:Adding mds.a on trial028 2026-02-24T09:16:35.950 INFO:tasks.cephadm:Adding mds.d on trial028 2026-02-24T09:16:35.950 INFO:tasks.cephadm:Adding mds.g on trial028 2026-02-24T09:16:35.950 INFO:tasks.cephadm:Adding mds.j on trial028 2026-02-24T09:16:35.950 INFO:tasks.cephadm:Adding mds.b on trial074 2026-02-24T09:16:35.950 INFO:tasks.cephadm:Adding mds.e on trial074 2026-02-24T09:16:35.951 INFO:tasks.cephadm:Adding mds.h on trial074 2026-02-24T09:16:35.951 INFO:tasks.cephadm:Adding mds.k on trial074 2026-02-24T09:16:35.951 INFO:tasks.cephadm:Adding mds.c on trial159 2026-02-24T09:16:35.951 INFO:tasks.cephadm:Adding mds.f on trial159 2026-02-24T09:16:35.951 INFO:tasks.cephadm:Adding mds.i on trial159 2026-02-24T09:16:35.951 INFO:tasks.cephadm:Adding mds.l on trial159 2026-02-24T09:16:35.951 DEBUG:teuthology.orchestra.run.trial159:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph orch apply mds all '12;trial028=a;trial028=d;trial028=g;trial028=j;trial074=b;trial074=e;trial074=h;trial074=k;trial159=c;trial159=f;trial159=i;trial159=l' 2026-02-24T09:16:36.135 INFO:teuthology.orchestra.run.trial159.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.c/config 2026-02-24T09:16:36.324 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.323+0000 7f8fb9cfe640 1 -- 10.20.193.159:0/1480915217 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8fb4060090 msgr2=0x7f8fb4060460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:36.324 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.323+0000 7f8fb9cfe640 1 --2- 10.20.193.159:0/1480915217 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8fb4060090 0x7f8fb4060460 secure :-1 s=READY pgs=68 gs=1 cs=0 l=1 c_cookie=1616670197139140755 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fa0009950 tx=0x7f8fa002f190 comp rx=0 tx=0).stop 2026-02-24T09:16:36.324 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.324+0000 7f8fb9cfe640 1 -- 10.20.193.159:0/1480915217 shutdown_connections 2026-02-24T09:16:36.324 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.324+0000 7f8fb9cfe640 1 --2- 10.20.193.159:0/1480915217 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8fb41135c0 0x7f8fb4173f90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:36.324 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.324+0000 7f8fb9cfe640 1 --2- 10.20.193.159:0/1480915217 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fb4060a80 0x7f8fb4112e10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:36.324 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.324+0000 7f8fb9cfe640 1 --2- 10.20.193.159:0/1480915217 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8fb4060090 0x7f8fb4060460 unknown :-1 s=CLOSED pgs=68 gs=1 cs=0 l=1 c_cookie=1616670197139140755 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:36.324 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.324+0000 7f8fb9cfe640 1 -- 10.20.193.159:0/1480915217 >> 10.20.193.159:0/1480915217 conn(0x7f8fb40e9b80 msgr2=0x7f8fb4109f90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:36.325 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.324+0000 7f8fb9cfe640 1 -- 10.20.193.159:0/1480915217 shutdown_connections 2026-02-24T09:16:36.325 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.324+0000 7f8fb9cfe640 1 -- 10.20.193.159:0/1480915217 wait complete. 2026-02-24T09:16:36.325 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.324+0000 7f8fb9cfe640 1 Processor -- start 2026-02-24T09:16:36.325 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.325+0000 7f8fb9cfe640 1 -- start start 2026-02-24T09:16:36.326 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.325+0000 7f8fb9cfe640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8fb4060090 0x7f8fb40f3eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:36.326 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.325+0000 7f8fb9cfe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fb4060a80 0x7f8fb4173e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:36.327 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.325+0000 7f8fb9cfe640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8fb41135c0 0x7f8fb40f45b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:36.327 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.325+0000 7f8fb9cfe640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb40f97c0 con 0x7f8fb4060a80 2026-02-24T09:16:36.327 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.325+0000 7f8fb9cfe640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb40f9930 con 0x7f8fb4060090 2026-02-24T09:16:36.327 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.325+0000 7f8fb9cfe640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb40f9af0 con 0x7f8fb41135c0 2026-02-24T09:16:36.327 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.325+0000 7f8fb3fff640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8fb41135c0 0x7f8fb40f45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:36.327 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.325+0000 7f8fb2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fb4060a80 0x7f8fb4173e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:36.327 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.325+0000 7f8fb37fe640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8fb4060090 0x7f8fb40f3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:36.327 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.325+0000 7f8fb3fff640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8fb41135c0 0x7f8fb40f45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.159:58908/0 (socket says 10.20.193.159:58908) 2026-02-24T09:16:36.327 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.325+0000 7f8fb2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fb4060a80 0x7f8fb4173e90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.159:45674/0 (socket says 10.20.193.159:45674) 2026-02-24T09:16:36.327 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.325+0000 7f8fb3fff640 1 -- 10.20.193.159:0/2453056597 learned_addr learned my addr 10.20.193.159:0/2453056597 (peer_addr_for_me v2:10.20.193.159:0/0) 2026-02-24T09:16:36.328 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.326+0000 7f8fb3fff640 1 -- 10.20.193.159:0/2453056597 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8fb4060090 msgr2=0x7f8fb40f3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:36.328 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.326+0000 7f8fb3fff640 1 --2- 10.20.193.159:0/2453056597 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8fb4060090 0x7f8fb40f3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:36.328 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.326+0000 7f8fb3fff640 1 -- 10.20.193.159:0/2453056597 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fb4060a80 msgr2=0x7f8fb4173e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:36.328 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.326+0000 7f8fb3fff640 1 --2- 10.20.193.159:0/2453056597 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fb4060a80 0x7f8fb4173e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:36.328 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.326+0000 7f8fb3fff640 1 -- 10.20.193.159:0/2453056597 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa0009570 con 0x7f8fb41135c0 2026-02-24T09:16:36.328 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.326+0000 7f8fb2ffd640 1 --2- 10.20.193.159:0/2453056597 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fb4060a80 0x7f8fb4173e90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:16:36.328 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.326+0000 7f8fb3fff640 1 --2- 10.20.193.159:0/2453056597 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8fb41135c0 0x7f8fb40f45b0 secure :-1 s=READY pgs=69 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fa800f8d0 tx=0x7f8fa800fda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:36.328 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.326+0000 7f8fb0ff9640 1 -- 10.20.193.159:0/2453056597 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8fa800dce0 con 0x7f8fb41135c0 2026-02-24T09:16:36.328 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.326+0000 7f8fb9cfe640 1 -- 10.20.193.159:0/2453056597 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fb40f9dd0 con 0x7f8fb41135c0 2026-02-24T09:16:36.328 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.326+0000 7f8fb0ff9640 1 -- 10.20.193.159:0/2453056597 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8fa800de40 con 0x7f8fb41135c0 2026-02-24T09:16:36.328 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.326+0000 7f8fb9cfe640 1 -- 10.20.193.159:0/2453056597 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fb40fa2a0 con 0x7f8fb41135c0 2026-02-24T09:16:36.328 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.326+0000 7f8fb0ff9640 1 -- 10.20.193.159:0/2453056597 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8fa800dce0 con 0x7f8fb41135c0 2026-02-24T09:16:36.329 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.327+0000 7f8fb9cfe640 1 -- 10.20.193.159:0/2453056597 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fb410e6b0 con 0x7f8fb41135c0 2026-02-24T09:16:36.329 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.329+0000 7f8fb0ff9640 1 -- 10.20.193.159:0/2453056597 <== mon.1 v2:10.20.193.159:3300/0 4 ==== mgrmap(e 19) ==== 157139+0+0 (secure 0 0 0) 0x7f8fa8020060 con 0x7f8fb41135c0 2026-02-24T09:16:36.331 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.331+0000 7f8fb0ff9640 1 --2- 10.20.193.159:0/2453056597 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8f880b5780 0x7f8f880d5c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:36.331 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.331+0000 7f8fb0ff9640 1 -- 10.20.193.159:0/2453056597 <== mon.1 v2:10.20.193.159:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7334+0+0 (secure 0 0 0) 0x7f8fa8015070 con 0x7f8fb41135c0 2026-02-24T09:16:36.331 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.331+0000 7f8fb0ff9640 1 -- 10.20.193.159:0/2453056597 <== mon.1 v2:10.20.193.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f8fa80e7880 con 0x7f8fb41135c0 2026-02-24T09:16:36.331 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.331+0000 7f8fb37fe640 1 --2- 10.20.193.159:0/2453056597 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8f880b5780 0x7f8f880d5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:36.331 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.332+0000 7f8fb37fe640 1 --2- 10.20.193.159:0/2453056597 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8f880b5780 0x7f8f880d5c30 secure :-1 s=READY pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fa00098a0 tx=0x7f8fa003a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:36.451 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.451+0000 7f8fb9cfe640 1 -- 10.20.193.159:0/2453056597 --> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial028=a;trial028=d;trial028=g;trial028=j;trial074=b;trial074=e;trial074=h;trial074=k;trial159=c;trial159=f;trial159=i;trial159=l", "target": ["mon-mgr", ""]}) -- 0x7f8fb40f5040 con 0x7f8f880b5780 2026-02-24T09:16:36.454 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.455+0000 7f8fb0ff9640 1 -- 10.20.193.159:0/2453056597 <== mgr.14223 v2:10.20.193.28:6800/906910473 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f8fb40f5040 con 0x7f8f880b5780 2026-02-24T09:16:36.455 INFO:teuthology.orchestra.run.trial159.stdout:Scheduled mds.all update... 2026-02-24T09:16:36.457 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.457+0000 7f8fb9cfe640 1 -- 10.20.193.159:0/2453056597 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8f880b5780 msgr2=0x7f8f880d5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:36.457 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.457+0000 7f8fb9cfe640 1 --2- 10.20.193.159:0/2453056597 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8f880b5780 0x7f8f880d5c30 secure :-1 s=READY pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fa00098a0 tx=0x7f8fa003a040 comp rx=0 tx=0).stop 2026-02-24T09:16:36.457 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.457+0000 7f8fb9cfe640 1 -- 10.20.193.159:0/2453056597 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8fb41135c0 msgr2=0x7f8fb40f45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:36.457 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.457+0000 7f8fb9cfe640 1 --2- 10.20.193.159:0/2453056597 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8fb41135c0 0x7f8fb40f45b0 secure :-1 s=READY pgs=69 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fa800f8d0 tx=0x7f8fa800fda0 comp rx=0 tx=0).stop 2026-02-24T09:16:36.457 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.457+0000 7f8fb9cfe640 1 -- 10.20.193.159:0/2453056597 shutdown_connections 2026-02-24T09:16:36.457 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.457+0000 7f8fb9cfe640 1 --2- 10.20.193.159:0/2453056597 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8f880b5780 0x7f8f880d5c30 unknown :-1 s=CLOSED pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:36.458 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.457+0000 7f8fb9cfe640 1 --2- 10.20.193.159:0/2453056597 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8fb41135c0 0x7f8fb40f45b0 unknown :-1 s=CLOSED pgs=69 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:36.458 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.457+0000 7f8fb9cfe640 1 --2- 10.20.193.159:0/2453056597 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fb4060a80 0x7f8fb4173e90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:36.458 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.457+0000 7f8fb9cfe640 1 --2- 10.20.193.159:0/2453056597 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8fb4060090 0x7f8fb40f3eb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:36.458 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.457+0000 7f8fb9cfe640 1 -- 10.20.193.159:0/2453056597 >> 10.20.193.159:0/2453056597 conn(0x7f8fb40e9b80 msgr2=0x7f8fb410a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:36.458 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.457+0000 7f8fb9cfe640 1 -- 10.20.193.159:0/2453056597 shutdown_connections 2026-02-24T09:16:36.458 INFO:teuthology.orchestra.run.trial159.stderr:2026-02-24T09:16:36.457+0000 7f8fb9cfe640 1 -- 10.20.193.159:0/2453056597 wait complete. 2026-02-24T09:16:36.483 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:36 trial159 ceph-mon[44242]: osdmap e88: 12 total, 12 up, 12 in 2026-02-24T09:16:36.483 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:36 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/567485245' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:16:36.483 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:36 trial159 ceph-mon[44242]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:36.484 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:36 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/1203472529' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-24T09:16:36.560 DEBUG:teuthology.orchestra.run.trial028:mds.a> sudo journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.a.service 2026-02-24T09:16:36.563 DEBUG:teuthology.orchestra.run.trial028:mds.d> sudo journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.d.service 2026-02-24T09:16:36.608 DEBUG:teuthology.orchestra.run.trial028:mds.g> sudo journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.g.service 2026-02-24T09:16:36.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:36 trial028 ceph-mon[40371]: osdmap e88: 12 total, 12 up, 12 in 2026-02-24T09:16:36.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:36 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/567485245' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:16:36.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:36 trial028 ceph-mon[40371]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:36.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:36 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/1203472529' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-24T09:16:36.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:36 trial074 ceph-mon[44412]: osdmap e88: 12 total, 12 up, 12 in 2026-02-24T09:16:36.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:36 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/567485245' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:16:36.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:36 trial074 ceph-mon[44412]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:36.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:36 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/1203472529' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-24T09:16:36.652 DEBUG:teuthology.orchestra.run.trial028:mds.j> sudo journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.j.service 2026-02-24T09:16:36.697 DEBUG:teuthology.orchestra.run.trial074:mds.b> sudo journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.b.service 2026-02-24T09:16:36.701 DEBUG:teuthology.orchestra.run.trial074:mds.e> sudo journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.e.service 2026-02-24T09:16:36.746 DEBUG:teuthology.orchestra.run.trial074:mds.h> sudo journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.h.service 2026-02-24T09:16:36.790 DEBUG:teuthology.orchestra.run.trial074:mds.k> sudo journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.k.service 2026-02-24T09:16:36.835 DEBUG:teuthology.orchestra.run.trial159:mds.c> sudo journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.c.service 2026-02-24T09:16:36.840 DEBUG:teuthology.orchestra.run.trial159:mds.f> sudo journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.f.service 2026-02-24T09:16:36.883 DEBUG:teuthology.orchestra.run.trial159:mds.i> sudo journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.i.service 2026-02-24T09:16:36.928 DEBUG:teuthology.orchestra.run.trial159:mds.l> sudo journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.l.service 2026-02-24T09:16:36.973 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2026-02-24T09:16:36.973 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:16:37.156 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:16:37.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.323+0000 7efe963a5640 1 -- 10.20.193.28:0/4076606500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe9010f600 msgr2=0x7efe9010f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:37.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.323+0000 7efe963a5640 1 --2- 10.20.193.28:0/4076606500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe9010f600 0x7efe9010f9d0 secure :-1 s=READY pgs=211 gs=1 cs=0 l=1 c_cookie=3629688390824366901 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe7c009950 tx=0x7efe7c02f190 comp rx=0 tx=0).stop 2026-02-24T09:16:37.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.323+0000 7efe963a5640 1 -- 10.20.193.28:0/4076606500 shutdown_connections 2026-02-24T09:16:37.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.323+0000 7efe963a5640 1 --2- 10.20.193.28:0/4076606500 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7efe90115760 0x7efe90176130 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:37.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.323+0000 7efe963a5640 1 --2- 10.20.193.28:0/4076606500 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7efe9010fff0 0x7efe90114fb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:37.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.323+0000 7efe963a5640 1 --2- 10.20.193.28:0/4076606500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe9010f600 0x7efe9010f9d0 unknown :-1 s=CLOSED pgs=211 gs=1 cs=0 l=1 c_cookie=3629688390824366901 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:37.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.323+0000 7efe963a5640 1 -- 10.20.193.28:0/4076606500 >> 10.20.193.28:0/4076606500 conn(0x7efe900ecef0 msgr2=0x7efe9010d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:37.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.323+0000 7efe963a5640 1 -- 10.20.193.28:0/4076606500 shutdown_connections 2026-02-24T09:16:37.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.323+0000 7efe963a5640 1 -- 10.20.193.28:0/4076606500 wait complete. 2026-02-24T09:16:37.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.323+0000 7efe963a5640 1 Processor -- start 2026-02-24T09:16:37.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.324+0000 7efe963a5640 1 -- start start 2026-02-24T09:16:37.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.324+0000 7efe963a5640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7efe9010f600 0x7efe9011df00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:37.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.324+0000 7efe963a5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe9010fff0 0x7efe9011e440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:37.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.324+0000 7efe963a5640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7efe90115760 0x7efe90123810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:37.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.324+0000 7efe963a5640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efe90123e30 con 0x7efe9010fff0 2026-02-24T09:16:37.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.324+0000 7efe963a5640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7efe90123fa0 con 0x7efe9010f600 2026-02-24T09:16:37.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.324+0000 7efe963a5640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7efe90124160 con 0x7efe90115760 2026-02-24T09:16:37.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.324+0000 7efe8ffff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7efe9010f600 0x7efe9011df00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:37.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.324+0000 7efe9491b640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7efe90115760 0x7efe90123810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:37.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.324+0000 7efe8ffff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7efe9010f600 0x7efe9011df00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:50278/0 (socket says 10.20.193.28:50278) 2026-02-24T09:16:37.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.324+0000 7efe8ffff640 1 -- 10.20.193.28:0/1729114249 learned_addr learned my addr 10.20.193.28:0/1729114249 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:16:37.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.324+0000 7efe8f7fe640 1 --2- 10.20.193.28:0/1729114249 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe9010fff0 0x7efe9011e440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:37.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.325+0000 7efe8ffff640 1 -- 10.20.193.28:0/1729114249 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7efe90115760 msgr2=0x7efe90123810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:37.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.325+0000 7efe8ffff640 1 --2- 10.20.193.28:0/1729114249 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7efe90115760 0x7efe90123810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:37.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.325+0000 7efe8ffff640 1 -- 10.20.193.28:0/1729114249 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe9010fff0 msgr2=0x7efe9011e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:37.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.325+0000 7efe8ffff640 1 --2- 10.20.193.28:0/1729114249 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe9010fff0 0x7efe9011e440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:37.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.325+0000 7efe8ffff640 1 -- 10.20.193.28:0/1729114249 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe7c009570 con 0x7efe9010f600 2026-02-24T09:16:37.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.325+0000 7efe8ffff640 1 --2- 10.20.193.28:0/1729114249 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7efe9010f600 0x7efe9011df00 secure :-1 s=READY pgs=75 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe7c0098a0 tx=0x7efe7c0028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:37.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.325+0000 7efe8d7fa640 1 -- 10.20.193.28:0/1729114249 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efe7c03d070 con 0x7efe9010f600 2026-02-24T09:16:37.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.325+0000 7efe963a5640 1 -- 10.20.193.28:0/1729114249 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe901243e0 con 0x7efe9010f600 2026-02-24T09:16:37.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.325+0000 7efe963a5640 1 -- 10.20.193.28:0/1729114249 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe90164b40 con 0x7efe9010f600 2026-02-24T09:16:37.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.325+0000 7efe8d7fa640 1 -- 10.20.193.28:0/1729114249 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7efe7c002a70 con 0x7efe9010f600 2026-02-24T09:16:37.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.325+0000 7efe8d7fa640 1 -- 10.20.193.28:0/1729114249 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efe7c041700 con 0x7efe9010f600 2026-02-24T09:16:37.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.326+0000 7efe963a5640 1 -- 10.20.193.28:0/1729114249 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe901108e0 con 0x7efe9010f600 2026-02-24T09:16:37.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.329+0000 7efe8d7fa640 1 -- 10.20.193.28:0/1729114249 <== mon.2 v2:10.20.193.74:3300/0 4 ==== mgrmap(e 19) ==== 157139+0+0 (secure 0 0 0) 0x7efe7c0386a0 con 0x7efe9010f600 2026-02-24T09:16:37.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.331+0000 7efe8d7fa640 1 --2- 10.20.193.28:0/1729114249 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7efe640b57b0 0x7efe640d5c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:37.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.331+0000 7efe8d7fa640 1 -- 10.20.193.28:0/1729114249 <== mon.2 v2:10.20.193.74:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7334+0+0 (secure 0 0 0) 0x7efe7c10afa0 con 0x7efe9010f600 2026-02-24T09:16:37.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.331+0000 7efe8d7fa640 1 -- 10.20.193.28:0/1729114249 <== mon.2 v2:10.20.193.74:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7efe7c10b420 con 0x7efe9010f600 2026-02-24T09:16:37.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.331+0000 7efe8f7fe640 1 --2- 10.20.193.28:0/1729114249 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7efe640b57b0 0x7efe640d5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:37.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.331+0000 7efe8f7fe640 1 --2- 10.20.193.28:0/1729114249 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7efe640b57b0 0x7efe640d5c60 secure :-1 s=READY pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe901248a0 tx=0x7efe8000b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:37.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.474+0000 7efe963a5640 1 -- 10.20.193.28:0/1729114249 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe9010f9d0 con 0x7efe9010f600 2026-02-24T09:16:37.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.474+0000 7efe8d7fa640 1 -- 10.20.193.28:0/1729114249 <== mon.2 v2:10.20.193.74:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7efe7c0cdd80 con 0x7efe9010f600 2026-02-24T09:16:37.475 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:16:37.476 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":1,"btime":"2026-02-24T09:12:33:966558+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2026-02-24T09:16:37.476 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 1 2026-02-24T09:16:37.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.475+0000 7efe963a5640 1 -- 10.20.193.28:0/1729114249 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7efe640b57b0 msgr2=0x7efe640d5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:37.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.475+0000 7efe963a5640 1 --2- 10.20.193.28:0/1729114249 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7efe640b57b0 0x7efe640d5c60 secure :-1 s=READY pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe901248a0 tx=0x7efe8000b410 comp rx=0 tx=0).stop 2026-02-24T09:16:37.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.475+0000 7efe963a5640 1 -- 10.20.193.28:0/1729114249 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7efe9010f600 msgr2=0x7efe9011df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:37.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.475+0000 7efe963a5640 1 --2- 10.20.193.28:0/1729114249 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7efe9010f600 0x7efe9011df00 secure :-1 s=READY pgs=75 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe7c0098a0 tx=0x7efe7c0028d0 comp rx=0 tx=0).stop 2026-02-24T09:16:37.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.476+0000 7efe963a5640 1 -- 10.20.193.28:0/1729114249 shutdown_connections 2026-02-24T09:16:37.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.476+0000 7efe963a5640 1 --2- 10.20.193.28:0/1729114249 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7efe640b57b0 0x7efe640d5c60 unknown :-1 s=CLOSED pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:37.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.476+0000 7efe963a5640 1 --2- 10.20.193.28:0/1729114249 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7efe90115760 0x7efe90123810 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:37.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.476+0000 7efe963a5640 1 --2- 10.20.193.28:0/1729114249 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe9010fff0 0x7efe9011e440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:37.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.476+0000 7efe963a5640 1 --2- 10.20.193.28:0/1729114249 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7efe9010f600 0x7efe9011df00 unknown :-1 s=CLOSED pgs=75 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:37.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.476+0000 7efe963a5640 1 -- 10.20.193.28:0/1729114249 >> 10.20.193.28:0/1729114249 conn(0x7efe900ecef0 msgr2=0x7efe9010d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:37.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.476+0000 7efe963a5640 1 -- 10.20.193.28:0/1729114249 shutdown_connections 2026-02-24T09:16:37.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:37.476+0000 7efe963a5640 1 -- 10.20.193.28:0/1729114249 wait complete. 2026-02-24T09:16:37.547 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:37 trial028 ceph-mon[40371]: from='client.24676 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial028=a;trial028=d;trial028=g;trial028=j;trial074=b;trial074=e;trial074=h;trial074=k;trial159=c;trial159=f;trial159=i;trial159=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:16:37.547 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:37 trial028 ceph-mon[40371]: Saving service mds.all spec with placement trial028=a;trial028=d;trial028=g;trial028=j;trial074=b;trial074=e;trial074=h;trial074=k;trial159=c;trial159=f;trial159=i;trial159=l;count:12 2026-02-24T09:16:37.547 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:37 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:37.547 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:37 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:37.547 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:37 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:37.547 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:37 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:16:37.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:37 trial159 ceph-mon[44242]: from='client.24676 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial028=a;trial028=d;trial028=g;trial028=j;trial074=b;trial074=e;trial074=h;trial074=k;trial159=c;trial159=f;trial159=i;trial159=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:16:37.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:37 trial159 ceph-mon[44242]: Saving service mds.all spec with placement trial028=a;trial028=d;trial028=g;trial028=j;trial074=b;trial074=e;trial074=h;trial074=k;trial159=c;trial159=f;trial159=i;trial159=l;count:12 2026-02-24T09:16:37.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:37 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:37.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:37 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:37.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:37 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:37.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:37 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:16:37.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:37 trial074 ceph-mon[44412]: from='client.24676 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial028=a;trial028=d;trial028=g;trial028=j;trial074=b;trial074=e;trial074=h;trial074=k;trial159=c;trial159=f;trial159=i;trial159=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:16:37.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:37 trial074 ceph-mon[44412]: Saving service mds.all spec with placement trial028=a;trial028=d;trial028=g;trial028=j;trial074=b;trial074=e;trial074=h;trial074=k;trial159=c;trial159=f;trial159=i;trial159=l;count:12 2026-02-24T09:16:37.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:37 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:37.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:37 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:37.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:37 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:37.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:37 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:16:38.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:38 trial159 ceph-mon[44242]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:38.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:38 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/1729114249' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:16:38.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:38 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:38.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:38 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:38.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:38 trial028 ceph-mon[40371]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:38.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:38 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/1729114249' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:16:38.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:38 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:38.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:38 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:38.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:38 trial074 ceph-mon[44412]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:38.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:38 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/1729114249' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:16:38.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:38 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:38.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:38 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:39.576 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:16:39.761 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:16:39.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.945+0000 7fe037fff640 1 -- 10.20.193.28:0/3580920960 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0381112e0 msgr2=0x7fe038111cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:39.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.945+0000 7fe037fff640 1 --2- 10.20.193.28:0/3580920960 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0381112e0 0x7fe038111cc0 secure :-1 s=READY pgs=212 gs=1 cs=0 l=1 c_cookie=999214585415942230 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe02800aa30 tx=0x7fe028030270 comp rx=0 tx=0).stop 2026-02-24T09:16:39.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.945+0000 7fe037fff640 1 -- 10.20.193.28:0/3580920960 shutdown_connections 2026-02-24T09:16:39.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.945+0000 7fe037fff640 1 --2- 10.20.193.28:0/3580920960 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0381112e0 0x7fe038111cc0 unknown :-1 s=CLOSED pgs=212 gs=1 cs=0 l=1 c_cookie=999214585415942230 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:39.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.945+0000 7fe037fff640 1 --2- 10.20.193.28:0/3580920960 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fe03810bcc0 0x7fe038110b50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:39.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.945+0000 7fe037fff640 1 --2- 10.20.193.28:0/3580920960 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe03810b2d0 0x7fe03810b6a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:39.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.945+0000 7fe037fff640 1 -- 10.20.193.28:0/3580920960 >> 10.20.193.28:0/3580920960 conn(0x7fe0380e8e40 msgr2=0x7fe038109250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:39.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.945+0000 7fe037fff640 1 -- 10.20.193.28:0/3580920960 shutdown_connections 2026-02-24T09:16:39.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.945+0000 7fe037fff640 1 -- 10.20.193.28:0/3580920960 wait complete. 2026-02-24T09:16:39.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.946+0000 7fe037fff640 1 Processor -- start 2026-02-24T09:16:39.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.946+0000 7fe037fff640 1 -- start start 2026-02-24T09:16:39.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.947+0000 7fe037fff640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe03810b2d0 0x7fe038120700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:39.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.947+0000 7fe037fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe03810bcc0 0x7fe038120c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:39.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.947+0000 7fe037fff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fe0381112e0 0x7fe03805e220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:39.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.947+0000 7fe037fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe03805e920 con 0x7fe03810bcc0 2026-02-24T09:16:39.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.947+0000 7fe037fff640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fe03805ea90 con 0x7fe0381112e0 2026-02-24T09:16:39.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.947+0000 7fe037fff640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe03805ec50 con 0x7fe03810b2d0 2026-02-24T09:16:39.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.947+0000 7fe0367fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe03810bcc0 0x7fe038120c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:39.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.947+0000 7fe0367fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe03810bcc0 0x7fe038120c40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53242/0 (socket says 10.20.193.28:53242) 2026-02-24T09:16:39.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.947+0000 7fe0367fc640 1 -- 10.20.193.28:0/3679340442 learned_addr learned my addr 10.20.193.28:0/3679340442 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:16:39.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.947+0000 7fe036ffd640 1 --2- 10.20.193.28:0/3679340442 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe03810b2d0 0x7fe038120700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:39.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.947+0000 7fe0377fe640 1 --2- 10.20.193.28:0/3679340442 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fe0381112e0 0x7fe03805e220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:39.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.947+0000 7fe0367fc640 1 -- 10.20.193.28:0/3679340442 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe03810b2d0 msgr2=0x7fe038120700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:39.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.947+0000 7fe0367fc640 1 --2- 10.20.193.28:0/3679340442 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe03810b2d0 0x7fe038120700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:39.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.947+0000 7fe0367fc640 1 -- 10.20.193.28:0/3679340442 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fe0381112e0 msgr2=0x7fe03805e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:39.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.947+0000 7fe0367fc640 1 --2- 10.20.193.28:0/3679340442 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fe0381112e0 0x7fe03805e220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:39.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.947+0000 7fe0367fc640 1 -- 10.20.193.28:0/3679340442 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe02800a650 con 0x7fe03810bcc0 2026-02-24T09:16:39.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.947+0000 7fe0367fc640 1 --2- 10.20.193.28:0/3679340442 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe03810bcc0 0x7fe038120c40 secure :-1 s=READY pgs=213 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe02000e9c0 tx=0x7fe02000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:39.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.948+0000 7fe017fff640 1 -- 10.20.193.28:0/3679340442 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe02000ccb0 con 0x7fe03810bcc0 2026-02-24T09:16:39.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.948+0000 7fe017fff640 1 -- 10.20.193.28:0/3679340442 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fe02000ce10 con 0x7fe03810bcc0 2026-02-24T09:16:39.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.948+0000 7fe017fff640 1 -- 10.20.193.28:0/3679340442 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe0200106b0 con 0x7fe03810bcc0 2026-02-24T09:16:39.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.948+0000 7fe037fff640 1 -- 10.20.193.28:0/3679340442 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe03805ef30 con 0x7fe03810bcc0 2026-02-24T09:16:39.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.948+0000 7fe037fff640 1 -- 10.20.193.28:0/3679340442 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe038161700 con 0x7fe03810bcc0 2026-02-24T09:16:39.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.948+0000 7fe037fff640 1 -- 10.20.193.28:0/3679340442 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdffc005300 con 0x7fe03810bcc0 2026-02-24T09:16:39.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.951+0000 7fe017fff640 1 -- 10.20.193.28:0/3679340442 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 19) ==== 157139+0+0 (secure 0 0 0) 0x7fe0200040d0 con 0x7fe03810bcc0 2026-02-24T09:16:39.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.952+0000 7fe017fff640 1 --2- 10.20.193.28:0/3679340442 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe00c0b57b0 0x7fe00c0d5c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:39.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.952+0000 7fe017fff640 1 -- 10.20.193.28:0/3679340442 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7334+0+0 (secure 0 0 0) 0x7fe020014070 con 0x7fe03810bcc0 2026-02-24T09:16:39.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.953+0000 7fe036ffd640 1 --2- 10.20.193.28:0/3679340442 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe00c0b57b0 0x7fe00c0d5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:39.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.953+0000 7fe017fff640 1 -- 10.20.193.28:0/3679340442 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fe02011f930 con 0x7fe03810bcc0 2026-02-24T09:16:39.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:39.953+0000 7fe036ffd640 1 --2- 10.20.193.28:0/3679340442 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe00c0b57b0 0x7fe00c0d5c60 secure :-1 s=READY pgs=114 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe02c004740 tx=0x7fe02c009190 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:40.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:40.094+0000 7fe037fff640 1 -- 10.20.193.28:0/3679340442 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdffc005950 con 0x7fe03810bcc0 2026-02-24T09:16:40.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:40.094+0000 7fe017fff640 1 -- 10.20.193.28:0/3679340442 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fe0200a9940 con 0x7fe03810bcc0 2026-02-24T09:16:40.095 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:16:40.095 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":1,"btime":"2026-02-24T09:12:33:966558+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2026-02-24T09:16:40.095 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 1 2026-02-24T09:16:40.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:40.095+0000 7fe037fff640 1 -- 10.20.193.28:0/3679340442 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe00c0b57b0 msgr2=0x7fe00c0d5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:40.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:40.095+0000 7fe037fff640 1 --2- 10.20.193.28:0/3679340442 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe00c0b57b0 0x7fe00c0d5c60 secure :-1 s=READY pgs=114 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe02c004740 tx=0x7fe02c009190 comp rx=0 tx=0).stop 2026-02-24T09:16:40.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:40.095+0000 7fe037fff640 1 -- 10.20.193.28:0/3679340442 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe03810bcc0 msgr2=0x7fe038120c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:40.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:40.095+0000 7fe037fff640 1 --2- 10.20.193.28:0/3679340442 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe03810bcc0 0x7fe038120c40 secure :-1 s=READY pgs=213 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe02000e9c0 tx=0x7fe02000ee90 comp rx=0 tx=0).stop 2026-02-24T09:16:40.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:40.095+0000 7fe037fff640 1 -- 10.20.193.28:0/3679340442 shutdown_connections 2026-02-24T09:16:40.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:40.095+0000 7fe037fff640 1 --2- 10.20.193.28:0/3679340442 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe00c0b57b0 0x7fe00c0d5c60 unknown :-1 s=CLOSED pgs=114 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:40.095+0000 7fe037fff640 1 --2- 10.20.193.28:0/3679340442 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fe0381112e0 0x7fe03805e220 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:40.095+0000 7fe037fff640 1 --2- 10.20.193.28:0/3679340442 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe03810bcc0 0x7fe038120c40 unknown :-1 s=CLOSED pgs=213 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:40.095+0000 7fe037fff640 1 --2- 10.20.193.28:0/3679340442 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe03810b2d0 0x7fe038120700 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:40.095+0000 7fe037fff640 1 -- 10.20.193.28:0/3679340442 >> 10.20.193.28:0/3679340442 conn(0x7fe0380e8e40 msgr2=0x7fe038109220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:40.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:40.095+0000 7fe037fff640 1 -- 10.20.193.28:0/3679340442 shutdown_connections 2026-02-24T09:16:40.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:40.095+0000 7fe037fff640 1 -- 10.20.193.28:0/3679340442 wait complete. 2026-02-24T09:16:40.163 INFO:journalctl@ceph.mds.l.trial159.stdout:Feb 24 09:16:40 trial159 systemd[1]: Starting Ceph mds.l for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:16:40.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:40.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:40.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:40.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:16:40.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:40.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:16:40.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:40.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:40.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:40.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:40 trial159 ceph-mon[44242]: Deploying daemon mds.l on trial159 2026-02-24T09:16:40.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:40 trial159 ceph-mon[44242]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:40.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:40 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/3679340442' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:16:40.532 INFO:journalctl@ceph.mds.l.trial159.stdout:Feb 24 09:16:40 trial159 podman[97297]: 2026-02-24 09:16:40.28699552 +0000 UTC m=+0.028294569 container create 946a22caf5969dfb565a1608f97594dd745b4d7dacaffff9941bb3fbaf4c81fa (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-l, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, ceph=True, OSD_FLAVOR=default, CEPH_REF=wip-vshankar-testing-20260223.155722, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3) 2026-02-24T09:16:40.532 INFO:journalctl@ceph.mds.l.trial159.stdout:Feb 24 09:16:40 trial159 podman[97297]: 2026-02-24 09:16:40.325617592 +0000 UTC m=+0.066916651 container init 946a22caf5969dfb565a1608f97594dd745b4d7dacaffff9941bb3fbaf4c81fa (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-l, OSD_FLAVOR=default, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2) 2026-02-24T09:16:40.532 INFO:journalctl@ceph.mds.l.trial159.stdout:Feb 24 09:16:40 trial159 podman[97297]: 2026-02-24 09:16:40.330855478 +0000 UTC m=+0.072154527 container start 946a22caf5969dfb565a1608f97594dd745b4d7dacaffff9941bb3fbaf4c81fa (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-l, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, OSD_FLAVOR=default, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, ceph=True, CEPH_REF=wip-vshankar-testing-20260223.155722, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-24T09:16:40.532 INFO:journalctl@ceph.mds.l.trial159.stdout:Feb 24 09:16:40 trial159 bash[97297]: 946a22caf5969dfb565a1608f97594dd745b4d7dacaffff9941bb3fbaf4c81fa 2026-02-24T09:16:40.532 INFO:journalctl@ceph.mds.l.trial159.stdout:Feb 24 09:16:40 trial159 podman[97297]: 2026-02-24 09:16:40.276644571 +0000 UTC m=+0.017943630 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b 2026-02-24T09:16:40.532 INFO:journalctl@ceph.mds.l.trial159.stdout:Feb 24 09:16:40 trial159 systemd[1]: Started Ceph mds.l for e9ad50af-1160-11f1-800e-d404e6e7d460. 2026-02-24T09:16:40.532 INFO:journalctl@ceph.mds.l.trial159.stdout:Feb 24 09:16:40 trial159 ceph-mds[97317]: -- 10.20.193.159:0/3296732784 <== mon.1 v2:10.20.193.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0xeb1f860 con 0xeb53c00 2026-02-24T09:16:40.532 INFO:journalctl@ceph.mds.l.trial159.stdout:Feb 24 09:16:40 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-l[97313]: starting mds.l at 2026-02-24T09:16:40.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:40.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:40.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:40.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:16:40.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:40.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:16:40.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:40.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:40.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:40.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:40 trial028 ceph-mon[40371]: Deploying daemon mds.l on trial159 2026-02-24T09:16:40.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:40 trial028 ceph-mon[40371]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:40.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:40 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/3679340442' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:16:40.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:40.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:40.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:40.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:16:40.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:40.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:16:40.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:40.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:40.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:40.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:40 trial074 ceph-mon[44412]: Deploying daemon mds.l on trial159 2026-02-24T09:16:40.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:40 trial074 ceph-mon[44412]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:40.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:40 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/3679340442' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:16:41.367 INFO:journalctl@ceph.mds.k.trial074.stdout:Feb 24 09:16:41 trial074 systemd[1]: Starting Ceph mds.k for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:16:41.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:41 trial074 ceph-mon[44412]: mds.? [v2:10.20.193.159:6832/3049112106,v1:10.20.193.159:6833/3049112106] up:boot 2026-02-24T09:16:41.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:41 trial074 ceph-mon[44412]: fsmap 1 up:standby 2026-02-24T09:16:41.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:41 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-24T09:16:41.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:41 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:41.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:41 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:41.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:41 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:41.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:41 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:41.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:41 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:41.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:41 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:41.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:41 trial074 ceph-mon[44412]: Deploying daemon mds.k on trial074 2026-02-24T09:16:41.625 INFO:journalctl@ceph.mds.k.trial074.stdout:Feb 24 09:16:41 trial074 podman[96905]: 2026-02-24 09:16:41.497269328 +0000 UTC m=+0.027802952 container create 770bcb83261fec786297742f978526ce08b65be795493eca1e9f94fa2a4acd1d (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-k, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, CEPH_REF=wip-vshankar-testing-20260223.155722, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.41.3) 2026-02-24T09:16:41.625 INFO:journalctl@ceph.mds.k.trial074.stdout:Feb 24 09:16:41 trial074 podman[96905]: 2026-02-24 09:16:41.542023305 +0000 UTC m=+0.072556949 container init 770bcb83261fec786297742f978526ce08b65be795493eca1e9f94fa2a4acd1d (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-k, CEPH_REF=wip-vshankar-testing-20260223.155722, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, org.label-schema.build-date=20260223, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3) 2026-02-24T09:16:41.625 INFO:journalctl@ceph.mds.k.trial074.stdout:Feb 24 09:16:41 trial074 podman[96905]: 2026-02-24 09:16:41.546950314 +0000 UTC m=+0.077483948 container start 770bcb83261fec786297742f978526ce08b65be795493eca1e9f94fa2a4acd1d (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-k, org.label-schema.vendor=CentOS, CEPH_REF=wip-vshankar-testing-20260223.155722, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260223, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-24T09:16:41.625 INFO:journalctl@ceph.mds.k.trial074.stdout:Feb 24 09:16:41 trial074 bash[96905]: 770bcb83261fec786297742f978526ce08b65be795493eca1e9f94fa2a4acd1d 2026-02-24T09:16:41.625 INFO:journalctl@ceph.mds.k.trial074.stdout:Feb 24 09:16:41 trial074 podman[96905]: 2026-02-24 09:16:41.486771877 +0000 UTC m=+0.017305511 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b 2026-02-24T09:16:41.626 INFO:journalctl@ceph.mds.k.trial074.stdout:Feb 24 09:16:41 trial074 systemd[1]: Started Ceph mds.k for e9ad50af-1160-11f1-800e-d404e6e7d460. 2026-02-24T09:16:41.626 INFO:journalctl@ceph.mds.k.trial074.stdout:Feb 24 09:16:41 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-k[96919]: starting mds.k at 2026-02-24T09:16:41.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:41 trial159 ceph-mon[44242]: mds.? [v2:10.20.193.159:6832/3049112106,v1:10.20.193.159:6833/3049112106] up:boot 2026-02-24T09:16:41.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:41 trial159 ceph-mon[44242]: fsmap 1 up:standby 2026-02-24T09:16:41.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:41 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-24T09:16:41.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:41 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:41.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:41 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:41.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:41 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:41.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:41 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:41.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:41 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:41.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:41 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:41.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:41 trial159 ceph-mon[44242]: Deploying daemon mds.k on trial074 2026-02-24T09:16:41.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:41 trial028 ceph-mon[40371]: mds.? [v2:10.20.193.159:6832/3049112106,v1:10.20.193.159:6833/3049112106] up:boot 2026-02-24T09:16:41.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:41 trial028 ceph-mon[40371]: fsmap 1 up:standby 2026-02-24T09:16:41.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:41 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-24T09:16:41.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:41 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:41.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:41 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:41.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:41 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:41.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:41 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:41.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:41 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:41.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:41 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:41.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:41 trial028 ceph-mon[40371]: Deploying daemon mds.k on trial074 2026-02-24T09:16:42.196 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:16:42.429 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:16:42.560 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:42 trial028 ceph-mon[40371]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:42.560 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:42 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:42.561 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:42 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:42.561 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:42 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:42.561 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:42 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:42.561 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:42 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:42.561 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:42 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:42.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.667+0000 7fbabc942640 1 -- 10.20.193.28:0/1092007589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbab8114020 msgr2=0x7fbab81143f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:42.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.667+0000 7fbabc942640 1 --2- 10.20.193.28:0/1092007589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbab8114020 0x7fbab81143f0 secure :-1 s=READY pgs=214 gs=1 cs=0 l=1 c_cookie=10503763072142757875 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbaac009950 tx=0x7fbaac02f190 comp rx=0 tx=0).stop 2026-02-24T09:16:42.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.667+0000 7fbabc942640 1 -- 10.20.193.28:0/1092007589 shutdown_connections 2026-02-24T09:16:42.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.667+0000 7fbabc942640 1 --2- 10.20.193.28:0/1092007589 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fbab81199a0 0x7fbab817a370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.667+0000 7fbabc942640 1 --2- 10.20.193.28:0/1092007589 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fbab8114a10 0x7fbab81191f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.667+0000 7fbabc942640 1 --2- 10.20.193.28:0/1092007589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbab8114020 0x7fbab81143f0 unknown :-1 s=CLOSED pgs=214 gs=1 cs=0 l=1 c_cookie=10503763072142757875 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.667+0000 7fbabc942640 1 -- 10.20.193.28:0/1092007589 >> 10.20.193.28:0/1092007589 conn(0x7fbab8064810 msgr2=0x7fbab8064c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:42.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.668+0000 7fbabc942640 1 -- 10.20.193.28:0/1092007589 shutdown_connections 2026-02-24T09:16:42.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.669+0000 7fbabc942640 1 -- 10.20.193.28:0/1092007589 wait complete. 2026-02-24T09:16:42.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.669+0000 7fbabc942640 1 Processor -- start 2026-02-24T09:16:42.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.669+0000 7fbabc942640 1 -- start start 2026-02-24T09:16:42.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.669+0000 7fbabc942640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fbab8114020 0x7fbab8122100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.669+0000 7fbabc942640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbab8114a10 0x7fbab8122640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.669+0000 7fbabc942640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fbab81199a0 0x7fbab8127a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.670+0000 7fbabc942640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbab8128030 con 0x7fbab8114a10 2026-02-24T09:16:42.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.670+0000 7fbabc942640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fbab81281a0 con 0x7fbab81199a0 2026-02-24T09:16:42.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.670+0000 7fbabc942640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbab8128360 con 0x7fbab8114020 2026-02-24T09:16:42.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.670+0000 7fbab6d76640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fbab8114020 0x7fbab8122100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.670+0000 7fbab7577640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fbab81199a0 0x7fbab8127a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.670+0000 7fbab7577640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fbab81199a0 0x7fbab8127a10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:50316/0 (socket says 10.20.193.28:50316) 2026-02-24T09:16:42.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.670+0000 7fbab7577640 1 -- 10.20.193.28:0/1796432708 learned_addr learned my addr 10.20.193.28:0/1796432708 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:16:42.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.670+0000 7fbab6575640 1 --2- 10.20.193.28:0/1796432708 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbab8114a10 0x7fbab8122640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.670+0000 7fbab7577640 1 -- 10.20.193.28:0/1796432708 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fbab8114020 msgr2=0x7fbab8122100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:42.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.670+0000 7fbab7577640 1 --2- 10.20.193.28:0/1796432708 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fbab8114020 0x7fbab8122100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.670+0000 7fbab7577640 1 -- 10.20.193.28:0/1796432708 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbab8114a10 msgr2=0x7fbab8122640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:42.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.671+0000 7fbab7577640 1 --2- 10.20.193.28:0/1796432708 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbab8114a10 0x7fbab8122640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.671+0000 7fbab7577640 1 -- 10.20.193.28:0/1796432708 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaac009570 con 0x7fbab81199a0 2026-02-24T09:16:42.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.671+0000 7fbab6575640 1 --2- 10.20.193.28:0/1796432708 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbab8114a10 0x7fbab8122640 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:16:42.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.671+0000 7fbab7577640 1 --2- 10.20.193.28:0/1796432708 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fbab81199a0 0x7fbab8127a10 secure :-1 s=READY pgs=78 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbaa800f8d0 tx=0x7fbaa800fda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:42.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.671+0000 7fba97fff640 1 -- 10.20.193.28:0/1796432708 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbaa800dce0 con 0x7fbab81199a0 2026-02-24T09:16:42.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.671+0000 7fbabc942640 1 -- 10.20.193.28:0/1796432708 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbab8128640 con 0x7fbab81199a0 2026-02-24T09:16:42.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.671+0000 7fba97fff640 1 -- 10.20.193.28:0/1796432708 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fbaa800de40 con 0x7fbab81199a0 2026-02-24T09:16:42.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.671+0000 7fba97fff640 1 -- 10.20.193.28:0/1796432708 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbaa80116b0 con 0x7fbab81199a0 2026-02-24T09:16:42.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.671+0000 7fbabc942640 1 -- 10.20.193.28:0/1796432708 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbab8168d40 con 0x7fbab81199a0 2026-02-24T09:16:42.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.672+0000 7fbabc942640 1 -- 10.20.193.28:0/1796432708 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbab8067220 con 0x7fbab81199a0 2026-02-24T09:16:42.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.675+0000 7fba97fff640 1 -- 10.20.193.28:0/1796432708 <== mon.2 v2:10.20.193.74:3300/0 4 ==== mgrmap(e 19) ==== 157139+0+0 (secure 0 0 0) 0x7fbaa8020060 con 0x7fbab81199a0 2026-02-24T09:16:42.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.677+0000 7fba97fff640 1 --2- 10.20.193.28:0/1796432708 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fba8c0b57b0 0x7fba8c0d5c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.677+0000 7fba97fff640 1 -- 10.20.193.28:0/1796432708 <== mon.2 v2:10.20.193.74:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7334+0+0 (secure 0 0 0) 0x7fbaa8015070 con 0x7fbab81199a0 2026-02-24T09:16:42.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.677+0000 7fbab6d76640 1 --2- 10.20.193.28:0/1796432708 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fba8c0b57b0 0x7fba8c0d5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.677+0000 7fba97fff640 1 -- 10.20.193.28:0/1796432708 <== mon.2 v2:10.20.193.74:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fbaa80e7c00 con 0x7fbab81199a0 2026-02-24T09:16:42.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.678+0000 7fbab6d76640 1 --2- 10.20.193.28:0/1796432708 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fba8c0b57b0 0x7fba8c0d5c60 secure :-1 s=READY pgs=117 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbaac0098a0 tx=0x7fbaac03a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:42.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:42 trial159 ceph-mon[44242]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:42.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:42 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:42.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:42 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:42.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:42 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:42.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:42 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:42.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:42 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:42.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:42 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:42.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.819+0000 7fbabc942640 1 -- 10.20.193.28:0/1796432708 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbab81143f0 con 0x7fbab81199a0 2026-02-24T09:16:42.820 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 24 09:16:42 trial028 systemd[1]: Started Ceph mds.j for e9ad50af-1160-11f1-800e-d404e6e7d460. 2026-02-24T09:16:42.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.819+0000 7fba97fff640 1 -- 10.20.193.28:0/1796432708 <== mon.2 v2:10.20.193.74:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2263 (secure 0 0 0) 0x7fbaa80aa670 con 0x7fbab81199a0 2026-02-24T09:16:42.821 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:16:42.822 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":3,"btime":"2026-02-24T09:16:42:395552+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24691,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.159:6833/3049112106","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6832","nonce":3049112106},{"type":"v1","addr":"10.20.193.159:6833","nonce":3049112106}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24710,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.74:6833/1426135976","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6832","nonce":1426135976},{"type":"v1","addr":"10.20.193.74:6833","nonce":1426135976}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2026-02-24T09:16:42.822 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 3 2026-02-24T09:16:42.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.822+0000 7fbabc942640 1 -- 10.20.193.28:0/1796432708 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fba8c0b57b0 msgr2=0x7fba8c0d5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:42.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.822+0000 7fbabc942640 1 --2- 10.20.193.28:0/1796432708 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fba8c0b57b0 0x7fba8c0d5c60 secure :-1 s=READY pgs=117 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbaac0098a0 tx=0x7fbaac03a040 comp rx=0 tx=0).stop 2026-02-24T09:16:42.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.822+0000 7fbabc942640 1 -- 10.20.193.28:0/1796432708 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fbab81199a0 msgr2=0x7fbab8127a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:42.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.822+0000 7fbabc942640 1 --2- 10.20.193.28:0/1796432708 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fbab81199a0 0x7fbab8127a10 secure :-1 s=READY pgs=78 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbaa800f8d0 tx=0x7fbaa800fda0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.822+0000 7fbabc942640 1 -- 10.20.193.28:0/1796432708 shutdown_connections 2026-02-24T09:16:42.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.822+0000 7fbabc942640 1 --2- 10.20.193.28:0/1796432708 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fba8c0b57b0 0x7fba8c0d5c60 unknown :-1 s=CLOSED pgs=117 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.822+0000 7fbabc942640 1 --2- 10.20.193.28:0/1796432708 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fbab81199a0 0x7fbab8127a10 unknown :-1 s=CLOSED pgs=78 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.822+0000 7fbabc942640 1 --2- 10.20.193.28:0/1796432708 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbab8114a10 0x7fbab8122640 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.822+0000 7fbabc942640 1 --2- 10.20.193.28:0/1796432708 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fbab8114020 0x7fbab8122100 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.822+0000 7fbabc942640 1 -- 10.20.193.28:0/1796432708 >> 10.20.193.28:0/1796432708 conn(0x7fbab8064810 msgr2=0x7fbab8065bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:42.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.822+0000 7fbabc942640 1 -- 10.20.193.28:0/1796432708 shutdown_connections 2026-02-24T09:16:42.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:42.823+0000 7fbabc942640 1 -- 10.20.193.28:0/1796432708 wait complete. 2026-02-24T09:16:42.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:42 trial074 ceph-mon[44412]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:42.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:42 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:42.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:42 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:42.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:42 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:42.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:42 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:42.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:42 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:42.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:42 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:43.110 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 24 09:16:42 trial028 ceph-mds[108453]: -- 10.20.193.28:0/3555783055 <== mon.0 v2:10.20.193.28:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x1938f860 con 0x194ca000 2026-02-24T09:16:43.110 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 24 09:16:42 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-j[108449]: starting mds.j at 2026-02-24T09:16:43.589 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:43 trial028 ceph-mon[40371]: Deploying daemon mds.j on trial028 2026-02-24T09:16:43.590 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:43 trial028 ceph-mon[40371]: mds.? [v2:10.20.193.74:6832/1426135976,v1:10.20.193.74:6833/1426135976] up:boot 2026-02-24T09:16:43.590 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:43 trial028 ceph-mon[40371]: fsmap 2 up:standby 2026-02-24T09:16:43.590 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:43 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-24T09:16:43.590 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:43 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/1796432708' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:16:43.590 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:43 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:43.590 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:43 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:43.590 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:43 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:43.590 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:43 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:43.590 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:43 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:43.591 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:43 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:43.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:43 trial159 ceph-mon[44242]: Deploying daemon mds.j on trial028 2026-02-24T09:16:43.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:43 trial159 ceph-mon[44242]: mds.? [v2:10.20.193.74:6832/1426135976,v1:10.20.193.74:6833/1426135976] up:boot 2026-02-24T09:16:43.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:43 trial159 ceph-mon[44242]: fsmap 2 up:standby 2026-02-24T09:16:43.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:43 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-24T09:16:43.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:43 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/1796432708' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:16:43.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:43 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:43.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:43 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:43.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:43 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:43.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:43 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:43.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:43 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:43.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:43 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:43.860 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 24 09:16:43 trial028 systemd[1]: Starting Ceph mds.d for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:16:43.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:43 trial074 ceph-mon[44412]: Deploying daemon mds.j on trial028 2026-02-24T09:16:43.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:43 trial074 ceph-mon[44412]: mds.? [v2:10.20.193.74:6832/1426135976,v1:10.20.193.74:6833/1426135976] up:boot 2026-02-24T09:16:43.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:43 trial074 ceph-mon[44412]: fsmap 2 up:standby 2026-02-24T09:16:43.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:43 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-24T09:16:43.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:43 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/1796432708' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:16:43.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:43 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:43.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:43 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:43.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:43 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:43.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:43 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:43.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:43 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:43.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:43 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:44.360 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 24 09:16:43 trial028 podman[108748]: 2026-02-24 09:16:43.979054099 +0000 UTC m=+0.027480736 container create 58d73f612dc122e942e1902fab2190d719de33499a3490ca4e5a68b614ca348a (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-d, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, org.label-schema.license=GPLv2, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.build-date=20260223) 2026-02-24T09:16:44.361 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 24 09:16:44 trial028 podman[108748]: 2026-02-24 09:16:44.021707 +0000 UTC m=+0.070133627 container init 58d73f612dc122e942e1902fab2190d719de33499a3490ca4e5a68b614ca348a (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-d, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-vshankar-testing-20260223.155722, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.label-schema.license=GPLv2, org.label-schema.build-date=20260223, io.buildah.version=1.41.3) 2026-02-24T09:16:44.361 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 24 09:16:44 trial028 podman[108748]: 2026-02-24 09:16:44.027253426 +0000 UTC m=+0.075680053 container start 58d73f612dc122e942e1902fab2190d719de33499a3490ca4e5a68b614ca348a (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-d, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-vshankar-testing-20260223.155722, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260223, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, io.buildah.version=1.41.3, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b) 2026-02-24T09:16:44.361 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 24 09:16:44 trial028 bash[108748]: 58d73f612dc122e942e1902fab2190d719de33499a3490ca4e5a68b614ca348a 2026-02-24T09:16:44.361 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 24 09:16:44 trial028 podman[108748]: 2026-02-24 09:16:43.969279393 +0000 UTC m=+0.017706040 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b 2026-02-24T09:16:44.361 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 24 09:16:44 trial028 systemd[1]: Started Ceph mds.d for e9ad50af-1160-11f1-800e-d404e6e7d460. 2026-02-24T09:16:44.361 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 24 09:16:44 trial028 ceph-mds[108768]: -- 10.20.193.28:0/519964684 <== mon.0 v2:10.20.193.28:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x3367f860 con 0x343ea400 2026-02-24T09:16:44.361 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 24 09:16:44 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-d[108764]: starting mds.d at 2026-02-24T09:16:44.680 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:44 trial074 ceph-mon[44412]: Deploying daemon mds.d on trial028 2026-02-24T09:16:44.680 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:44 trial074 ceph-mon[44412]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:44.680 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:44 trial074 ceph-mon[44412]: mds.? [v2:10.20.193.28:6834/3473030842,v1:10.20.193.28:6835/3473030842] up:boot 2026-02-24T09:16:44.680 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:44 trial074 ceph-mon[44412]: fsmap 3 up:standby 2026-02-24T09:16:44.680 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:44 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-24T09:16:44.680 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:44 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:44.680 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:44 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:44.680 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:44 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:44.680 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:44 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:44.680 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:44 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:44.680 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:44 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:44.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:44 trial159 ceph-mon[44242]: Deploying daemon mds.d on trial028 2026-02-24T09:16:44.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:44 trial159 ceph-mon[44242]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:44.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:44 trial159 ceph-mon[44242]: mds.? [v2:10.20.193.28:6834/3473030842,v1:10.20.193.28:6835/3473030842] up:boot 2026-02-24T09:16:44.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:44 trial159 ceph-mon[44242]: fsmap 3 up:standby 2026-02-24T09:16:44.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:44 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-24T09:16:44.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:44 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:44.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:44 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:44.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:44 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:44.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:44 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:44.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:44 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:44.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:44 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:44.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:44 trial028 ceph-mon[40371]: Deploying daemon mds.d on trial028 2026-02-24T09:16:44.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:44 trial028 ceph-mon[40371]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:44.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:44 trial028 ceph-mon[40371]: mds.? [v2:10.20.193.28:6834/3473030842,v1:10.20.193.28:6835/3473030842] up:boot 2026-02-24T09:16:44.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:44 trial028 ceph-mon[40371]: fsmap 3 up:standby 2026-02-24T09:16:44.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:44 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-24T09:16:44.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:44 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:44.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:44 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:44.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:44 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:44.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:44 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:44.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:44 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:44.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:44 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:44.963 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:16:45.124 INFO:journalctl@ceph.mds.e.trial074.stdout:Feb 24 09:16:45 trial074 systemd[1]: Starting Ceph mds.e for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:16:45.150 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:16:45.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.329+0000 7f59aa6fa640 1 -- 10.20.193.28:0/658600920 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59a410bcc0 msgr2=0x7f59a4110b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:45.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.329+0000 7f59aa6fa640 1 --2- 10.20.193.28:0/658600920 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59a410bcc0 0x7f59a4110b50 secure :-1 s=READY pgs=219 gs=1 cs=0 l=1 c_cookie=13578603250519328354 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5998009950 tx=0x7f599802f190 comp rx=0 tx=0).stop 2026-02-24T09:16:45.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.329+0000 7f59aa6fa640 1 -- 10.20.193.28:0/658600920 shutdown_connections 2026-02-24T09:16:45.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.329+0000 7f59aa6fa640 1 --2- 10.20.193.28:0/658600920 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f59a41112e0 0x7f59a4111cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:45.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.329+0000 7f59aa6fa640 1 --2- 10.20.193.28:0/658600920 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59a410bcc0 0x7f59a4110b50 unknown :-1 s=CLOSED pgs=219 gs=1 cs=0 l=1 c_cookie=13578603250519328354 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:45.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.329+0000 7f59aa6fa640 1 --2- 10.20.193.28:0/658600920 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f59a410b2d0 0x7f59a410b6a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:45.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.329+0000 7f59aa6fa640 1 -- 10.20.193.28:0/658600920 >> 10.20.193.28:0/658600920 conn(0x7f59a40e8e40 msgr2=0x7f59a4109250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:45.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.329+0000 7f59aa6fa640 1 -- 10.20.193.28:0/658600920 shutdown_connections 2026-02-24T09:16:45.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.329+0000 7f59aa6fa640 1 -- 10.20.193.28:0/658600920 wait complete. 2026-02-24T09:16:45.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.330+0000 7f59aa6fa640 1 Processor -- start 2026-02-24T09:16:45.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.330+0000 7f59aa6fa640 1 -- start start 2026-02-24T09:16:45.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.330+0000 7f59aa6fa640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f59a410b2d0 0x7f59a40f12c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:45.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.330+0000 7f59aa6fa640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f59a410bcc0 0x7f59a40f1800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:45.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.330+0000 7f59aa6fa640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59a41112e0 0x7f59a40f6b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:45.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.330+0000 7f59aa6fa640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f59a40f71a0 con 0x7f59a41112e0 2026-02-24T09:16:45.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.330+0000 7f59aa6fa640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f59a40f7310 con 0x7f59a410bcc0 2026-02-24T09:16:45.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.330+0000 7f59aa6fa640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f59a40f74d0 con 0x7f59a410b2d0 2026-02-24T09:16:45.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.330+0000 7f59a9ef9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59a41112e0 0x7f59a40f6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:45.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.330+0000 7f59a9ef9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59a41112e0 0x7f59a40f6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53316/0 (socket says 10.20.193.28:53316) 2026-02-24T09:16:45.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.330+0000 7f59a9ef9640 1 -- 10.20.193.28:0/3958531043 learned_addr learned my addr 10.20.193.28:0/3958531043 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:16:45.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.330+0000 7f59a8ef7640 1 --2- 10.20.193.28:0/3958531043 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f59a410bcc0 0x7f59a40f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:45.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.330+0000 7f59a96f8640 1 --2- 10.20.193.28:0/3958531043 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f59a410b2d0 0x7f59a40f12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:45.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.330+0000 7f59a9ef9640 1 -- 10.20.193.28:0/3958531043 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f59a410b2d0 msgr2=0x7f59a40f12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:45.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.330+0000 7f59a9ef9640 1 --2- 10.20.193.28:0/3958531043 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f59a410b2d0 0x7f59a40f12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:45.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.330+0000 7f59a9ef9640 1 -- 10.20.193.28:0/3958531043 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f59a410bcc0 msgr2=0x7f59a40f1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:45.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.330+0000 7f59a9ef9640 1 --2- 10.20.193.28:0/3958531043 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f59a410bcc0 0x7f59a40f1800 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:45.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.330+0000 7f59a9ef9640 1 -- 10.20.193.28:0/3958531043 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5998009570 con 0x7f59a41112e0 2026-02-24T09:16:45.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.331+0000 7f59a9ef9640 1 --2- 10.20.193.28:0/3958531043 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59a41112e0 0x7f59a40f6b80 secure :-1 s=READY pgs=220 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59a000c750 tx=0x7f59a000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:45.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.331+0000 7f59927fc640 1 -- 10.20.193.28:0/3958531043 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59a0005500 con 0x7f59a41112e0 2026-02-24T09:16:45.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.331+0000 7f59927fc640 1 -- 10.20.193.28:0/3958531043 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f59a0003c40 con 0x7f59a41112e0 2026-02-24T09:16:45.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.331+0000 7f59927fc640 1 -- 10.20.193.28:0/3958531043 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59a000dd40 con 0x7f59a41112e0 2026-02-24T09:16:45.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.331+0000 7f59aa6fa640 1 -- 10.20.193.28:0/3958531043 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59a40f77b0 con 0x7f59a41112e0 2026-02-24T09:16:45.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.331+0000 7f59aa6fa640 1 -- 10.20.193.28:0/3958531043 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59a40f7f10 con 0x7f59a41112e0 2026-02-24T09:16:45.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.331+0000 7f59aa6fa640 1 -- 10.20.193.28:0/3958531043 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59a40f79d0 con 0x7f59a41112e0 2026-02-24T09:16:45.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.334+0000 7f59927fc640 1 -- 10.20.193.28:0/3958531043 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 19) ==== 157139+0+0 (secure 0 0 0) 0x7f59a0003780 con 0x7f59a41112e0 2026-02-24T09:16:45.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.336+0000 7f59927fc640 1 --2- 10.20.193.28:0/3958531043 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f59800b57b0 0x7f59800d5c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:45.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.336+0000 7f59927fc640 1 -- 10.20.193.28:0/3958531043 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7334+0+0 (secure 0 0 0) 0x7f59a00e6c70 con 0x7f59a41112e0 2026-02-24T09:16:45.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.336+0000 7f59927fc640 1 -- 10.20.193.28:0/3958531043 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f59a00e70f0 con 0x7f59a41112e0 2026-02-24T09:16:45.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.336+0000 7f59a96f8640 1 --2- 10.20.193.28:0/3958531043 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f59800b57b0 0x7f59800d5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:45.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.336+0000 7f59a96f8640 1 --2- 10.20.193.28:0/3958531043 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f59800b57b0 0x7f59800d5c60 secure :-1 s=READY pgs=120 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5994006fd0 tx=0x7f5994008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:45.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.478+0000 7f59aa6fa640 1 -- 10.20.193.28:0/3958531043 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59a40f23d0 con 0x7f59a41112e0 2026-02-24T09:16:45.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.478+0000 7f59927fc640 1 -- 10.20.193.28:0/3958531043 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3913 (secure 0 0 0) 0x7f59a00a9a30 con 0x7f59a41112e0 2026-02-24T09:16:45.481 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:16:45.481 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":5,"btime":"2026-02-24T09:16:44:868156+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14856,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/3473030842","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":3473030842},{"type":"v1","addr":"10.20.193.28:6835","nonce":3473030842}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14862,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/4120804601","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":4120804601},{"type":"v1","addr":"10.20.193.28:6837","nonce":4120804601}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24691,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.159:6833/3049112106","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6832","nonce":3049112106},{"type":"v1","addr":"10.20.193.159:6833","nonce":3049112106}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24710,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.74:6833/1426135976","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6832","nonce":1426135976},{"type":"v1","addr":"10.20.193.74:6833","nonce":1426135976}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2026-02-24T09:16:45.481 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 5 2026-02-24T09:16:45.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.480+0000 7f59aa6fa640 1 -- 10.20.193.28:0/3958531043 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f59800b57b0 msgr2=0x7f59800d5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:45.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.480+0000 7f59aa6fa640 1 --2- 10.20.193.28:0/3958531043 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f59800b57b0 0x7f59800d5c60 secure :-1 s=READY pgs=120 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5994006fd0 tx=0x7f5994008040 comp rx=0 tx=0).stop 2026-02-24T09:16:45.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.480+0000 7f59aa6fa640 1 -- 10.20.193.28:0/3958531043 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59a41112e0 msgr2=0x7f59a40f6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:45.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.480+0000 7f59aa6fa640 1 --2- 10.20.193.28:0/3958531043 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59a41112e0 0x7f59a40f6b80 secure :-1 s=READY pgs=220 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59a000c750 tx=0x7f59a000cc20 comp rx=0 tx=0).stop 2026-02-24T09:16:45.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.480+0000 7f59aa6fa640 1 -- 10.20.193.28:0/3958531043 shutdown_connections 2026-02-24T09:16:45.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.480+0000 7f59aa6fa640 1 --2- 10.20.193.28:0/3958531043 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f59800b57b0 0x7f59800d5c60 unknown :-1 s=CLOSED pgs=120 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:45.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.480+0000 7f59aa6fa640 1 --2- 10.20.193.28:0/3958531043 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59a41112e0 0x7f59a40f6b80 unknown :-1 s=CLOSED pgs=220 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:45.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.480+0000 7f59aa6fa640 1 --2- 10.20.193.28:0/3958531043 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f59a410bcc0 0x7f59a40f1800 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:45.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.480+0000 7f59aa6fa640 1 --2- 10.20.193.28:0/3958531043 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f59a410b2d0 0x7f59a40f12c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:45.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.481+0000 7f59aa6fa640 1 -- 10.20.193.28:0/3958531043 >> 10.20.193.28:0/3958531043 conn(0x7f59a40e8e40 msgr2=0x7f59a410f150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:45.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.481+0000 7f59aa6fa640 1 -- 10.20.193.28:0/3958531043 shutdown_connections 2026-02-24T09:16:45.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:45.481+0000 7f59aa6fa640 1 -- 10.20.193.28:0/3958531043 wait complete. 2026-02-24T09:16:45.540 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:45 trial028 ceph-mon[40371]: Deploying daemon mds.e on trial074 2026-02-24T09:16:45.540 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:45 trial028 ceph-mon[40371]: mds.? [v2:10.20.193.28:6836/4120804601,v1:10.20.193.28:6837/4120804601] up:boot 2026-02-24T09:16:45.540 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:45 trial028 ceph-mon[40371]: fsmap 4 up:standby 2026-02-24T09:16:45.540 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:45 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-24T09:16:45.541 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:45 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:45.541 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:45 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:45.541 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:45 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:45.541 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:45 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:45.541 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:45 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:45.541 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:45 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:45.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:45 trial074 ceph-mon[44412]: Deploying daemon mds.e on trial074 2026-02-24T09:16:45.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:45 trial074 ceph-mon[44412]: mds.? [v2:10.20.193.28:6836/4120804601,v1:10.20.193.28:6837/4120804601] up:boot 2026-02-24T09:16:45.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:45 trial074 ceph-mon[44412]: fsmap 4 up:standby 2026-02-24T09:16:45.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:45 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-24T09:16:45.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:45 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:45.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:45 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:45.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:45 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:45.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:45 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:45.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:45 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:45.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:45 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:45.625 INFO:journalctl@ceph.mds.e.trial074.stdout:Feb 24 09:16:45 trial074 podman[97199]: 2026-02-24 09:16:45.239556968 +0000 UTC m=+0.027253784 container create cc859768621fa5c5e7416d48272c694691bd9d9e30e03dbdec6590e01f1526d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-e, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, org.label-schema.build-date=20260223, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, CEPH_REF=wip-vshankar-testing-20260223.155722) 2026-02-24T09:16:45.625 INFO:journalctl@ceph.mds.e.trial074.stdout:Feb 24 09:16:45 trial074 podman[97199]: 2026-02-24 09:16:45.278694567 +0000 UTC m=+0.066391373 container init cc859768621fa5c5e7416d48272c694691bd9d9e30e03dbdec6590e01f1526d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-e, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, CEPH_REF=wip-vshankar-testing-20260223.155722, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-24T09:16:45.625 INFO:journalctl@ceph.mds.e.trial074.stdout:Feb 24 09:16:45 trial074 podman[97199]: 2026-02-24 09:16:45.283457208 +0000 UTC m=+0.071154024 container start cc859768621fa5c5e7416d48272c694691bd9d9e30e03dbdec6590e01f1526d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-e, org.label-schema.build-date=20260223, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-vshankar-testing-20260223.155722, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, ceph=True, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS) 2026-02-24T09:16:45.625 INFO:journalctl@ceph.mds.e.trial074.stdout:Feb 24 09:16:45 trial074 bash[97199]: cc859768621fa5c5e7416d48272c694691bd9d9e30e03dbdec6590e01f1526d5 2026-02-24T09:16:45.625 INFO:journalctl@ceph.mds.e.trial074.stdout:Feb 24 09:16:45 trial074 podman[97199]: 2026-02-24 09:16:45.229481777 +0000 UTC m=+0.017178593 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b 2026-02-24T09:16:45.625 INFO:journalctl@ceph.mds.e.trial074.stdout:Feb 24 09:16:45 trial074 systemd[1]: Started Ceph mds.e for e9ad50af-1160-11f1-800e-d404e6e7d460. 2026-02-24T09:16:45.625 INFO:journalctl@ceph.mds.e.trial074.stdout:Feb 24 09:16:45 trial074 ceph-mds[97219]: -- 10.20.193.74:0/357840490 <== mon.2 v2:10.20.193.74:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x12fc9860 con 0x12ffdc00 2026-02-24T09:16:45.626 INFO:journalctl@ceph.mds.e.trial074.stdout:Feb 24 09:16:45 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-e[97215]: starting mds.e at 2026-02-24T09:16:45.696 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:45 trial159 ceph-mon[44242]: Deploying daemon mds.e on trial074 2026-02-24T09:16:45.696 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:45 trial159 ceph-mon[44242]: mds.? [v2:10.20.193.28:6836/4120804601,v1:10.20.193.28:6837/4120804601] up:boot 2026-02-24T09:16:45.696 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:45 trial159 ceph-mon[44242]: fsmap 4 up:standby 2026-02-24T09:16:45.696 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:45 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-24T09:16:45.696 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:45 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:45.696 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:45 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:45.696 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:45 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:45.697 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:45 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:45.697 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:45 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:45.697 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:45 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:46.417 INFO:journalctl@ceph.mds.f.trial159.stdout:Feb 24 09:16:46 trial159 systemd[1]: Starting Ceph mds.f for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:16:46.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:46 trial159 ceph-mon[44242]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:46.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:46 trial159 ceph-mon[44242]: Deploying daemon mds.f on trial159 2026-02-24T09:16:46.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:46 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/3958531043' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:16:46.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:46 trial159 ceph-mon[44242]: mds.? [v2:10.20.193.74:6834/2067708838,v1:10.20.193.74:6835/2067708838] up:boot 2026-02-24T09:16:46.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:46 trial159 ceph-mon[44242]: fsmap 5 up:standby 2026-02-24T09:16:46.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:46 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-24T09:16:46.780 INFO:journalctl@ceph.mds.f.trial159.stdout:Feb 24 09:16:46 trial159 podman[97589]: 2026-02-24 09:16:46.480113852 +0000 UTC m=+0.030437737 container create a30a19c3bc777d6a4cc8b5c4b030876c8a30b2fead01d89211aa6ceaa7fa1d0c (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-f, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260223, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-vshankar-testing-20260223.155722, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b) 2026-02-24T09:16:46.780 INFO:journalctl@ceph.mds.f.trial159.stdout:Feb 24 09:16:46 trial159 podman[97589]: 2026-02-24 09:16:46.518489865 +0000 UTC m=+0.068813759 container init a30a19c3bc777d6a4cc8b5c4b030876c8a30b2fead01d89211aa6ceaa7fa1d0c (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-f, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.build-date=20260223, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-24T09:16:46.780 INFO:journalctl@ceph.mds.f.trial159.stdout:Feb 24 09:16:46 trial159 podman[97589]: 2026-02-24 09:16:46.523507278 +0000 UTC m=+0.073831162 container start a30a19c3bc777d6a4cc8b5c4b030876c8a30b2fead01d89211aa6ceaa7fa1d0c (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-vshankar-testing-20260223.155722, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, ceph=True, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b) 2026-02-24T09:16:46.780 INFO:journalctl@ceph.mds.f.trial159.stdout:Feb 24 09:16:46 trial159 bash[97589]: a30a19c3bc777d6a4cc8b5c4b030876c8a30b2fead01d89211aa6ceaa7fa1d0c 2026-02-24T09:16:46.780 INFO:journalctl@ceph.mds.f.trial159.stdout:Feb 24 09:16:46 trial159 podman[97589]: 2026-02-24 09:16:46.469152242 +0000 UTC m=+0.019476116 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b 2026-02-24T09:16:46.780 INFO:journalctl@ceph.mds.f.trial159.stdout:Feb 24 09:16:46 trial159 systemd[1]: Started Ceph mds.f for e9ad50af-1160-11f1-800e-d404e6e7d460. 2026-02-24T09:16:46.780 INFO:journalctl@ceph.mds.f.trial159.stdout:Feb 24 09:16:46 trial159 ceph-mds[97609]: -- 10.20.193.159:0/2312549069 <== mon.1 v2:10.20.193.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x4ca1860 con 0x5a0c400 2026-02-24T09:16:46.780 INFO:journalctl@ceph.mds.f.trial159.stdout:Feb 24 09:16:46 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-f[97605]: starting mds.f at 2026-02-24T09:16:46.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:46 trial028 ceph-mon[40371]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:46.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:46 trial028 ceph-mon[40371]: Deploying daemon mds.f on trial159 2026-02-24T09:16:46.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:46 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/3958531043' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:16:46.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:46 trial028 ceph-mon[40371]: mds.? [v2:10.20.193.74:6834/2067708838,v1:10.20.193.74:6835/2067708838] up:boot 2026-02-24T09:16:46.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:46 trial028 ceph-mon[40371]: fsmap 5 up:standby 2026-02-24T09:16:46.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:46 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-24T09:16:46.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:46 trial074 ceph-mon[44412]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:46.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:46 trial074 ceph-mon[44412]: Deploying daemon mds.f on trial159 2026-02-24T09:16:46.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:46 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/3958531043' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:16:46.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:46 trial074 ceph-mon[44412]: mds.? [v2:10.20.193.74:6834/2067708838,v1:10.20.193.74:6835/2067708838] up:boot 2026-02-24T09:16:46.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:46 trial074 ceph-mon[44412]: fsmap 5 up:standby 2026-02-24T09:16:46.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:46 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-24T09:16:47.586 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:16:47.738 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:47.738 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:47.738 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:47.738 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:47.738 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:47.738 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:47.739 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:47 trial159 ceph-mon[44242]: Deploying daemon mds.c on trial159 2026-02-24T09:16:47.739 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:47 trial159 ceph-mon[44242]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:47.739 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:47 trial159 ceph-mon[44242]: mds.? [v2:10.20.193.159:6834/3999384392,v1:10.20.193.159:6835/3999384392] up:boot 2026-02-24T09:16:47.739 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:47 trial159 ceph-mon[44242]: fsmap 6 up:standby 2026-02-24T09:16:47.739 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:47 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-24T09:16:47.772 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:16:47.839 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:47.839 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:47.839 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:47.839 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:47.839 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:47.839 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:47.839 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:47 trial028 ceph-mon[40371]: Deploying daemon mds.c on trial159 2026-02-24T09:16:47.840 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:47 trial028 ceph-mon[40371]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:47.840 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:47 trial028 ceph-mon[40371]: mds.? [v2:10.20.193.159:6834/3999384392,v1:10.20.193.159:6835/3999384392] up:boot 2026-02-24T09:16:47.840 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:47 trial028 ceph-mon[40371]: fsmap 6 up:standby 2026-02-24T09:16:47.840 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:47 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-24T09:16:47.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:47.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:47.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:47.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:47.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:47.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:47.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:47 trial074 ceph-mon[44412]: Deploying daemon mds.c on trial159 2026-02-24T09:16:47.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:47 trial074 ceph-mon[44412]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:47.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:47 trial074 ceph-mon[44412]: mds.? [v2:10.20.193.159:6834/3999384392,v1:10.20.193.159:6835/3999384392] up:boot 2026-02-24T09:16:47.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:47 trial074 ceph-mon[44412]: fsmap 6 up:standby 2026-02-24T09:16:47.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:47 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-24T09:16:47.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.947+0000 7f608a71a640 1 -- 10.20.193.28:0/2879039059 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f608410e120 msgr2=0x7f608410e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:47.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.947+0000 7f608a71a640 1 --2- 10.20.193.28:0/2879039059 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f608410e120 0x7f608410e4f0 secure :-1 s=READY pgs=221 gs=1 cs=0 l=1 c_cookie=4387526446473851672 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6074009950 tx=0x7f607402f190 comp rx=0 tx=0).stop 2026-02-24T09:16:47.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.947+0000 7f608a71a640 1 -- 10.20.193.28:0/2879039059 shutdown_connections 2026-02-24T09:16:47.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.947+0000 7f608a71a640 1 --2- 10.20.193.28:0/2879039059 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f60841536d0 0x7f6084173af0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:47.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.947+0000 7f608a71a640 1 --2- 10.20.193.28:0/2879039059 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f608410eb10 0x7f6084153190 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:47.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.947+0000 7f608a71a640 1 --2- 10.20.193.28:0/2879039059 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f608410e120 0x7f608410e4f0 unknown :-1 s=CLOSED pgs=221 gs=1 cs=0 l=1 c_cookie=4387526446473851672 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:47.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.947+0000 7f608a71a640 1 -- 10.20.193.28:0/2879039059 >> 10.20.193.28:0/2879039059 conn(0x7f60840e9b70 msgr2=0x7f6084109f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:47.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.947+0000 7f608a71a640 1 -- 10.20.193.28:0/2879039059 shutdown_connections 2026-02-24T09:16:47.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.947+0000 7f608a71a640 1 -- 10.20.193.28:0/2879039059 wait complete. 2026-02-24T09:16:47.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.948+0000 7f608a71a640 1 Processor -- start 2026-02-24T09:16:47.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.948+0000 7f608a71a640 1 -- start start 2026-02-24T09:16:47.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.948+0000 7f608a71a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f608410e120 0x7f608415fe00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:47.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.948+0000 7f608a71a640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f608410eb10 0x7f6084160340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:47.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.948+0000 7f608a71a640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f60841536d0 0x7f6084165710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:47.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.948+0000 7f608a71a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6084165d30 con 0x7f608410e120 2026-02-24T09:16:47.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.948+0000 7f608a71a640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f6084165ea0 con 0x7f608410eb10 2026-02-24T09:16:47.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.948+0000 7f608a71a640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6084166060 con 0x7f60841536d0 2026-02-24T09:16:47.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.948+0000 7f6089718640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f608410e120 0x7f608415fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:47.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.948+0000 7f6089718640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f608410e120 0x7f608415fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40454/0 (socket says 10.20.193.28:40454) 2026-02-24T09:16:47.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.948+0000 7f6089718640 1 -- 10.20.193.28:0/593928778 learned_addr learned my addr 10.20.193.28:0/593928778 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:16:47.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.948+0000 7f6088f17640 1 --2- 10.20.193.28:0/593928778 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f608410eb10 0x7f6084160340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:47.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.949+0000 7f6089f19640 1 --2- 10.20.193.28:0/593928778 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f60841536d0 0x7f6084165710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:47.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.949+0000 7f6089718640 1 -- 10.20.193.28:0/593928778 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f60841536d0 msgr2=0x7f6084165710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:47.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.949+0000 7f6089718640 1 --2- 10.20.193.28:0/593928778 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f60841536d0 0x7f6084165710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:47.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.949+0000 7f6089718640 1 -- 10.20.193.28:0/593928778 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f608410eb10 msgr2=0x7f6084160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:47.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.949+0000 7f6089718640 1 --2- 10.20.193.28:0/593928778 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f608410eb10 0x7f6084160340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:47.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.949+0000 7f6089718640 1 -- 10.20.193.28:0/593928778 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6074009570 con 0x7f608410e120 2026-02-24T09:16:47.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.949+0000 7f6089718640 1 --2- 10.20.193.28:0/593928778 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f608410e120 0x7f608415fe00 secure :-1 s=READY pgs=222 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f60740098a0 tx=0x7f60740028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:47.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.949+0000 7f60727fc640 1 -- 10.20.193.28:0/593928778 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f607403d070 con 0x7f608410e120 2026-02-24T09:16:47.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.949+0000 7f60727fc640 1 -- 10.20.193.28:0/593928778 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6074002a40 con 0x7f608410e120 2026-02-24T09:16:47.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.949+0000 7f60727fc640 1 -- 10.20.193.28:0/593928778 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6074041820 con 0x7f608410e120 2026-02-24T09:16:47.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.949+0000 7f608a71a640 1 -- 10.20.193.28:0/593928778 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60841662e0 con 0x7f608410e120 2026-02-24T09:16:47.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.949+0000 7f608a71a640 1 -- 10.20.193.28:0/593928778 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f608414f150 con 0x7f608410e120 2026-02-24T09:16:47.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.950+0000 7f608a71a640 1 -- 10.20.193.28:0/593928778 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6084060380 con 0x7f608410e120 2026-02-24T09:16:47.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.952+0000 7f60727fc640 1 -- 10.20.193.28:0/593928778 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 19) ==== 157139+0+0 (secure 0 0 0) 0x7f60740419c0 con 0x7f608410e120 2026-02-24T09:16:47.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.954+0000 7f60727fc640 1 --2- 10.20.193.28:0/593928778 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f60600b57b0 0x7f60600d5c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:47.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.954+0000 7f60727fc640 1 -- 10.20.193.28:0/593928778 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7334+0+0 (secure 0 0 0) 0x7f607410b120 con 0x7f608410e120 2026-02-24T09:16:47.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.954+0000 7f6088f17640 1 --2- 10.20.193.28:0/593928778 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f60600b57b0 0x7f60600d5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:47.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.954+0000 7f60727fc640 1 -- 10.20.193.28:0/593928778 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f607410b5a0 con 0x7f608410e120 2026-02-24T09:16:47.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:47.954+0000 7f6088f17640 1 --2- 10.20.193.28:0/593928778 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f60600b57b0 0x7f60600d5c60 secure :-1 s=READY pgs=123 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f60841667a0 tx=0x7f6078005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:48.030 INFO:journalctl@ceph.mds.c.trial159.stdout:Feb 24 09:16:47 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-c[97899]: starting mds.c at 2026-02-24T09:16:48.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:48.094+0000 7f608a71a640 1 -- 10.20.193.28:0/593928778 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f608410e4f0 con 0x7f608410e120 2026-02-24T09:16:48.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:48.094+0000 7f60727fc640 1 -- 10.20.193.28:0/593928778 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5566 (secure 0 0 0) 0x7f60740cde50 con 0x7f608410e120 2026-02-24T09:16:48.096 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:16:48.096 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":7,"btime":"2026-02-24T09:16:47:416137+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14856,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/3473030842","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":3473030842},{"type":"v1","addr":"10.20.193.28:6835","nonce":3473030842}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14862,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/4120804601","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":4120804601},{"type":"v1","addr":"10.20.193.28:6837","nonce":4120804601}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24691,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.159:6833/3049112106","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6832","nonce":3049112106},{"type":"v1","addr":"10.20.193.159:6833","nonce":3049112106}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24710,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.74:6833/1426135976","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6832","nonce":1426135976},{"type":"v1","addr":"10.20.193.74:6833","nonce":1426135976}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24721,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.159:6835/3999384392","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6834","nonce":3999384392},{"type":"v1","addr":"10.20.193.159:6835","nonce":3999384392}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24734,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.74:6835/2067708838","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6834","nonce":2067708838},{"type":"v1","addr":"10.20.193.74:6835","nonce":2067708838}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2026-02-24T09:16:48.096 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 7 2026-02-24T09:16:48.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:48.095+0000 7f608a71a640 1 -- 10.20.193.28:0/593928778 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f60600b57b0 msgr2=0x7f60600d5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:48.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:48.095+0000 7f608a71a640 1 --2- 10.20.193.28:0/593928778 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f60600b57b0 0x7f60600d5c60 secure :-1 s=READY pgs=123 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f60841667a0 tx=0x7f6078005f90 comp rx=0 tx=0).stop 2026-02-24T09:16:48.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:48.095+0000 7f608a71a640 1 -- 10.20.193.28:0/593928778 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f608410e120 msgr2=0x7f608415fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:48.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:48.095+0000 7f608a71a640 1 --2- 10.20.193.28:0/593928778 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f608410e120 0x7f608415fe00 secure :-1 s=READY pgs=222 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f60740098a0 tx=0x7f60740028d0 comp rx=0 tx=0).stop 2026-02-24T09:16:48.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:48.096+0000 7f608a71a640 1 -- 10.20.193.28:0/593928778 shutdown_connections 2026-02-24T09:16:48.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:48.096+0000 7f608a71a640 1 --2- 10.20.193.28:0/593928778 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f60600b57b0 0x7f60600d5c60 unknown :-1 s=CLOSED pgs=123 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:48.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:48.096+0000 7f608a71a640 1 --2- 10.20.193.28:0/593928778 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f60841536d0 0x7f6084165710 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:48.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:48.096+0000 7f608a71a640 1 --2- 10.20.193.28:0/593928778 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f608410eb10 0x7f6084160340 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:48.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:48.096+0000 7f608a71a640 1 --2- 10.20.193.28:0/593928778 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f608410e120 0x7f608415fe00 unknown :-1 s=CLOSED pgs=222 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:48.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:48.096+0000 7f608a71a640 1 -- 10.20.193.28:0/593928778 >> 10.20.193.28:0/593928778 conn(0x7f60840e9b70 msgr2=0x7f6084109f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:48.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:48.096+0000 7f608a71a640 1 -- 10.20.193.28:0/593928778 shutdown_connections 2026-02-24T09:16:48.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:48.096+0000 7f608a71a640 1 -- 10.20.193.28:0/593928778 wait complete. 2026-02-24T09:16:48.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:48 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:48.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:48 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:48.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:48 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:48.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:48 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:48.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:48 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:48.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:48 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:48.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:48 trial074 ceph-mon[44412]: Deploying daemon mds.h on trial074 2026-02-24T09:16:48.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:48 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/593928778' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:16:48.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:48 trial074 ceph-mon[44412]: mds.? [v2:10.20.193.159:6836/2059577520,v1:10.20.193.159:6837/2059577520] up:boot 2026-02-24T09:16:48.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:48 trial074 ceph-mon[44412]: fsmap 7 up:standby 2026-02-24T09:16:48.875 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:48 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-24T09:16:49.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:48 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:49.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:48 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:49.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:48 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:49.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:48 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:49.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:48 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:49.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:48 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:49.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:48 trial028 ceph-mon[40371]: Deploying daemon mds.h on trial074 2026-02-24T09:16:49.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:48 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/593928778' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:16:49.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:48 trial028 ceph-mon[40371]: mds.? [v2:10.20.193.159:6836/2059577520,v1:10.20.193.159:6837/2059577520] up:boot 2026-02-24T09:16:49.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:48 trial028 ceph-mon[40371]: fsmap 7 up:standby 2026-02-24T09:16:49.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:48 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-24T09:16:49.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:48 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:49.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:48 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:49.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:48 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:49.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:48 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:49.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:48 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:49.281 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:48 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:49.281 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:48 trial159 ceph-mon[44242]: Deploying daemon mds.h on trial074 2026-02-24T09:16:49.281 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:48 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/593928778' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:16:49.281 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:48 trial159 ceph-mon[44242]: mds.? [v2:10.20.193.159:6836/2059577520,v1:10.20.193.159:6837/2059577520] up:boot 2026-02-24T09:16:49.281 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:48 trial159 ceph-mon[44242]: fsmap 7 up:standby 2026-02-24T09:16:49.281 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:48 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-24T09:16:49.374 INFO:journalctl@ceph.mds.h.trial074.stdout:Feb 24 09:16:49 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-h[97510]: starting mds.h at 2026-02-24T09:16:50.199 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:16:50.263 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:50 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:50.263 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:50 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:50.263 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:50 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:50.263 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:50 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:50.263 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:50 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:50.263 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:50 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:50.263 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:50 trial159 ceph-mon[44242]: Deploying daemon mds.i on trial159 2026-02-24T09:16:50.263 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:50 trial159 ceph-mon[44242]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:50.263 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:50 trial159 ceph-mon[44242]: mds.? [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] up:boot 2026-02-24T09:16:50.264 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:50 trial159 ceph-mon[44242]: fsmap 8 up:standby 2026-02-24T09:16:50.264 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:50 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-24T09:16:50.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:50 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:50.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:50 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:50.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:50 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:50.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:50 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:50.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:50 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:50.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:50 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:50.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:50 trial074 ceph-mon[44412]: Deploying daemon mds.i on trial159 2026-02-24T09:16:50.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:50 trial074 ceph-mon[44412]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:50.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:50 trial074 ceph-mon[44412]: mds.? [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] up:boot 2026-02-24T09:16:50.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:50 trial074 ceph-mon[44412]: fsmap 8 up:standby 2026-02-24T09:16:50.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:50 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-24T09:16:50.389 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:16:50.435 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:50 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:50.435 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:50 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:50.435 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:50 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:50.435 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:50 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:50.435 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:50 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:50.435 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:50 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:50.435 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:50 trial028 ceph-mon[40371]: Deploying daemon mds.i on trial159 2026-02-24T09:16:50.435 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:50 trial028 ceph-mon[40371]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:50.435 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:50 trial028 ceph-mon[40371]: mds.? [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] up:boot 2026-02-24T09:16:50.435 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:50 trial028 ceph-mon[40371]: fsmap 8 up:standby 2026-02-24T09:16:50.436 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:50 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-24T09:16:50.530 INFO:journalctl@ceph.mds.i.trial159.stdout:Feb 24 09:16:50 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-i[98194]: starting mds.i at 2026-02-24T09:16:50.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.569+0000 7f4bae6a2640 1 -- 10.20.193.28:0/2902790135 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ba810aec0 msgr2=0x7f4ba810b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:50.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.569+0000 7f4bae6a2640 1 --2- 10.20.193.28:0/2902790135 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ba810aec0 0x7f4ba810b290 secure :-1 s=READY pgs=223 gs=1 cs=0 l=1 c_cookie=16050466241605212044 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4b98009950 tx=0x7f4b9802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:16:50.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.570+0000 7f4bae6a2640 1 -- 10.20.193.28:0/2902790135 shutdown_connections 2026-02-24T09:16:50.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.570+0000 7f4bae6a2640 1 --2- 10.20.193.28:0/2902790135 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f4ba8110ed0 0x7f4ba81118b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:50.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.570+0000 7f4bae6a2640 1 --2- 10.20.193.28:0/2902790135 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f4ba810b8b0 0x7f4ba8110740 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:50.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.570+0000 7f4bae6a2640 1 --2- 10.20.193.28:0/2902790135 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ba810aec0 0x7f4ba810b290 unknown :-1 s=CLOSED pgs=223 gs=1 cs=0 l=1 c_cookie=16050466241605212044 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:50.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.570+0000 7f4bae6a2640 1 -- 10.20.193.28:0/2902790135 >> 10.20.193.28:0/2902790135 conn(0x7f4ba80e8a50 msgr2=0x7f4ba8108e60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:50.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.570+0000 7f4bae6a2640 1 -- 10.20.193.28:0/2902790135 shutdown_connections 2026-02-24T09:16:50.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.570+0000 7f4bae6a2640 1 -- 10.20.193.28:0/2902790135 wait complete. 2026-02-24T09:16:50.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.570+0000 7f4bae6a2640 1 Processor -- start 2026-02-24T09:16:50.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.571+0000 7f4bae6a2640 1 -- start start 2026-02-24T09:16:50.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.571+0000 7f4bae6a2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ba810aec0 0x7f4ba81231c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:50.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.571+0000 7f4bae6a2640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f4ba810b8b0 0x7f4ba8123700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:50.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.571+0000 7f4bae6a2640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f4ba8110ed0 0x7f4ba8128ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:50.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.571+0000 7f4bae6a2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba81290f0 con 0x7f4ba810aec0 2026-02-24T09:16:50.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.571+0000 7f4bae6a2640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba8129260 con 0x7f4ba810b8b0 2026-02-24T09:16:50.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.571+0000 7f4bae6a2640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba8129420 con 0x7f4ba8110ed0 2026-02-24T09:16:50.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.571+0000 7f4bace9f640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f4ba810b8b0 0x7f4ba8123700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:50.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.571+0000 7f4bace9f640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f4ba810b8b0 0x7f4ba8123700 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:57418/0 (socket says 10.20.193.28:57418) 2026-02-24T09:16:50.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.571+0000 7f4bace9f640 1 -- 10.20.193.28:0/4052643461 learned_addr learned my addr 10.20.193.28:0/4052643461 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:16:50.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.571+0000 7f4bad6a0640 1 --2- 10.20.193.28:0/4052643461 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ba810aec0 0x7f4ba81231c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:50.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.571+0000 7f4badea1640 1 --2- 10.20.193.28:0/4052643461 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f4ba8110ed0 0x7f4ba8128ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:50.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.571+0000 7f4bace9f640 1 -- 10.20.193.28:0/4052643461 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f4ba8110ed0 msgr2=0x7f4ba8128ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:50.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.571+0000 7f4bace9f640 1 --2- 10.20.193.28:0/4052643461 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f4ba8110ed0 0x7f4ba8128ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:50.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.571+0000 7f4bace9f640 1 -- 10.20.193.28:0/4052643461 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ba810aec0 msgr2=0x7f4ba81231c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:50.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.572+0000 7f4bace9f640 1 --2- 10.20.193.28:0/4052643461 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ba810aec0 0x7f4ba81231c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:50.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.572+0000 7f4bace9f640 1 -- 10.20.193.28:0/4052643461 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b98009570 con 0x7f4ba810b8b0 2026-02-24T09:16:50.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.572+0000 7f4bad6a0640 1 --2- 10.20.193.28:0/4052643461 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ba810aec0 0x7f4ba81231c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:16:50.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.572+0000 7f4bace9f640 1 --2- 10.20.193.28:0/4052643461 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f4ba810b8b0 0x7f4ba8123700 secure :-1 s=READY pgs=83 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4b9c00d950 tx=0x7f4b9c00de20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:50.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.572+0000 7f4b967fc640 1 -- 10.20.193.28:0/4052643461 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4b9c004500 con 0x7f4ba810b8b0 2026-02-24T09:16:50.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.572+0000 7f4bae6a2640 1 -- 10.20.193.28:0/4052643461 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ba8129700 con 0x7f4ba810b8b0 2026-02-24T09:16:50.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.572+0000 7f4b967fc640 1 -- 10.20.193.28:0/4052643461 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f4b9c004d10 con 0x7f4ba810b8b0 2026-02-24T09:16:50.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.572+0000 7f4b967fc640 1 -- 10.20.193.28:0/4052643461 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4b9c005280 con 0x7f4ba810b8b0 2026-02-24T09:16:50.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.572+0000 7f4bae6a2640 1 -- 10.20.193.28:0/4052643461 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ba8169e00 con 0x7f4ba810b8b0 2026-02-24T09:16:50.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.573+0000 7f4bae6a2640 1 -- 10.20.193.28:0/4052643461 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ba810bfe0 con 0x7f4ba810b8b0 2026-02-24T09:16:50.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.576+0000 7f4b967fc640 1 -- 10.20.193.28:0/4052643461 <== mon.2 v2:10.20.193.74:3300/0 4 ==== mgrmap(e 19) ==== 157139+0+0 (secure 0 0 0) 0x7f4b9c005410 con 0x7f4ba810b8b0 2026-02-24T09:16:50.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.577+0000 7f4b967fc640 1 --2- 10.20.193.28:0/4052643461 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f4b840b57b0 0x7f4b840d5c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:50.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.578+0000 7f4b967fc640 1 -- 10.20.193.28:0/4052643461 <== mon.2 v2:10.20.193.74:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7334+0+0 (secure 0 0 0) 0x7f4b9c0e6650 con 0x7f4ba810b8b0 2026-02-24T09:16:50.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.578+0000 7f4bad6a0640 1 --2- 10.20.193.28:0/4052643461 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f4b840b57b0 0x7f4b840d5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:50.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.578+0000 7f4b967fc640 1 -- 10.20.193.28:0/4052643461 <== mon.2 v2:10.20.193.74:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f4b9c0e6ad0 con 0x7f4ba810b8b0 2026-02-24T09:16:50.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.578+0000 7f4bad6a0640 1 --2- 10.20.193.28:0/4052643461 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f4b840b57b0 0x7f4b840d5c60 secure :-1 s=READY pgs=126 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4b980098a0 tx=0x7f4b9803a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:50.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.721+0000 7f4bae6a2640 1 -- 10.20.193.28:0/4052643461 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ba8110740 con 0x7f4ba810b8b0 2026-02-24T09:16:50.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.721+0000 7f4b967fc640 1 -- 10.20.193.28:0/4052643461 <== mon.2 v2:10.20.193.74:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7216 (secure 0 0 0) 0x7f4b9c0a9380 con 0x7f4ba810b8b0 2026-02-24T09:16:50.724 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:16:50.724 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":9,"btime":"2026-02-24T09:16:49:844426+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14856,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/3473030842","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":3473030842},{"type":"v1","addr":"10.20.193.28:6835","nonce":3473030842}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14862,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/4120804601","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":4120804601},{"type":"v1","addr":"10.20.193.28:6837","nonce":4120804601}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24691,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.159:6833/3049112106","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6832","nonce":3049112106},{"type":"v1","addr":"10.20.193.159:6833","nonce":3049112106}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24710,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.74:6833/1426135976","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6832","nonce":1426135976},{"type":"v1","addr":"10.20.193.74:6833","nonce":1426135976}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24721,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.159:6835/3999384392","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6834","nonce":3999384392},{"type":"v1","addr":"10.20.193.159:6835","nonce":3999384392}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24727,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.159:6837/2059577520","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6836","nonce":2059577520},{"type":"v1","addr":"10.20.193.159:6837","nonce":2059577520}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24734,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.74:6835/2067708838","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6834","nonce":2067708838},{"type":"v1","addr":"10.20.193.74:6835","nonce":2067708838}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24761,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.74:6837/958749351","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6836","nonce":958749351},{"type":"v1","addr":"10.20.193.74:6837","nonce":958749351}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2026-02-24T09:16:50.724 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 9 2026-02-24T09:16:50.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.724+0000 7f4bae6a2640 1 -- 10.20.193.28:0/4052643461 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f4b840b57b0 msgr2=0x7f4b840d5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:50.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.724+0000 7f4bae6a2640 1 --2- 10.20.193.28:0/4052643461 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f4b840b57b0 0x7f4b840d5c60 secure :-1 s=READY pgs=126 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4b980098a0 tx=0x7f4b9803a040 comp rx=0 tx=0).stop 2026-02-24T09:16:50.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.724+0000 7f4bae6a2640 1 -- 10.20.193.28:0/4052643461 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f4ba810b8b0 msgr2=0x7f4ba8123700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:50.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.724+0000 7f4bae6a2640 1 --2- 10.20.193.28:0/4052643461 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f4ba810b8b0 0x7f4ba8123700 secure :-1 s=READY pgs=83 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4b9c00d950 tx=0x7f4b9c00de20 comp rx=0 tx=0).stop 2026-02-24T09:16:50.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.724+0000 7f4bae6a2640 1 -- 10.20.193.28:0/4052643461 shutdown_connections 2026-02-24T09:16:50.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.724+0000 7f4bae6a2640 1 --2- 10.20.193.28:0/4052643461 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f4b840b57b0 0x7f4b840d5c60 unknown :-1 s=CLOSED pgs=126 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:50.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.724+0000 7f4bae6a2640 1 --2- 10.20.193.28:0/4052643461 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f4ba8110ed0 0x7f4ba8128ad0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:50.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.724+0000 7f4bae6a2640 1 --2- 10.20.193.28:0/4052643461 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f4ba810b8b0 0x7f4ba8123700 unknown :-1 s=CLOSED pgs=83 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:50.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.724+0000 7f4bae6a2640 1 --2- 10.20.193.28:0/4052643461 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ba810aec0 0x7f4ba81231c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:50.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.724+0000 7f4bae6a2640 1 -- 10.20.193.28:0/4052643461 >> 10.20.193.28:0/4052643461 conn(0x7f4ba80e8a50 msgr2=0x7f4ba8108e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:50.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.724+0000 7f4bae6a2640 1 -- 10.20.193.28:0/4052643461 shutdown_connections 2026-02-24T09:16:50.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:50.724+0000 7f4bae6a2640 1 -- 10.20.193.28:0/4052643461 wait complete. 2026-02-24T09:16:51.534 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:51 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:51.534 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:51 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:51.534 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:51 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:51.535 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:51 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:51.535 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:51 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:51.535 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:51 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:51.535 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:51 trial028 ceph-mon[40371]: Deploying daemon mds.g on trial028 2026-02-24T09:16:51.535 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:51 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/4052643461' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:16:51.535 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:51 trial028 ceph-mon[40371]: mds.? [v2:10.20.193.159:6838/533862317,v1:10.20.193.159:6839/533862317] up:boot 2026-02-24T09:16:51.535 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:51 trial028 ceph-mon[40371]: fsmap 9 up:standby 2026-02-24T09:16:51.535 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:51 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-24T09:16:51.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:51 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:51.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:51 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:51.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:51 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:51.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:51 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:51.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:51 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:51.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:51 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:51.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:51 trial074 ceph-mon[44412]: Deploying daemon mds.g on trial028 2026-02-24T09:16:51.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:51 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/4052643461' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:16:51.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:51 trial074 ceph-mon[44412]: mds.? [v2:10.20.193.159:6838/533862317,v1:10.20.193.159:6839/533862317] up:boot 2026-02-24T09:16:51.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:51 trial074 ceph-mon[44412]: fsmap 9 up:standby 2026-02-24T09:16:51.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:51 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-24T09:16:51.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:51 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:51.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:51 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:51.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:51 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:51.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:51 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:51.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:51 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:51.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:51 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:51.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:51 trial159 ceph-mon[44242]: Deploying daemon mds.g on trial028 2026-02-24T09:16:51.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:51 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/4052643461' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:16:51.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:51 trial159 ceph-mon[44242]: mds.? [v2:10.20.193.159:6838/533862317,v1:10.20.193.159:6839/533862317] up:boot 2026-02-24T09:16:51.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:51 trial159 ceph-mon[44242]: fsmap 9 up:standby 2026-02-24T09:16:51.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:51 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-24T09:16:51.860 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 24 09:16:51 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-g[109323]: starting mds.g at 2026-02-24T09:16:52.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:52 trial159 ceph-mon[44242]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:52.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:52 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:52.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:52 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:52.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:52 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:52.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:52 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:52.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:52 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:52.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:52 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:52.783 INFO:journalctl@ceph.mds.a.trial028.stdout:Feb 24 09:16:52 trial028 systemd[1]: Starting Ceph mds.a for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:16:52.783 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:52 trial028 ceph-mon[40371]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:52.783 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:52 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:52.783 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:52 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:52.783 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:52 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:52.784 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:52 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:52.784 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:52 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:52.784 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:52 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:52.860 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:16:52.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:52 trial074 ceph-mon[44412]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:52.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:52 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:52.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:52 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:52.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:52 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:52.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:52 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:52.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:52 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:52.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:52 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:53.051 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:16:53.094 INFO:journalctl@ceph.mds.a.trial028.stdout:Feb 24 09:16:52 trial028 podman[109603]: 2026-02-24 09:16:52.782006543 +0000 UTC m=+0.029053957 container create 43cb11de53deb38d438a2356ad5fdeea11f56d4decd245a388e84d4e497f487a (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-a, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260223, OSD_FLAVOR=default, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b) 2026-02-24T09:16:53.094 INFO:journalctl@ceph.mds.a.trial028.stdout:Feb 24 09:16:52 trial028 podman[109603]: 2026-02-24 09:16:52.820794639 +0000 UTC m=+0.067842053 container init 43cb11de53deb38d438a2356ad5fdeea11f56d4decd245a388e84d4e497f487a (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-a, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-vshankar-testing-20260223.155722, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, ceph=True, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2026-02-24T09:16:53.094 INFO:journalctl@ceph.mds.a.trial028.stdout:Feb 24 09:16:52 trial028 podman[109603]: 2026-02-24 09:16:52.826116518 +0000 UTC m=+0.073163942 container start 43cb11de53deb38d438a2356ad5fdeea11f56d4decd245a388e84d4e497f487a (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-a, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.build-date=20260223, OSD_FLAVOR=default, CEPH_REF=wip-vshankar-testing-20260223.155722, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , ceph=True) 2026-02-24T09:16:53.095 INFO:journalctl@ceph.mds.a.trial028.stdout:Feb 24 09:16:52 trial028 bash[109603]: 43cb11de53deb38d438a2356ad5fdeea11f56d4decd245a388e84d4e497f487a 2026-02-24T09:16:53.095 INFO:journalctl@ceph.mds.a.trial028.stdout:Feb 24 09:16:52 trial028 podman[109603]: 2026-02-24 09:16:52.771229025 +0000 UTC m=+0.018276449 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b 2026-02-24T09:16:53.095 INFO:journalctl@ceph.mds.a.trial028.stdout:Feb 24 09:16:52 trial028 systemd[1]: Started Ceph mds.a for e9ad50af-1160-11f1-800e-d404e6e7d460. 2026-02-24T09:16:53.095 INFO:journalctl@ceph.mds.a.trial028.stdout:Feb 24 09:16:52 trial028 ceph-mds[109623]: -- 10.20.193.28:0/530880554 <== mon.0 v2:10.20.193.28:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x29d09860 con 0x29d3dc00 2026-02-24T09:16:53.095 INFO:journalctl@ceph.mds.a.trial028.stdout:Feb 24 09:16:52 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-a[109619]: starting mds.a at 2026-02-24T09:16:53.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.241+0000 7f22633e8640 1 -- 10.20.193.28:0/3852857781 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f225c1112f0 msgr2=0x7f225c111cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:53.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.241+0000 7f22633e8640 1 --2- 10.20.193.28:0/3852857781 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f225c1112f0 0x7f225c111cd0 secure :-1 s=READY pgs=227 gs=1 cs=0 l=1 c_cookie=10733878633523088013 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f225800aa30 tx=0x7f2258030270 comp rx=0 tx=0).stop 2026-02-24T09:16:53.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.241+0000 7f22633e8640 1 -- 10.20.193.28:0/3852857781 shutdown_connections 2026-02-24T09:16:53.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.241+0000 7f22633e8640 1 --2- 10.20.193.28:0/3852857781 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f225c1112f0 0x7f225c111cd0 unknown :-1 s=CLOSED pgs=227 gs=1 cs=0 l=1 c_cookie=10733878633523088013 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:53.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.241+0000 7f22633e8640 1 --2- 10.20.193.28:0/3852857781 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f225c10bcd0 0x7f225c110b60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:53.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.241+0000 7f22633e8640 1 --2- 10.20.193.28:0/3852857781 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f225c10b2e0 0x7f225c10b6b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:53.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.241+0000 7f22633e8640 1 -- 10.20.193.28:0/3852857781 >> 10.20.193.28:0/3852857781 conn(0x7f225c0e8e50 msgr2=0x7f225c109260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:53.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.241+0000 7f22633e8640 1 -- 10.20.193.28:0/3852857781 shutdown_connections 2026-02-24T09:16:53.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.241+0000 7f22633e8640 1 -- 10.20.193.28:0/3852857781 wait complete. 2026-02-24T09:16:53.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.242+0000 7f22633e8640 1 Processor -- start 2026-02-24T09:16:53.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.242+0000 7f22633e8640 1 -- start start 2026-02-24T09:16:53.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.242+0000 7f22633e8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f225c10b2e0 0x7f225c122ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:53.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.242+0000 7f22633e8640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f225c10bcd0 0x7f225c1230e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:53.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.242+0000 7f22633e8640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f225c1112f0 0x7f225c1284b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:53.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.242+0000 7f22633e8640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f225c128ad0 con 0x7f225c10b2e0 2026-02-24T09:16:53.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.242+0000 7f22633e8640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f225c128c40 con 0x7f225c10bcd0 2026-02-24T09:16:53.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.242+0000 7f22633e8640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f225c128e00 con 0x7f225c1112f0 2026-02-24T09:16:53.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.242+0000 7f226115d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f225c10b2e0 0x7f225c122ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:53.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.242+0000 7f226115d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f225c10b2e0 0x7f225c122ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40544/0 (socket says 10.20.193.28:40544) 2026-02-24T09:16:53.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.242+0000 7f226115d640 1 -- 10.20.193.28:0/3066805406 learned_addr learned my addr 10.20.193.28:0/3066805406 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:16:53.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.242+0000 7f226195e640 1 --2- 10.20.193.28:0/3066805406 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f225c1112f0 0x7f225c1284b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:53.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.243+0000 7f226095c640 1 --2- 10.20.193.28:0/3066805406 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f225c10bcd0 0x7f225c1230e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:53.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.243+0000 7f226115d640 1 -- 10.20.193.28:0/3066805406 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f225c1112f0 msgr2=0x7f225c1284b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:53.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.243+0000 7f226115d640 1 --2- 10.20.193.28:0/3066805406 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f225c1112f0 0x7f225c1284b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:53.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.243+0000 7f226115d640 1 -- 10.20.193.28:0/3066805406 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f225c10bcd0 msgr2=0x7f225c1230e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:53.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.243+0000 7f226115d640 1 --2- 10.20.193.28:0/3066805406 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f225c10bcd0 0x7f225c1230e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:53.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.243+0000 7f226115d640 1 -- 10.20.193.28:0/3066805406 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f225800a650 con 0x7f225c10b2e0 2026-02-24T09:16:53.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.243+0000 7f226095c640 1 --2- 10.20.193.28:0/3066805406 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f225c10bcd0 0x7f225c1230e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:16:53.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.243+0000 7f226115d640 1 --2- 10.20.193.28:0/3066805406 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f225c10b2e0 0x7f225c122ba0 secure :-1 s=READY pgs=228 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f224c00d950 tx=0x7f224c00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:53.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.243+0000 7f224a7fc640 1 -- 10.20.193.28:0/3066805406 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f224c004540 con 0x7f225c10b2e0 2026-02-24T09:16:53.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.243+0000 7f224a7fc640 1 -- 10.20.193.28:0/3066805406 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f224c009ce0 con 0x7f225c10b2e0 2026-02-24T09:16:53.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.243+0000 7f22633e8640 1 -- 10.20.193.28:0/3066805406 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f225c1290e0 con 0x7f225c10b2e0 2026-02-24T09:16:53.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.243+0000 7f22633e8640 1 -- 10.20.193.28:0/3066805406 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f225c1697e0 con 0x7f225c10b2e0 2026-02-24T09:16:53.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.243+0000 7f224a7fc640 1 -- 10.20.193.28:0/3066805406 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f224c0106e0 con 0x7f225c10b2e0 2026-02-24T09:16:53.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.244+0000 7f22633e8640 1 -- 10.20.193.28:0/3066805406 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f225c10c400 con 0x7f225c10b2e0 2026-02-24T09:16:53.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.246+0000 7f224a7fc640 1 -- 10.20.193.28:0/3066805406 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 19) ==== 157139+0+0 (secure 0 0 0) 0x7f224c0097c0 con 0x7f225c10b2e0 2026-02-24T09:16:53.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.248+0000 7f224a7fc640 1 --2- 10.20.193.28:0/3066805406 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f22380b5730 0x7f22380d5be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:53.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.248+0000 7f224a7fc640 1 -- 10.20.193.28:0/3066805406 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7334+0+0 (secure 0 0 0) 0x7f224c0e6ca0 con 0x7f225c10b2e0 2026-02-24T09:16:53.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.248+0000 7f224a7fc640 1 -- 10.20.193.28:0/3066805406 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f224c0e7120 con 0x7f225c10b2e0 2026-02-24T09:16:53.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.248+0000 7f226095c640 1 --2- 10.20.193.28:0/3066805406 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f22380b5730 0x7f22380d5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:53.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.248+0000 7f226095c640 1 --2- 10.20.193.28:0/3066805406 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f22380b5730 0x7f22380d5be0 secure :-1 s=READY pgs=129 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f225c129540 tx=0x7f2250005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:53.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.388+0000 7f22633e8640 1 -- 10.20.193.28:0/3066805406 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f225c110b60 con 0x7f225c10b2e0 2026-02-24T09:16:53.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.389+0000 7f224a7fc640 1 -- 10.20.193.28:0/3066805406 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9692 (secure 0 0 0) 0x7f224c0a99d0 con 0x7f225c10b2e0 2026-02-24T09:16:53.392 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:16:53.392 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":12,"btime":"2026-02-24T09:16:53:376703+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14856,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/3473030842","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":3473030842},{"type":"v1","addr":"10.20.193.28:6835","nonce":3473030842}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14862,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/4120804601","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":4120804601},{"type":"v1","addr":"10.20.193.28:6837","nonce":4120804601}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14910,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/1354296520","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1354296520},{"type":"v1","addr":"10.20.193.28:6839","nonce":1354296520}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24691,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.159:6833/3049112106","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6832","nonce":3049112106},{"type":"v1","addr":"10.20.193.159:6833","nonce":3049112106}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24710,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.74:6833/1426135976","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6832","nonce":1426135976},{"type":"v1","addr":"10.20.193.74:6833","nonce":1426135976}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24721,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.159:6835/3999384392","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6834","nonce":3999384392},{"type":"v1","addr":"10.20.193.159:6835","nonce":3999384392}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24727,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.159:6837/2059577520","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6836","nonce":2059577520},{"type":"v1","addr":"10.20.193.159:6837","nonce":2059577520}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24734,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.74:6835/2067708838","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6834","nonce":2067708838},{"type":"v1","addr":"10.20.193.74:6835","nonce":2067708838}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24745,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.159:6839/533862317","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6838","nonce":533862317},{"type":"v1","addr":"10.20.193.159:6839","nonce":533862317}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/492586680","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":492586680},{"type":"v1","addr":"10.20.193.28:6841","nonce":492586680}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24761,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.74:6837/958749351","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6836","nonce":958749351},{"type":"v1","addr":"10.20.193.74:6837","nonce":958749351}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2026-02-24T09:16:53.393 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 12 2026-02-24T09:16:53.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.391+0000 7f22633e8640 1 -- 10.20.193.28:0/3066805406 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f22380b5730 msgr2=0x7f22380d5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:53.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.391+0000 7f22633e8640 1 --2- 10.20.193.28:0/3066805406 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f22380b5730 0x7f22380d5be0 secure :-1 s=READY pgs=129 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f225c129540 tx=0x7f2250005f90 comp rx=0 tx=0).stop 2026-02-24T09:16:53.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.391+0000 7f22633e8640 1 -- 10.20.193.28:0/3066805406 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f225c10b2e0 msgr2=0x7f225c122ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:53.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.391+0000 7f22633e8640 1 --2- 10.20.193.28:0/3066805406 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f225c10b2e0 0x7f225c122ba0 secure :-1 s=READY pgs=228 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f224c00d950 tx=0x7f224c00de20 comp rx=0 tx=0).stop 2026-02-24T09:16:53.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.391+0000 7f22633e8640 1 -- 10.20.193.28:0/3066805406 shutdown_connections 2026-02-24T09:16:53.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.391+0000 7f22633e8640 1 --2- 10.20.193.28:0/3066805406 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f22380b5730 0x7f22380d5be0 unknown :-1 s=CLOSED pgs=129 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:53.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.391+0000 7f22633e8640 1 --2- 10.20.193.28:0/3066805406 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f225c1112f0 0x7f225c1284b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:53.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.391+0000 7f22633e8640 1 --2- 10.20.193.28:0/3066805406 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f225c10bcd0 0x7f225c1230e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:53.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.391+0000 7f22633e8640 1 --2- 10.20.193.28:0/3066805406 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f225c10b2e0 0x7f225c122ba0 unknown :-1 s=CLOSED pgs=228 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:53.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.391+0000 7f22633e8640 1 -- 10.20.193.28:0/3066805406 >> 10.20.193.28:0/3066805406 conn(0x7f225c0e8e50 msgr2=0x7f225c109230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:53.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.391+0000 7f22633e8640 1 -- 10.20.193.28:0/3066805406 shutdown_connections 2026-02-24T09:16:53.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:53.391+0000 7f22633e8640 1 -- 10.20.193.28:0/3066805406 wait complete. 2026-02-24T09:16:53.503 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:53 trial074 ceph-mon[44412]: Deploying daemon mds.a on trial028 2026-02-24T09:16:53.504 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:53 trial074 ceph-mon[44412]: mds.? [v2:10.20.193.28:6838/1354296520,v1:10.20.193.28:6839/1354296520] up:boot 2026-02-24T09:16:53.504 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:53 trial074 ceph-mon[44412]: fsmap 10 up:standby 2026-02-24T09:16:53.504 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:53 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-24T09:16:53.504 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:53 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:53.504 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:53 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:53.504 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:53 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:53.504 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:53 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:53.504 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:53 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:53.504 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:53 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:53.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:53 trial159 ceph-mon[44242]: Deploying daemon mds.a on trial028 2026-02-24T09:16:53.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:53 trial159 ceph-mon[44242]: mds.? [v2:10.20.193.28:6838/1354296520,v1:10.20.193.28:6839/1354296520] up:boot 2026-02-24T09:16:53.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:53 trial159 ceph-mon[44242]: fsmap 10 up:standby 2026-02-24T09:16:53.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:53 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-24T09:16:53.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:53 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:53.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:53 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:53.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:53 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:53.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:53 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:53.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:53 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:53.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:53 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:53.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:53 trial028 ceph-mon[40371]: Deploying daemon mds.a on trial028 2026-02-24T09:16:53.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:53 trial028 ceph-mon[40371]: mds.? [v2:10.20.193.28:6838/1354296520,v1:10.20.193.28:6839/1354296520] up:boot 2026-02-24T09:16:53.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:53 trial028 ceph-mon[40371]: fsmap 10 up:standby 2026-02-24T09:16:53.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:53 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-24T09:16:53.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:53 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:53.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:53 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:53.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:53 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:53.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:53 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:16:53.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:53 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:16:53.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:53 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:54.064 INFO:journalctl@ceph.mds.b.trial074.stdout:Feb 24 09:16:53 trial074 systemd[1]: Starting Ceph mds.b for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:16:54.374 INFO:journalctl@ceph.mds.b.trial074.stdout:Feb 24 09:16:54 trial074 podman[97791]: 2026-02-24 09:16:54.062214759 +0000 UTC m=+0.028871331 container create 5667a6cc81df457f3b68de333ca1ce0dc3049907e074fc71f255b842f9a4d564 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-b, org.label-schema.build-date=20260223, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, OSD_FLAVOR=default) 2026-02-24T09:16:54.374 INFO:journalctl@ceph.mds.b.trial074.stdout:Feb 24 09:16:54 trial074 podman[97791]: 2026-02-24 09:16:54.110144118 +0000 UTC m=+0.076800700 container init 5667a6cc81df457f3b68de333ca1ce0dc3049907e074fc71f255b842f9a4d564 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, io.buildah.version=1.41.3, OSD_FLAVOR=default, ceph=True, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-vshankar-testing-20260223.155722, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-24T09:16:54.374 INFO:journalctl@ceph.mds.b.trial074.stdout:Feb 24 09:16:54 trial074 podman[97791]: 2026-02-24 09:16:54.11547936 +0000 UTC m=+0.082135942 container start 5667a6cc81df457f3b68de333ca1ce0dc3049907e074fc71f255b842f9a4d564 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, OSD_FLAVOR=default, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-24T09:16:54.374 INFO:journalctl@ceph.mds.b.trial074.stdout:Feb 24 09:16:54 trial074 bash[97791]: 5667a6cc81df457f3b68de333ca1ce0dc3049907e074fc71f255b842f9a4d564 2026-02-24T09:16:54.374 INFO:journalctl@ceph.mds.b.trial074.stdout:Feb 24 09:16:54 trial074 podman[97791]: 2026-02-24 09:16:54.050787598 +0000 UTC m=+0.017444180 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b 2026-02-24T09:16:54.374 INFO:journalctl@ceph.mds.b.trial074.stdout:Feb 24 09:16:54 trial074 systemd[1]: Started Ceph mds.b for e9ad50af-1160-11f1-800e-d404e6e7d460. 2026-02-24T09:16:54.375 INFO:journalctl@ceph.mds.b.trial074.stdout:Feb 24 09:16:54 trial074 ceph-mds[97810]: -- 10.20.193.74:0/3272104755 <== mon.2 v2:10.20.193.74:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x1186b860 con 0x1199c400 2026-02-24T09:16:54.375 INFO:journalctl@ceph.mds.b.trial074.stdout:Feb 24 09:16:54 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-b[97806]: starting mds.b at 2026-02-24T09:16:54.659 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:54 trial028 ceph-mon[40371]: Deploying daemon mds.b on trial074 2026-02-24T09:16:54.659 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:54 trial028 ceph-mon[40371]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:54.659 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:54 trial028 ceph-mon[40371]: mds.? [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] up:boot 2026-02-24T09:16:54.659 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:54 trial028 ceph-mon[40371]: fsmap 11 up:standby 2026-02-24T09:16:54.659 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:54 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-24T09:16:54.660 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:54 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/3066805406' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:16:54.660 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:54 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:54.660 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:54 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:54.660 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:54 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:54.660 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:54 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:54.660 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:54 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:54.660 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:54 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:16:54.664 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:54 trial074 ceph-mon[44412]: Deploying daemon mds.b on trial074 2026-02-24T09:16:54.664 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:54 trial074 ceph-mon[44412]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:54.664 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:54 trial074 ceph-mon[44412]: mds.? [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] up:boot 2026-02-24T09:16:54.664 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:54 trial074 ceph-mon[44412]: fsmap 11 up:standby 2026-02-24T09:16:54.664 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:54 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-24T09:16:54.664 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:54 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/3066805406' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:16:54.665 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:54 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:54.665 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:54 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:54.665 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:54 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:54.665 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:54 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:54.665 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:54 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:54.665 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:54 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:16:54.666 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:54 trial159 ceph-mon[44242]: Deploying daemon mds.b on trial074 2026-02-24T09:16:54.667 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:54 trial159 ceph-mon[44242]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:54.667 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:54 trial159 ceph-mon[44242]: mds.? [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] up:boot 2026-02-24T09:16:54.667 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:54 trial159 ceph-mon[44242]: fsmap 11 up:standby 2026-02-24T09:16:54.667 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:54 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-24T09:16:54.667 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:54 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/3066805406' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:16:54.667 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:54 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:54.667 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:54 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:54.667 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:54 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:54.667 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:54 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:54.667 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:54 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:54.668 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:54 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:16:55.493 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:16:55.679 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:16:55.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:55 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:55.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:55 trial028 ceph-mon[40371]: mds.? [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] up:boot 2026-02-24T09:16:55.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:55 trial028 ceph-mon[40371]: fsmap 12 up:standby 2026-02-24T09:16:55.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:55 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-24T09:16:55.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:55 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:55.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:55 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:55.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:55 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:55.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:55 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:55.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:55 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:55.725 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:55 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:55.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:55 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:55.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:55 trial159 ceph-mon[44242]: mds.? [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] up:boot 2026-02-24T09:16:55.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:55 trial159 ceph-mon[44242]: fsmap 12 up:standby 2026-02-24T09:16:55.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:55 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-24T09:16:55.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:55 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:55.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:55 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:55.782 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:55 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:55.782 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:55 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:55.782 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:55 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:55.782 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:55 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:55.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:55 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:55.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:55 trial074 ceph-mon[44412]: mds.? [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] up:boot 2026-02-24T09:16:55.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:55 trial074 ceph-mon[44412]: fsmap 12 up:standby 2026-02-24T09:16:55.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:55 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-24T09:16:55.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:55 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:55.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:55 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:55.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:55 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:55.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:55 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:55.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:55 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:55.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:55 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:55.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.871+0000 7f2513fff640 1 -- 10.20.193.28:0/3217117212 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2514114a10 msgr2=0x7f25141191f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:55.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.871+0000 7f2513fff640 1 --2- 10.20.193.28:0/3217117212 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2514114a10 0x7f25141191f0 secure :-1 s=READY pgs=229 gs=1 cs=0 l=1 c_cookie=15786693816163137840 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24fc009950 tx=0x7f24fc02f190 comp rx=0 tx=0).stop 2026-02-24T09:16:55.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.872+0000 7f2513fff640 1 -- 10.20.193.28:0/3217117212 shutdown_connections 2026-02-24T09:16:55.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.872+0000 7f2513fff640 1 --2- 10.20.193.28:0/3217117212 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f25141199a0 0x7f251417a370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:55.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.872+0000 7f2513fff640 1 --2- 10.20.193.28:0/3217117212 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2514114a10 0x7f25141191f0 unknown :-1 s=CLOSED pgs=229 gs=1 cs=0 l=1 c_cookie=15786693816163137840 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:55.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.872+0000 7f2513fff640 1 --2- 10.20.193.28:0/3217117212 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f2514114020 0x7f25141143f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:55.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.872+0000 7f2513fff640 1 -- 10.20.193.28:0/3217117212 >> 10.20.193.28:0/3217117212 conn(0x7f2514064810 msgr2=0x7f2514064c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:55.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.872+0000 7f2513fff640 1 -- 10.20.193.28:0/3217117212 shutdown_connections 2026-02-24T09:16:55.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.872+0000 7f2513fff640 1 -- 10.20.193.28:0/3217117212 wait complete. 2026-02-24T09:16:55.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.872+0000 7f2513fff640 1 Processor -- start 2026-02-24T09:16:55.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.873+0000 7f2513fff640 1 -- start start 2026-02-24T09:16:55.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.873+0000 7f2513fff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2514114020 0x7f25140fbd60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:55.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.873+0000 7f2513fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2514114a10 0x7f251417a270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:55.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.873+0000 7f2513fff640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f25141199a0 0x7f25140fc460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:55.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.873+0000 7f2513fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2514101670 con 0x7f2514114a10 2026-02-24T09:16:55.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.873+0000 7f2513fff640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f25141017e0 con 0x7f2514114020 2026-02-24T09:16:55.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.873+0000 7f2513fff640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f25141019a0 con 0x7f25141199a0 2026-02-24T09:16:55.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.873+0000 7f2512ffd640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2514114020 0x7f25140fbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:55.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.873+0000 7f25127fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2514114a10 0x7f251417a270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:55.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.873+0000 7f25137fe640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f25141199a0 0x7f25140fc460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:55.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.873+0000 7f25127fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2514114a10 0x7f251417a270 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40560/0 (socket says 10.20.193.28:40560) 2026-02-24T09:16:55.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.873+0000 7f25127fc640 1 -- 10.20.193.28:0/2530524263 learned_addr learned my addr 10.20.193.28:0/2530524263 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:16:55.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.873+0000 7f25127fc640 1 -- 10.20.193.28:0/2530524263 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f25141199a0 msgr2=0x7f25140fc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:55.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.873+0000 7f25127fc640 1 --2- 10.20.193.28:0/2530524263 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f25141199a0 0x7f25140fc460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:55.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.873+0000 7f25127fc640 1 -- 10.20.193.28:0/2530524263 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2514114020 msgr2=0x7f25140fbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:55.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.873+0000 7f25127fc640 1 --2- 10.20.193.28:0/2530524263 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2514114020 0x7f25140fbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:55.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.873+0000 7f25127fc640 1 -- 10.20.193.28:0/2530524263 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24fc009570 con 0x7f2514114a10 2026-02-24T09:16:55.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.873+0000 7f25137fe640 1 --2- 10.20.193.28:0/2530524263 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f25141199a0 0x7f25140fc460 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:16:55.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.874+0000 7f25127fc640 1 --2- 10.20.193.28:0/2530524263 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2514114a10 0x7f251417a270 secure :-1 s=READY pgs=230 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24fc0098a0 tx=0x7f24fc0028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:55.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.874+0000 7f2518989640 1 -- 10.20.193.28:0/2530524263 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f24fc03d070 con 0x7f2514114a10 2026-02-24T09:16:55.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.874+0000 7f2518989640 1 -- 10.20.193.28:0/2530524263 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f24fc002a40 con 0x7f2514114a10 2026-02-24T09:16:55.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.874+0000 7f2518989640 1 -- 10.20.193.28:0/2530524263 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f24fc041820 con 0x7f2514114a10 2026-02-24T09:16:55.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.874+0000 7f2513fff640 1 -- 10.20.193.28:0/2530524263 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2514101c20 con 0x7f2514114a10 2026-02-24T09:16:55.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.874+0000 7f2513fff640 1 -- 10.20.193.28:0/2530524263 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2514102040 con 0x7f2514114a10 2026-02-24T09:16:55.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.875+0000 7f2513fff640 1 -- 10.20.193.28:0/2530524263 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2514067220 con 0x7f2514114a10 2026-02-24T09:16:55.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.877+0000 7f2518989640 1 -- 10.20.193.28:0/2530524263 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 19) ==== 157139+0+0 (secure 0 0 0) 0x7f24fc0419c0 con 0x7f2514114a10 2026-02-24T09:16:55.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.879+0000 7f2518989640 1 --2- 10.20.193.28:0/2530524263 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f24e80b5870 0x7f24e80d5d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:55.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.879+0000 7f2518989640 1 -- 10.20.193.28:0/2530524263 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7334+0+0 (secure 0 0 0) 0x7f24fc10b130 con 0x7f2514114a10 2026-02-24T09:16:55.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.879+0000 7f2518989640 1 -- 10.20.193.28:0/2530524263 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f24fc10b5b0 con 0x7f2514114a10 2026-02-24T09:16:55.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.879+0000 7f2512ffd640 1 --2- 10.20.193.28:0/2530524263 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f24e80b5870 0x7f24e80d5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:55.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:55.880+0000 7f2512ffd640 1 --2- 10.20.193.28:0/2530524263 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f24e80b5870 0x7f24e80d5d20 secure :-1 s=READY pgs=132 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2508004740 tx=0x7f2508005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:56.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.023+0000 7f2513fff640 1 -- 10.20.193.28:0/2530524263 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25141143f0 con 0x7f2514114a10 2026-02-24T09:16:56.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.023+0000 7f2518989640 1 -- 10.20.193.28:0/2530524263 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10515 (secure 0 0 0) 0x7f24fc0cde60 con 0x7f2514114a10 2026-02-24T09:16:56.025 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:16:56.026 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":13,"btime":"2026-02-24T09:16:54:897173+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14856,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/3473030842","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":3473030842},{"type":"v1","addr":"10.20.193.28:6835","nonce":3473030842}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14862,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/4120804601","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":4120804601},{"type":"v1","addr":"10.20.193.28:6837","nonce":4120804601}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14910,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/1354296520","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1354296520},{"type":"v1","addr":"10.20.193.28:6839","nonce":1354296520}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24691,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.159:6833/3049112106","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6832","nonce":3049112106},{"type":"v1","addr":"10.20.193.159:6833","nonce":3049112106}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24710,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.74:6833/1426135976","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6832","nonce":1426135976},{"type":"v1","addr":"10.20.193.74:6833","nonce":1426135976}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24721,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.159:6835/3999384392","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6834","nonce":3999384392},{"type":"v1","addr":"10.20.193.159:6835","nonce":3999384392}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24727,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.159:6837/2059577520","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6836","nonce":2059577520},{"type":"v1","addr":"10.20.193.159:6837","nonce":2059577520}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24734,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.74:6835/2067708838","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6834","nonce":2067708838},{"type":"v1","addr":"10.20.193.74:6835","nonce":2067708838}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24745,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.159:6839/533862317","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6838","nonce":533862317},{"type":"v1","addr":"10.20.193.159:6839","nonce":533862317}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/492586680","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":492586680},{"type":"v1","addr":"10.20.193.28:6841","nonce":492586680}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24761,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.74:6837/958749351","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6836","nonce":958749351},{"type":"v1","addr":"10.20.193.74:6837","nonce":958749351}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24788,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.74:6839/828566790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6838","nonce":828566790},{"type":"v1","addr":"10.20.193.74:6839","nonce":828566790}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2026-02-24T09:16:56.026 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 13 2026-02-24T09:16:56.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.026+0000 7f2513fff640 1 -- 10.20.193.28:0/2530524263 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f24e80b5870 msgr2=0x7f24e80d5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:56.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.026+0000 7f2513fff640 1 --2- 10.20.193.28:0/2530524263 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f24e80b5870 0x7f24e80d5d20 secure :-1 s=READY pgs=132 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2508004740 tx=0x7f2508005f90 comp rx=0 tx=0).stop 2026-02-24T09:16:56.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.026+0000 7f2513fff640 1 -- 10.20.193.28:0/2530524263 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2514114a10 msgr2=0x7f251417a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:56.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.026+0000 7f2513fff640 1 --2- 10.20.193.28:0/2530524263 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2514114a10 0x7f251417a270 secure :-1 s=READY pgs=230 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24fc0098a0 tx=0x7f24fc0028d0 comp rx=0 tx=0).stop 2026-02-24T09:16:56.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.026+0000 7f2513fff640 1 -- 10.20.193.28:0/2530524263 shutdown_connections 2026-02-24T09:16:56.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.026+0000 7f2513fff640 1 --2- 10.20.193.28:0/2530524263 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f24e80b5870 0x7f24e80d5d20 unknown :-1 s=CLOSED pgs=132 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:56.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.026+0000 7f2513fff640 1 --2- 10.20.193.28:0/2530524263 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f25141199a0 0x7f25140fc460 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:56.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.026+0000 7f2513fff640 1 --2- 10.20.193.28:0/2530524263 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2514114a10 0x7f251417a270 unknown :-1 s=CLOSED pgs=230 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:56.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.026+0000 7f2513fff640 1 --2- 10.20.193.28:0/2530524263 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2514114020 0x7f25140fbd60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:56.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.026+0000 7f2513fff640 1 -- 10.20.193.28:0/2530524263 >> 10.20.193.28:0/2530524263 conn(0x7f2514064810 msgr2=0x7f2514117780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:56.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.026+0000 7f2513fff640 1 -- 10.20.193.28:0/2530524263 shutdown_connections 2026-02-24T09:16:56.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.026+0000 7f2513fff640 1 -- 10.20.193.28:0/2530524263 wait complete. 2026-02-24T09:16:56.132 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph --format=json-pretty osd lspools 2026-02-24T09:16:56.317 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:16:56.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.493+0000 7f5f5a6ef640 1 -- 10.20.193.28:0/2325173884 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f5410f6c0 msgr2=0x7f5f5410fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:56.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.493+0000 7f5f5a6ef640 1 --2- 10.20.193.28:0/2325173884 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f5410f6c0 0x7f5f5410fa90 secure :-1 s=READY pgs=231 gs=1 cs=0 l=1 c_cookie=10960475137450896251 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f40009950 tx=0x7f5f4002f190 comp rx=0 tx=0).stop 2026-02-24T09:16:56.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.493+0000 7f5f5a6ef640 1 -- 10.20.193.28:0/2325173884 shutdown_connections 2026-02-24T09:16:56.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.493+0000 7f5f5a6ef640 1 --2- 10.20.193.28:0/2325173884 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5f541158b0 0x7f5f54176280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:56.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.493+0000 7f5f5a6ef640 1 --2- 10.20.193.28:0/2325173884 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5f541100b0 0x7f5f54115100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:56.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.493+0000 7f5f5a6ef640 1 --2- 10.20.193.28:0/2325173884 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f5410f6c0 0x7f5f5410fa90 unknown :-1 s=CLOSED pgs=231 gs=1 cs=0 l=1 c_cookie=10960475137450896251 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:56.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.493+0000 7f5f5a6ef640 1 -- 10.20.193.28:0/2325173884 >> 10.20.193.28:0/2325173884 conn(0x7f5f540ecfd0 msgr2=0x7f5f5410d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:56.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.493+0000 7f5f5a6ef640 1 -- 10.20.193.28:0/2325173884 shutdown_connections 2026-02-24T09:16:56.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.493+0000 7f5f5a6ef640 1 -- 10.20.193.28:0/2325173884 wait complete. 2026-02-24T09:16:56.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.494+0000 7f5f5a6ef640 1 Processor -- start 2026-02-24T09:16:56.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.494+0000 7f5f5a6ef640 1 -- start start 2026-02-24T09:16:56.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.494+0000 7f5f5a6ef640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5f5410f6c0 0x7f5f5411e070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:56.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.494+0000 7f5f5a6ef640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5f541100b0 0x7f5f5411e5b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:56.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.494+0000 7f5f5a6ef640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f541158b0 0x7f5f54123980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:56.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.494+0000 7f5f5a6ef640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5f54123fa0 con 0x7f5f541158b0 2026-02-24T09:16:56.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.494+0000 7f5f5a6ef640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f5f54124110 con 0x7f5f541100b0 2026-02-24T09:16:56.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.494+0000 7f5f5a6ef640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5f541242d0 con 0x7f5f5410f6c0 2026-02-24T09:16:56.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.494+0000 7f5f53fff640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5f5410f6c0 0x7f5f5411e070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:56.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.495+0000 7f5f53fff640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5f5410f6c0 0x7f5f5411e070 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:58424/0 (socket says 10.20.193.28:58424) 2026-02-24T09:16:56.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.495+0000 7f5f53fff640 1 -- 10.20.193.28:0/431262616 learned_addr learned my addr 10.20.193.28:0/431262616 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:16:56.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.495+0000 7f5f537fe640 1 --2- 10.20.193.28:0/431262616 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5f541100b0 0x7f5f5411e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:56.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.495+0000 7f5f58c65640 1 --2- 10.20.193.28:0/431262616 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f541158b0 0x7f5f54123980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:56.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.495+0000 7f5f53fff640 1 -- 10.20.193.28:0/431262616 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5f541100b0 msgr2=0x7f5f5411e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:56.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.495+0000 7f5f53fff640 1 --2- 10.20.193.28:0/431262616 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5f541100b0 0x7f5f5411e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:56.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.495+0000 7f5f53fff640 1 -- 10.20.193.28:0/431262616 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f541158b0 msgr2=0x7f5f54123980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:56.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.495+0000 7f5f53fff640 1 --2- 10.20.193.28:0/431262616 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f541158b0 0x7f5f54123980 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:56.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.495+0000 7f5f53fff640 1 -- 10.20.193.28:0/431262616 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f40009570 con 0x7f5f5410f6c0 2026-02-24T09:16:56.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.495+0000 7f5f537fe640 1 --2- 10.20.193.28:0/431262616 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5f541100b0 0x7f5f5411e5b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:16:56.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.495+0000 7f5f58c65640 1 --2- 10.20.193.28:0/431262616 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f541158b0 0x7f5f54123980 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:16:56.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.495+0000 7f5f53fff640 1 --2- 10.20.193.28:0/431262616 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5f5410f6c0 0x7f5f5411e070 secure :-1 s=READY pgs=79 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f400098a0 tx=0x7f5f40038720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:56.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.496+0000 7f5f517fa640 1 -- 10.20.193.28:0/431262616 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5f4002fc10 con 0x7f5f5410f6c0 2026-02-24T09:16:56.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.496+0000 7f5f5a6ef640 1 -- 10.20.193.28:0/431262616 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f54124550 con 0x7f5f5410f6c0 2026-02-24T09:16:56.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.496+0000 7f5f517fa640 1 -- 10.20.193.28:0/431262616 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f5f400046a0 con 0x7f5f5410f6c0 2026-02-24T09:16:56.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.496+0000 7f5f517fa640 1 -- 10.20.193.28:0/431262616 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5f40041ca0 con 0x7f5f5410f6c0 2026-02-24T09:16:56.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.496+0000 7f5f5a6ef640 1 -- 10.20.193.28:0/431262616 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f54164cb0 con 0x7f5f5410f6c0 2026-02-24T09:16:56.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.496+0000 7f5f5a6ef640 1 -- 10.20.193.28:0/431262616 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f541109a0 con 0x7f5f5410f6c0 2026-02-24T09:16:56.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.498+0000 7f5f517fa640 1 -- 10.20.193.28:0/431262616 <== mon.1 v2:10.20.193.159:3300/0 4 ==== mgrmap(e 19) ==== 157139+0+0 (secure 0 0 0) 0x7f5f40038b20 con 0x7f5f5410f6c0 2026-02-24T09:16:56.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.500+0000 7f5f517fa640 1 --2- 10.20.193.28:0/431262616 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5f280b57b0 0x7f5f280d5c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:56.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.500+0000 7f5f537fe640 1 --2- 10.20.193.28:0/431262616 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5f280b57b0 0x7f5f280d5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:56.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.500+0000 7f5f517fa640 1 -- 10.20.193.28:0/431262616 <== mon.1 v2:10.20.193.159:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7334+0+0 (secure 0 0 0) 0x7f5f4010b3e0 con 0x7f5f5410f6c0 2026-02-24T09:16:56.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.500+0000 7f5f517fa640 1 -- 10.20.193.28:0/431262616 <== mon.1 v2:10.20.193.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f5f400ce1c0 con 0x7f5f5410f6c0 2026-02-24T09:16:56.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.501+0000 7f5f537fe640 1 --2- 10.20.193.28:0/431262616 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5f280b57b0 0x7f5f280d5c60 secure :-1 s=READY pgs=133 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f54124a10 tx=0x7f5f4400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:56.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.616+0000 7f5f5a6ef640 1 -- 10.20.193.28:0/431262616 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f5f5411f1d0 con 0x7f5f5410f6c0 2026-02-24T09:16:56.619 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:56 trial028 ceph-mon[40371]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:56.619 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:56 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:56.619 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:56 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:16:56.619 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:56 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:56.619 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:56 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:16:56.619 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:56 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/2530524263' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:16:56.619 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:56 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:16:56.620 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:16:56.620 INFO:teuthology.orchestra.run.trial028.stdout:[ 2026-02-24T09:16:56.620 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:16:56.620 INFO:teuthology.orchestra.run.trial028.stdout: "poolnum": 1, 2026-02-24T09:16:56.620 INFO:teuthology.orchestra.run.trial028.stdout: "poolname": ".mgr" 2026-02-24T09:16:56.620 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:16:56.620 INFO:teuthology.orchestra.run.trial028.stdout:] 2026-02-24T09:16:56.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.616+0000 7f5f517fa640 1 -- 10.20.193.28:0/431262616 <== mon.1 v2:10.20.193.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v88) ==== 84+0+65 (secure 0 0 0) 0x7f5f40005bf0 con 0x7f5f5410f6c0 2026-02-24T09:16:56.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.619+0000 7f5f5a6ef640 1 -- 10.20.193.28:0/431262616 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5f280b57b0 msgr2=0x7f5f280d5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:56.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.619+0000 7f5f5a6ef640 1 --2- 10.20.193.28:0/431262616 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5f280b57b0 0x7f5f280d5c60 secure :-1 s=READY pgs=133 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f54124a10 tx=0x7f5f4400b410 comp rx=0 tx=0).stop 2026-02-24T09:16:56.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.619+0000 7f5f5a6ef640 1 -- 10.20.193.28:0/431262616 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5f5410f6c0 msgr2=0x7f5f5411e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:56.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.619+0000 7f5f5a6ef640 1 --2- 10.20.193.28:0/431262616 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5f5410f6c0 0x7f5f5411e070 secure :-1 s=READY pgs=79 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f400098a0 tx=0x7f5f40038720 comp rx=0 tx=0).stop 2026-02-24T09:16:56.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.619+0000 7f5f5a6ef640 1 -- 10.20.193.28:0/431262616 shutdown_connections 2026-02-24T09:16:56.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.619+0000 7f5f5a6ef640 1 --2- 10.20.193.28:0/431262616 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5f280b57b0 0x7f5f280d5c60 unknown :-1 s=CLOSED pgs=133 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:56.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.619+0000 7f5f5a6ef640 1 --2- 10.20.193.28:0/431262616 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f541158b0 0x7f5f54123980 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:56.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.619+0000 7f5f5a6ef640 1 --2- 10.20.193.28:0/431262616 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5f541100b0 0x7f5f5411e5b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:56.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.619+0000 7f5f5a6ef640 1 --2- 10.20.193.28:0/431262616 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5f5410f6c0 0x7f5f5411e070 unknown :-1 s=CLOSED pgs=79 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:56.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.619+0000 7f5f5a6ef640 1 -- 10.20.193.28:0/431262616 >> 10.20.193.28:0/431262616 conn(0x7f5f540ecfd0 msgr2=0x7f5f5410d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:56.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.621+0000 7f5f5a6ef640 1 -- 10.20.193.28:0/431262616 shutdown_connections 2026-02-24T09:16:56.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:56.621+0000 7f5f5a6ef640 1 -- 10.20.193.28:0/431262616 wait complete. 2026-02-24T09:16:56.759 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2026-02-24T09:16:56.760 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2026-02-24T09:16:56.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:56 trial159 ceph-mon[44242]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:56.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:56 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:56.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:56 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:16:56.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:56 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:56.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:56 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:16:56.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:56 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/2530524263' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:16:56.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:56 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:16:56.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:56 trial074 ceph-mon[44412]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:56.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:56 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:56.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:56 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:16:56.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:56 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:56.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:56 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:16:56.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:56 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/2530524263' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:16:56.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:56 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:16:56.944 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:16:57.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.125+0000 7faaded9e640 1 -- 10.20.193.28:0/1679102234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faad81112e0 msgr2=0x7faad8111cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:57.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.125+0000 7faaded9e640 1 --2- 10.20.193.28:0/1679102234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faad81112e0 0x7faad8111cc0 secure :-1 s=READY pgs=232 gs=1 cs=0 l=1 c_cookie=1950331613920587868 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faad400aa30 tx=0x7faad4030290 comp rx=0 tx=0).stop 2026-02-24T09:16:57.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.125+0000 7faaded9e640 1 -- 10.20.193.28:0/1679102234 shutdown_connections 2026-02-24T09:16:57.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.125+0000 7faaded9e640 1 --2- 10.20.193.28:0/1679102234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faad81112e0 0x7faad8111cc0 unknown :-1 s=CLOSED pgs=232 gs=1 cs=0 l=1 c_cookie=1950331613920587868 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:57.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.125+0000 7faaded9e640 1 --2- 10.20.193.28:0/1679102234 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7faad810bcc0 0x7faad8110b50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:57.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.125+0000 7faaded9e640 1 --2- 10.20.193.28:0/1679102234 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7faad810b2d0 0x7faad810b6a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:57.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.125+0000 7faaded9e640 1 -- 10.20.193.28:0/1679102234 >> 10.20.193.28:0/1679102234 conn(0x7faad80e8e40 msgr2=0x7faad8109250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:57.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.125+0000 7faaded9e640 1 -- 10.20.193.28:0/1679102234 shutdown_connections 2026-02-24T09:16:57.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.125+0000 7faaded9e640 1 -- 10.20.193.28:0/1679102234 wait complete. 2026-02-24T09:16:57.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.126+0000 7faaded9e640 1 Processor -- start 2026-02-24T09:16:57.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.126+0000 7faaded9e640 1 -- start start 2026-02-24T09:16:57.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.126+0000 7faaded9e640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7faad810b2d0 0x7faad8123530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:57.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.126+0000 7faaded9e640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7faad810bcc0 0x7faad8123a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:57.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.126+0000 7faaded9e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faad81112e0 0x7faad8128e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:57.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.126+0000 7faaded9e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7faad8129460 con 0x7faad81112e0 2026-02-24T09:16:57.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.127+0000 7faaded9e640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7faad81295d0 con 0x7faad810bcc0 2026-02-24T09:16:57.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.127+0000 7faaded9e640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7faad8129790 con 0x7faad810b2d0 2026-02-24T09:16:57.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.127+0000 7faadd59b640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7faad810bcc0 0x7faad8123a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:57.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.127+0000 7faade59d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faad81112e0 0x7faad8128e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:57.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.127+0000 7faadd59b640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7faad810bcc0 0x7faad8123a70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:46930/0 (socket says 10.20.193.28:46930) 2026-02-24T09:16:57.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.127+0000 7faadd59b640 1 -- 10.20.193.28:0/17210969 learned_addr learned my addr 10.20.193.28:0/17210969 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:16:57.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.127+0000 7faaddd9c640 1 --2- 10.20.193.28:0/17210969 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7faad810b2d0 0x7faad8123530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:57.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.127+0000 7faaddd9c640 1 -- 10.20.193.28:0/17210969 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7faad810bcc0 msgr2=0x7faad8123a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:57.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.127+0000 7faaddd9c640 1 --2- 10.20.193.28:0/17210969 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7faad810bcc0 0x7faad8123a70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:57.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.127+0000 7faaddd9c640 1 -- 10.20.193.28:0/17210969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faad81112e0 msgr2=0x7faad8128e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:57.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.127+0000 7faaddd9c640 1 --2- 10.20.193.28:0/17210969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faad81112e0 0x7faad8128e40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:57.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.127+0000 7faaddd9c640 1 -- 10.20.193.28:0/17210969 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faad400a650 con 0x7faad810b2d0 2026-02-24T09:16:57.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.127+0000 7faadd59b640 1 --2- 10.20.193.28:0/17210969 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7faad810bcc0 0x7faad8123a70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:16:57.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.127+0000 7faade59d640 1 --2- 10.20.193.28:0/17210969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faad81112e0 0x7faad8128e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:16:57.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.127+0000 7faaddd9c640 1 --2- 10.20.193.28:0/17210969 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7faad810b2d0 0x7faad8123530 secure :-1 s=READY pgs=80 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faac800d720 tx=0x7faac800dbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:57.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.128+0000 7faac6ffd640 1 -- 10.20.193.28:0/17210969 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faac8004500 con 0x7faad810b2d0 2026-02-24T09:16:57.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.128+0000 7faaded9e640 1 -- 10.20.193.28:0/17210969 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faad8129a70 con 0x7faad810b2d0 2026-02-24T09:16:57.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.128+0000 7faaded9e640 1 -- 10.20.193.28:0/17210969 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faad816a170 con 0x7faad810b2d0 2026-02-24T09:16:57.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.128+0000 7faac6ffd640 1 -- 10.20.193.28:0/17210969 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7faac8004d10 con 0x7faad810b2d0 2026-02-24T09:16:57.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.128+0000 7faac6ffd640 1 -- 10.20.193.28:0/17210969 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faac8005020 con 0x7faad810b2d0 2026-02-24T09:16:57.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.128+0000 7faaded9e640 1 -- 10.20.193.28:0/17210969 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faad810c3f0 con 0x7faad810b2d0 2026-02-24T09:16:57.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.131+0000 7faac6ffd640 1 -- 10.20.193.28:0/17210969 <== mon.1 v2:10.20.193.159:3300/0 4 ==== mgrmap(e 19) ==== 157139+0+0 (secure 0 0 0) 0x7faac8004770 con 0x7faad810b2d0 2026-02-24T09:16:57.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.133+0000 7faac6ffd640 1 --2- 10.20.193.28:0/17210969 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7faab40b57b0 0x7faab40d5c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:57.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.133+0000 7faac6ffd640 1 -- 10.20.193.28:0/17210969 <== mon.1 v2:10.20.193.159:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7334+0+0 (secure 0 0 0) 0x7faac80e6540 con 0x7faad810b2d0 2026-02-24T09:16:57.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.133+0000 7faac6ffd640 1 -- 10.20.193.28:0/17210969 <== mon.1 v2:10.20.193.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7faac80e69c0 con 0x7faad810b2d0 2026-02-24T09:16:57.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.133+0000 7faadd59b640 1 --2- 10.20.193.28:0/17210969 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7faab40b57b0 0x7faab40d5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:57.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.134+0000 7faadd59b640 1 --2- 10.20.193.28:0/17210969 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7faab40b57b0 0x7faab40d5c60 secure :-1 s=READY pgs=134 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faad8129ed0 tx=0x7faacc005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:57.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:57.251+0000 7faaded9e640 1 -- 10.20.193.28:0/17210969 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7faad8124690 con 0x7faad810b2d0 2026-02-24T09:16:57.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:57 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/431262616' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-24T09:16:57.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:57 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:57.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:57 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:57.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:57 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:57.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:57 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:57.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:57 trial028 ceph-mon[40371]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-24T09:16:57.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:57 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/17210969' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-24T09:16:57.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:57 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:57.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:57 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:57.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:57 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:57.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:57 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:16:57.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:57 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:57.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:57 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:16:57.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:57 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/431262616' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-24T09:16:57.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:57 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:57.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:57 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:57.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:57 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:57.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:57 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:57.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:57 trial159 ceph-mon[44242]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-24T09:16:57.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:57 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/17210969' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-24T09:16:57.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:57 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:57.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:57 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:57.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:57 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:57.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:57 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:16:57.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:57 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:57.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:57 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:16:57.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:57 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/431262616' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-24T09:16:57.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:57 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:57.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:57 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:57.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:57 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:57.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:57 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:57.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:57 trial074 ceph-mon[44412]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-24T09:16:57.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:57 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/17210969' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-24T09:16:57.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:57 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:57.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:57 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:57.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:57 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:57.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:57 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:16:57.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:57 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:16:57.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:57 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:16:58.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.224+0000 7faac6ffd640 1 -- 10.20.193.28:0/17210969 <== mon.1 v2:10.20.193.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v89) ==== 138+0+0 (secure 0 0 0) 0x7faac80a9320 con 0x7faad810b2d0 2026-02-24T09:16:58.226 INFO:teuthology.orchestra.run.trial028.stderr:pool 'cephfs_metadata' created 2026-02-24T09:16:58.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.228+0000 7faaded9e640 1 -- 10.20.193.28:0/17210969 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7faab40b57b0 msgr2=0x7faab40d5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:58.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.228+0000 7faaded9e640 1 --2- 10.20.193.28:0/17210969 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7faab40b57b0 0x7faab40d5c60 secure :-1 s=READY pgs=134 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faad8129ed0 tx=0x7faacc005f90 comp rx=0 tx=0).stop 2026-02-24T09:16:58.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.228+0000 7faaded9e640 1 -- 10.20.193.28:0/17210969 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7faad810b2d0 msgr2=0x7faad8123530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:58.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.228+0000 7faaded9e640 1 --2- 10.20.193.28:0/17210969 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7faad810b2d0 0x7faad8123530 secure :-1 s=READY pgs=80 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faac800d720 tx=0x7faac800dbf0 comp rx=0 tx=0).stop 2026-02-24T09:16:58.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.228+0000 7faaded9e640 1 -- 10.20.193.28:0/17210969 shutdown_connections 2026-02-24T09:16:58.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.228+0000 7faaded9e640 1 --2- 10.20.193.28:0/17210969 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7faab40b57b0 0x7faab40d5c60 unknown :-1 s=CLOSED pgs=134 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:58.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.228+0000 7faaded9e640 1 --2- 10.20.193.28:0/17210969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faad81112e0 0x7faad8128e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:58.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.228+0000 7faaded9e640 1 --2- 10.20.193.28:0/17210969 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7faad810bcc0 0x7faad8123a70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:58.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.228+0000 7faaded9e640 1 --2- 10.20.193.28:0/17210969 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7faad810b2d0 0x7faad8123530 unknown :-1 s=CLOSED pgs=80 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:58.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.228+0000 7faaded9e640 1 -- 10.20.193.28:0/17210969 >> 10.20.193.28:0/17210969 conn(0x7faad80e8e40 msgr2=0x7faad8109220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:58.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.229+0000 7faaded9e640 1 -- 10.20.193.28:0/17210969 shutdown_connections 2026-02-24T09:16:58.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.229+0000 7faaded9e640 1 -- 10.20.193.28:0/17210969 wait complete. 2026-02-24T09:16:58.327 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2026-02-24T09:16:58.511 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:16:58.556 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:58 trial028 ceph-mon[40371]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:58.556 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:58 trial028 ceph-mon[40371]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-24T09:16:58.556 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:58 trial028 ceph-mon[40371]: osdmap e89: 12 total, 12 up, 12 in 2026-02-24T09:16:58.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.704+0000 7f02a951d640 1 -- 10.20.193.28:0/397255177 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f02a410f6c0 msgr2=0x7f02a410fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:58.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.704+0000 7f02a951d640 1 --2- 10.20.193.28:0/397255177 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f02a410f6c0 0x7f02a410fa90 secure :-1 s=READY pgs=233 gs=1 cs=0 l=1 c_cookie=11247649936195980553 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0298009950 tx=0x7f029802f190 comp rx=0 tx=0).stop 2026-02-24T09:16:58.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.704+0000 7f02a951d640 1 -- 10.20.193.28:0/397255177 shutdown_connections 2026-02-24T09:16:58.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.704+0000 7f02a951d640 1 --2- 10.20.193.28:0/397255177 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f02a41158b0 0x7f02a4176280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:58.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.704+0000 7f02a951d640 1 --2- 10.20.193.28:0/397255177 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f02a41100b0 0x7f02a4115100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:58.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.704+0000 7f02a951d640 1 --2- 10.20.193.28:0/397255177 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f02a410f6c0 0x7f02a410fa90 unknown :-1 s=CLOSED pgs=233 gs=1 cs=0 l=1 c_cookie=11247649936195980553 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:58.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.704+0000 7f02a951d640 1 -- 10.20.193.28:0/397255177 >> 10.20.193.28:0/397255177 conn(0x7f02a40ecfd0 msgr2=0x7f02a410d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:58.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.704+0000 7f02a951d640 1 -- 10.20.193.28:0/397255177 shutdown_connections 2026-02-24T09:16:58.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.704+0000 7f02a951d640 1 -- 10.20.193.28:0/397255177 wait complete. 2026-02-24T09:16:58.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.705+0000 7f02a951d640 1 Processor -- start 2026-02-24T09:16:58.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.705+0000 7f02a951d640 1 -- start start 2026-02-24T09:16:58.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.705+0000 7f02a951d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f02a410f6c0 0x7f02a40f59e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:58.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.705+0000 7f02a951d640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f02a41100b0 0x7f02a4176180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:58.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.705+0000 7f02a951d640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f02a41158b0 0x7f02a40f60e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:58.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.705+0000 7f02a951d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f02a40fb2f0 con 0x7f02a410f6c0 2026-02-24T09:16:58.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.705+0000 7f02a951d640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f02a40fb460 con 0x7f02a41158b0 2026-02-24T09:16:58.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.705+0000 7f02a951d640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f02a40fb620 con 0x7f02a41100b0 2026-02-24T09:16:58.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.705+0000 7f02a2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f02a410f6c0 0x7f02a40f59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:58.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.705+0000 7f02a2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f02a410f6c0 0x7f02a40f59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39910/0 (socket says 10.20.193.28:39910) 2026-02-24T09:16:58.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.705+0000 7f02a2ffd640 1 -- 10.20.193.28:0/584111742 learned_addr learned my addr 10.20.193.28:0/584111742 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:16:58.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.705+0000 7f02a37fe640 1 --2- 10.20.193.28:0/584111742 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f02a41158b0 0x7f02a40f60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:58.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.705+0000 7f02a27fc640 1 --2- 10.20.193.28:0/584111742 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f02a41100b0 0x7f02a4176180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:58.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.706+0000 7f02a2ffd640 1 -- 10.20.193.28:0/584111742 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f02a41100b0 msgr2=0x7f02a4176180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:58.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.706+0000 7f02a2ffd640 1 --2- 10.20.193.28:0/584111742 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f02a41100b0 0x7f02a4176180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:58.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.706+0000 7f02a2ffd640 1 -- 10.20.193.28:0/584111742 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f02a41158b0 msgr2=0x7f02a40f60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:58.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.706+0000 7f02a2ffd640 1 --2- 10.20.193.28:0/584111742 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f02a41158b0 0x7f02a40f60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:58.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.706+0000 7f02a2ffd640 1 -- 10.20.193.28:0/584111742 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0298009570 con 0x7f02a410f6c0 2026-02-24T09:16:58.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.706+0000 7f02a2ffd640 1 --2- 10.20.193.28:0/584111742 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f02a410f6c0 0x7f02a40f59e0 secure :-1 s=READY pgs=234 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02980098a0 tx=0x7f02980028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:58.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.706+0000 7f0283fff640 1 -- 10.20.193.28:0/584111742 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f029803d070 con 0x7f02a410f6c0 2026-02-24T09:16:58.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.706+0000 7f0283fff640 1 -- 10.20.193.28:0/584111742 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f029802fe20 con 0x7f02a410f6c0 2026-02-24T09:16:58.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.706+0000 7f0283fff640 1 -- 10.20.193.28:0/584111742 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0298041890 con 0x7f02a410f6c0 2026-02-24T09:16:58.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.706+0000 7f02a951d640 1 -- 10.20.193.28:0/584111742 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02a40fb8a0 con 0x7f02a410f6c0 2026-02-24T09:16:58.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.706+0000 7f02a951d640 1 -- 10.20.193.28:0/584111742 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02a40fbd60 con 0x7f02a410f6c0 2026-02-24T09:16:58.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.707+0000 7f0281ffb640 1 -- 10.20.193.28:0/584111742 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02a41109a0 con 0x7f02a410f6c0 2026-02-24T09:16:58.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.709+0000 7f0283fff640 1 -- 10.20.193.28:0/584111742 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 19) ==== 157139+0+0 (secure 0 0 0) 0x7f0298041a20 con 0x7f02a410f6c0 2026-02-24T09:16:58.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.711+0000 7f0283fff640 1 --2- 10.20.193.28:0/584111742 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f02780b57a0 0x7f02780d5c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:58.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.711+0000 7f0283fff640 1 -- 10.20.193.28:0/584111742 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7707+0+0 (secure 0 0 0) 0x7f029810b630 con 0x7f02a410f6c0 2026-02-24T09:16:58.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.711+0000 7f02a27fc640 1 --2- 10.20.193.28:0/584111742 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f02780b57a0 0x7f02780d5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:58.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.711+0000 7f0283fff640 1 -- 10.20.193.28:0/584111742 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f029810bab0 con 0x7f02a410f6c0 2026-02-24T09:16:58.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.712+0000 7f02a27fc640 1 --2- 10.20.193.28:0/584111742 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f02780b57a0 0x7f02780d5c50 secure :-1 s=READY pgs=135 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f028c005970 tx=0x7f028c005900 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:58.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:58 trial159 ceph-mon[44242]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:58.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:58 trial159 ceph-mon[44242]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-24T09:16:58.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:58 trial159 ceph-mon[44242]: osdmap e89: 12 total, 12 up, 12 in 2026-02-24T09:16:58.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:58.826+0000 7f0281ffb640 1 -- 10.20.193.28:0/584111742 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f02a40f6b40 con 0x7f02a410f6c0 2026-02-24T09:16:58.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:58 trial074 ceph-mon[44412]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:16:58.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:58 trial074 ceph-mon[44412]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-24T09:16:58.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:58 trial074 ceph-mon[44412]: osdmap e89: 12 total, 12 up, 12 in 2026-02-24T09:16:59.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.225+0000 7f0283fff640 1 -- 10.20.193.28:0/584111742 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v90) ==== 170+0+0 (secure 0 0 0) 0x7f02980ce1f0 con 0x7f02a410f6c0 2026-02-24T09:16:59.228 INFO:teuthology.orchestra.run.trial028.stderr:pool 'cephfs_data' created 2026-02-24T09:16:59.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.227+0000 7f0281ffb640 1 -- 10.20.193.28:0/584111742 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f02780b57a0 msgr2=0x7f02780d5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:59.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.227+0000 7f0281ffb640 1 --2- 10.20.193.28:0/584111742 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f02780b57a0 0x7f02780d5c50 secure :-1 s=READY pgs=135 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f028c005970 tx=0x7f028c005900 comp rx=0 tx=0).stop 2026-02-24T09:16:59.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.227+0000 7f0281ffb640 1 -- 10.20.193.28:0/584111742 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f02a410f6c0 msgr2=0x7f02a40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:59.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.227+0000 7f0281ffb640 1 --2- 10.20.193.28:0/584111742 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f02a410f6c0 0x7f02a40f59e0 secure :-1 s=READY pgs=234 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02980098a0 tx=0x7f02980028d0 comp rx=0 tx=0).stop 2026-02-24T09:16:59.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.228+0000 7f0281ffb640 1 -- 10.20.193.28:0/584111742 shutdown_connections 2026-02-24T09:16:59.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.228+0000 7f0281ffb640 1 --2- 10.20.193.28:0/584111742 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f02780b57a0 0x7f02780d5c50 unknown :-1 s=CLOSED pgs=135 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:59.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.228+0000 7f0281ffb640 1 --2- 10.20.193.28:0/584111742 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f02a41158b0 0x7f02a40f60e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:59.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.228+0000 7f0281ffb640 1 --2- 10.20.193.28:0/584111742 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f02a41100b0 0x7f02a4176180 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:59.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.228+0000 7f0281ffb640 1 --2- 10.20.193.28:0/584111742 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f02a410f6c0 0x7f02a40f59e0 unknown :-1 s=CLOSED pgs=234 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:59.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.228+0000 7f0281ffb640 1 -- 10.20.193.28:0/584111742 >> 10.20.193.28:0/584111742 conn(0x7f02a40ecfd0 msgr2=0x7f02a4111bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:59.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.228+0000 7f0281ffb640 1 -- 10.20.193.28:0/584111742 shutdown_connections 2026-02-24T09:16:59.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.228+0000 7f0281ffb640 1 -- 10.20.193.28:0/584111742 wait complete. 2026-02-24T09:16:59.367 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph fs new cephfs cephfs_metadata cephfs_data 2026-02-24T09:16:59.551 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:16:59.593 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:59 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/584111742' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-24T09:16:59.593 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:59 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/584111742' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-24T09:16:59.593 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:16:59 trial028 ceph-mon[40371]: osdmap e90: 12 total, 12 up, 12 in 2026-02-24T09:16:59.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.739+0000 7f8733847640 1 -- 10.20.193.28:0/3597201517 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f872c10c290 msgr2=0x7f872c10c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:59.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.739+0000 7f8733847640 1 --2- 10.20.193.28:0/3597201517 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f872c10c290 0x7f872c10c660 secure :-1 s=READY pgs=235 gs=1 cs=0 l=1 c_cookie=17705039594107074008 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f871c009950 tx=0x7f871c02f190 comp rx=0 tx=0).stop 2026-02-24T09:16:59.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.740+0000 7f8733847640 1 -- 10.20.193.28:0/3597201517 shutdown_connections 2026-02-24T09:16:59.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.740+0000 7f8733847640 1 --2- 10.20.193.28:0/3597201517 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f872c112480 0x7f872c172e50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:59.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.740+0000 7f8733847640 1 --2- 10.20.193.28:0/3597201517 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f872c10cc80 0x7f872c111cd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:59.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.740+0000 7f8733847640 1 --2- 10.20.193.28:0/3597201517 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f872c10c290 0x7f872c10c660 unknown :-1 s=CLOSED pgs=235 gs=1 cs=0 l=1 c_cookie=17705039594107074008 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:59.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.740+0000 7f8733847640 1 -- 10.20.193.28:0/3597201517 >> 10.20.193.28:0/3597201517 conn(0x7f872c0e9b80 msgr2=0x7f872c109f90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:59.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.740+0000 7f8733847640 1 -- 10.20.193.28:0/3597201517 shutdown_connections 2026-02-24T09:16:59.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.740+0000 7f8733847640 1 -- 10.20.193.28:0/3597201517 wait complete. 2026-02-24T09:16:59.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.741+0000 7f8733847640 1 Processor -- start 2026-02-24T09:16:59.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.741+0000 7f8733847640 1 -- start start 2026-02-24T09:16:59.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.741+0000 7f8733847640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f872c10c290 0x7f872c1191a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:59.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.741+0000 7f8733847640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f872c10cc80 0x7f872c1196e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:59.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.741+0000 7f8733847640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f872c112480 0x7f872c11eab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:59.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.741+0000 7f8733847640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f872c11f0d0 con 0x7f872c112480 2026-02-24T09:16:59.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.741+0000 7f8733847640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f872c11f240 con 0x7f872c10cc80 2026-02-24T09:16:59.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.741+0000 7f8733847640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f872c11f400 con 0x7f872c10c290 2026-02-24T09:16:59.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.742+0000 7f8731dbd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f872c112480 0x7f872c11eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:59.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.742+0000 7f8731dbd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f872c112480 0x7f872c11eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39924/0 (socket says 10.20.193.28:39924) 2026-02-24T09:16:59.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.742+0000 7f8731dbd640 1 -- 10.20.193.28:0/4217679457 learned_addr learned my addr 10.20.193.28:0/4217679457 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:16:59.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.742+0000 7f8730dbb640 1 --2- 10.20.193.28:0/4217679457 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f872c10cc80 0x7f872c1196e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:59.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.742+0000 7f87315bc640 1 --2- 10.20.193.28:0/4217679457 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f872c10c290 0x7f872c1191a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:59.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.742+0000 7f8731dbd640 1 -- 10.20.193.28:0/4217679457 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f872c10c290 msgr2=0x7f872c1191a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:59.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.742+0000 7f8731dbd640 1 --2- 10.20.193.28:0/4217679457 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f872c10c290 0x7f872c1191a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:59.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.742+0000 7f8731dbd640 1 -- 10.20.193.28:0/4217679457 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f872c10cc80 msgr2=0x7f872c1196e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:59.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.742+0000 7f8731dbd640 1 --2- 10.20.193.28:0/4217679457 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f872c10cc80 0x7f872c1196e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:59.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.742+0000 7f8731dbd640 1 -- 10.20.193.28:0/4217679457 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f871c009570 con 0x7f872c112480 2026-02-24T09:16:59.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.742+0000 7f8730dbb640 1 --2- 10.20.193.28:0/4217679457 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f872c10cc80 0x7f872c1196e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:16:59.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.742+0000 7f8731dbd640 1 --2- 10.20.193.28:0/4217679457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f872c112480 0x7f872c11eab0 secure :-1 s=READY pgs=236 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8728006e90 tx=0x7f872800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:59.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.742+0000 7f871a7fc640 1 -- 10.20.193.28:0/4217679457 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8728005500 con 0x7f872c112480 2026-02-24T09:16:59.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.742+0000 7f871a7fc640 1 -- 10.20.193.28:0/4217679457 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8728005df0 con 0x7f872c112480 2026-02-24T09:16:59.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.742+0000 7f871a7fc640 1 -- 10.20.193.28:0/4217679457 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8728003a00 con 0x7f872c112480 2026-02-24T09:16:59.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.742+0000 7f8733847640 1 -- 10.20.193.28:0/4217679457 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f872c11f6e0 con 0x7f872c112480 2026-02-24T09:16:59.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.742+0000 7f8733847640 1 -- 10.20.193.28:0/4217679457 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f872c15fde0 con 0x7f872c112480 2026-02-24T09:16:59.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.743+0000 7f8733847640 1 -- 10.20.193.28:0/4217679457 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f872c11f900 con 0x7f872c112480 2026-02-24T09:16:59.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.745+0000 7f871a7fc640 1 -- 10.20.193.28:0/4217679457 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 19) ==== 157139+0+0 (secure 0 0 0) 0x7f8728003b60 con 0x7f872c112480 2026-02-24T09:16:59.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.747+0000 7f871a7fc640 1 --2- 10.20.193.28:0/4217679457 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f87080b57b0 0x7f87080d5c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:59.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.747+0000 7f871a7fc640 1 -- 10.20.193.28:0/4217679457 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8092+0+0 (secure 0 0 0) 0x7f87280e7cb0 con 0x7f872c112480 2026-02-24T09:16:59.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.747+0000 7f871a7fc640 1 -- 10.20.193.28:0/4217679457 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f87280e8130 con 0x7f872c112480 2026-02-24T09:16:59.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.747+0000 7f87315bc640 1 --2- 10.20.193.28:0/4217679457 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f87080b57b0 0x7f87080d5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:59.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.748+0000 7f87315bc640 1 --2- 10.20.193.28:0/4217679457 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f87080b57b0 0x7f87080d5c60 secure :-1 s=READY pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f871c0023d0 tx=0x7f871c031040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:59.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:59 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/584111742' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-24T09:16:59.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:59 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/584111742' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-24T09:16:59.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:16:59 trial159 ceph-mon[44242]: osdmap e90: 12 total, 12 up, 12 in 2026-02-24T09:16:59.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:59 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/584111742' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-24T09:16:59.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:59 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/584111742' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-24T09:16:59.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:16:59 trial074 ceph-mon[44412]: osdmap e90: 12 total, 12 up, 12 in 2026-02-24T09:16:59.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:16:59.887+0000 7f8733847640 1 -- 10.20.193.28:0/4217679457 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f872c11a300 con 0x7f872c112480 2026-02-24T09:17:00.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.475+0000 7f871a7fc640 1 -- 10.20.193.28:0/4217679457 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f87280aa6f0 con 0x7f872c112480 2026-02-24T09:17:00.477 INFO:teuthology.orchestra.run.trial028.stderr:new fs with metadata pool 2 and data pool 3 2026-02-24T09:17:00.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.478+0000 7f8733847640 1 -- 10.20.193.28:0/4217679457 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f87080b57b0 msgr2=0x7f87080d5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:00.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.478+0000 7f8733847640 1 --2- 10.20.193.28:0/4217679457 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f87080b57b0 0x7f87080d5c60 secure :-1 s=READY pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f871c0023d0 tx=0x7f871c031040 comp rx=0 tx=0).stop 2026-02-24T09:17:00.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.478+0000 7f8733847640 1 -- 10.20.193.28:0/4217679457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f872c112480 msgr2=0x7f872c11eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:00.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.478+0000 7f8733847640 1 --2- 10.20.193.28:0/4217679457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f872c112480 0x7f872c11eab0 secure :-1 s=READY pgs=236 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8728006e90 tx=0x7f872800edf0 comp rx=0 tx=0).stop 2026-02-24T09:17:00.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.478+0000 7f8733847640 1 -- 10.20.193.28:0/4217679457 shutdown_connections 2026-02-24T09:17:00.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.478+0000 7f8733847640 1 --2- 10.20.193.28:0/4217679457 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f87080b57b0 0x7f87080d5c60 unknown :-1 s=CLOSED pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:00.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.478+0000 7f8733847640 1 --2- 10.20.193.28:0/4217679457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f872c112480 0x7f872c11eab0 unknown :-1 s=CLOSED pgs=236 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:00.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.478+0000 7f8733847640 1 --2- 10.20.193.28:0/4217679457 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f872c10cc80 0x7f872c1196e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:00.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.478+0000 7f8733847640 1 --2- 10.20.193.28:0/4217679457 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f872c10c290 0x7f872c1191a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:00.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.478+0000 7f8733847640 1 -- 10.20.193.28:0/4217679457 >> 10.20.193.28:0/4217679457 conn(0x7f872c0e9b80 msgr2=0x7f872c109f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:00.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.478+0000 7f8733847640 1 -- 10.20.193.28:0/4217679457 shutdown_connections 2026-02-24T09:17:00.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.478+0000 7f8733847640 1 -- 10.20.193.28:0/4217679457 wait complete. 2026-02-24T09:17:00.582 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T09:17:00.764 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:00.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:00 trial159 ceph-mon[44242]: pgmap v178: 97 pgs: 14 creating+peering, 82 unknown, 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:17:00.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:00 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/4217679457' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-24T09:17:00.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:00 trial159 ceph-mon[44242]: daemon mds.b assigned to filesystem cephfs as rank 0 2026-02-24T09:17:00.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:00 trial159 ceph-mon[44242]: osdmap e91: 12 total, 12 up, 12 in 2026-02-24T09:17:00.809 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:00 trial028 ceph-mon[40371]: pgmap v178: 97 pgs: 14 creating+peering, 82 unknown, 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:17:00.810 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:00 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/4217679457' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-24T09:17:00.810 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:00 trial028 ceph-mon[40371]: daemon mds.b assigned to filesystem cephfs as rank 0 2026-02-24T09:17:00.810 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:00 trial028 ceph-mon[40371]: osdmap e91: 12 total, 12 up, 12 in 2026-02-24T09:17:00.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:00 trial074 ceph-mon[44412]: pgmap v178: 97 pgs: 14 creating+peering, 82 unknown, 1 active+clean; 577 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:17:00.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:00 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/4217679457' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-24T09:17:00.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:00 trial074 ceph-mon[44412]: daemon mds.b assigned to filesystem cephfs as rank 0 2026-02-24T09:17:00.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:00 trial074 ceph-mon[44412]: osdmap e91: 12 total, 12 up, 12 in 2026-02-24T09:17:00.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.942+0000 7f16f1dbc640 1 -- 10.20.193.28:0/3428324134 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f16ec113200 msgr2=0x7f16ec173bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:00.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.942+0000 7f16f1dbc640 1 --2- 10.20.193.28:0/3428324134 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f16ec113200 0x7f16ec173bd0 secure :-1 s=READY pgs=237 gs=1 cs=0 l=1 c_cookie=10777012831552096718 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16e000aa30 tx=0x7f16e0030270 comp rx=0 tx=0).stop 2026-02-24T09:17:00.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.943+0000 7f16f1dbc640 1 -- 10.20.193.28:0/3428324134 shutdown_connections 2026-02-24T09:17:00.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.943+0000 7f16f1dbc640 1 --2- 10.20.193.28:0/3428324134 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f16ec113200 0x7f16ec173bd0 unknown :-1 s=CLOSED pgs=237 gs=1 cs=0 l=1 c_cookie=10777012831552096718 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:00.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.943+0000 7f16f1dbc640 1 --2- 10.20.193.28:0/3428324134 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f16ec10da00 0x7f16ec112a50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:00.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.943+0000 7f16f1dbc640 1 --2- 10.20.193.28:0/3428324134 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f16ec10d010 0x7f16ec10d3e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:00.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.943+0000 7f16f1dbc640 1 -- 10.20.193.28:0/3428324134 >> 10.20.193.28:0/3428324134 conn(0x7f16ec05f830 msgr2=0x7f16ec10ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:00.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.943+0000 7f16f1dbc640 1 -- 10.20.193.28:0/3428324134 shutdown_connections 2026-02-24T09:17:00.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.943+0000 7f16f1dbc640 1 -- 10.20.193.28:0/3428324134 wait complete. 2026-02-24T09:17:00.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.943+0000 7f16f1dbc640 1 Processor -- start 2026-02-24T09:17:00.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.944+0000 7f16f1dbc640 1 -- start start 2026-02-24T09:17:00.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.944+0000 7f16f1dbc640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f16ec10d010 0x7f16ec0eec90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:00.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.944+0000 7f16f1dbc640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f16ec10da00 0x7f16ec173ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:00.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.944+0000 7f16f1dbc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f16ec113200 0x7f16ec0ef390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:00.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.944+0000 7f16f1dbc640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f16ec0f45a0 con 0x7f16ec113200 2026-02-24T09:17:00.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.944+0000 7f16f1dbc640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f16ec0f4710 con 0x7f16ec10d010 2026-02-24T09:17:00.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.944+0000 7f16f1dbc640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f16ec0f48d0 con 0x7f16ec10da00 2026-02-24T09:17:00.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.944+0000 7f16ebfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f16ec113200 0x7f16ec0ef390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:00.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.944+0000 7f16ebfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f16ec113200 0x7f16ec0ef390 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39932/0 (socket says 10.20.193.28:39932) 2026-02-24T09:17:00.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.944+0000 7f16ebfff640 1 -- 10.20.193.28:0/1177722398 learned_addr learned my addr 10.20.193.28:0/1177722398 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:00.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.944+0000 7f16eb7fe640 1 --2- 10.20.193.28:0/1177722398 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f16ec10d010 0x7f16ec0eec90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:00.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.944+0000 7f16eaffd640 1 --2- 10.20.193.28:0/1177722398 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f16ec10da00 0x7f16ec173ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:00.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.944+0000 7f16ebfff640 1 -- 10.20.193.28:0/1177722398 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f16ec10da00 msgr2=0x7f16ec173ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:00.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.944+0000 7f16ebfff640 1 --2- 10.20.193.28:0/1177722398 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f16ec10da00 0x7f16ec173ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:00.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.944+0000 7f16ebfff640 1 -- 10.20.193.28:0/1177722398 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f16ec10d010 msgr2=0x7f16ec0eec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:00.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.944+0000 7f16ebfff640 1 --2- 10.20.193.28:0/1177722398 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f16ec10d010 0x7f16ec0eec90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:00.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.944+0000 7f16ebfff640 1 -- 10.20.193.28:0/1177722398 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e000a650 con 0x7f16ec113200 2026-02-24T09:17:00.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.944+0000 7f16ebfff640 1 --2- 10.20.193.28:0/1177722398 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f16ec113200 0x7f16ec0ef390 secure :-1 s=READY pgs=238 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16e0032fe0 tx=0x7f16e00039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:00.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.945+0000 7f16e8ff9640 1 -- 10.20.193.28:0/1177722398 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16e003e070 con 0x7f16ec113200 2026-02-24T09:17:00.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.945+0000 7f16e8ff9640 1 -- 10.20.193.28:0/1177722398 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f16e0003e00 con 0x7f16ec113200 2026-02-24T09:17:00.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.945+0000 7f16e8ff9640 1 -- 10.20.193.28:0/1177722398 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16e0042940 con 0x7f16ec113200 2026-02-24T09:17:00.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.945+0000 7f16f1dbc640 1 -- 10.20.193.28:0/1177722398 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16ec0f4b50 con 0x7f16ec113200 2026-02-24T09:17:00.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.945+0000 7f16f1dbc640 1 -- 10.20.193.28:0/1177722398 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16ec0f4f70 con 0x7f16ec113200 2026-02-24T09:17:00.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.945+0000 7f16f1dbc640 1 -- 10.20.193.28:0/1177722398 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16b0005300 con 0x7f16ec113200 2026-02-24T09:17:00.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.948+0000 7f16e8ff9640 1 -- 10.20.193.28:0/1177722398 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 19) ==== 157139+0+0 (secure 0 0 0) 0x7f16e0042ad0 con 0x7f16ec113200 2026-02-24T09:17:00.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.949+0000 7f16e8ff9640 1 --2- 10.20.193.28:0/1177722398 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f16c00b57a0 0x7f16c00d5c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:00.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.949+0000 7f16e8ff9640 1 -- 10.20.193.28:0/1177722398 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8192+0+0 (secure 0 0 0) 0x7f16e010c990 con 0x7f16ec113200 2026-02-24T09:17:00.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.949+0000 7f16e8ff9640 1 -- 10.20.193.28:0/1177722398 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f16e0145930 con 0x7f16ec113200 2026-02-24T09:17:00.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.949+0000 7f16eb7fe640 1 --2- 10.20.193.28:0/1177722398 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f16c00b57a0 0x7f16c00d5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:00.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:00.950+0000 7f16eb7fe640 1 --2- 10.20.193.28:0/1177722398 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f16c00b57a0 0x7f16c00d5c50 secure :-1 s=READY pgs=137 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16d8004740 tx=0x7f16d800b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:01.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.064+0000 7f16f1dbc640 1 -- 10.20.193.28:0/1177722398 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f16b0005880 con 0x7f16ec113200 2026-02-24T09:17:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.065+0000 7f16e8ff9640 1 -- 10.20.193.28:0/1177722398 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+22645 (secure 0 0 0) 0x7f16e00cf430 con 0x7f16ec113200 2026-02-24T09:17:01.067 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:17:01.068 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":91,"fsid":"e9ad50af-1160-11f1-800e-d404e6e7d460","created":"2026-02-24T09:12:33.966733+0000","modified":"2026-02-24T09:16:59.889533+0000","last_up_change":"2026-02-24T09:16:34.222008+0000","last_in_change":"2026-02-24T09:16:20.530109+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":38,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T09:14:33.468078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-24T09:16:57.259549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-24T09:16:58.835796+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7836f68-f25a-4aea-830a-3c2ce8ac79e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6803","nonce":2124354447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6805","nonce":2124354447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6809","nonce":2124354447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6807","nonce":2124354447}]},"public_addr":"10.20.193.28:6803/2124354447","cluster_addr":"10.20.193.28:6805/2124354447","heartbeat_back_addr":"10.20.193.28:6809/2124354447","heartbeat_front_addr":"10.20.193.28:6807/2124354447","state":["exists","up"]},{"osd":1,"uuid":"04273ff8-91e3-4e70-8041-cc8c205b9a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6800","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6801","nonce":267363486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6802","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6803","nonce":267363486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6806","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6807","nonce":267363486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6804","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6805","nonce":267363486}]},"public_addr":"10.20.193.74:6801/267363486","cluster_addr":"10.20.193.74:6803/267363486","heartbeat_back_addr":"10.20.193.74:6807/267363486","heartbeat_front_addr":"10.20.193.74:6805/267363486","state":["exists","up"]},{"osd":2,"uuid":"dea96db1-588b-4d08-8e52-52c4c995bdc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6800","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6801","nonce":3320466721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6802","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6803","nonce":3320466721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6806","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6807","nonce":3320466721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6804","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6805","nonce":3320466721}]},"public_addr":"10.20.193.159:6801/3320466721","cluster_addr":"10.20.193.159:6803/3320466721","heartbeat_back_addr":"10.20.193.159:6807/3320466721","heartbeat_front_addr":"10.20.193.159:6805/3320466721","state":["exists","up"]},{"osd":3,"uuid":"c785c244-eb3f-4af5-83c6-cd492459f75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6811","nonce":1790609615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6813","nonce":1790609615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6817","nonce":1790609615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6815","nonce":1790609615}]},"public_addr":"10.20.193.28:6811/1790609615","cluster_addr":"10.20.193.28:6813/1790609615","heartbeat_back_addr":"10.20.193.28:6817/1790609615","heartbeat_front_addr":"10.20.193.28:6815/1790609615","state":["exists","up"]},{"osd":4,"uuid":"041239c2-6187-4154-9557-b1b5846f9e0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6808","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6809","nonce":610990618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6810","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6811","nonce":610990618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6814","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6815","nonce":610990618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6812","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6813","nonce":610990618}]},"public_addr":"10.20.193.74:6809/610990618","cluster_addr":"10.20.193.74:6811/610990618","heartbeat_back_addr":"10.20.193.74:6815/610990618","heartbeat_front_addr":"10.20.193.74:6813/610990618","state":["exists","up"]},{"osd":5,"uuid":"ffeeb021-0924-4421-aecf-bac2e74364a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6808","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6809","nonce":1653417923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6810","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6811","nonce":1653417923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6814","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6815","nonce":1653417923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6812","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6813","nonce":1653417923}]},"public_addr":"10.20.193.159:6809/1653417923","cluster_addr":"10.20.193.159:6811/1653417923","heartbeat_back_addr":"10.20.193.159:6815/1653417923","heartbeat_front_addr":"10.20.193.159:6813/1653417923","state":["exists","up"]},{"osd":6,"uuid":"f3736156-4951-4901-9323-7930fb73b8dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6819","nonce":1891043856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6821","nonce":1891043856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6825","nonce":1891043856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6823","nonce":1891043856}]},"public_addr":"10.20.193.28:6819/1891043856","cluster_addr":"10.20.193.28:6821/1891043856","heartbeat_back_addr":"10.20.193.28:6825/1891043856","heartbeat_front_addr":"10.20.193.28:6823/1891043856","state":["exists","up"]},{"osd":7,"uuid":"214b27ee-75f9-4a54-a59b-e8bfbb895903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6816","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6817","nonce":2328869739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6818","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6819","nonce":2328869739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6822","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6823","nonce":2328869739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6820","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6821","nonce":2328869739}]},"public_addr":"10.20.193.74:6817/2328869739","cluster_addr":"10.20.193.74:6819/2328869739","heartbeat_back_addr":"10.20.193.74:6823/2328869739","heartbeat_front_addr":"10.20.193.74:6821/2328869739","state":["exists","up"]},{"osd":8,"uuid":"76599c26-6778-4fa2-b85d-feea8baac7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6816","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6817","nonce":3877834753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6818","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6819","nonce":3877834753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6822","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6823","nonce":3877834753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6820","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6821","nonce":3877834753}]},"public_addr":"10.20.193.159:6817/3877834753","cluster_addr":"10.20.193.159:6819/3877834753","heartbeat_back_addr":"10.20.193.159:6823/3877834753","heartbeat_front_addr":"10.20.193.159:6821/3877834753","state":["exists","up"]},{"osd":9,"uuid":"52b52b35-2d65-4e53-b7d8-fd7385d5ae88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6827","nonce":4207785690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6829","nonce":4207785690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6833","nonce":4207785690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6831","nonce":4207785690}]},"public_addr":"10.20.193.28:6827/4207785690","cluster_addr":"10.20.193.28:6829/4207785690","heartbeat_back_addr":"10.20.193.28:6833/4207785690","heartbeat_front_addr":"10.20.193.28:6831/4207785690","state":["exists","up"]},{"osd":10,"uuid":"65c8e576-a1c7-4c03-bbf6-57c775f2860f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6824","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6825","nonce":2590408209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6826","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6827","nonce":2590408209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6830","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6831","nonce":2590408209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6828","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6829","nonce":2590408209}]},"public_addr":"10.20.193.74:6825/2590408209","cluster_addr":"10.20.193.74:6827/2590408209","heartbeat_back_addr":"10.20.193.74:6831/2590408209","heartbeat_front_addr":"10.20.193.74:6829/2590408209","state":["exists","up"]},{"osd":11,"uuid":"e2305377-fadb-4cf0-8384-87387f116255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":87,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6824","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6825","nonce":709820718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6826","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6827","nonce":709820718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6830","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6831","nonce":709820718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6828","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6829","nonce":709820718}]},"public_addr":"10.20.193.159:6825/709820718","cluster_addr":"10.20.193.159:6827/709820718","heartbeat_back_addr":"10.20.193.159:6831/709820718","heartbeat_front_addr":"10.20.193.159:6829/709820718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:02.414561+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:16.784172+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:30.639920+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:44.510387+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:58.186053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:11.714819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:25.188981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:38.602303+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:51.899864+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:16:05.444224+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:16:18.900719+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:16:32.290361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:0/3696280830":"2026-02-25T09:13:39.242729+0000","10.20.193.28:6801/3539300247":"2026-02-25T09:13:39.242729+0000","10.20.193.28:0/3799405177":"2026-02-25T09:12:46.171932+0000","10.20.193.28:0/1189576634":"2026-02-25T09:12:46.171932+0000","10.20.193.28:6800/1682009277":"2026-02-25T09:12:46.171932+0000","10.20.193.28:6800/3539300247":"2026-02-25T09:13:39.242729+0000","10.20.193.28:6801/1682009277":"2026-02-25T09:12:46.171932+0000","10.20.193.28:0/673213915":"2026-02-25T09:12:59.028609+0000","10.20.193.28:0/857248143":"2026-02-25T09:13:39.242729+0000","10.20.193.28:0/1541006046":"2026-02-25T09:12:46.171932+0000","10.20.193.28:0/264576041":"2026-02-25T09:12:59.028609+0000","10.20.193.28:6800/2303472235":"2026-02-25T09:12:59.028609+0000","10.20.193.28:6801/2303472235":"2026-02-25T09:12:59.028609+0000","10.20.193.28:0/2622827224":"2026-02-25T09:12:59.028609+0000","10.20.193.28:0/3614117448":"2026-02-25T09:13:39.242729+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T09:17:01.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.066+0000 7f16f1dbc640 1 -- 10.20.193.28:0/1177722398 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f16c00b57a0 msgr2=0x7f16c00d5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:01.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.066+0000 7f16f1dbc640 1 --2- 10.20.193.28:0/1177722398 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f16c00b57a0 0x7f16c00d5c50 secure :-1 s=READY pgs=137 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16d8004740 tx=0x7f16d800b410 comp rx=0 tx=0).stop 2026-02-24T09:17:01.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.066+0000 7f16f1dbc640 1 -- 10.20.193.28:0/1177722398 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f16ec113200 msgr2=0x7f16ec0ef390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:01.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.066+0000 7f16f1dbc640 1 --2- 10.20.193.28:0/1177722398 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f16ec113200 0x7f16ec0ef390 secure :-1 s=READY pgs=238 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16e0032fe0 tx=0x7f16e00039b0 comp rx=0 tx=0).stop 2026-02-24T09:17:01.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.066+0000 7f16f1dbc640 1 -- 10.20.193.28:0/1177722398 shutdown_connections 2026-02-24T09:17:01.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.066+0000 7f16f1dbc640 1 --2- 10.20.193.28:0/1177722398 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f16c00b57a0 0x7f16c00d5c50 unknown :-1 s=CLOSED pgs=137 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:01.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.066+0000 7f16f1dbc640 1 --2- 10.20.193.28:0/1177722398 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f16ec113200 0x7f16ec0ef390 unknown :-1 s=CLOSED pgs=238 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:01.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.066+0000 7f16f1dbc640 1 --2- 10.20.193.28:0/1177722398 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f16ec10da00 0x7f16ec173ad0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:01.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.066+0000 7f16f1dbc640 1 --2- 10.20.193.28:0/1177722398 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f16ec10d010 0x7f16ec0eec90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:01.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.066+0000 7f16f1dbc640 1 -- 10.20.193.28:0/1177722398 >> 10.20.193.28:0/1177722398 conn(0x7f16ec05f830 msgr2=0x7f16ec110000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:01.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.067+0000 7f16f1dbc640 1 -- 10.20.193.28:0/1177722398 shutdown_connections 2026-02-24T09:17:01.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.067+0000 7f16f1dbc640 1 -- 10.20.193.28:0/1177722398 wait complete. 2026-02-24T09:17:01.168 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T09:17:01.353 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:01.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.529+0000 7ff6207cc640 1 -- 10.20.193.28:0/946734014 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff61810f6c0 msgr2=0x7ff61810fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:01.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.529+0000 7ff6207cc640 1 --2- 10.20.193.28:0/946734014 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff61810f6c0 0x7ff61810fa90 secure :-1 s=READY pgs=239 gs=1 cs=0 l=1 c_cookie=4603965359158349402 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff608009950 tx=0x7ff60802f190 comp rx=0 tx=0).stop 2026-02-24T09:17:01.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.529+0000 7ff6207cc640 1 -- 10.20.193.28:0/946734014 shutdown_connections 2026-02-24T09:17:01.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.529+0000 7ff6207cc640 1 --2- 10.20.193.28:0/946734014 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff6181158b0 0x7ff618176280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:01.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.529+0000 7ff6207cc640 1 --2- 10.20.193.28:0/946734014 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff6181100b0 0x7ff618115100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:01.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.529+0000 7ff6207cc640 1 --2- 10.20.193.28:0/946734014 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff61810f6c0 0x7ff61810fa90 unknown :-1 s=CLOSED pgs=239 gs=1 cs=0 l=1 c_cookie=4603965359158349402 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:01.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.529+0000 7ff6207cc640 1 -- 10.20.193.28:0/946734014 >> 10.20.193.28:0/946734014 conn(0x7ff6180ecfd0 msgr2=0x7ff61810d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:01.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.529+0000 7ff6207cc640 1 -- 10.20.193.28:0/946734014 shutdown_connections 2026-02-24T09:17:01.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.529+0000 7ff6207cc640 1 -- 10.20.193.28:0/946734014 wait complete. 2026-02-24T09:17:01.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.530+0000 7ff6207cc640 1 Processor -- start 2026-02-24T09:17:01.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.530+0000 7ff6207cc640 1 -- start start 2026-02-24T09:17:01.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.530+0000 7ff6207cc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff61810f6c0 0x7ff6180f59e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:01.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.530+0000 7ff6207cc640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff6181100b0 0x7ff618176180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:01.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.530+0000 7ff6207cc640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff6181158b0 0x7ff6180f60e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:01.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.530+0000 7ff6207cc640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff6180fb2f0 con 0x7ff61810f6c0 2026-02-24T09:17:01.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.530+0000 7ff6207cc640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7ff6180fb460 con 0x7ff6181158b0 2026-02-24T09:17:01.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.530+0000 7ff6207cc640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff6180fb620 con 0x7ff6181100b0 2026-02-24T09:17:01.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.531+0000 7ff61ed42640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff6181158b0 0x7ff6180f60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:01.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.531+0000 7ff61ed42640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff6181158b0 0x7ff6180f60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:46982/0 (socket says 10.20.193.28:46982) 2026-02-24T09:17:01.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.531+0000 7ff61ed42640 1 -- 10.20.193.28:0/4039457976 learned_addr learned my addr 10.20.193.28:0/4039457976 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:01.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.531+0000 7ff61e541640 1 --2- 10.20.193.28:0/4039457976 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff61810f6c0 0x7ff6180f59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:01.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.531+0000 7ff61dd40640 1 --2- 10.20.193.28:0/4039457976 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff6181100b0 0x7ff618176180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:01.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.531+0000 7ff61e541640 1 -- 10.20.193.28:0/4039457976 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff6181100b0 msgr2=0x7ff618176180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:01.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.531+0000 7ff61e541640 1 --2- 10.20.193.28:0/4039457976 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff6181100b0 0x7ff618176180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:01.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.531+0000 7ff61e541640 1 -- 10.20.193.28:0/4039457976 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff6181158b0 msgr2=0x7ff6180f60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:01.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.531+0000 7ff61e541640 1 --2- 10.20.193.28:0/4039457976 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff6181158b0 0x7ff6180f60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:01.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.531+0000 7ff61e541640 1 -- 10.20.193.28:0/4039457976 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff608009570 con 0x7ff61810f6c0 2026-02-24T09:17:01.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.531+0000 7ff61e541640 1 --2- 10.20.193.28:0/4039457976 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff61810f6c0 0x7ff6180f59e0 secure :-1 s=READY pgs=240 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff608009950 tx=0x7ff6080028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:01.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.531+0000 7ff5ff7fe640 1 -- 10.20.193.28:0/4039457976 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff60803d070 con 0x7ff61810f6c0 2026-02-24T09:17:01.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.531+0000 7ff5ff7fe640 1 -- 10.20.193.28:0/4039457976 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff6080043b0 con 0x7ff61810f6c0 2026-02-24T09:17:01.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.531+0000 7ff5ff7fe640 1 -- 10.20.193.28:0/4039457976 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff608041690 con 0x7ff61810f6c0 2026-02-24T09:17:01.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.531+0000 7ff6207cc640 1 -- 10.20.193.28:0/4039457976 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6180fb8a0 con 0x7ff61810f6c0 2026-02-24T09:17:01.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.532+0000 7ff6207cc640 1 -- 10.20.193.28:0/4039457976 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6180fbd60 con 0x7ff61810f6c0 2026-02-24T09:17:01.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.532+0000 7ff6207cc640 1 -- 10.20.193.28:0/4039457976 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6181109a0 con 0x7ff61810f6c0 2026-02-24T09:17:01.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.534+0000 7ff5ff7fe640 1 -- 10.20.193.28:0/4039457976 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 19) ==== 157139+0+0 (secure 0 0 0) 0x7ff6080386a0 con 0x7ff61810f6c0 2026-02-24T09:17:01.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.536+0000 7ff5ff7fe640 1 --2- 10.20.193.28:0/4039457976 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff5f40b57a0 0x7ff5f40d5c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:01.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.536+0000 7ff5ff7fe640 1 -- 10.20.193.28:0/4039457976 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7ff60810b070 con 0x7ff61810f6c0 2026-02-24T09:17:01.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.537+0000 7ff61dd40640 1 --2- 10.20.193.28:0/4039457976 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff5f40b57a0 0x7ff5f40d5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:01.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.537+0000 7ff5ff7fe640 1 -- 10.20.193.28:0/4039457976 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7ff6080cdb50 con 0x7ff61810f6c0 2026-02-24T09:17:01.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.537+0000 7ff61dd40640 1 --2- 10.20.193.28:0/4039457976 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff5f40b57a0 0x7ff5f40d5c50 secure :-1 s=READY pgs=138 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6180fc380 tx=0x7ff60c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:01.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.652+0000 7ff6207cc640 1 -- 10.20.193.28:0/4039457976 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff6180f6b70 con 0x7ff61810f6c0 2026-02-24T09:17:01.655 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:01 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/4217679457' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-24T09:17:01.655 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:01 trial028 ceph-mon[40371]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2026-02-24T09:17:01.655 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:01 trial028 ceph-mon[40371]: daemon mds.b is now active in filesystem cephfs as rank 0 2026-02-24T09:17:01.655 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:01 trial028 ceph-mon[40371]: mds.? [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] up:active 2026-02-24T09:17:01.655 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:01 trial028 ceph-mon[40371]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-24T09:17:01.656 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:01 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/1177722398' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:17:01.656 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:01 trial028 ceph-mon[40371]: osdmap e92: 12 total, 12 up, 12 in 2026-02-24T09:17:01.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.653+0000 7ff5ff7fe640 1 -- 10.20.193.28:0/4039457976 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+22632 (secure 0 0 0) 0x7ff608005bf0 con 0x7ff61810f6c0 2026-02-24T09:17:01.657 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:17:01.657 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":92,"fsid":"e9ad50af-1160-11f1-800e-d404e6e7d460","created":"2026-02-24T09:12:33.966733+0000","modified":"2026-02-24T09:17:01.228853+0000","last_up_change":"2026-02-24T09:16:34.222008+0000","last_in_change":"2026-02-24T09:16:20.530109+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":38,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T09:14:33.468078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-24T09:16:57.259549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-24T09:16:58.835796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7836f68-f25a-4aea-830a-3c2ce8ac79e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6803","nonce":2124354447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6805","nonce":2124354447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6809","nonce":2124354447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6807","nonce":2124354447}]},"public_addr":"10.20.193.28:6803/2124354447","cluster_addr":"10.20.193.28:6805/2124354447","heartbeat_back_addr":"10.20.193.28:6809/2124354447","heartbeat_front_addr":"10.20.193.28:6807/2124354447","state":["exists","up"]},{"osd":1,"uuid":"04273ff8-91e3-4e70-8041-cc8c205b9a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6800","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6801","nonce":267363486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6802","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6803","nonce":267363486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6806","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6807","nonce":267363486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6804","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6805","nonce":267363486}]},"public_addr":"10.20.193.74:6801/267363486","cluster_addr":"10.20.193.74:6803/267363486","heartbeat_back_addr":"10.20.193.74:6807/267363486","heartbeat_front_addr":"10.20.193.74:6805/267363486","state":["exists","up"]},{"osd":2,"uuid":"dea96db1-588b-4d08-8e52-52c4c995bdc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6800","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6801","nonce":3320466721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6802","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6803","nonce":3320466721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6806","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6807","nonce":3320466721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6804","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6805","nonce":3320466721}]},"public_addr":"10.20.193.159:6801/3320466721","cluster_addr":"10.20.193.159:6803/3320466721","heartbeat_back_addr":"10.20.193.159:6807/3320466721","heartbeat_front_addr":"10.20.193.159:6805/3320466721","state":["exists","up"]},{"osd":3,"uuid":"c785c244-eb3f-4af5-83c6-cd492459f75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6811","nonce":1790609615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6813","nonce":1790609615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6817","nonce":1790609615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6815","nonce":1790609615}]},"public_addr":"10.20.193.28:6811/1790609615","cluster_addr":"10.20.193.28:6813/1790609615","heartbeat_back_addr":"10.20.193.28:6817/1790609615","heartbeat_front_addr":"10.20.193.28:6815/1790609615","state":["exists","up"]},{"osd":4,"uuid":"041239c2-6187-4154-9557-b1b5846f9e0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6808","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6809","nonce":610990618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6810","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6811","nonce":610990618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6814","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6815","nonce":610990618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6812","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6813","nonce":610990618}]},"public_addr":"10.20.193.74:6809/610990618","cluster_addr":"10.20.193.74:6811/610990618","heartbeat_back_addr":"10.20.193.74:6815/610990618","heartbeat_front_addr":"10.20.193.74:6813/610990618","state":["exists","up"]},{"osd":5,"uuid":"ffeeb021-0924-4421-aecf-bac2e74364a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6808","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6809","nonce":1653417923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6810","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6811","nonce":1653417923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6814","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6815","nonce":1653417923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6812","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6813","nonce":1653417923}]},"public_addr":"10.20.193.159:6809/1653417923","cluster_addr":"10.20.193.159:6811/1653417923","heartbeat_back_addr":"10.20.193.159:6815/1653417923","heartbeat_front_addr":"10.20.193.159:6813/1653417923","state":["exists","up"]},{"osd":6,"uuid":"f3736156-4951-4901-9323-7930fb73b8dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6819","nonce":1891043856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6821","nonce":1891043856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6825","nonce":1891043856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6823","nonce":1891043856}]},"public_addr":"10.20.193.28:6819/1891043856","cluster_addr":"10.20.193.28:6821/1891043856","heartbeat_back_addr":"10.20.193.28:6825/1891043856","heartbeat_front_addr":"10.20.193.28:6823/1891043856","state":["exists","up"]},{"osd":7,"uuid":"214b27ee-75f9-4a54-a59b-e8bfbb895903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6816","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6817","nonce":2328869739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6818","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6819","nonce":2328869739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6822","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6823","nonce":2328869739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6820","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6821","nonce":2328869739}]},"public_addr":"10.20.193.74:6817/2328869739","cluster_addr":"10.20.193.74:6819/2328869739","heartbeat_back_addr":"10.20.193.74:6823/2328869739","heartbeat_front_addr":"10.20.193.74:6821/2328869739","state":["exists","up"]},{"osd":8,"uuid":"76599c26-6778-4fa2-b85d-feea8baac7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6816","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6817","nonce":3877834753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6818","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6819","nonce":3877834753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6822","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6823","nonce":3877834753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6820","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6821","nonce":3877834753}]},"public_addr":"10.20.193.159:6817/3877834753","cluster_addr":"10.20.193.159:6819/3877834753","heartbeat_back_addr":"10.20.193.159:6823/3877834753","heartbeat_front_addr":"10.20.193.159:6821/3877834753","state":["exists","up"]},{"osd":9,"uuid":"52b52b35-2d65-4e53-b7d8-fd7385d5ae88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6827","nonce":4207785690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6829","nonce":4207785690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6833","nonce":4207785690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6831","nonce":4207785690}]},"public_addr":"10.20.193.28:6827/4207785690","cluster_addr":"10.20.193.28:6829/4207785690","heartbeat_back_addr":"10.20.193.28:6833/4207785690","heartbeat_front_addr":"10.20.193.28:6831/4207785690","state":["exists","up"]},{"osd":10,"uuid":"65c8e576-a1c7-4c03-bbf6-57c775f2860f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6824","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6825","nonce":2590408209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6826","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6827","nonce":2590408209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6830","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6831","nonce":2590408209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6828","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6829","nonce":2590408209}]},"public_addr":"10.20.193.74:6825/2590408209","cluster_addr":"10.20.193.74:6827/2590408209","heartbeat_back_addr":"10.20.193.74:6831/2590408209","heartbeat_front_addr":"10.20.193.74:6829/2590408209","state":["exists","up"]},{"osd":11,"uuid":"e2305377-fadb-4cf0-8384-87387f116255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":87,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6824","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6825","nonce":709820718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6826","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6827","nonce":709820718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6830","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6831","nonce":709820718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6828","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6829","nonce":709820718}]},"public_addr":"10.20.193.159:6825/709820718","cluster_addr":"10.20.193.159:6827/709820718","heartbeat_back_addr":"10.20.193.159:6831/709820718","heartbeat_front_addr":"10.20.193.159:6829/709820718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:02.414561+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:16.784172+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:30.639920+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:44.510387+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:58.186053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:11.714819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:25.188981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:38.602303+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:51.899864+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:16:05.444224+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:16:18.900719+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:16:32.290361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:0/3696280830":"2026-02-25T09:13:39.242729+0000","10.20.193.28:6801/3539300247":"2026-02-25T09:13:39.242729+0000","10.20.193.28:0/3799405177":"2026-02-25T09:12:46.171932+0000","10.20.193.28:0/1189576634":"2026-02-25T09:12:46.171932+0000","10.20.193.28:6800/1682009277":"2026-02-25T09:12:46.171932+0000","10.20.193.28:6800/3539300247":"2026-02-25T09:13:39.242729+0000","10.20.193.28:6801/1682009277":"2026-02-25T09:12:46.171932+0000","10.20.193.28:0/673213915":"2026-02-25T09:12:59.028609+0000","10.20.193.28:0/857248143":"2026-02-25T09:13:39.242729+0000","10.20.193.28:0/1541006046":"2026-02-25T09:12:46.171932+0000","10.20.193.28:0/264576041":"2026-02-25T09:12:59.028609+0000","10.20.193.28:6800/2303472235":"2026-02-25T09:12:59.028609+0000","10.20.193.28:6801/2303472235":"2026-02-25T09:12:59.028609+0000","10.20.193.28:0/2622827224":"2026-02-25T09:12:59.028609+0000","10.20.193.28:0/3614117448":"2026-02-25T09:13:39.242729+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T09:17:01.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.655+0000 7ff6207cc640 1 -- 10.20.193.28:0/4039457976 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff5f40b57a0 msgr2=0x7ff5f40d5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:01.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.655+0000 7ff6207cc640 1 --2- 10.20.193.28:0/4039457976 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff5f40b57a0 0x7ff5f40d5c50 secure :-1 s=READY pgs=138 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6180fc380 tx=0x7ff60c005f90 comp rx=0 tx=0).stop 2026-02-24T09:17:01.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.655+0000 7ff6207cc640 1 -- 10.20.193.28:0/4039457976 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff61810f6c0 msgr2=0x7ff6180f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:01.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.655+0000 7ff6207cc640 1 --2- 10.20.193.28:0/4039457976 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff61810f6c0 0x7ff6180f59e0 secure :-1 s=READY pgs=240 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff608009950 tx=0x7ff6080028d0 comp rx=0 tx=0).stop 2026-02-24T09:17:01.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.655+0000 7ff6207cc640 1 -- 10.20.193.28:0/4039457976 shutdown_connections 2026-02-24T09:17:01.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.655+0000 7ff6207cc640 1 --2- 10.20.193.28:0/4039457976 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff5f40b57a0 0x7ff5f40d5c50 unknown :-1 s=CLOSED pgs=138 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:01.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.655+0000 7ff6207cc640 1 --2- 10.20.193.28:0/4039457976 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff6181158b0 0x7ff6180f60e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:01.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.655+0000 7ff6207cc640 1 --2- 10.20.193.28:0/4039457976 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff6181100b0 0x7ff618176180 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:01.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.655+0000 7ff6207cc640 1 --2- 10.20.193.28:0/4039457976 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff61810f6c0 0x7ff6180f59e0 unknown :-1 s=CLOSED pgs=240 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:01.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.655+0000 7ff6207cc640 1 -- 10.20.193.28:0/4039457976 >> 10.20.193.28:0/4039457976 conn(0x7ff6180ecfd0 msgr2=0x7ff618111b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:01.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.655+0000 7ff6207cc640 1 -- 10.20.193.28:0/4039457976 shutdown_connections 2026-02-24T09:17:01.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:01.655+0000 7ff6207cc640 1 -- 10.20.193.28:0/4039457976 wait complete. 2026-02-24T09:17:01.756 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph fs set cephfs standby_count_wanted 0 2026-02-24T09:17:01.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:01 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/4217679457' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-24T09:17:01.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:01 trial159 ceph-mon[44242]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2026-02-24T09:17:01.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:01 trial159 ceph-mon[44242]: daemon mds.b is now active in filesystem cephfs as rank 0 2026-02-24T09:17:01.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:01 trial159 ceph-mon[44242]: mds.? [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] up:active 2026-02-24T09:17:01.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:01 trial159 ceph-mon[44242]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-24T09:17:01.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:01 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/1177722398' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:17:01.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:01 trial159 ceph-mon[44242]: osdmap e92: 12 total, 12 up, 12 in 2026-02-24T09:17:01.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:01 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/4217679457' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-24T09:17:01.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:01 trial074 ceph-mon[44412]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2026-02-24T09:17:01.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:01 trial074 ceph-mon[44412]: daemon mds.b is now active in filesystem cephfs as rank 0 2026-02-24T09:17:01.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:01 trial074 ceph-mon[44412]: mds.? [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] up:active 2026-02-24T09:17:01.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:01 trial074 ceph-mon[44412]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-24T09:17:01.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:01 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/1177722398' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:17:01.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:01 trial074 ceph-mon[44412]: osdmap e92: 12 total, 12 up, 12 in 2026-02-24T09:17:01.936 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:02.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.124+0000 7f602268f640 1 -- 10.20.193.28:0/2000499056 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f601c10f740 msgr2=0x7f601c10fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:02.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.124+0000 7f602268f640 1 --2- 10.20.193.28:0/2000499056 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f601c10f740 0x7f601c10fb10 secure :-1 s=READY pgs=241 gs=1 cs=0 l=1 c_cookie=15383874653421619266 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f600800aa30 tx=0x7f6008030270 comp rx=0 tx=0).stop 2026-02-24T09:17:02.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.124+0000 7f602268f640 1 -- 10.20.193.28:0/2000499056 shutdown_connections 2026-02-24T09:17:02.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.124+0000 7f602268f640 1 --2- 10.20.193.28:0/2000499056 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f601c115930 0x7f601c176300 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:02.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.124+0000 7f602268f640 1 --2- 10.20.193.28:0/2000499056 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f601c110130 0x7f601c115180 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:02.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.124+0000 7f602268f640 1 --2- 10.20.193.28:0/2000499056 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f601c10f740 0x7f601c10fb10 unknown :-1 s=CLOSED pgs=241 gs=1 cs=0 l=1 c_cookie=15383874653421619266 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:02.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.124+0000 7f602268f640 1 -- 10.20.193.28:0/2000499056 >> 10.20.193.28:0/2000499056 conn(0x7f601c0ed050 msgr2=0x7f601c10d460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:02.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.124+0000 7f602268f640 1 -- 10.20.193.28:0/2000499056 shutdown_connections 2026-02-24T09:17:02.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.124+0000 7f602268f640 1 -- 10.20.193.28:0/2000499056 wait complete. 2026-02-24T09:17:02.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.125+0000 7f602268f640 1 Processor -- start 2026-02-24T09:17:02.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.125+0000 7f602268f640 1 -- start start 2026-02-24T09:17:02.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.125+0000 7f602268f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f601c10f740 0x7f601c0f5b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:02.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.125+0000 7f602268f640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f601c110130 0x7f601c176200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:02.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.125+0000 7f602268f640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f601c115930 0x7f601c0f6210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:02.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.125+0000 7f602268f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f601c0fb420 con 0x7f601c10f740 2026-02-24T09:17:02.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.125+0000 7f602268f640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f601c0fb590 con 0x7f601c110130 2026-02-24T09:17:02.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.125+0000 7f602268f640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f601c0fb750 con 0x7f601c115930 2026-02-24T09:17:02.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.126+0000 7f601bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f601c10f740 0x7f601c0f5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:02.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.126+0000 7f601bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f601c10f740 0x7f601c0f5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39962/0 (socket says 10.20.193.28:39962) 2026-02-24T09:17:02.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.126+0000 7f601bfff640 1 -- 10.20.193.28:0/2584897289 learned_addr learned my addr 10.20.193.28:0/2584897289 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:02.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.126+0000 7f6020c05640 1 --2- 10.20.193.28:0/2584897289 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f601c115930 0x7f601c0f6210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:02.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.126+0000 7f601b7fe640 1 --2- 10.20.193.28:0/2584897289 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f601c110130 0x7f601c176200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:02.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.126+0000 7f601bfff640 1 -- 10.20.193.28:0/2584897289 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f601c115930 msgr2=0x7f601c0f6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:02.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.126+0000 7f601bfff640 1 --2- 10.20.193.28:0/2584897289 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f601c115930 0x7f601c0f6210 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:02.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.126+0000 7f601bfff640 1 -- 10.20.193.28:0/2584897289 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f601c110130 msgr2=0x7f601c176200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:02.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.126+0000 7f601bfff640 1 --2- 10.20.193.28:0/2584897289 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f601c110130 0x7f601c176200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:02.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.126+0000 7f601bfff640 1 -- 10.20.193.28:0/2584897289 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f600800a650 con 0x7f601c10f740 2026-02-24T09:17:02.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.126+0000 7f601bfff640 1 --2- 10.20.193.28:0/2584897289 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f601c10f740 0x7f601c0f5b10 secure :-1 s=READY pgs=242 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f600800a360 tx=0x7f6008030ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:02.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.126+0000 7f60197fa640 1 -- 10.20.193.28:0/2584897289 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f600803e070 con 0x7f601c10f740 2026-02-24T09:17:02.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.126+0000 7f60197fa640 1 -- 10.20.193.28:0/2584897289 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6008039de0 con 0x7f601c10f740 2026-02-24T09:17:02.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.126+0000 7f602268f640 1 -- 10.20.193.28:0/2584897289 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f601c0fb9d0 con 0x7f601c10f740 2026-02-24T09:17:02.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.126+0000 7f60197fa640 1 -- 10.20.193.28:0/2584897289 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6008042820 con 0x7f601c10f740 2026-02-24T09:17:02.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.126+0000 7f602268f640 1 -- 10.20.193.28:0/2584897289 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f601c0fbe90 con 0x7f601c10f740 2026-02-24T09:17:02.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.127+0000 7f602268f640 1 -- 10.20.193.28:0/2584897289 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f601c110a20 con 0x7f601c10f740 2026-02-24T09:17:02.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.129+0000 7f60197fa640 1 -- 10.20.193.28:0/2584897289 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 19) ==== 157139+0+0 (secure 0 0 0) 0x7f6008005350 con 0x7f601c10f740 2026-02-24T09:17:02.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.131+0000 7f60197fa640 1 --2- 10.20.193.28:0/2584897289 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5ff00b57a0 0x7f5ff00d5c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:02.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.131+0000 7f60197fa640 1 -- 10.20.193.28:0/2584897289 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f600810c5f0 con 0x7f601c10f740 2026-02-24T09:17:02.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.131+0000 7f601b7fe640 1 --2- 10.20.193.28:0/2584897289 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5ff00b57a0 0x7f5ff00d5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:02.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.131+0000 7f60197fa640 1 -- 10.20.193.28:0/2584897289 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f600810ca70 con 0x7f601c10f740 2026-02-24T09:17:02.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.132+0000 7f601b7fe640 1 --2- 10.20.193.28:0/2584897289 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5ff00b57a0 0x7f5ff00d5c50 secure :-1 s=READY pgs=139 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f601c0fc4b0 tx=0x7f600c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:02.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:02.271+0000 7f602268f640 1 -- 10.20.193.28:0/2584897289 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f601c0f6c70 con 0x7f601c10f740 2026-02-24T09:17:02.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:02 trial028 ceph-mon[40371]: pgmap v181: 97 pgs: 16 creating+peering, 51 unknown, 30 active+clean; 578 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 767 B/s wr, 1 op/s 2026-02-24T09:17:02.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:02 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/4039457976' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:17:02.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:02 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/2584897289' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-24T09:17:02.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:02 trial159 ceph-mon[44242]: pgmap v181: 97 pgs: 16 creating+peering, 51 unknown, 30 active+clean; 578 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 767 B/s wr, 1 op/s 2026-02-24T09:17:02.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:02 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/4039457976' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:17:02.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:02 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/2584897289' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-24T09:17:02.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:02 trial074 ceph-mon[44412]: pgmap v181: 97 pgs: 16 creating+peering, 51 unknown, 30 active+clean; 578 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 767 B/s wr, 1 op/s 2026-02-24T09:17:02.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:02 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/4039457976' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:17:02.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:02 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/2584897289' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-24T09:17:03.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.231+0000 7f60197fa640 1 -- 10.20.193.28:0/2584897289 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f60080cf090 con 0x7f601c10f740 2026-02-24T09:17:03.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.235+0000 7f602268f640 1 -- 10.20.193.28:0/2584897289 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5ff00b57a0 msgr2=0x7f5ff00d5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:03.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.235+0000 7f602268f640 1 --2- 10.20.193.28:0/2584897289 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5ff00b57a0 0x7f5ff00d5c50 secure :-1 s=READY pgs=139 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f601c0fc4b0 tx=0x7f600c005f90 comp rx=0 tx=0).stop 2026-02-24T09:17:03.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.235+0000 7f602268f640 1 -- 10.20.193.28:0/2584897289 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f601c10f740 msgr2=0x7f601c0f5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:03.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.235+0000 7f602268f640 1 --2- 10.20.193.28:0/2584897289 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f601c10f740 0x7f601c0f5b10 secure :-1 s=READY pgs=242 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f600800a360 tx=0x7f6008030ce0 comp rx=0 tx=0).stop 2026-02-24T09:17:03.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.235+0000 7f602268f640 1 -- 10.20.193.28:0/2584897289 shutdown_connections 2026-02-24T09:17:03.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.235+0000 7f602268f640 1 --2- 10.20.193.28:0/2584897289 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5ff00b57a0 0x7f5ff00d5c50 unknown :-1 s=CLOSED pgs=139 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:03.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.235+0000 7f602268f640 1 --2- 10.20.193.28:0/2584897289 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f601c115930 0x7f601c0f6210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:03.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.235+0000 7f602268f640 1 --2- 10.20.193.28:0/2584897289 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f601c110130 0x7f601c176200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:03.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.235+0000 7f602268f640 1 --2- 10.20.193.28:0/2584897289 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f601c10f740 0x7f601c0f5b10 unknown :-1 s=CLOSED pgs=242 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:03.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.235+0000 7f602268f640 1 -- 10.20.193.28:0/2584897289 >> 10.20.193.28:0/2584897289 conn(0x7f601c0ed050 msgr2=0x7f601c111c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:03.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.235+0000 7f602268f640 1 -- 10.20.193.28:0/2584897289 shutdown_connections 2026-02-24T09:17:03.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.235+0000 7f602268f640 1 -- 10.20.193.28:0/2584897289 wait complete. 2026-02-24T09:17:03.337 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['disabled'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2026-02-24T09:17:03.337 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph fs set cephfs max_mds 3 --yes-i-really-mean-it 2026-02-24T09:17:03.519 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:03.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.697+0000 7f50e8849640 1 -- 10.20.193.28:0/238651711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f50e410f250 msgr2=0x7f50e410f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:03.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.697+0000 7f50e8849640 1 --2- 10.20.193.28:0/238651711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f50e410f250 0x7f50e410f620 secure :-1 s=READY pgs=243 gs=1 cs=0 l=1 c_cookie=11563721962750994880 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50d8009950 tx=0x7f50d802f190 comp rx=0 tx=0).stop 2026-02-24T09:17:03.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.697+0000 7f50e8849640 1 -- 10.20.193.28:0/238651711 shutdown_connections 2026-02-24T09:17:03.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.697+0000 7f50e8849640 1 --2- 10.20.193.28:0/238651711 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f50e4115440 0x7f50e4175e10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:03.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.697+0000 7f50e8849640 1 --2- 10.20.193.28:0/238651711 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f50e410fc40 0x7f50e4114c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:03.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.697+0000 7f50e8849640 1 --2- 10.20.193.28:0/238651711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f50e410f250 0x7f50e410f620 unknown :-1 s=CLOSED pgs=243 gs=1 cs=0 l=1 c_cookie=11563721962750994880 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:03.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.697+0000 7f50e8849640 1 -- 10.20.193.28:0/238651711 >> 10.20.193.28:0/238651711 conn(0x7f50e40ecb40 msgr2=0x7f50e410cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:03.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.698+0000 7f50e8849640 1 -- 10.20.193.28:0/238651711 shutdown_connections 2026-02-24T09:17:03.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.698+0000 7f50e8849640 1 -- 10.20.193.28:0/238651711 wait complete. 2026-02-24T09:17:03.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.699+0000 7f50e8849640 1 Processor -- start 2026-02-24T09:17:03.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.699+0000 7f50e8849640 1 -- start start 2026-02-24T09:17:03.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.699+0000 7f50e8849640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f50e410f250 0x7f50e40f55d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:03.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.699+0000 7f50e8849640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f50e410fc40 0x7f50e4175d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:03.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.699+0000 7f50e8849640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f50e4115440 0x7f50e40f5cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:03.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.699+0000 7f50e8849640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f50e40faee0 con 0x7f50e4115440 2026-02-24T09:17:03.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.699+0000 7f50e8849640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f50e40fb050 con 0x7f50e410f250 2026-02-24T09:17:03.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.699+0000 7f50e8849640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f50e40fb210 con 0x7f50e410fc40 2026-02-24T09:17:03.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.699+0000 7f50e3577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f50e4115440 0x7f50e40f5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:03.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.699+0000 7f50e3577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f50e4115440 0x7f50e40f5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39990/0 (socket says 10.20.193.28:39990) 2026-02-24T09:17:03.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.699+0000 7f50e3577640 1 -- 10.20.193.28:0/2538546988 learned_addr learned my addr 10.20.193.28:0/2538546988 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:03.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.699+0000 7f50e2d76640 1 --2- 10.20.193.28:0/2538546988 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f50e410f250 0x7f50e40f55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:03.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.699+0000 7f50e2575640 1 --2- 10.20.193.28:0/2538546988 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f50e410fc40 0x7f50e4175d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:03.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.700+0000 7f50e3577640 1 -- 10.20.193.28:0/2538546988 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f50e410fc40 msgr2=0x7f50e4175d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:03.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.700+0000 7f50e3577640 1 --2- 10.20.193.28:0/2538546988 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f50e410fc40 0x7f50e4175d10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:03.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.700+0000 7f50e3577640 1 -- 10.20.193.28:0/2538546988 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f50e410f250 msgr2=0x7f50e40f55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:03.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.700+0000 7f50e3577640 1 --2- 10.20.193.28:0/2538546988 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f50e410f250 0x7f50e40f55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:03.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.700+0000 7f50e3577640 1 -- 10.20.193.28:0/2538546988 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d8009570 con 0x7f50e4115440 2026-02-24T09:17:03.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.700+0000 7f50e3577640 1 --2- 10.20.193.28:0/2538546988 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f50e4115440 0x7f50e40f5cd0 secure :-1 s=READY pgs=244 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50d4006e90 tx=0x7f50d400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:03.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.700+0000 7f50c3fff640 1 -- 10.20.193.28:0/2538546988 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f50d400cb80 con 0x7f50e4115440 2026-02-24T09:17:03.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.700+0000 7f50c3fff640 1 -- 10.20.193.28:0/2538546988 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f50d4005df0 con 0x7f50e4115440 2026-02-24T09:17:03.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.700+0000 7f50e8849640 1 -- 10.20.193.28:0/2538546988 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50e40fb4f0 con 0x7f50e4115440 2026-02-24T09:17:03.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.700+0000 7f50c3fff640 1 -- 10.20.193.28:0/2538546988 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f50d4003a00 con 0x7f50e4115440 2026-02-24T09:17:03.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.700+0000 7f50e8849640 1 -- 10.20.193.28:0/2538546988 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50e40fba10 con 0x7f50e4115440 2026-02-24T09:17:03.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.701+0000 7f50e8849640 1 -- 10.20.193.28:0/2538546988 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50e4110530 con 0x7f50e4115440 2026-02-24T09:17:03.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.703+0000 7f50c3fff640 1 -- 10.20.193.28:0/2538546988 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 19) ==== 157139+0+0 (secure 0 0 0) 0x7f50d4003b90 con 0x7f50e4115440 2026-02-24T09:17:03.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.704+0000 7f50c3fff640 1 --2- 10.20.193.28:0/2538546988 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f50b80b57a0 0x7f50b80d5c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:03.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.704+0000 7f50c3fff640 1 -- 10.20.193.28:0/2538546988 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f50d40e77b0 con 0x7f50e4115440 2026-02-24T09:17:03.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.705+0000 7f50e2d76640 1 --2- 10.20.193.28:0/2538546988 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f50b80b57a0 0x7f50b80d5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:03.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.705+0000 7f50e2d76640 1 --2- 10.20.193.28:0/2538546988 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f50b80b57a0 0x7f50b80d5c50 secure :-1 s=READY pgs=140 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50d80098a0 tx=0x7f50d803a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:03.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.705+0000 7f50c3fff640 1 -- 10.20.193.28:0/2538546988 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f50d40aa250 con 0x7f50e4115440 2026-02-24T09:17:03.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:03.847+0000 7f50e8849640 1 -- 10.20.193.28:0/2538546988 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true} v 0) -- 0x7f50e40f6730 con 0x7f50e4115440 2026-02-24T09:17:04.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.237+0000 7f50c3fff640 1 -- 10.20.193.28:0/2538546988 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true}]=0 v17) ==== 135+0+0 (secure 0 0 0) 0x7f50d40ad400 con 0x7f50e4115440 2026-02-24T09:17:04.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.238+0000 7f50e8849640 1 -- 10.20.193.28:0/2538546988 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f50b80b57a0 msgr2=0x7f50b80d5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:04.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.238+0000 7f50e8849640 1 --2- 10.20.193.28:0/2538546988 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f50b80b57a0 0x7f50b80d5c50 secure :-1 s=READY pgs=140 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50d80098a0 tx=0x7f50d803a040 comp rx=0 tx=0).stop 2026-02-24T09:17:04.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.238+0000 7f50e8849640 1 -- 10.20.193.28:0/2538546988 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f50e4115440 msgr2=0x7f50e40f5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:04.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.238+0000 7f50e8849640 1 --2- 10.20.193.28:0/2538546988 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f50e4115440 0x7f50e40f5cd0 secure :-1 s=READY pgs=244 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50d4006e90 tx=0x7f50d400eeb0 comp rx=0 tx=0).stop 2026-02-24T09:17:04.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.239+0000 7f50e8849640 1 -- 10.20.193.28:0/2538546988 shutdown_connections 2026-02-24T09:17:04.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.239+0000 7f50e8849640 1 --2- 10.20.193.28:0/2538546988 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f50b80b57a0 0x7f50b80d5c50 unknown :-1 s=CLOSED pgs=140 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:04.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.239+0000 7f50e8849640 1 --2- 10.20.193.28:0/2538546988 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f50e4115440 0x7f50e40f5cd0 unknown :-1 s=CLOSED pgs=244 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:04.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.239+0000 7f50e8849640 1 --2- 10.20.193.28:0/2538546988 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f50e410fc40 0x7f50e4175d10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:04.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.239+0000 7f50e8849640 1 --2- 10.20.193.28:0/2538546988 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f50e410f250 0x7f50e40f55d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:04.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.239+0000 7f50e8849640 1 -- 10.20.193.28:0/2538546988 >> 10.20.193.28:0/2538546988 conn(0x7f50e40ecb40 msgr2=0x7f50e41116f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:04.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.239+0000 7f50e8849640 1 -- 10.20.193.28:0/2538546988 shutdown_connections 2026-02-24T09:17:04.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.239+0000 7f50e8849640 1 -- 10.20.193.28:0/2538546988 wait complete. 2026-02-24T09:17:04.341 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph fs set cephfs allow_standby_replay true 2026-02-24T09:17:04.523 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:04.529 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:04 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/2584897289' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-24T09:17:04.529 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:04 trial159 ceph-mon[44242]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-24T09:17:04.529 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:04 trial159 ceph-mon[44242]: pgmap v182: 97 pgs: 16 creating+peering, 10 unknown, 71 active+clean; 579 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s wr, 4 op/s 2026-02-24T09:17:04.529 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:04 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/2538546988' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true} : dispatch 2026-02-24T09:17:04.564 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:04 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/2584897289' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-24T09:17:04.564 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:04 trial028 ceph-mon[40371]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-24T09:17:04.564 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:04 trial028 ceph-mon[40371]: pgmap v182: 97 pgs: 16 creating+peering, 10 unknown, 71 active+clean; 579 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s wr, 4 op/s 2026-02-24T09:17:04.564 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:04 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/2538546988' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true} : dispatch 2026-02-24T09:17:04.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:04 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/2584897289' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-24T09:17:04.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:04 trial074 ceph-mon[44412]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-24T09:17:04.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:04 trial074 ceph-mon[44412]: pgmap v182: 97 pgs: 16 creating+peering, 10 unknown, 71 active+clean; 579 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s wr, 4 op/s 2026-02-24T09:17:04.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:04 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/2538546988' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true} : dispatch 2026-02-24T09:17:04.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.701+0000 7ff9d593f640 1 -- 10.20.193.28:0/3736832010 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff9d0110130 msgr2=0x7ff9d0115180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:04.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.701+0000 7ff9d593f640 1 --2- 10.20.193.28:0/3736832010 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff9d0110130 0x7ff9d0115180 secure :-1 s=READY pgs=245 gs=3 cs=0 l=1 c_cookie=7421360567557980906 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9b8009950 tx=0x7ff9b802f190 comp rx=0 tx=0).stop 2026-02-24T09:17:04.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.701+0000 7ff9d593f640 1 -- 10.20.193.28:0/3736832010 shutdown_connections 2026-02-24T09:17:04.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.701+0000 7ff9d593f640 1 --2- 10.20.193.28:0/3736832010 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff9d0115930 0x7ff9d0176300 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:04.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.701+0000 7ff9d593f640 1 --2- 10.20.193.28:0/3736832010 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff9d0110130 0x7ff9d0115180 unknown :-1 s=CLOSED pgs=245 gs=3 cs=0 l=1 c_cookie=7421360567557980906 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:04.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.701+0000 7ff9d593f640 1 --2- 10.20.193.28:0/3736832010 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff9d010f740 0x7ff9d010fb10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:04.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.701+0000 7ff9d593f640 1 -- 10.20.193.28:0/3736832010 >> 10.20.193.28:0/3736832010 conn(0x7ff9d00ed050 msgr2=0x7ff9d010d460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:04.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.701+0000 7ff9d593f640 1 -- 10.20.193.28:0/3736832010 shutdown_connections 2026-02-24T09:17:04.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.701+0000 7ff9d593f640 1 -- 10.20.193.28:0/3736832010 wait complete. 2026-02-24T09:17:04.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.701+0000 7ff9d593f640 1 Processor -- start 2026-02-24T09:17:04.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.701+0000 7ff9d593f640 1 -- start start 2026-02-24T09:17:04.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.702+0000 7ff9d593f640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff9d010f740 0x7ff9d00f5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:04.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.702+0000 7ff9d593f640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff9d0110130 0x7ff9d0176200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:04.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.702+0000 7ff9d593f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff9d0115930 0x7ff9d00f61b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:04.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.702+0000 7ff9d593f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d00fb3c0 con 0x7ff9d0115930 2026-02-24T09:17:04.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.702+0000 7ff9d593f640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d00fb530 con 0x7ff9d0110130 2026-02-24T09:17:04.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.702+0000 7ff9d593f640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d00fb6f0 con 0x7ff9d010f740 2026-02-24T09:17:04.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.702+0000 7ff9ceffd640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff9d010f740 0x7ff9d00f5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:04.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.702+0000 7ff9ce7fc640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff9d0110130 0x7ff9d0176200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:04.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.702+0000 7ff9ceffd640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff9d010f740 0x7ff9d00f5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:48472/0 (socket says 10.20.193.28:48472) 2026-02-24T09:17:04.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.702+0000 7ff9ceffd640 1 -- 10.20.193.28:0/3994150041 learned_addr learned my addr 10.20.193.28:0/3994150041 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:04.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.702+0000 7ff9cf7fe640 1 --2- 10.20.193.28:0/3994150041 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff9d0115930 0x7ff9d00f61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:04.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.702+0000 7ff9ceffd640 1 -- 10.20.193.28:0/3994150041 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff9d0110130 msgr2=0x7ff9d0176200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:04.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.702+0000 7ff9ceffd640 1 --2- 10.20.193.28:0/3994150041 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff9d0110130 0x7ff9d0176200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:04.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.702+0000 7ff9ceffd640 1 -- 10.20.193.28:0/3994150041 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff9d0115930 msgr2=0x7ff9d00f61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:04.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.702+0000 7ff9ceffd640 1 --2- 10.20.193.28:0/3994150041 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff9d0115930 0x7ff9d00f61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:04.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.702+0000 7ff9ceffd640 1 -- 10.20.193.28:0/3994150041 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b8009570 con 0x7ff9d010f740 2026-02-24T09:17:04.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.702+0000 7ff9ce7fc640 1 --2- 10.20.193.28:0/3994150041 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff9d0110130 0x7ff9d0176200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:17:04.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.703+0000 7ff9ceffd640 1 --2- 10.20.193.28:0/3994150041 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff9d010f740 0x7ff9d00f5ab0 secure :-1 s=READY pgs=81 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9c4009480 tx=0x7ff9c400ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:04.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.703+0000 7ff9d493d640 1 -- 10.20.193.28:0/3994150041 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff9c400cd40 con 0x7ff9d010f740 2026-02-24T09:17:04.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.703+0000 7ff9d493d640 1 -- 10.20.193.28:0/3994150041 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff9c4004d10 con 0x7ff9d010f740 2026-02-24T09:17:04.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.703+0000 7ff9d593f640 1 -- 10.20.193.28:0/3994150041 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9d00fb9d0 con 0x7ff9d010f740 2026-02-24T09:17:04.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.703+0000 7ff9d493d640 1 -- 10.20.193.28:0/3994150041 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff9c40106b0 con 0x7ff9d010f740 2026-02-24T09:17:04.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.703+0000 7ff9d593f640 1 -- 10.20.193.28:0/3994150041 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9d00fbea0 con 0x7ff9d010f740 2026-02-24T09:17:04.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.703+0000 7ff9d593f640 1 -- 10.20.193.28:0/3994150041 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9d0110a20 con 0x7ff9d010f740 2026-02-24T09:17:04.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.707+0000 7ff9d493d640 1 -- 10.20.193.28:0/3994150041 <== mon.1 v2:10.20.193.159:3300/0 4 ==== mgrmap(e 19) ==== 157139+0+0 (secure 0 0 0) 0x7ff9c4004770 con 0x7ff9d010f740 2026-02-24T09:17:04.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.708+0000 7ff9d493d640 1 --2- 10.20.193.28:0/3994150041 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff9a40b5720 0x7ff9a40d5bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:04.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.709+0000 7ff9d493d640 1 -- 10.20.193.28:0/3994150041 <== mon.1 v2:10.20.193.159:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7ff9c4014070 con 0x7ff9d010f740 2026-02-24T09:17:04.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.709+0000 7ff9ce7fc640 1 --2- 10.20.193.28:0/3994150041 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff9a40b5720 0x7ff9a40d5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:04.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.709+0000 7ff9d493d640 1 -- 10.20.193.28:0/3994150041 <== mon.1 v2:10.20.193.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7ff9c40e7570 con 0x7ff9d010f740 2026-02-24T09:17:04.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.709+0000 7ff9ce7fc640 1 --2- 10.20.193.28:0/3994150041 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff9a40b5720 0x7ff9a40d5bd0 secure :-1 s=READY pgs=141 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9d00fc450 tx=0x7ff9b803a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:04.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:04.853+0000 7ff9d593f640 1 -- 10.20.193.28:0/3994150041 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7ff9d00f6c10 con 0x7ff9d010f740 2026-02-24T09:17:05.240 INFO:journalctl@ceph.mds.b.trial074.stdout:Feb 24 09:17:04 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-b[97806]: 2026-02-24T09:17:04.905+0000 7f3cad24b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2026-02-24T09:17:05.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.245+0000 7ff9d493d640 1 -- 10.20.193.28:0/3994150041 <== mon.1 v2:10.20.193.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7ff9c40a9c70 con 0x7ff9d010f740 2026-02-24T09:17:05.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.248+0000 7ff9d593f640 1 -- 10.20.193.28:0/3994150041 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff9a40b5720 msgr2=0x7ff9a40d5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:05.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.248+0000 7ff9d593f640 1 --2- 10.20.193.28:0/3994150041 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff9a40b5720 0x7ff9a40d5bd0 secure :-1 s=READY pgs=141 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9d00fc450 tx=0x7ff9b803a040 comp rx=0 tx=0).stop 2026-02-24T09:17:05.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.248+0000 7ff9d593f640 1 -- 10.20.193.28:0/3994150041 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff9d010f740 msgr2=0x7ff9d00f5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:05.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.248+0000 7ff9d593f640 1 --2- 10.20.193.28:0/3994150041 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff9d010f740 0x7ff9d00f5ab0 secure :-1 s=READY pgs=81 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9c4009480 tx=0x7ff9c400ee60 comp rx=0 tx=0).stop 2026-02-24T09:17:05.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.248+0000 7ff9d593f640 1 -- 10.20.193.28:0/3994150041 shutdown_connections 2026-02-24T09:17:05.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.248+0000 7ff9d593f640 1 --2- 10.20.193.28:0/3994150041 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff9a40b5720 0x7ff9a40d5bd0 unknown :-1 s=CLOSED pgs=141 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.248+0000 7ff9d593f640 1 --2- 10.20.193.28:0/3994150041 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff9d0115930 0x7ff9d00f61b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.248+0000 7ff9d593f640 1 --2- 10.20.193.28:0/3994150041 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff9d0110130 0x7ff9d0176200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.248+0000 7ff9d593f640 1 --2- 10.20.193.28:0/3994150041 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff9d010f740 0x7ff9d00f5ab0 unknown :-1 s=CLOSED pgs=81 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.248+0000 7ff9d593f640 1 -- 10.20.193.28:0/3994150041 >> 10.20.193.28:0/3994150041 conn(0x7ff9d00ed050 msgr2=0x7ff9d0111f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:05.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.248+0000 7ff9d593f640 1 -- 10.20.193.28:0/3994150041 shutdown_connections 2026-02-24T09:17:05.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.248+0000 7ff9d593f640 1 -- 10.20.193.28:0/3994150041 wait complete. 2026-02-24T09:17:05.350 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph fs set cephfs session_timeout 300 2026-02-24T09:17:05.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:05 trial159 ceph-mon[44242]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-24T09:17:05.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:05 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/2538546988' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true}]': finished 2026-02-24T09:17:05.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:05 trial159 ceph-mon[44242]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-24T09:17:05.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:05 trial159 ceph-mon[44242]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-24T09:17:05.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:05 trial159 ceph-mon[44242]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2026-02-24T09:17:05.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:05 trial159 ceph-mon[44242]: daemon mds.h is now active in filesystem cephfs as rank 1 2026-02-24T09:17:05.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:05 trial159 ceph-mon[44242]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-24T09:17:05.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:05 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/3994150041' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-24T09:17:05.532 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:05.574 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:05 trial028 ceph-mon[40371]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-24T09:17:05.575 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:05 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/2538546988' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true}]': finished 2026-02-24T09:17:05.575 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:05 trial028 ceph-mon[40371]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-24T09:17:05.575 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:05 trial028 ceph-mon[40371]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-24T09:17:05.575 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:05 trial028 ceph-mon[40371]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2026-02-24T09:17:05.575 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:05 trial028 ceph-mon[40371]: daemon mds.h is now active in filesystem cephfs as rank 1 2026-02-24T09:17:05.575 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:05 trial028 ceph-mon[40371]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-24T09:17:05.575 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:05 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/3994150041' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-24T09:17:05.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:05 trial074 ceph-mon[44412]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-24T09:17:05.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:05 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/2538546988' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true}]': finished 2026-02-24T09:17:05.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:05 trial074 ceph-mon[44412]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-24T09:17:05.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:05 trial074 ceph-mon[44412]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-24T09:17:05.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:05 trial074 ceph-mon[44412]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2026-02-24T09:17:05.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:05 trial074 ceph-mon[44412]: daemon mds.h is now active in filesystem cephfs as rank 1 2026-02-24T09:17:05.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:05 trial074 ceph-mon[44412]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-24T09:17:05.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:05 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/3994150041' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-24T09:17:05.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.710+0000 7fafdac7b640 1 -- 10.20.193.28:0/1806435304 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafd41136e0 msgr2=0x7fafd41740b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:05.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.710+0000 7fafdac7b640 1 --2- 10.20.193.28:0/1806435304 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafd41136e0 0x7fafd41740b0 secure :-1 s=READY pgs=246 gs=1 cs=0 l=1 c_cookie=2174889218640687127 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fafd000aa30 tx=0x7fafd0030280 comp rx=0 tx=0).stop 2026-02-24T09:17:05.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.710+0000 7fafdac7b640 1 -- 10.20.193.28:0/1806435304 shutdown_connections 2026-02-24T09:17:05.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.710+0000 7fafdac7b640 1 --2- 10.20.193.28:0/1806435304 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafd41136e0 0x7fafd41740b0 unknown :-1 s=CLOSED pgs=246 gs=1 cs=0 l=1 c_cookie=2174889218640687127 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.710+0000 7fafdac7b640 1 --2- 10.20.193.28:0/1806435304 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fafd410dee0 0x7fafd4112f30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.710+0000 7fafdac7b640 1 --2- 10.20.193.28:0/1806435304 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fafd410d4f0 0x7fafd410d8c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.710+0000 7fafdac7b640 1 -- 10.20.193.28:0/1806435304 >> 10.20.193.28:0/1806435304 conn(0x7fafd40eade0 msgr2=0x7fafd410b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:05.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.710+0000 7fafdac7b640 1 -- 10.20.193.28:0/1806435304 shutdown_connections 2026-02-24T09:17:05.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.710+0000 7fafdac7b640 1 -- 10.20.193.28:0/1806435304 wait complete. 2026-02-24T09:17:05.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.711+0000 7fafdac7b640 1 Processor -- start 2026-02-24T09:17:05.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.711+0000 7fafdac7b640 1 -- start start 2026-02-24T09:17:05.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.711+0000 7fafdac7b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafd410d4f0 0x7fafd40f5a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:05.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.711+0000 7fafdac7b640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fafd410dee0 0x7fafd4173fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:05.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.711+0000 7fafdac7b640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fafd41136e0 0x7fafd40f6170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:05.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.712+0000 7fafdac7b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fafd40fb380 con 0x7fafd410d4f0 2026-02-24T09:17:05.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.712+0000 7fafdac7b640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fafd40fb4f0 con 0x7fafd41136e0 2026-02-24T09:17:05.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.712+0000 7fafdac7b640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fafd40fb6b0 con 0x7fafd410dee0 2026-02-24T09:17:05.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.712+0000 7fafd89f0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafd410d4f0 0x7fafd40f5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:05.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.712+0000 7fafd89f0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafd410d4f0 0x7fafd40f5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40024/0 (socket says 10.20.193.28:40024) 2026-02-24T09:17:05.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.712+0000 7fafd89f0640 1 -- 10.20.193.28:0/2465783046 learned_addr learned my addr 10.20.193.28:0/2465783046 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:05.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.712+0000 7fafcbfff640 1 --2- 10.20.193.28:0/2465783046 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fafd410dee0 0x7fafd4173fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:05.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.712+0000 7fafd91f1640 1 --2- 10.20.193.28:0/2465783046 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fafd41136e0 0x7fafd40f6170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:05.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.712+0000 7fafd89f0640 1 -- 10.20.193.28:0/2465783046 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fafd410dee0 msgr2=0x7fafd4173fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:05.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.712+0000 7fafd89f0640 1 --2- 10.20.193.28:0/2465783046 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fafd410dee0 0x7fafd4173fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.712+0000 7fafd89f0640 1 -- 10.20.193.28:0/2465783046 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fafd41136e0 msgr2=0x7fafd40f6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:05.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.712+0000 7fafd89f0640 1 --2- 10.20.193.28:0/2465783046 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fafd41136e0 0x7fafd40f6170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.712+0000 7fafd89f0640 1 -- 10.20.193.28:0/2465783046 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd000a650 con 0x7fafd410d4f0 2026-02-24T09:17:05.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.712+0000 7fafd89f0640 1 --2- 10.20.193.28:0/2465783046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafd410d4f0 0x7fafd40f5a70 secure :-1 s=READY pgs=247 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fafc40072a0 tx=0x7fafc400ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:05.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.712+0000 7fafc9ffb640 1 -- 10.20.193.28:0/2465783046 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fafc4004500 con 0x7fafd410d4f0 2026-02-24T09:17:05.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.712+0000 7fafc9ffb640 1 -- 10.20.193.28:0/2465783046 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fafc400bd00 con 0x7fafd410d4f0 2026-02-24T09:17:05.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.712+0000 7fafc9ffb640 1 -- 10.20.193.28:0/2465783046 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fafc40106e0 con 0x7fafd410d4f0 2026-02-24T09:17:05.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.712+0000 7fafdac7b640 1 -- 10.20.193.28:0/2465783046 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd40fb990 con 0x7fafd410d4f0 2026-02-24T09:17:05.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.712+0000 7fafdac7b640 1 -- 10.20.193.28:0/2465783046 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd40fbe10 con 0x7fafd410d4f0 2026-02-24T09:17:05.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.713+0000 7fafdac7b640 1 -- 10.20.193.28:0/2465783046 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafd410e7d0 con 0x7fafd410d4f0 2026-02-24T09:17:05.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.715+0000 7fafc9ffb640 1 -- 10.20.193.28:0/2465783046 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 19) ==== 157139+0+0 (secure 0 0 0) 0x7fafc400b840 con 0x7fafd410d4f0 2026-02-24T09:17:05.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.717+0000 7fafc9ffb640 1 --2- 10.20.193.28:0/2465783046 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fafb00b5820 0x7fafb00d5cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:05.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.717+0000 7fafc9ffb640 1 -- 10.20.193.28:0/2465783046 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7fafc40e6ba0 con 0x7fafd410d4f0 2026-02-24T09:17:05.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.717+0000 7fafcbfff640 1 --2- 10.20.193.28:0/2465783046 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fafb00b5820 0x7fafb00d5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:05.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.717+0000 7fafc9ffb640 1 -- 10.20.193.28:0/2465783046 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fafc411f930 con 0x7fafd410d4f0 2026-02-24T09:17:05.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.717+0000 7fafcbfff640 1 --2- 10.20.193.28:0/2465783046 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fafb00b5820 0x7fafb00d5cd0 secure :-1 s=READY pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fafd40fc410 tx=0x7fafbc005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:05.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:05.857+0000 7fafdac7b640 1 -- 10.20.193.28:0/2465783046 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fafd410d8c0 con 0x7fafd410d4f0 2026-02-24T09:17:06.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:06 trial159 ceph-mon[44242]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-24T09:17:06.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:06 trial159 ceph-mon[44242]: mds.? [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] up:active 2026-02-24T09:17:06.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:06 trial159 ceph-mon[44242]: daemon mds.a assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-24T09:17:06.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:06 trial159 ceph-mon[44242]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-24T09:17:06.530 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:06 trial159 ceph-mon[44242]: Cluster is now healthy 2026-02-24T09:17:06.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:06 trial159 ceph-mon[44242]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2026-02-24T09:17:06.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:06 trial159 ceph-mon[44242]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=a=up:creating} 9 up:standby 2026-02-24T09:17:06.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:06 trial159 ceph-mon[44242]: daemon mds.a is now active in filesystem cephfs as rank 2 2026-02-24T09:17:06.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:06 trial159 ceph-mon[44242]: pgmap v183: 97 pgs: 97 active+clean; 579 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s wr, 8 op/s 2026-02-24T09:17:06.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:06 trial159 ceph-mon[44242]: mds.? [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] up:active 2026-02-24T09:17:06.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:06 trial159 ceph-mon[44242]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=a=up:active} 3 up:standby-replay 6 up:standby 2026-02-24T09:17:06.531 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:06 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/2465783046' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-24T09:17:06.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:06.566+0000 7fafc9ffb640 1 -- 10.20.193.28:0/2465783046 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v22) ==== 115+0+0 (secure 0 0 0) 0x7fafc40a9590 con 0x7fafd410d4f0 2026-02-24T09:17:06.569 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:06 trial028 ceph-mon[40371]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-24T09:17:06.569 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:06 trial028 ceph-mon[40371]: mds.? [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] up:active 2026-02-24T09:17:06.569 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:06 trial028 ceph-mon[40371]: daemon mds.a assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-24T09:17:06.569 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:06 trial028 ceph-mon[40371]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-24T09:17:06.569 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:06 trial028 ceph-mon[40371]: Cluster is now healthy 2026-02-24T09:17:06.570 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:06 trial028 ceph-mon[40371]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2026-02-24T09:17:06.570 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:06 trial028 ceph-mon[40371]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=a=up:creating} 9 up:standby 2026-02-24T09:17:06.570 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:06 trial028 ceph-mon[40371]: daemon mds.a is now active in filesystem cephfs as rank 2 2026-02-24T09:17:06.570 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:06 trial028 ceph-mon[40371]: pgmap v183: 97 pgs: 97 active+clean; 579 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s wr, 8 op/s 2026-02-24T09:17:06.570 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:06 trial028 ceph-mon[40371]: mds.? [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] up:active 2026-02-24T09:17:06.570 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:06 trial028 ceph-mon[40371]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=a=up:active} 3 up:standby-replay 6 up:standby 2026-02-24T09:17:06.570 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:06 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/2465783046' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-24T09:17:06.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:06.570+0000 7fafdac7b640 1 -- 10.20.193.28:0/2465783046 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fafb00b5820 msgr2=0x7fafb00d5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:06.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:06.570+0000 7fafdac7b640 1 --2- 10.20.193.28:0/2465783046 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fafb00b5820 0x7fafb00d5cd0 secure :-1 s=READY pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fafd40fc410 tx=0x7fafbc005f90 comp rx=0 tx=0).stop 2026-02-24T09:17:06.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:06.570+0000 7fafdac7b640 1 -- 10.20.193.28:0/2465783046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafd410d4f0 msgr2=0x7fafd40f5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:06.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:06.570+0000 7fafdac7b640 1 --2- 10.20.193.28:0/2465783046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafd410d4f0 0x7fafd40f5a70 secure :-1 s=READY pgs=247 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fafc40072a0 tx=0x7fafc400ddf0 comp rx=0 tx=0).stop 2026-02-24T09:17:06.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:06.570+0000 7fafdac7b640 1 -- 10.20.193.28:0/2465783046 shutdown_connections 2026-02-24T09:17:06.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:06.570+0000 7fafdac7b640 1 --2- 10.20.193.28:0/2465783046 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fafb00b5820 0x7fafb00d5cd0 unknown :-1 s=CLOSED pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:06.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:06.570+0000 7fafdac7b640 1 --2- 10.20.193.28:0/2465783046 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fafd41136e0 0x7fafd40f6170 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:06.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:06.570+0000 7fafdac7b640 1 --2- 10.20.193.28:0/2465783046 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fafd410dee0 0x7fafd4173fb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:06.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:06.570+0000 7fafdac7b640 1 --2- 10.20.193.28:0/2465783046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafd410d4f0 0x7fafd40f5a70 unknown :-1 s=CLOSED pgs=247 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:06.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:06.570+0000 7fafdac7b640 1 -- 10.20.193.28:0/2465783046 >> 10.20.193.28:0/2465783046 conn(0x7fafd40eade0 msgr2=0x7fafd410b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:06.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:06.570+0000 7fafdac7b640 1 -- 10.20.193.28:0/2465783046 shutdown_connections 2026-02-24T09:17:06.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:06.570+0000 7fafdac7b640 1 -- 10.20.193.28:0/2465783046 wait complete. 2026-02-24T09:17:06.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:06 trial074 ceph-mon[44412]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-24T09:17:06.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:06 trial074 ceph-mon[44412]: mds.? [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] up:active 2026-02-24T09:17:06.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:06 trial074 ceph-mon[44412]: daemon mds.a assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-24T09:17:06.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:06 trial074 ceph-mon[44412]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-24T09:17:06.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:06 trial074 ceph-mon[44412]: Cluster is now healthy 2026-02-24T09:17:06.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:06 trial074 ceph-mon[44412]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2026-02-24T09:17:06.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:06 trial074 ceph-mon[44412]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=a=up:creating} 9 up:standby 2026-02-24T09:17:06.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:06 trial074 ceph-mon[44412]: daemon mds.a is now active in filesystem cephfs as rank 2 2026-02-24T09:17:06.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:06 trial074 ceph-mon[44412]: pgmap v183: 97 pgs: 97 active+clean; 579 KiB data, 330 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s wr, 8 op/s 2026-02-24T09:17:06.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:06 trial074 ceph-mon[44412]: mds.? [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] up:active 2026-02-24T09:17:06.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:06 trial074 ceph-mon[44412]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=a=up:active} 3 up:standby-replay 6 up:standby 2026-02-24T09:17:06.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:06 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/2465783046' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-24T09:17:06.676 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2026-02-24T09:17:06.676 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph fs subvolumegroup create cephfs qa 2026-02-24T09:17:06.858 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:07.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.036+0000 7f1b15aec640 1 -- 10.20.193.28:0/3816819475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b10110130 msgr2=0x7f1b10115180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:07.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.036+0000 7f1b15aec640 1 --2- 10.20.193.28:0/3816819475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b10110130 0x7f1b10115180 secure :-1 s=READY pgs=248 gs=1 cs=0 l=1 c_cookie=12904709269582393819 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b00009950 tx=0x7f1b0002f190 comp rx=0 tx=0).stop 2026-02-24T09:17:07.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.036+0000 7f1b15aec640 1 -- 10.20.193.28:0/3816819475 shutdown_connections 2026-02-24T09:17:07.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.036+0000 7f1b15aec640 1 --2- 10.20.193.28:0/3816819475 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1b10115930 0x7f1b10176300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:07.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.036+0000 7f1b15aec640 1 --2- 10.20.193.28:0/3816819475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b10110130 0x7f1b10115180 unknown :-1 s=CLOSED pgs=248 gs=1 cs=0 l=1 c_cookie=12904709269582393819 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:07.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.036+0000 7f1b15aec640 1 --2- 10.20.193.28:0/3816819475 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f1b1010f740 0x7f1b1010fb10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:07.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.036+0000 7f1b15aec640 1 -- 10.20.193.28:0/3816819475 >> 10.20.193.28:0/3816819475 conn(0x7f1b100ed050 msgr2=0x7f1b1010d460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:07.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.036+0000 7f1b15aec640 1 -- 10.20.193.28:0/3816819475 shutdown_connections 2026-02-24T09:17:07.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.036+0000 7f1b15aec640 1 -- 10.20.193.28:0/3816819475 wait complete. 2026-02-24T09:17:07.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.037+0000 7f1b15aec640 1 Processor -- start 2026-02-24T09:17:07.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.037+0000 7f1b15aec640 1 -- start start 2026-02-24T09:17:07.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.037+0000 7f1b15aec640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f1b1010f740 0x7f1b100f5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:07.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.037+0000 7f1b15aec640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1b10110130 0x7f1b10176200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:07.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.037+0000 7f1b15aec640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b10115930 0x7f1b100f61b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:07.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.037+0000 7f1b15aec640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1b100fb3c0 con 0x7f1b10115930 2026-02-24T09:17:07.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.037+0000 7f1b15aec640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f1b100fb530 con 0x7f1b1010f740 2026-02-24T09:17:07.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.037+0000 7f1b15aec640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1b100fb6f0 con 0x7f1b10110130 2026-02-24T09:17:07.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.038+0000 7f1b0ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b10115930 0x7f1b100f61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:07.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.038+0000 7f1b0effd640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1b10110130 0x7f1b10176200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:07.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.038+0000 7f1b0f7fe640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f1b1010f740 0x7f1b100f5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:07.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.038+0000 7f1b0effd640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1b10110130 0x7f1b10176200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:38754/0 (socket says 10.20.193.28:38754) 2026-02-24T09:17:07.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.038+0000 7f1b0effd640 1 -- 10.20.193.28:0/2411216100 learned_addr learned my addr 10.20.193.28:0/2411216100 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:07.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.038+0000 7f1b0ffff640 1 -- 10.20.193.28:0/2411216100 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1b10110130 msgr2=0x7f1b10176200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:07.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.038+0000 7f1b0ffff640 1 --2- 10.20.193.28:0/2411216100 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1b10110130 0x7f1b10176200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:07.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.038+0000 7f1b0ffff640 1 -- 10.20.193.28:0/2411216100 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f1b1010f740 msgr2=0x7f1b100f5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:07.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.038+0000 7f1b0ffff640 1 --2- 10.20.193.28:0/2411216100 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f1b1010f740 0x7f1b100f5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:07.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.038+0000 7f1b0ffff640 1 -- 10.20.193.28:0/2411216100 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b00009570 con 0x7f1b10115930 2026-02-24T09:17:07.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.038+0000 7f1b0ffff640 1 --2- 10.20.193.28:0/2411216100 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b10115930 0x7f1b100f61b0 secure :-1 s=READY pgs=249 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b0400f940 tx=0x7f1b0400fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:07.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.038+0000 7f1b0cff9640 1 -- 10.20.193.28:0/2411216100 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b0400dce0 con 0x7f1b10115930 2026-02-24T09:17:07.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.038+0000 7f1b0cff9640 1 -- 10.20.193.28:0/2411216100 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f1b0400de40 con 0x7f1b10115930 2026-02-24T09:17:07.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.038+0000 7f1b0cff9640 1 -- 10.20.193.28:0/2411216100 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b040116b0 con 0x7f1b10115930 2026-02-24T09:17:07.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.038+0000 7f1b15aec640 1 -- 10.20.193.28:0/2411216100 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b100fb9d0 con 0x7f1b10115930 2026-02-24T09:17:07.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.039+0000 7f1b15aec640 1 -- 10.20.193.28:0/2411216100 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b100fbe50 con 0x7f1b10115930 2026-02-24T09:17:07.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.039+0000 7f1b15aec640 1 -- 10.20.193.28:0/2411216100 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b10110a20 con 0x7f1b10115930 2026-02-24T09:17:07.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.041+0000 7f1b0cff9640 1 -- 10.20.193.28:0/2411216100 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 19) ==== 157139+0+0 (secure 0 0 0) 0x7f1b04020060 con 0x7f1b10115930 2026-02-24T09:17:07.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.043+0000 7f1b0cff9640 1 --2- 10.20.193.28:0/2411216100 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f1ae40b57a0 0x7f1ae40d5c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:07.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.043+0000 7f1b0cff9640 1 -- 10.20.193.28:0/2411216100 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f1b04015070 con 0x7f1b10115930 2026-02-24T09:17:07.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.043+0000 7f1b0cff9640 1 -- 10.20.193.28:0/2411216100 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f1b04120930 con 0x7f1b10115930 2026-02-24T09:17:07.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.043+0000 7f1b0f7fe640 1 --2- 10.20.193.28:0/2411216100 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f1ae40b57a0 0x7f1ae40d5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:07.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.043+0000 7f1b0f7fe640 1 --2- 10.20.193.28:0/2411216100 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f1ae40b57a0 0x7f1ae40d5c50 secure :-1 s=READY pgs=143 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1afc004740 tx=0x7f1afc005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:07.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.179+0000 7f1b15aec640 1 -- 10.20.193.28:0/2411216100 --> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f1b100f6c10 con 0x7f1ae40b57a0 2026-02-24T09:17:07.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.202+0000 7f1b0cff9640 1 -- 10.20.193.28:0/2411216100 <== mgr.14223 v2:10.20.193.28:6800/906910473 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1b100f6c10 con 0x7f1ae40b57a0 2026-02-24T09:17:07.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.204+0000 7f1b15aec640 1 -- 10.20.193.28:0/2411216100 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f1ae40b57a0 msgr2=0x7f1ae40d5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:07.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.204+0000 7f1b15aec640 1 --2- 10.20.193.28:0/2411216100 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f1ae40b57a0 0x7f1ae40d5c50 secure :-1 s=READY pgs=143 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1afc004740 tx=0x7f1afc005f90 comp rx=0 tx=0).stop 2026-02-24T09:17:07.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.204+0000 7f1b15aec640 1 -- 10.20.193.28:0/2411216100 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b10115930 msgr2=0x7f1b100f61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:07.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.204+0000 7f1b15aec640 1 --2- 10.20.193.28:0/2411216100 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b10115930 0x7f1b100f61b0 secure :-1 s=READY pgs=249 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b0400f940 tx=0x7f1b0400fe10 comp rx=0 tx=0).stop 2026-02-24T09:17:07.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.204+0000 7f1b15aec640 1 -- 10.20.193.28:0/2411216100 shutdown_connections 2026-02-24T09:17:07.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.204+0000 7f1b15aec640 1 --2- 10.20.193.28:0/2411216100 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f1ae40b57a0 0x7f1ae40d5c50 unknown :-1 s=CLOSED pgs=143 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:07.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.204+0000 7f1b15aec640 1 --2- 10.20.193.28:0/2411216100 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b10115930 0x7f1b100f61b0 unknown :-1 s=CLOSED pgs=249 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:07.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.204+0000 7f1b15aec640 1 --2- 10.20.193.28:0/2411216100 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1b10110130 0x7f1b10176200 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:07.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.204+0000 7f1b15aec640 1 --2- 10.20.193.28:0/2411216100 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f1b1010f740 0x7f1b100f5ab0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:07.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.204+0000 7f1b15aec640 1 -- 10.20.193.28:0/2411216100 >> 10.20.193.28:0/2411216100 conn(0x7f1b100ed050 msgr2=0x7f1b10111f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:07.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.204+0000 7f1b15aec640 1 -- 10.20.193.28:0/2411216100 shutdown_connections 2026-02-24T09:17:07.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.204+0000 7f1b15aec640 1 -- 10.20.193.28:0/2411216100 wait complete. 2026-02-24T09:17:07.305 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2026-02-24T09:17:07.488 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:07.531 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:17:07 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: 2026-02-24T09:17:07.187+0000 7fd6689bd640 -1 client.15006 error registering admin socket command: (17) File exists 2026-02-24T09:17:07.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.661+0000 7f3eeaa38640 1 -- 10.20.193.28:0/1435849536 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ee41158b0 msgr2=0x7f3ee4176280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:07.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.661+0000 7f3eeaa38640 1 --2- 10.20.193.28:0/1435849536 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ee41158b0 0x7f3ee4176280 secure :-1 s=READY pgs=252 gs=1 cs=0 l=1 c_cookie=11427151738006604535 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ed800aa30 tx=0x7f3ed8030270 comp rx=0 tx=0).stop 2026-02-24T09:17:07.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.661+0000 7f3eeaa38640 1 -- 10.20.193.28:0/1435849536 shutdown_connections 2026-02-24T09:17:07.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.661+0000 7f3eeaa38640 1 --2- 10.20.193.28:0/1435849536 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ee41158b0 0x7f3ee4176280 unknown :-1 s=CLOSED pgs=252 gs=1 cs=0 l=1 c_cookie=11427151738006604535 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:07.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.661+0000 7f3eeaa38640 1 --2- 10.20.193.28:0/1435849536 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3ee41100b0 0x7f3ee4115100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:07.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.661+0000 7f3eeaa38640 1 --2- 10.20.193.28:0/1435849536 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3ee410f6c0 0x7f3ee410fa90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:07.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.661+0000 7f3eeaa38640 1 -- 10.20.193.28:0/1435849536 >> 10.20.193.28:0/1435849536 conn(0x7f3ee40ecfd0 msgr2=0x7f3ee410d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:07.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.661+0000 7f3eeaa38640 1 -- 10.20.193.28:0/1435849536 shutdown_connections 2026-02-24T09:17:07.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.661+0000 7f3eeaa38640 1 -- 10.20.193.28:0/1435849536 wait complete. 2026-02-24T09:17:07.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.662+0000 7f3eeaa38640 1 Processor -- start 2026-02-24T09:17:07.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.662+0000 7f3eeaa38640 1 -- start start 2026-02-24T09:17:07.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.662+0000 7f3eeaa38640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3ee410f6c0 0x7f3ee40f5a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:07.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.662+0000 7f3eeaa38640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ee41100b0 0x7f3ee4176180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:07.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.662+0000 7f3eeaa38640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3ee41158b0 0x7f3ee40f6160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:07.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.662+0000 7f3eeaa38640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee40fb370 con 0x7f3ee41100b0 2026-02-24T09:17:07.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.662+0000 7f3eeaa38640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee40fb4e0 con 0x7f3ee41158b0 2026-02-24T09:17:07.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.662+0000 7f3eeaa38640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee40fb6a0 con 0x7f3ee410f6c0 2026-02-24T09:17:07.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.663+0000 7f3ee37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ee41100b0 0x7f3ee4176180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:07.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.663+0000 7f3ee3fff640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3ee410f6c0 0x7f3ee40f5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:07.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.663+0000 7f3ee3fff640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3ee410f6c0 0x7f3ee40f5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:38796/0 (socket says 10.20.193.28:38796) 2026-02-24T09:17:07.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.663+0000 7f3ee3fff640 1 -- 10.20.193.28:0/1221339539 learned_addr learned my addr 10.20.193.28:0/1221339539 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:07.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.663+0000 7f3ee8fae640 1 --2- 10.20.193.28:0/1221339539 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3ee41158b0 0x7f3ee40f6160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:07.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.663+0000 7f3ee37fe640 1 -- 10.20.193.28:0/1221339539 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3ee410f6c0 msgr2=0x7f3ee40f5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:07.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.663+0000 7f3ee37fe640 1 --2- 10.20.193.28:0/1221339539 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3ee410f6c0 0x7f3ee40f5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:07.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.663+0000 7f3ee37fe640 1 -- 10.20.193.28:0/1221339539 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3ee41158b0 msgr2=0x7f3ee40f6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:07.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.663+0000 7f3ee37fe640 1 --2- 10.20.193.28:0/1221339539 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3ee41158b0 0x7f3ee40f6160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:07.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.663+0000 7f3ee37fe640 1 -- 10.20.193.28:0/1221339539 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed800a650 con 0x7f3ee41100b0 2026-02-24T09:17:07.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.663+0000 7f3ee37fe640 1 --2- 10.20.193.28:0/1221339539 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ee41100b0 0x7f3ee4176180 secure :-1 s=READY pgs=253 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ed400d720 tx=0x7f3ed400dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:07.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.663+0000 7f3ee17fa640 1 -- 10.20.193.28:0/1221339539 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3ed4004500 con 0x7f3ee41100b0 2026-02-24T09:17:07.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.663+0000 7f3ee17fa640 1 -- 10.20.193.28:0/1221339539 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3ed4004d10 con 0x7f3ee41100b0 2026-02-24T09:17:07.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.663+0000 7f3ee17fa640 1 -- 10.20.193.28:0/1221339539 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3ed40052a0 con 0x7f3ee41100b0 2026-02-24T09:17:07.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.663+0000 7f3eeaa38640 1 -- 10.20.193.28:0/1221339539 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ee40fb980 con 0x7f3ee41100b0 2026-02-24T09:17:07.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.663+0000 7f3eeaa38640 1 -- 10.20.193.28:0/1221339539 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ee40fbe00 con 0x7f3ee41100b0 2026-02-24T09:17:07.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.664+0000 7f3eeaa38640 1 -- 10.20.193.28:0/1221339539 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ee41109a0 con 0x7f3ee41100b0 2026-02-24T09:17:07.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.666+0000 7f3ee17fa640 1 -- 10.20.193.28:0/1221339539 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f3ed4005430 con 0x7f3ee41100b0 2026-02-24T09:17:07.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.668+0000 7f3ee17fa640 1 --2- 10.20.193.28:0/1221339539 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3eb80b5830 0x7f3eb80d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:07.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.668+0000 7f3ee17fa640 1 -- 10.20.193.28:0/1221339539 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f3ed40e6a70 con 0x7f3ee41100b0 2026-02-24T09:17:07.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.668+0000 7f3ee17fa640 1 -- 10.20.193.28:0/1221339539 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f3ed411f930 con 0x7f3ee41100b0 2026-02-24T09:17:07.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.668+0000 7f3ee3fff640 1 --2- 10.20.193.28:0/1221339539 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3eb80b5830 0x7f3eb80d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:07.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.669+0000 7f3ee3fff640 1 --2- 10.20.193.28:0/1221339539 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3eb80b5830 0x7f3eb80d5ce0 secure :-1 s=READY pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ed00095b0 tx=0x7f3ed0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:07.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.802+0000 7f3eeaa38640 1 -- 10.20.193.28:0/1221339539 --> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f3ee40f6bc0 con 0x7f3eb80b5830 2026-02-24T09:17:07.804 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:07 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/2465783046' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-24T09:17:07.804 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:07 trial028 ceph-mon[40371]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=a=up:active} 3 up:standby-replay 6 up:standby 2026-02-24T09:17:07.804 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:07 trial028 ceph-mon[40371]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:07.804 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:07 trial028 ceph-mon[40371]: pgmap v184: 97 pgs: 97 active+clean; 579 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 767 B/s rd, 2.9 KiB/s wr, 10 op/s 2026-02-24T09:17:07.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.820+0000 7f3ee17fa640 1 -- 10.20.193.28:0/1221339539 <== mgr.14223 v2:10.20.193.28:6800/906910473 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3ee40f6bc0 con 0x7f3eb80b5830 2026-02-24T09:17:07.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.822+0000 7f3eeaa38640 1 -- 10.20.193.28:0/1221339539 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3eb80b5830 msgr2=0x7f3eb80d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:07.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.822+0000 7f3eeaa38640 1 --2- 10.20.193.28:0/1221339539 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3eb80b5830 0x7f3eb80d5ce0 secure :-1 s=READY pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ed00095b0 tx=0x7f3ed0005f90 comp rx=0 tx=0).stop 2026-02-24T09:17:07.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.822+0000 7f3eeaa38640 1 -- 10.20.193.28:0/1221339539 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ee41100b0 msgr2=0x7f3ee4176180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:07.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.822+0000 7f3eeaa38640 1 --2- 10.20.193.28:0/1221339539 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ee41100b0 0x7f3ee4176180 secure :-1 s=READY pgs=253 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ed400d720 tx=0x7f3ed400dbf0 comp rx=0 tx=0).stop 2026-02-24T09:17:07.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.822+0000 7f3eeaa38640 1 -- 10.20.193.28:0/1221339539 shutdown_connections 2026-02-24T09:17:07.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.822+0000 7f3eeaa38640 1 --2- 10.20.193.28:0/1221339539 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3eb80b5830 0x7f3eb80d5ce0 unknown :-1 s=CLOSED pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:07.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.822+0000 7f3eeaa38640 1 --2- 10.20.193.28:0/1221339539 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3ee41158b0 0x7f3ee40f6160 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:07.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.822+0000 7f3eeaa38640 1 --2- 10.20.193.28:0/1221339539 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ee41100b0 0x7f3ee4176180 unknown :-1 s=CLOSED pgs=253 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:07.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.822+0000 7f3eeaa38640 1 --2- 10.20.193.28:0/1221339539 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3ee410f6c0 0x7f3ee40f5a60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:07.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.822+0000 7f3eeaa38640 1 -- 10.20.193.28:0/1221339539 >> 10.20.193.28:0/1221339539 conn(0x7f3ee40ecfd0 msgr2=0x7f3ee410db90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:07.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.822+0000 7f3eeaa38640 1 -- 10.20.193.28:0/1221339539 shutdown_connections 2026-02-24T09:17:07.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:07.822+0000 7f3eeaa38640 1 -- 10.20.193.28:0/1221339539 wait complete. 2026-02-24T09:17:07.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:07 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/2465783046' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-24T09:17:07.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:07 trial074 ceph-mon[44412]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=a=up:active} 3 up:standby-replay 6 up:standby 2026-02-24T09:17:07.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:07 trial074 ceph-mon[44412]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:07.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:07 trial074 ceph-mon[44412]: pgmap v184: 97 pgs: 97 active+clean; 579 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 767 B/s rd, 2.9 KiB/s wr, 10 op/s 2026-02-24T09:17:07.925 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2026-02-24T09:17:08.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:07 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/2465783046' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-24T09:17:08.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:07 trial159 ceph-mon[44242]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=a=up:active} 3 up:standby-replay 6 up:standby 2026-02-24T09:17:08.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:07 trial159 ceph-mon[44242]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:08.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:07 trial159 ceph-mon[44242]: pgmap v184: 97 pgs: 97 active+clean; 579 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 767 B/s rd, 2.9 KiB/s wr, 10 op/s 2026-02-24T09:17:08.107 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:08.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.282+0000 7f3bfae47640 1 -- 10.20.193.28:0/4248222903 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3bf410f600 msgr2=0x7f3bf410f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:08.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.282+0000 7f3bfae47640 1 --2- 10.20.193.28:0/4248222903 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3bf410f600 0x7f3bf410f9d0 secure :-1 s=READY pgs=254 gs=2 cs=0 l=1 c_cookie=1774686701448782640 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3be4009950 tx=0x7f3be402f190 comp rx=0 tx=0).stop 2026-02-24T09:17:08.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.283+0000 7f3bfae47640 1 -- 10.20.193.28:0/4248222903 shutdown_connections 2026-02-24T09:17:08.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.283+0000 7f3bfae47640 1 --2- 10.20.193.28:0/4248222903 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3bf41157f0 0x7f3bf41761c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:08.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.283+0000 7f3bfae47640 1 --2- 10.20.193.28:0/4248222903 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3bf410fff0 0x7f3bf4115040 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:08.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.283+0000 7f3bfae47640 1 --2- 10.20.193.28:0/4248222903 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3bf410f600 0x7f3bf410f9d0 unknown :-1 s=CLOSED pgs=254 gs=2 cs=0 l=1 c_cookie=1774686701448782640 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:08.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.283+0000 7f3bfae47640 1 -- 10.20.193.28:0/4248222903 >> 10.20.193.28:0/4248222903 conn(0x7f3bf40ecef0 msgr2=0x7f3bf410d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:08.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.283+0000 7f3bfae47640 1 -- 10.20.193.28:0/4248222903 shutdown_connections 2026-02-24T09:17:08.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.283+0000 7f3bfae47640 1 -- 10.20.193.28:0/4248222903 wait complete. 2026-02-24T09:17:08.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.283+0000 7f3bfae47640 1 Processor -- start 2026-02-24T09:17:08.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.284+0000 7f3bfae47640 1 -- start start 2026-02-24T09:17:08.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.284+0000 7f3bfae47640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3bf410f600 0x7f3bf411dfe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:08.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.284+0000 7f3bfae47640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3bf410fff0 0x7f3bf411e520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:08.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.284+0000 7f3bfae47640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3bf41157f0 0x7f3bf41238f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:08.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.284+0000 7f3bfae47640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf4123f10 con 0x7f3bf410fff0 2026-02-24T09:17:08.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.284+0000 7f3bfae47640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf4124080 con 0x7f3bf410f600 2026-02-24T09:17:08.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.284+0000 7f3bfae47640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf4124240 con 0x7f3bf41157f0 2026-02-24T09:17:08.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.284+0000 7f3bf9644640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3bf410fff0 0x7f3bf411e520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:08.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.284+0000 7f3bf9644640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3bf410fff0 0x7f3bf411e520 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39218/0 (socket says 10.20.193.28:39218) 2026-02-24T09:17:08.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.284+0000 7f3bf9644640 1 -- 10.20.193.28:0/93532705 learned_addr learned my addr 10.20.193.28:0/93532705 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:08.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.284+0000 7f3bfa646640 1 --2- 10.20.193.28:0/93532705 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3bf41157f0 0x7f3bf41238f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:08.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.284+0000 7f3bf9e45640 1 --2- 10.20.193.28:0/93532705 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3bf410f600 0x7f3bf411dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:08.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.284+0000 7f3bf9644640 1 -- 10.20.193.28:0/93532705 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3bf41157f0 msgr2=0x7f3bf41238f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:08.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.284+0000 7f3bf9644640 1 --2- 10.20.193.28:0/93532705 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3bf41157f0 0x7f3bf41238f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:08.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.284+0000 7f3bf9644640 1 -- 10.20.193.28:0/93532705 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3bf410f600 msgr2=0x7f3bf411dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:08.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.284+0000 7f3bf9644640 1 --2- 10.20.193.28:0/93532705 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3bf410f600 0x7f3bf411dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:08.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.284+0000 7f3bf9644640 1 -- 10.20.193.28:0/93532705 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3be4009570 con 0x7f3bf410fff0 2026-02-24T09:17:08.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.285+0000 7f3bf9644640 1 --2- 10.20.193.28:0/93532705 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3bf410fff0 0x7f3bf411e520 secure :-1 s=READY pgs=255 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3be8005db0 tx=0x7f3be800ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:08.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.285+0000 7f3be2ffd640 1 -- 10.20.193.28:0/93532705 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3be8004500 con 0x7f3bf410fff0 2026-02-24T09:17:08.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.285+0000 7f3be2ffd640 1 -- 10.20.193.28:0/93532705 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3be8004d10 con 0x7f3bf410fff0 2026-02-24T09:17:08.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.285+0000 7f3be2ffd640 1 -- 10.20.193.28:0/93532705 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3be8005280 con 0x7f3bf410fff0 2026-02-24T09:17:08.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.285+0000 7f3bfae47640 1 -- 10.20.193.28:0/93532705 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bf4124520 con 0x7f3bf410fff0 2026-02-24T09:17:08.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.285+0000 7f3bfae47640 1 -- 10.20.193.28:0/93532705 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bf4164c20 con 0x7f3bf410fff0 2026-02-24T09:17:08.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.286+0000 7f3bfae47640 1 -- 10.20.193.28:0/93532705 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bf4124740 con 0x7f3bf410fff0 2026-02-24T09:17:08.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.287+0000 7f3be2ffd640 1 -- 10.20.193.28:0/93532705 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f3be8005410 con 0x7f3bf410fff0 2026-02-24T09:17:08.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.289+0000 7f3be2ffd640 1 --2- 10.20.193.28:0/93532705 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3bd00b58c0 0x7f3bd00d5d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:08.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.289+0000 7f3be2ffd640 1 -- 10.20.193.28:0/93532705 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f3be80e6cd0 con 0x7f3bf410fff0 2026-02-24T09:17:08.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.289+0000 7f3bf9e45640 1 --2- 10.20.193.28:0/93532705 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3bd00b58c0 0x7f3bd00d5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:08.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.290+0000 7f3bf9e45640 1 --2- 10.20.193.28:0/93532705 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3bd00b58c0 0x7f3bd00d5d70 secure :-1 s=READY pgs=145 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3be40098a0 tx=0x7f3be403a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:08.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.290+0000 7f3be2ffd640 1 -- 10.20.193.28:0/93532705 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f3be80a9560 con 0x7f3bf410fff0 2026-02-24T09:17:08.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.425+0000 7f3bfae47640 1 -- 10.20.193.28:0/93532705 --> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f3bf410f9d0 con 0x7f3bd00b58c0 2026-02-24T09:17:08.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.429+0000 7f3be2ffd640 1 -- 10.20.193.28:0/93532705 <== mgr.14223 v2:10.20.193.28:6800/906910473 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f3bf410f9d0 con 0x7f3bd00b58c0 2026-02-24T09:17:08.431 INFO:teuthology.orchestra.run.trial028.stdout:/volumes/qa/sv_0/df987db1-0b17-4685-b91f-d18b9920239e 2026-02-24T09:17:08.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.430+0000 7f3bfae47640 1 -- 10.20.193.28:0/93532705 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3bd00b58c0 msgr2=0x7f3bd00d5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:08.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.430+0000 7f3bfae47640 1 --2- 10.20.193.28:0/93532705 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3bd00b58c0 0x7f3bd00d5d70 secure :-1 s=READY pgs=145 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3be40098a0 tx=0x7f3be403a040 comp rx=0 tx=0).stop 2026-02-24T09:17:08.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.430+0000 7f3bfae47640 1 -- 10.20.193.28:0/93532705 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3bf410fff0 msgr2=0x7f3bf411e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:08.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.430+0000 7f3bfae47640 1 --2- 10.20.193.28:0/93532705 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3bf410fff0 0x7f3bf411e520 secure :-1 s=READY pgs=255 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3be8005db0 tx=0x7f3be800ddf0 comp rx=0 tx=0).stop 2026-02-24T09:17:08.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.431+0000 7f3bfae47640 1 -- 10.20.193.28:0/93532705 shutdown_connections 2026-02-24T09:17:08.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.431+0000 7f3bfae47640 1 --2- 10.20.193.28:0/93532705 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3bd00b58c0 0x7f3bd00d5d70 unknown :-1 s=CLOSED pgs=145 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:08.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.431+0000 7f3bfae47640 1 --2- 10.20.193.28:0/93532705 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3bf41157f0 0x7f3bf41238f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:08.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.431+0000 7f3bfae47640 1 --2- 10.20.193.28:0/93532705 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3bf410fff0 0x7f3bf411e520 unknown :-1 s=CLOSED pgs=255 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:08.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.431+0000 7f3bfae47640 1 --2- 10.20.193.28:0/93532705 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3bf410f600 0x7f3bf411dfe0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:08.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.431+0000 7f3bfae47640 1 -- 10.20.193.28:0/93532705 >> 10.20.193.28:0/93532705 conn(0x7f3bf40ecef0 msgr2=0x7f3bf410d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:08.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.431+0000 7f3bfae47640 1 -- 10.20.193.28:0/93532705 shutdown_connections 2026-02-24T09:17:08.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.431+0000 7f3bfae47640 1 -- 10.20.193.28:0/93532705 wait complete. 2026-02-24T09:17:08.535 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2026-02-24T09:17:08.716 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:08.758 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:08 trial028 ceph-mon[40371]: mgrmap e20: x(active, since 3m), standbys: y, z 2026-02-24T09:17:08.758 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:08 trial028 ceph-mon[40371]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:08.759 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:08 trial028 ceph-mon[40371]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:08.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:08 trial074 ceph-mon[44412]: mgrmap e20: x(active, since 3m), standbys: y, z 2026-02-24T09:17:08.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:08 trial074 ceph-mon[44412]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:08.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:08 trial074 ceph-mon[44412]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:08.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.895+0000 7ff6effff640 1 -- 10.20.193.28:0/2729994718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6f010d2f0 msgr2=0x7ff6f010e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:08.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.895+0000 7ff6effff640 1 --2- 10.20.193.28:0/2729994718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6f010d2f0 0x7ff6f010e9d0 secure :-1 s=READY pgs=256 gs=3 cs=0 l=1 c_cookie=3620921542349524559 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6d8009950 tx=0x7ff6d802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:17:08.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.896+0000 7ff6effff640 1 -- 10.20.193.28:0/2729994718 shutdown_connections 2026-02-24T09:17:08.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.896+0000 7ff6effff640 1 --2- 10.20.193.28:0/2729994718 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff6f010f180 0x7ff6f0172d90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:08.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.896+0000 7ff6effff640 1 --2- 10.20.193.28:0/2729994718 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6f010d2f0 0x7ff6f010e9d0 unknown :-1 s=CLOSED pgs=256 gs=3 cs=0 l=1 c_cookie=3620921542349524559 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:08.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.896+0000 7ff6effff640 1 --2- 10.20.193.28:0/2729994718 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff6f010c900 0x7ff6f010ccd0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:08.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.896+0000 7ff6effff640 1 -- 10.20.193.28:0/2729994718 >> 10.20.193.28:0/2729994718 conn(0x7ff6f00e9260 msgr2=0x7ff6f0109670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:08.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.896+0000 7ff6effff640 1 -- 10.20.193.28:0/2729994718 shutdown_connections 2026-02-24T09:17:08.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.896+0000 7ff6effff640 1 -- 10.20.193.28:0/2729994718 wait complete. 2026-02-24T09:17:08.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.896+0000 7ff6effff640 1 Processor -- start 2026-02-24T09:17:08.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.897+0000 7ff6effff640 1 -- start start 2026-02-24T09:17:08.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.897+0000 7ff6effff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff6f010c900 0x7ff6f00f15d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:08.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.897+0000 7ff6effff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6f010d2f0 0x7ff6f0172c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:08.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.897+0000 7ff6effff640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff6f010f180 0x7ff6f00ed8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:08.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.897+0000 7ff6effff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f00ee030 con 0x7ff6f010d2f0 2026-02-24T09:17:08.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.897+0000 7ff6effff640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f00ee1a0 con 0x7ff6f010c900 2026-02-24T09:17:08.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.897+0000 7ff6effff640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f00ee360 con 0x7ff6f010f180 2026-02-24T09:17:08.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.897+0000 7ff6ee7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6f010d2f0 0x7ff6f0172c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:08.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.897+0000 7ff6ee7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6f010d2f0 0x7ff6f0172c90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39238/0 (socket says 10.20.193.28:39238) 2026-02-24T09:17:08.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.897+0000 7ff6ee7fc640 1 -- 10.20.193.28:0/372524716 learned_addr learned my addr 10.20.193.28:0/372524716 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:08.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.897+0000 7ff6eeffd640 1 --2- 10.20.193.28:0/372524716 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff6f010c900 0x7ff6f00f15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:08.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.897+0000 7ff6ef7fe640 1 --2- 10.20.193.28:0/372524716 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff6f010f180 0x7ff6f00ed8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:08.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.897+0000 7ff6ee7fc640 1 -- 10.20.193.28:0/372524716 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff6f010f180 msgr2=0x7ff6f00ed8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:08.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.897+0000 7ff6ee7fc640 1 --2- 10.20.193.28:0/372524716 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff6f010f180 0x7ff6f00ed8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:08.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.897+0000 7ff6ee7fc640 1 -- 10.20.193.28:0/372524716 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff6f010c900 msgr2=0x7ff6f00f15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:08.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.897+0000 7ff6ee7fc640 1 --2- 10.20.193.28:0/372524716 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff6f010c900 0x7ff6f00f15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:08.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.897+0000 7ff6ee7fc640 1 -- 10.20.193.28:0/372524716 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d8009570 con 0x7ff6f010d2f0 2026-02-24T09:17:08.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.897+0000 7ff6ef7fe640 1 --2- 10.20.193.28:0/372524716 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff6f010f180 0x7ff6f00ed8a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:17:08.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.898+0000 7ff6ee7fc640 1 --2- 10.20.193.28:0/372524716 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6f010d2f0 0x7ff6f0172c90 secure :-1 s=READY pgs=257 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6d80098a0 tx=0x7ff6d80028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:08.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.898+0000 7ff6f4a22640 1 -- 10.20.193.28:0/372524716 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff6d803d070 con 0x7ff6f010d2f0 2026-02-24T09:17:08.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.898+0000 7ff6f4a22640 1 -- 10.20.193.28:0/372524716 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff6d8002a40 con 0x7ff6f010d2f0 2026-02-24T09:17:08.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.898+0000 7ff6f4a22640 1 -- 10.20.193.28:0/372524716 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff6d8041720 con 0x7ff6f010d2f0 2026-02-24T09:17:08.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.898+0000 7ff6effff640 1 -- 10.20.193.28:0/372524716 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6f00ee5e0 con 0x7ff6f010d2f0 2026-02-24T09:17:08.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.898+0000 7ff6effff640 1 -- 10.20.193.28:0/372524716 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6f00fe850 con 0x7ff6f010d2f0 2026-02-24T09:17:08.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.899+0000 7ff6ce7fc640 1 -- 10.20.193.28:0/372524716 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6f005faf0 con 0x7ff6f010d2f0 2026-02-24T09:17:08.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.901+0000 7ff6f4a22640 1 -- 10.20.193.28:0/372524716 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7ff6d80386a0 con 0x7ff6f010d2f0 2026-02-24T09:17:08.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.902+0000 7ff6f4a22640 1 --2- 10.20.193.28:0/372524716 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff6c40b5840 0x7ff6c40d5cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:08.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.902+0000 7ff6f4a22640 1 -- 10.20.193.28:0/372524716 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7ff6d81123b0 con 0x7ff6f010d2f0 2026-02-24T09:17:08.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.903+0000 7ff6eeffd640 1 --2- 10.20.193.28:0/372524716 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff6c40b5840 0x7ff6c40d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:08.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.903+0000 7ff6eeffd640 1 --2- 10.20.193.28:0/372524716 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff6c40b5840 0x7ff6c40d5cf0 secure :-1 s=READY pgs=146 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6e4004740 tx=0x7ff6e4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:08.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:08.903+0000 7ff6f4a22640 1 -- 10.20.193.28:0/372524716 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7ff6d80cd8f0 con 0x7ff6f010d2f0 2026-02-24T09:17:09.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:08 trial159 ceph-mon[44242]: mgrmap e20: x(active, since 3m), standbys: y, z 2026-02-24T09:17:09.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:08 trial159 ceph-mon[44242]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:09.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:08 trial159 ceph-mon[44242]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:09.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.038+0000 7ff6ce7fc640 1 -- 10.20.193.28:0/372524716 --> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7ff6f00eebd0 con 0x7ff6c40b5840 2026-02-24T09:17:09.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.054+0000 7ff6f4a22640 1 -- 10.20.193.28:0/372524716 <== mgr.14223 v2:10.20.193.28:6800/906910473 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff6e40098d0 con 0x7ff6c40b5840 2026-02-24T09:17:09.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.056+0000 7ff6ce7fc640 1 -- 10.20.193.28:0/372524716 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff6c40b5840 msgr2=0x7ff6c40d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:09.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.056+0000 7ff6ce7fc640 1 --2- 10.20.193.28:0/372524716 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff6c40b5840 0x7ff6c40d5cf0 secure :-1 s=READY pgs=146 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6e4004740 tx=0x7ff6e4005f90 comp rx=0 tx=0).stop 2026-02-24T09:17:09.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.056+0000 7ff6ce7fc640 1 -- 10.20.193.28:0/372524716 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6f010d2f0 msgr2=0x7ff6f0172c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:09.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.056+0000 7ff6ce7fc640 1 --2- 10.20.193.28:0/372524716 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6f010d2f0 0x7ff6f0172c90 secure :-1 s=READY pgs=257 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6d80098a0 tx=0x7ff6d80028d0 comp rx=0 tx=0).stop 2026-02-24T09:17:09.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.056+0000 7ff6ce7fc640 1 -- 10.20.193.28:0/372524716 shutdown_connections 2026-02-24T09:17:09.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.056+0000 7ff6ce7fc640 1 --2- 10.20.193.28:0/372524716 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff6c40b5840 0x7ff6c40d5cf0 unknown :-1 s=CLOSED pgs=146 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:09.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.056+0000 7ff6ce7fc640 1 --2- 10.20.193.28:0/372524716 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff6f010f180 0x7ff6f00ed8a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:09.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.056+0000 7ff6ce7fc640 1 --2- 10.20.193.28:0/372524716 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6f010d2f0 0x7ff6f0172c90 unknown :-1 s=CLOSED pgs=257 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:09.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.056+0000 7ff6ce7fc640 1 --2- 10.20.193.28:0/372524716 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff6f010c900 0x7ff6f00f15d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:09.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.056+0000 7ff6ce7fc640 1 -- 10.20.193.28:0/372524716 >> 10.20.193.28:0/372524716 conn(0x7ff6f00e9260 msgr2=0x7ff6f0109e20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:09.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.056+0000 7ff6ce7fc640 1 -- 10.20.193.28:0/372524716 shutdown_connections 2026-02-24T09:17:09.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.056+0000 7ff6ce7fc640 1 -- 10.20.193.28:0/372524716 wait complete. 2026-02-24T09:17:09.155 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2026-02-24T09:17:09.340 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:09.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.521+0000 7fa3de54a640 1 -- 10.20.193.28:0/59213500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa3d8111b20 msgr2=0x7fa3d81724f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:09.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.521+0000 7fa3de54a640 1 --2- 10.20.193.28:0/59213500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa3d8111b20 0x7fa3d81724f0 secure :-1 s=READY pgs=258 gs=1 cs=0 l=1 c_cookie=4217993751939245229 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3d400aa30 tx=0x7fa3d4030270 comp rx=0 tx=0).stop 2026-02-24T09:17:09.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.521+0000 7fa3de54a640 1 -- 10.20.193.28:0/59213500 shutdown_connections 2026-02-24T09:17:09.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.521+0000 7fa3de54a640 1 --2- 10.20.193.28:0/59213500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa3d8111b20 0x7fa3d81724f0 unknown :-1 s=CLOSED pgs=258 gs=1 cs=0 l=1 c_cookie=4217993751939245229 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:09.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.521+0000 7fa3de54a640 1 --2- 10.20.193.28:0/59213500 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa3d810c320 0x7fa3d8111370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:09.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.521+0000 7fa3de54a640 1 --2- 10.20.193.28:0/59213500 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa3d810b930 0x7fa3d810bd00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:09.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.521+0000 7fa3de54a640 1 -- 10.20.193.28:0/59213500 >> 10.20.193.28:0/59213500 conn(0x7fa3d80e9260 msgr2=0x7fa3d8109670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:09.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.521+0000 7fa3de54a640 1 -- 10.20.193.28:0/59213500 shutdown_connections 2026-02-24T09:17:09.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.521+0000 7fa3de54a640 1 -- 10.20.193.28:0/59213500 wait complete. 2026-02-24T09:17:09.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.522+0000 7fa3de54a640 1 Processor -- start 2026-02-24T09:17:09.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.522+0000 7fa3de54a640 1 -- start start 2026-02-24T09:17:09.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.522+0000 7fa3de54a640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa3d810b930 0x7fa3d80f6140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:09.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.522+0000 7fa3de54a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa3d810c320 0x7fa3d81723f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:09.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.522+0000 7fa3de54a640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa3d8111b20 0x7fa3d80f6840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:09.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.522+0000 7fa3de54a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d80fba50 con 0x7fa3d810c320 2026-02-24T09:17:09.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.522+0000 7fa3de54a640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d80fbbc0 con 0x7fa3d8111b20 2026-02-24T09:17:09.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.522+0000 7fa3de54a640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d80fbd80 con 0x7fa3d810b930 2026-02-24T09:17:09.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.523+0000 7fa3dcd47640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa3d810c320 0x7fa3d81723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:09.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.523+0000 7fa3dd548640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa3d810b930 0x7fa3d80f6140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:09.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.523+0000 7fa3dd548640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa3d810b930 0x7fa3d80f6140 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:38846/0 (socket says 10.20.193.28:38846) 2026-02-24T09:17:09.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.523+0000 7fa3dd548640 1 -- 10.20.193.28:0/2126417435 learned_addr learned my addr 10.20.193.28:0/2126417435 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:09.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.523+0000 7fa3ddd49640 1 --2- 10.20.193.28:0/2126417435 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa3d8111b20 0x7fa3d80f6840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:09.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.523+0000 7fa3ddd49640 1 -- 10.20.193.28:0/2126417435 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa3d810b930 msgr2=0x7fa3d80f6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:09.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.523+0000 7fa3ddd49640 1 --2- 10.20.193.28:0/2126417435 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa3d810b930 0x7fa3d80f6140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:09.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.523+0000 7fa3ddd49640 1 -- 10.20.193.28:0/2126417435 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa3d810c320 msgr2=0x7fa3d81723f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:09.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.523+0000 7fa3ddd49640 1 --2- 10.20.193.28:0/2126417435 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa3d810c320 0x7fa3d81723f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:09.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.523+0000 7fa3ddd49640 1 -- 10.20.193.28:0/2126417435 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d400a650 con 0x7fa3d8111b20 2026-02-24T09:17:09.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.523+0000 7fa3ddd49640 1 --2- 10.20.193.28:0/2126417435 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa3d8111b20 0x7fa3d80f6840 secure :-1 s=READY pgs=86 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3d4033040 tx=0x7fa3d4030d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:09.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.523+0000 7fa3c67fc640 1 -- 10.20.193.28:0/2126417435 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa3d403e070 con 0x7fa3d8111b20 2026-02-24T09:17:09.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.524+0000 7fa3c67fc640 1 -- 10.20.193.28:0/2126417435 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fa3d4039de0 con 0x7fa3d8111b20 2026-02-24T09:17:09.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.524+0000 7fa3c67fc640 1 -- 10.20.193.28:0/2126417435 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa3d4042790 con 0x7fa3d8111b20 2026-02-24T09:17:09.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.524+0000 7fa3de54a640 1 -- 10.20.193.28:0/2126417435 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3d80fc000 con 0x7fa3d8111b20 2026-02-24T09:17:09.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.524+0000 7fa3de54a640 1 -- 10.20.193.28:0/2126417435 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3d80fc470 con 0x7fa3d8111b20 2026-02-24T09:17:09.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.524+0000 7fa3de54a640 1 -- 10.20.193.28:0/2126417435 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3d810cc10 con 0x7fa3d8111b20 2026-02-24T09:17:09.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.527+0000 7fa3c67fc640 1 -- 10.20.193.28:0/2126417435 <== mon.2 v2:10.20.193.74:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7fa3d40052e0 con 0x7fa3d8111b20 2026-02-24T09:17:09.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.529+0000 7fa3c67fc640 1 --2- 10.20.193.28:0/2126417435 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa3b40b5830 0x7fa3b40d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:09.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.529+0000 7fa3c67fc640 1 -- 10.20.193.28:0/2126417435 <== mon.2 v2:10.20.193.74:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7fa3d410c600 con 0x7fa3d8111b20 2026-02-24T09:17:09.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.529+0000 7fa3dd548640 1 --2- 10.20.193.28:0/2126417435 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa3b40b5830 0x7fa3b40d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:09.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.529+0000 7fa3c67fc640 1 -- 10.20.193.28:0/2126417435 <== mon.2 v2:10.20.193.74:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fa3d410ca80 con 0x7fa3d8111b20 2026-02-24T09:17:09.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.530+0000 7fa3dd548640 1 --2- 10.20.193.28:0/2126417435 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa3b40b5830 0x7fa3b40d5ce0 secure :-1 s=READY pgs=147 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3c800b840 tx=0x7fa3c800d040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:09.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.664+0000 7fa3de54a640 1 -- 10.20.193.28:0/2126417435 --> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fa3d80f72a0 con 0x7fa3b40b5830 2026-02-24T09:17:09.666 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:09 trial028 ceph-mon[40371]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:09.667 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:09 trial028 ceph-mon[40371]: pgmap v185: 97 pgs: 97 active+clean; 581 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 2.0 KiB/s rd, 4.1 KiB/s wr, 15 op/s 2026-02-24T09:17:09.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.667+0000 7fa3c67fc640 1 -- 10.20.193.28:0/2126417435 <== mgr.14223 v2:10.20.193.28:6800/906910473 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fa3d80f72a0 con 0x7fa3b40b5830 2026-02-24T09:17:09.669 INFO:teuthology.orchestra.run.trial028.stdout:/volumes/qa/sv_1/d4a84d03-0d57-4864-9955-67ab6670c82e 2026-02-24T09:17:09.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.669+0000 7fa3de54a640 1 -- 10.20.193.28:0/2126417435 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa3b40b5830 msgr2=0x7fa3b40d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:09.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.669+0000 7fa3de54a640 1 --2- 10.20.193.28:0/2126417435 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa3b40b5830 0x7fa3b40d5ce0 secure :-1 s=READY pgs=147 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3c800b840 tx=0x7fa3c800d040 comp rx=0 tx=0).stop 2026-02-24T09:17:09.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.669+0000 7fa3de54a640 1 -- 10.20.193.28:0/2126417435 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa3d8111b20 msgr2=0x7fa3d80f6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:09.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.669+0000 7fa3de54a640 1 --2- 10.20.193.28:0/2126417435 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa3d8111b20 0x7fa3d80f6840 secure :-1 s=READY pgs=86 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3d4033040 tx=0x7fa3d4030d00 comp rx=0 tx=0).stop 2026-02-24T09:17:09.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.669+0000 7fa3de54a640 1 -- 10.20.193.28:0/2126417435 shutdown_connections 2026-02-24T09:17:09.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.669+0000 7fa3de54a640 1 --2- 10.20.193.28:0/2126417435 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa3b40b5830 0x7fa3b40d5ce0 unknown :-1 s=CLOSED pgs=147 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:09.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.669+0000 7fa3de54a640 1 --2- 10.20.193.28:0/2126417435 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa3d8111b20 0x7fa3d80f6840 unknown :-1 s=CLOSED pgs=86 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:09.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.669+0000 7fa3de54a640 1 --2- 10.20.193.28:0/2126417435 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa3d810c320 0x7fa3d81723f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:09.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.669+0000 7fa3de54a640 1 --2- 10.20.193.28:0/2126417435 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa3d810b930 0x7fa3d80f6140 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:09.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.669+0000 7fa3de54a640 1 -- 10.20.193.28:0/2126417435 >> 10.20.193.28:0/2126417435 conn(0x7fa3d80e9260 msgr2=0x7fa3d810fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:09.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.669+0000 7fa3de54a640 1 -- 10.20.193.28:0/2126417435 shutdown_connections 2026-02-24T09:17:09.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:09.669+0000 7fa3de54a640 1 -- 10.20.193.28:0/2126417435 wait complete. 2026-02-24T09:17:09.769 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:17:09.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:09 trial074 ceph-mon[44412]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:09.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:09 trial074 ceph-mon[44412]: pgmap v185: 97 pgs: 97 active+clean; 581 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 2.0 KiB/s rd, 4.1 KiB/s wr, 15 op/s 2026-02-24T09:17:09.952 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:10.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:09 trial159 ceph-mon[44242]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:10.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:09 trial159 ceph-mon[44242]: pgmap v185: 97 pgs: 97 active+clean; 581 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 2.0 KiB/s rd, 4.1 KiB/s wr, 15 op/s 2026-02-24T09:17:10.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.118+0000 7fe27ebb0640 1 -- 10.20.193.28:0/1863895684 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe27810bcc0 msgr2=0x7fe278110b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:10.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.118+0000 7fe27ebb0640 1 --2- 10.20.193.28:0/1863895684 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe27810bcc0 0x7fe278110b50 secure :-1 s=READY pgs=259 gs=1 cs=0 l=1 c_cookie=5536405477437124007 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe26c009950 tx=0x7fe26c02f190 comp rx=0 tx=0).stop 2026-02-24T09:17:10.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.118+0000 7fe27ebb0640 1 -- 10.20.193.28:0/1863895684 shutdown_connections 2026-02-24T09:17:10.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.118+0000 7fe27ebb0640 1 --2- 10.20.193.28:0/1863895684 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fe2781112e0 0x7fe278111cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:10.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.118+0000 7fe27ebb0640 1 --2- 10.20.193.28:0/1863895684 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe27810bcc0 0x7fe278110b50 unknown :-1 s=CLOSED pgs=259 gs=1 cs=0 l=1 c_cookie=5536405477437124007 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:10.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.118+0000 7fe27ebb0640 1 --2- 10.20.193.28:0/1863895684 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe27810b2d0 0x7fe27810b6a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:10.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.118+0000 7fe27ebb0640 1 -- 10.20.193.28:0/1863895684 >> 10.20.193.28:0/1863895684 conn(0x7fe2780e8e40 msgr2=0x7fe278109250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:10.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.118+0000 7fe27ebb0640 1 -- 10.20.193.28:0/1863895684 shutdown_connections 2026-02-24T09:17:10.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.118+0000 7fe27ebb0640 1 -- 10.20.193.28:0/1863895684 wait complete. 2026-02-24T09:17:10.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.119+0000 7fe27ebb0640 1 Processor -- start 2026-02-24T09:17:10.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.119+0000 7fe27ebb0640 1 -- start start 2026-02-24T09:17:10.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.119+0000 7fe27ebb0640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe27810b2d0 0x7fe2780f12a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:10.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.119+0000 7fe27ebb0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe27810bcc0 0x7fe2780f17e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:10.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.119+0000 7fe27ebb0640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fe2781112e0 0x7fe2780f6bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:10.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.119+0000 7fe27ebb0640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe2780f71d0 con 0x7fe27810bcc0 2026-02-24T09:17:10.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.119+0000 7fe27ebb0640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fe2780f7340 con 0x7fe2781112e0 2026-02-24T09:17:10.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.119+0000 7fe27ebb0640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe2780f7500 con 0x7fe27810b2d0 2026-02-24T09:17:10.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.119+0000 7fe27d3ad640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe27810bcc0 0x7fe2780f17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:10.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.119+0000 7fe27d3ad640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe27810bcc0 0x7fe2780f17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39272/0 (socket says 10.20.193.28:39272) 2026-02-24T09:17:10.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.119+0000 7fe27d3ad640 1 -- 10.20.193.28:0/1998027849 learned_addr learned my addr 10.20.193.28:0/1998027849 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:10.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.120+0000 7fe27e3af640 1 --2- 10.20.193.28:0/1998027849 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fe2781112e0 0x7fe2780f6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:10.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.120+0000 7fe27dbae640 1 --2- 10.20.193.28:0/1998027849 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe27810b2d0 0x7fe2780f12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:10.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.120+0000 7fe27d3ad640 1 -- 10.20.193.28:0/1998027849 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe27810b2d0 msgr2=0x7fe2780f12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:10.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.120+0000 7fe27d3ad640 1 --2- 10.20.193.28:0/1998027849 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe27810b2d0 0x7fe2780f12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:10.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.120+0000 7fe27d3ad640 1 -- 10.20.193.28:0/1998027849 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fe2781112e0 msgr2=0x7fe2780f6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:10.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.120+0000 7fe27d3ad640 1 --2- 10.20.193.28:0/1998027849 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fe2781112e0 0x7fe2780f6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:10.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.120+0000 7fe27d3ad640 1 -- 10.20.193.28:0/1998027849 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe26c009570 con 0x7fe27810bcc0 2026-02-24T09:17:10.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.120+0000 7fe27d3ad640 1 --2- 10.20.193.28:0/1998027849 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe27810bcc0 0x7fe2780f17e0 secure :-1 s=READY pgs=260 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe26c0098a0 tx=0x7fe26c0028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:10.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.120+0000 7fe266ffd640 1 -- 10.20.193.28:0/1998027849 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe26c03d070 con 0x7fe27810bcc0 2026-02-24T09:17:10.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.120+0000 7fe266ffd640 1 -- 10.20.193.28:0/1998027849 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fe26c002a70 con 0x7fe27810bcc0 2026-02-24T09:17:10.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.120+0000 7fe266ffd640 1 -- 10.20.193.28:0/1998027849 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe26c0418c0 con 0x7fe27810bcc0 2026-02-24T09:17:10.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.120+0000 7fe27ebb0640 1 -- 10.20.193.28:0/1998027849 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2780f7780 con 0x7fe27810bcc0 2026-02-24T09:17:10.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.120+0000 7fe27ebb0640 1 -- 10.20.193.28:0/1998027849 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2780f7d20 con 0x7fe27810bcc0 2026-02-24T09:17:10.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.121+0000 7fe27ebb0640 1 -- 10.20.193.28:0/1998027849 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe240005300 con 0x7fe27810bcc0 2026-02-24T09:17:10.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.123+0000 7fe266ffd640 1 -- 10.20.193.28:0/1998027849 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7fe26c041a50 con 0x7fe27810bcc0 2026-02-24T09:17:10.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.125+0000 7fe266ffd640 1 --2- 10.20.193.28:0/1998027849 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe2540b5840 0x7fe2540d5cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:10.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.125+0000 7fe266ffd640 1 -- 10.20.193.28:0/1998027849 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7fe26c10b540 con 0x7fe27810bcc0 2026-02-24T09:17:10.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.125+0000 7fe266ffd640 1 -- 10.20.193.28:0/1998027849 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fe26c10b9c0 con 0x7fe27810bcc0 2026-02-24T09:17:10.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.125+0000 7fe27dbae640 1 --2- 10.20.193.28:0/1998027849 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe2540b5840 0x7fe2540d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:10.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.125+0000 7fe27dbae640 1 --2- 10.20.193.28:0/1998027849 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe2540b5840 0x7fe2540d5cf0 secure :-1 s=READY pgs=148 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe268005970 tx=0x7fe268005900 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:10.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.265+0000 7fe27ebb0640 1 -- 10.20.193.28:0/1998027849 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe240005950 con 0x7fe27810bcc0 2026-02-24T09:17:10.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.266+0000 7fe266ffd640 1 -- 10.20.193.28:0/1998027849 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11901 (secure 0 0 0) 0x7fe26c0cdee0 con 0x7fe27810bcc0 2026-02-24T09:17:10.268 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:17:10.268 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":22,"btime":"2026-02-24T09:17:06:566638+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14856,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/3473030842","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":3473030842},{"type":"v1","addr":"10.20.193.28:6835","nonce":3473030842}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14862,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/4120804601","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":4120804601},{"type":"v1","addr":"10.20.193.28:6837","nonce":4120804601}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14910,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/1354296520","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1354296520},{"type":"v1","addr":"10.20.193.28:6839","nonce":1354296520}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24691,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.159:6833/3049112106","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6832","nonce":3049112106},{"type":"v1","addr":"10.20.193.159:6833","nonce":3049112106}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24710,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.74:6833/1426135976","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6832","nonce":1426135976},{"type":"v1","addr":"10.20.193.74:6833","nonce":1426135976}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24721,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.159:6835/3999384392","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6834","nonce":3999384392},{"type":"v1","addr":"10.20.193.159:6835","nonce":3999384392}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:16:59.889500+0000","modified":"2026-02-24T09:17:05.859296+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24788,"mds_1":24761,"mds_2":24760},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24727":{"gid":24727,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.159:6837/2059577520","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6836","nonce":2059577520},{"type":"v1","addr":"10.20.193.159:6837","nonce":2059577520}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24734":{"gid":24734,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.74:6835/2067708838","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6834","nonce":2067708838},{"type":"v1","addr":"10.20.193.74:6835","nonce":2067708838}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24745":{"gid":24745,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.159:6839/533862317","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6838","nonce":533862317},{"type":"v1","addr":"10.20.193.159:6839","nonce":533862317}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24760":{"gid":24760,"name":"a","rank":2,"incarnation":20,"state":"up:active","state_seq":5,"addr":"10.20.193.28:6841/492586680","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":492586680},{"type":"v1","addr":"10.20.193.28:6841","nonce":492586680}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24761":{"gid":24761,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"10.20.193.74:6837/958749351","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6836","nonce":958749351},{"type":"v1","addr":"10.20.193.74:6837","nonce":958749351}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24788":{"gid":24788,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"10.20.193.74:6839/828566790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6838","nonce":828566790},{"type":"v1","addr":"10.20.193.74:6839","nonce":828566790}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24788,"qdb_cluster":[24788,24761,24760]},"id":1}]} 2026-02-24T09:17:10.268 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 22 2026-02-24T09:17:10.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.267+0000 7fe27ebb0640 1 -- 10.20.193.28:0/1998027849 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe2540b5840 msgr2=0x7fe2540d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:10.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.267+0000 7fe27ebb0640 1 --2- 10.20.193.28:0/1998027849 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe2540b5840 0x7fe2540d5cf0 secure :-1 s=READY pgs=148 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe268005970 tx=0x7fe268005900 comp rx=0 tx=0).stop 2026-02-24T09:17:10.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.267+0000 7fe27ebb0640 1 -- 10.20.193.28:0/1998027849 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe27810bcc0 msgr2=0x7fe2780f17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:10.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.267+0000 7fe27ebb0640 1 --2- 10.20.193.28:0/1998027849 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe27810bcc0 0x7fe2780f17e0 secure :-1 s=READY pgs=260 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe26c0098a0 tx=0x7fe26c0028d0 comp rx=0 tx=0).stop 2026-02-24T09:17:10.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.267+0000 7fe27ebb0640 1 -- 10.20.193.28:0/1998027849 shutdown_connections 2026-02-24T09:17:10.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.267+0000 7fe27ebb0640 1 --2- 10.20.193.28:0/1998027849 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe2540b5840 0x7fe2540d5cf0 unknown :-1 s=CLOSED pgs=148 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:10.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.267+0000 7fe27ebb0640 1 --2- 10.20.193.28:0/1998027849 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fe2781112e0 0x7fe2780f6bb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:10.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.267+0000 7fe27ebb0640 1 --2- 10.20.193.28:0/1998027849 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe27810bcc0 0x7fe2780f17e0 unknown :-1 s=CLOSED pgs=260 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:10.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.267+0000 7fe27ebb0640 1 --2- 10.20.193.28:0/1998027849 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe27810b2d0 0x7fe2780f12a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:10.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.267+0000 7fe27ebb0640 1 -- 10.20.193.28:0/1998027849 >> 10.20.193.28:0/1998027849 conn(0x7fe2780e8e40 msgr2=0x7fe27810f150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:10.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.267+0000 7fe27ebb0640 1 -- 10.20.193.28:0/1998027849 shutdown_connections 2026-02-24T09:17:10.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.267+0000 7fe27ebb0640 1 -- 10.20.193.28:0/1998027849 wait complete. 2026-02-24T09:17:10.367 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T09:17:10.373 INFO:journalctl@ceph.mds.b.trial074.stdout:Feb 24 09:17:09 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-b[97806]: 2026-02-24T09:17:09.905+0000 7f3cad24b640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2026-02-24T09:17:10.550 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:10.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.721+0000 7f90ef9e0640 1 -- 10.20.193.28:0/1435552805 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90e81100b0 msgr2=0x7f90e8115100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:10.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.721+0000 7f90ef9e0640 1 --2- 10.20.193.28:0/1435552805 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90e81100b0 0x7f90e8115100 secure :-1 s=READY pgs=261 gs=1 cs=0 l=1 c_cookie=1371967300840824987 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90dc009950 tx=0x7f90dc02f190 comp rx=0 tx=0).stop 2026-02-24T09:17:10.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.722+0000 7f90ef9e0640 1 -- 10.20.193.28:0/1435552805 shutdown_connections 2026-02-24T09:17:10.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.722+0000 7f90ef9e0640 1 --2- 10.20.193.28:0/1435552805 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f90e81158b0 0x7f90e8176280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:10.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.722+0000 7f90ef9e0640 1 --2- 10.20.193.28:0/1435552805 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90e81100b0 0x7f90e8115100 unknown :-1 s=CLOSED pgs=261 gs=1 cs=0 l=1 c_cookie=1371967300840824987 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:10.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.722+0000 7f90ef9e0640 1 --2- 10.20.193.28:0/1435552805 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f90e810f6c0 0x7f90e810fa90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:10.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.722+0000 7f90ef9e0640 1 -- 10.20.193.28:0/1435552805 >> 10.20.193.28:0/1435552805 conn(0x7f90e80ecfd0 msgr2=0x7f90e810d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:10.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.722+0000 7f90ef9e0640 1 -- 10.20.193.28:0/1435552805 shutdown_connections 2026-02-24T09:17:10.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.722+0000 7f90ef9e0640 1 -- 10.20.193.28:0/1435552805 wait complete. 2026-02-24T09:17:10.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.722+0000 7f90ef9e0640 1 Processor -- start 2026-02-24T09:17:10.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.722+0000 7f90ef9e0640 1 -- start start 2026-02-24T09:17:10.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.723+0000 7f90ef9e0640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f90e810f6c0 0x7f90e80f5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:10.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.723+0000 7f90ef9e0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90e81100b0 0x7f90e8176180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:10.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.723+0000 7f90ef9e0640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f90e81158b0 0x7f90e80f6320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:10.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.723+0000 7f90ef9e0640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f90e80fb490 con 0x7f90e81100b0 2026-02-24T09:17:10.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.723+0000 7f90ef9e0640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f90e80fb600 con 0x7f90e810f6c0 2026-02-24T09:17:10.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.723+0000 7f90ef9e0640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f90e80fb7c0 con 0x7f90e81158b0 2026-02-24T09:17:10.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.723+0000 7f90edf56640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f90e81158b0 0x7f90e80f6320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:10.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.723+0000 7f90ed755640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f90e810f6c0 0x7f90e80f5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:10.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.723+0000 7f90edf56640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f90e81158b0 0x7f90e80f6320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:38872/0 (socket says 10.20.193.28:38872) 2026-02-24T09:17:10.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.723+0000 7f90edf56640 1 -- 10.20.193.28:0/469656514 learned_addr learned my addr 10.20.193.28:0/469656514 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:10.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.723+0000 7f90ecf54640 1 --2- 10.20.193.28:0/469656514 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90e81100b0 0x7f90e8176180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:10.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.724+0000 7f90ecf54640 1 -- 10.20.193.28:0/469656514 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f90e81158b0 msgr2=0x7f90e80f6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:10.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.724+0000 7f90ecf54640 1 --2- 10.20.193.28:0/469656514 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f90e81158b0 0x7f90e80f6320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:10.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.724+0000 7f90ecf54640 1 -- 10.20.193.28:0/469656514 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f90e810f6c0 msgr2=0x7f90e80f5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:10.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.724+0000 7f90ecf54640 1 --2- 10.20.193.28:0/469656514 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f90e810f6c0 0x7f90e80f5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:10.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.724+0000 7f90ecf54640 1 -- 10.20.193.28:0/469656514 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90dc009570 con 0x7f90e81100b0 2026-02-24T09:17:10.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.724+0000 7f90ecf54640 1 --2- 10.20.193.28:0/469656514 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90e81100b0 0x7f90e8176180 secure :-1 s=READY pgs=262 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90dc009950 tx=0x7f90dc0026a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:10.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.724+0000 7f90d67fc640 1 -- 10.20.193.28:0/469656514 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f90dc03d070 con 0x7f90e81100b0 2026-02-24T09:17:10.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.724+0000 7f90d67fc640 1 -- 10.20.193.28:0/469656514 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f90dc02fc10 con 0x7f90e81100b0 2026-02-24T09:17:10.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.724+0000 7f90ef9e0640 1 -- 10.20.193.28:0/469656514 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90e80fba40 con 0x7f90e81100b0 2026-02-24T09:17:10.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.724+0000 7f90d67fc640 1 -- 10.20.193.28:0/469656514 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f90dc0418a0 con 0x7f90e81100b0 2026-02-24T09:17:10.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.724+0000 7f90ef9e0640 1 -- 10.20.193.28:0/469656514 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90e80fbf00 con 0x7f90e81100b0 2026-02-24T09:17:10.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.725+0000 7f90ef9e0640 1 -- 10.20.193.28:0/469656514 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90e81109a0 con 0x7f90e81100b0 2026-02-24T09:17:10.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.727+0000 7f90d67fc640 1 -- 10.20.193.28:0/469656514 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f90dc041a70 con 0x7f90e81100b0 2026-02-24T09:17:10.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.729+0000 7f90d67fc640 1 --2- 10.20.193.28:0/469656514 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f90c40b5830 0x7f90c40d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:10.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.729+0000 7f90d67fc640 1 -- 10.20.193.28:0/469656514 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f90dc10b600 con 0x7f90e81100b0 2026-02-24T09:17:10.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.729+0000 7f90d67fc640 1 -- 10.20.193.28:0/469656514 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f90dc10ba80 con 0x7f90e81100b0 2026-02-24T09:17:10.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.729+0000 7f90ed755640 1 --2- 10.20.193.28:0/469656514 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f90c40b5830 0x7f90c40d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:10.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.729+0000 7f90ed755640 1 --2- 10.20.193.28:0/469656514 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f90c40b5830 0x7f90c40d5ce0 secure :-1 s=READY pgs=149 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90d8004740 tx=0x7f90d8009190 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:10.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.843+0000 7f90ef9e0640 1 -- 10.20.193.28:0/469656514 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f90e80f6ce0 con 0x7f90e81100b0 2026-02-24T09:17:10.845 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:10 trial028 ceph-mon[40371]: from='client.24890 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:10.845 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:10 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/1998027849' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:17:10.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.844+0000 7f90d67fc640 1 -- 10.20.193.28:0/469656514 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+22632 (secure 0 0 0) 0x7f90dc0ce050 con 0x7f90e81100b0 2026-02-24T09:17:10.846 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:17:10.846 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":92,"fsid":"e9ad50af-1160-11f1-800e-d404e6e7d460","created":"2026-02-24T09:12:33.966733+0000","modified":"2026-02-24T09:17:01.228853+0000","last_up_change":"2026-02-24T09:16:34.222008+0000","last_in_change":"2026-02-24T09:16:20.530109+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":38,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T09:14:33.468078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-24T09:16:57.259549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-24T09:16:58.835796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7836f68-f25a-4aea-830a-3c2ce8ac79e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6803","nonce":2124354447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6805","nonce":2124354447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6809","nonce":2124354447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6807","nonce":2124354447}]},"public_addr":"10.20.193.28:6803/2124354447","cluster_addr":"10.20.193.28:6805/2124354447","heartbeat_back_addr":"10.20.193.28:6809/2124354447","heartbeat_front_addr":"10.20.193.28:6807/2124354447","state":["exists","up"]},{"osd":1,"uuid":"04273ff8-91e3-4e70-8041-cc8c205b9a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6800","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6801","nonce":267363486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6802","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6803","nonce":267363486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6806","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6807","nonce":267363486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6804","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6805","nonce":267363486}]},"public_addr":"10.20.193.74:6801/267363486","cluster_addr":"10.20.193.74:6803/267363486","heartbeat_back_addr":"10.20.193.74:6807/267363486","heartbeat_front_addr":"10.20.193.74:6805/267363486","state":["exists","up"]},{"osd":2,"uuid":"dea96db1-588b-4d08-8e52-52c4c995bdc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6800","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6801","nonce":3320466721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6802","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6803","nonce":3320466721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6806","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6807","nonce":3320466721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6804","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6805","nonce":3320466721}]},"public_addr":"10.20.193.159:6801/3320466721","cluster_addr":"10.20.193.159:6803/3320466721","heartbeat_back_addr":"10.20.193.159:6807/3320466721","heartbeat_front_addr":"10.20.193.159:6805/3320466721","state":["exists","up"]},{"osd":3,"uuid":"c785c244-eb3f-4af5-83c6-cd492459f75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6811","nonce":1790609615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6813","nonce":1790609615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6817","nonce":1790609615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6815","nonce":1790609615}]},"public_addr":"10.20.193.28:6811/1790609615","cluster_addr":"10.20.193.28:6813/1790609615","heartbeat_back_addr":"10.20.193.28:6817/1790609615","heartbeat_front_addr":"10.20.193.28:6815/1790609615","state":["exists","up"]},{"osd":4,"uuid":"041239c2-6187-4154-9557-b1b5846f9e0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6808","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6809","nonce":610990618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6810","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6811","nonce":610990618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6814","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6815","nonce":610990618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6812","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6813","nonce":610990618}]},"public_addr":"10.20.193.74:6809/610990618","cluster_addr":"10.20.193.74:6811/610990618","heartbeat_back_addr":"10.20.193.74:6815/610990618","heartbeat_front_addr":"10.20.193.74:6813/610990618","state":["exists","up"]},{"osd":5,"uuid":"ffeeb021-0924-4421-aecf-bac2e74364a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6808","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6809","nonce":1653417923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6810","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6811","nonce":1653417923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6814","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6815","nonce":1653417923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6812","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6813","nonce":1653417923}]},"public_addr":"10.20.193.159:6809/1653417923","cluster_addr":"10.20.193.159:6811/1653417923","heartbeat_back_addr":"10.20.193.159:6815/1653417923","heartbeat_front_addr":"10.20.193.159:6813/1653417923","state":["exists","up"]},{"osd":6,"uuid":"f3736156-4951-4901-9323-7930fb73b8dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6819","nonce":1891043856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6821","nonce":1891043856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6825","nonce":1891043856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6823","nonce":1891043856}]},"public_addr":"10.20.193.28:6819/1891043856","cluster_addr":"10.20.193.28:6821/1891043856","heartbeat_back_addr":"10.20.193.28:6825/1891043856","heartbeat_front_addr":"10.20.193.28:6823/1891043856","state":["exists","up"]},{"osd":7,"uuid":"214b27ee-75f9-4a54-a59b-e8bfbb895903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6816","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6817","nonce":2328869739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6818","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6819","nonce":2328869739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6822","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6823","nonce":2328869739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6820","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6821","nonce":2328869739}]},"public_addr":"10.20.193.74:6817/2328869739","cluster_addr":"10.20.193.74:6819/2328869739","heartbeat_back_addr":"10.20.193.74:6823/2328869739","heartbeat_front_addr":"10.20.193.74:6821/2328869739","state":["exists","up"]},{"osd":8,"uuid":"76599c26-6778-4fa2-b85d-feea8baac7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6816","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6817","nonce":3877834753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6818","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6819","nonce":3877834753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6822","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6823","nonce":3877834753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6820","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6821","nonce":3877834753}]},"public_addr":"10.20.193.159:6817/3877834753","cluster_addr":"10.20.193.159:6819/3877834753","heartbeat_back_addr":"10.20.193.159:6823/3877834753","heartbeat_front_addr":"10.20.193.159:6821/3877834753","state":["exists","up"]},{"osd":9,"uuid":"52b52b35-2d65-4e53-b7d8-fd7385d5ae88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6827","nonce":4207785690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6829","nonce":4207785690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6833","nonce":4207785690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6831","nonce":4207785690}]},"public_addr":"10.20.193.28:6827/4207785690","cluster_addr":"10.20.193.28:6829/4207785690","heartbeat_back_addr":"10.20.193.28:6833/4207785690","heartbeat_front_addr":"10.20.193.28:6831/4207785690","state":["exists","up"]},{"osd":10,"uuid":"65c8e576-a1c7-4c03-bbf6-57c775f2860f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6824","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6825","nonce":2590408209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6826","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6827","nonce":2590408209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6830","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6831","nonce":2590408209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6828","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6829","nonce":2590408209}]},"public_addr":"10.20.193.74:6825/2590408209","cluster_addr":"10.20.193.74:6827/2590408209","heartbeat_back_addr":"10.20.193.74:6831/2590408209","heartbeat_front_addr":"10.20.193.74:6829/2590408209","state":["exists","up"]},{"osd":11,"uuid":"e2305377-fadb-4cf0-8384-87387f116255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":87,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6824","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6825","nonce":709820718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6826","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6827","nonce":709820718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6830","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6831","nonce":709820718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6828","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6829","nonce":709820718}]},"public_addr":"10.20.193.159:6825/709820718","cluster_addr":"10.20.193.159:6827/709820718","heartbeat_back_addr":"10.20.193.159:6831/709820718","heartbeat_front_addr":"10.20.193.159:6829/709820718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:02.414561+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:16.784172+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:30.639920+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:44.510387+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:58.186053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:11.714819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:25.188981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:38.602303+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:51.899864+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:16:05.444224+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:16:18.900719+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:16:32.290361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:0/3696280830":"2026-02-25T09:13:39.242729+0000","10.20.193.28:6801/3539300247":"2026-02-25T09:13:39.242729+0000","10.20.193.28:0/3799405177":"2026-02-25T09:12:46.171932+0000","10.20.193.28:0/1189576634":"2026-02-25T09:12:46.171932+0000","10.20.193.28:6800/1682009277":"2026-02-25T09:12:46.171932+0000","10.20.193.28:6800/3539300247":"2026-02-25T09:13:39.242729+0000","10.20.193.28:6801/1682009277":"2026-02-25T09:12:46.171932+0000","10.20.193.28:0/673213915":"2026-02-25T09:12:59.028609+0000","10.20.193.28:0/857248143":"2026-02-25T09:13:39.242729+0000","10.20.193.28:0/1541006046":"2026-02-25T09:12:46.171932+0000","10.20.193.28:0/264576041":"2026-02-25T09:12:59.028609+0000","10.20.193.28:6800/2303472235":"2026-02-25T09:12:59.028609+0000","10.20.193.28:6801/2303472235":"2026-02-25T09:12:59.028609+0000","10.20.193.28:0/2622827224":"2026-02-25T09:12:59.028609+0000","10.20.193.28:0/3614117448":"2026-02-25T09:13:39.242729+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T09:17:10.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.845+0000 7f90ef9e0640 1 -- 10.20.193.28:0/469656514 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f90c40b5830 msgr2=0x7f90c40d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:10.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.845+0000 7f90ef9e0640 1 --2- 10.20.193.28:0/469656514 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f90c40b5830 0x7f90c40d5ce0 secure :-1 s=READY pgs=149 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90d8004740 tx=0x7f90d8009190 comp rx=0 tx=0).stop 2026-02-24T09:17:10.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.845+0000 7f90ef9e0640 1 -- 10.20.193.28:0/469656514 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90e81100b0 msgr2=0x7f90e8176180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:10.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.845+0000 7f90ef9e0640 1 --2- 10.20.193.28:0/469656514 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90e81100b0 0x7f90e8176180 secure :-1 s=READY pgs=262 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90dc009950 tx=0x7f90dc0026a0 comp rx=0 tx=0).stop 2026-02-24T09:17:10.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.845+0000 7f90ef9e0640 1 -- 10.20.193.28:0/469656514 shutdown_connections 2026-02-24T09:17:10.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.845+0000 7f90ef9e0640 1 --2- 10.20.193.28:0/469656514 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f90c40b5830 0x7f90c40d5ce0 unknown :-1 s=CLOSED pgs=149 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:10.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.845+0000 7f90ef9e0640 1 --2- 10.20.193.28:0/469656514 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f90e81158b0 0x7f90e80f6320 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:10.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.845+0000 7f90ef9e0640 1 --2- 10.20.193.28:0/469656514 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90e81100b0 0x7f90e8176180 unknown :-1 s=CLOSED pgs=262 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:10.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.845+0000 7f90ef9e0640 1 --2- 10.20.193.28:0/469656514 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f90e810f6c0 0x7f90e80f5c20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:10.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.845+0000 7f90ef9e0640 1 -- 10.20.193.28:0/469656514 >> 10.20.193.28:0/469656514 conn(0x7f90e80ecfd0 msgr2=0x7f90e8112f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:10.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.845+0000 7f90ef9e0640 1 -- 10.20.193.28:0/469656514 shutdown_connections 2026-02-24T09:17:10.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:10.845+0000 7f90ef9e0640 1 -- 10.20.193.28:0/469656514 wait complete. 2026-02-24T09:17:10.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:10 trial074 ceph-mon[44412]: from='client.24890 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:10.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:10 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/1998027849' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:17:10.949 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-24T09:17:10.949 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T09:17:11.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:10 trial159 ceph-mon[44242]: from='client.24890 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:11.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:10 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/1998027849' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:17:11.132 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:11.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.310+0000 7fde78b99640 1 -- 10.20.193.28:0/1837428773 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde741100b0 msgr2=0x7fde74115100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:11.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.310+0000 7fde78b99640 1 --2- 10.20.193.28:0/1837428773 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde741100b0 0x7fde74115100 secure :-1 s=READY pgs=263 gs=1 cs=0 l=1 c_cookie=62364149751607148 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde5c009950 tx=0x7fde5c02f190 comp rx=0 tx=0).stop 2026-02-24T09:17:11.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.311+0000 7fde78b99640 1 -- 10.20.193.28:0/1837428773 shutdown_connections 2026-02-24T09:17:11.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.311+0000 7fde78b99640 1 --2- 10.20.193.28:0/1837428773 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fde741158b0 0x7fde74176280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:11.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.311+0000 7fde78b99640 1 --2- 10.20.193.28:0/1837428773 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde741100b0 0x7fde74115100 unknown :-1 s=CLOSED pgs=263 gs=1 cs=0 l=1 c_cookie=62364149751607148 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:11.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.311+0000 7fde78b99640 1 --2- 10.20.193.28:0/1837428773 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fde7410f6c0 0x7fde7410fa90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:11.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.311+0000 7fde78b99640 1 -- 10.20.193.28:0/1837428773 >> 10.20.193.28:0/1837428773 conn(0x7fde740ecfd0 msgr2=0x7fde7410d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:11.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.311+0000 7fde78b99640 1 -- 10.20.193.28:0/1837428773 shutdown_connections 2026-02-24T09:17:11.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.311+0000 7fde78b99640 1 -- 10.20.193.28:0/1837428773 wait complete. 2026-02-24T09:17:11.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.311+0000 7fde78b99640 1 Processor -- start 2026-02-24T09:17:11.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.311+0000 7fde78b99640 1 -- start start 2026-02-24T09:17:11.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.312+0000 7fde78b99640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fde7410f6c0 0x7fde740f5a50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:11.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.312+0000 7fde78b99640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fde741100b0 0x7fde74176180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:11.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.312+0000 7fde78b99640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde741158b0 0x7fde740f6150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:11.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.312+0000 7fde78b99640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fde740fb360 con 0x7fde741158b0 2026-02-24T09:17:11.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.312+0000 7fde78b99640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fde740fb4d0 con 0x7fde7410f6c0 2026-02-24T09:17:11.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.312+0000 7fde78b99640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fde740fb690 con 0x7fde741100b0 2026-02-24T09:17:11.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.312+0000 7fde72d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde741158b0 0x7fde740f6150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:11.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.312+0000 7fde72d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde741158b0 0x7fde740f6150 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39320/0 (socket says 10.20.193.28:39320) 2026-02-24T09:17:11.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.312+0000 7fde72d76640 1 -- 10.20.193.28:0/4024600103 learned_addr learned my addr 10.20.193.28:0/4024600103 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:11.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.312+0000 7fde72575640 1 --2- 10.20.193.28:0/4024600103 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fde7410f6c0 0x7fde740f5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:11.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.312+0000 7fde71d74640 1 --2- 10.20.193.28:0/4024600103 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fde741100b0 0x7fde74176180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:11.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.312+0000 7fde72d76640 1 -- 10.20.193.28:0/4024600103 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fde741100b0 msgr2=0x7fde74176180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:11.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.312+0000 7fde72d76640 1 --2- 10.20.193.28:0/4024600103 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fde741100b0 0x7fde74176180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:11.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.312+0000 7fde72d76640 1 -- 10.20.193.28:0/4024600103 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fde7410f6c0 msgr2=0x7fde740f5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:11.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.312+0000 7fde72d76640 1 --2- 10.20.193.28:0/4024600103 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fde7410f6c0 0x7fde740f5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:11.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.312+0000 7fde72d76640 1 -- 10.20.193.28:0/4024600103 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde5c009570 con 0x7fde741158b0 2026-02-24T09:17:11.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.312+0000 7fde72d76640 1 --2- 10.20.193.28:0/4024600103 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde741158b0 0x7fde740f6150 secure :-1 s=READY pgs=264 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde64006e90 tx=0x7fde6400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:11.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.312+0000 7fde5b7fe640 1 -- 10.20.193.28:0/4024600103 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fde64005500 con 0x7fde741158b0 2026-02-24T09:17:11.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.312+0000 7fde5b7fe640 1 -- 10.20.193.28:0/4024600103 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fde64005df0 con 0x7fde741158b0 2026-02-24T09:17:11.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.312+0000 7fde5b7fe640 1 -- 10.20.193.28:0/4024600103 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fde64003a00 con 0x7fde741158b0 2026-02-24T09:17:11.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.312+0000 7fde78b99640 1 -- 10.20.193.28:0/4024600103 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde740fb970 con 0x7fde741158b0 2026-02-24T09:17:11.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.312+0000 7fde78b99640 1 -- 10.20.193.28:0/4024600103 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde740fbdf0 con 0x7fde741158b0 2026-02-24T09:17:11.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.313+0000 7fde78b99640 1 -- 10.20.193.28:0/4024600103 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde38005300 con 0x7fde741158b0 2026-02-24T09:17:11.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.315+0000 7fde5b7fe640 1 -- 10.20.193.28:0/4024600103 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7fde64003b60 con 0x7fde741158b0 2026-02-24T09:17:11.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.316+0000 7fde5b7fe640 1 --2- 10.20.193.28:0/4024600103 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fde4c0b5840 0x7fde4c0d5cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:11.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.317+0000 7fde5b7fe640 1 -- 10.20.193.28:0/4024600103 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7fde640e7990 con 0x7fde741158b0 2026-02-24T09:17:11.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.317+0000 7fde72575640 1 --2- 10.20.193.28:0/4024600103 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fde4c0b5840 0x7fde4c0d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:11.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.317+0000 7fde72575640 1 --2- 10.20.193.28:0/4024600103 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fde4c0b5840 0x7fde4c0d5cf0 secure :-1 s=READY pgs=150 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde68005fd0 tx=0x7fde6800a560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:11.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.317+0000 7fde5b7fe640 1 -- 10.20.193.28:0/4024600103 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fde640aa260 con 0x7fde741158b0 2026-02-24T09:17:11.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.429+0000 7fde78b99640 1 -- 10.20.193.28:0/4024600103 --> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fde38002bb0 con 0x7fde4c0b5840 2026-02-24T09:17:11.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.433+0000 7fde5b7fe640 1 -- 10.20.193.28:0/4024600103 <== mgr.14223 v2:10.20.193.28:6800/906910473 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258954 (secure 0 0 0) 0x7fde38002bb0 con 0x7fde4c0b5840 2026-02-24T09:17:11.439 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:17:11.442 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-24T09:17:11.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.436+0000 7fde78b99640 1 -- 10.20.193.28:0/4024600103 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fde4c0b5840 msgr2=0x7fde4c0d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:11.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.436+0000 7fde78b99640 1 --2- 10.20.193.28:0/4024600103 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fde4c0b5840 0x7fde4c0d5cf0 secure :-1 s=READY pgs=150 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde68005fd0 tx=0x7fde6800a560 comp rx=0 tx=0).stop 2026-02-24T09:17:11.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.436+0000 7fde78b99640 1 -- 10.20.193.28:0/4024600103 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde741158b0 msgr2=0x7fde740f6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:11.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.436+0000 7fde78b99640 1 --2- 10.20.193.28:0/4024600103 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde741158b0 0x7fde740f6150 secure :-1 s=READY pgs=264 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde64006e90 tx=0x7fde6400edf0 comp rx=0 tx=0).stop 2026-02-24T09:17:11.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.436+0000 7fde78b99640 1 -- 10.20.193.28:0/4024600103 shutdown_connections 2026-02-24T09:17:11.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.436+0000 7fde78b99640 1 --2- 10.20.193.28:0/4024600103 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fde4c0b5840 0x7fde4c0d5cf0 unknown :-1 s=CLOSED pgs=150 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:11.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.436+0000 7fde78b99640 1 --2- 10.20.193.28:0/4024600103 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde741158b0 0x7fde740f6150 unknown :-1 s=CLOSED pgs=264 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:11.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.436+0000 7fde78b99640 1 --2- 10.20.193.28:0/4024600103 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fde741100b0 0x7fde74176180 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:11.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.436+0000 7fde78b99640 1 --2- 10.20.193.28:0/4024600103 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fde7410f6c0 0x7fde740f5a50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:11.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.436+0000 7fde78b99640 1 -- 10.20.193.28:0/4024600103 >> 10.20.193.28:0/4024600103 conn(0x7fde740ecfd0 msgr2=0x7fde74111ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:11.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.436+0000 7fde78b99640 1 -- 10.20.193.28:0/4024600103 shutdown_connections 2026-02-24T09:17:11.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.436+0000 7fde78b99640 1 -- 10.20.193.28:0/4024600103 wait complete. 2026-02-24T09:17:11.536 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2026-02-24T09:17:11.272688+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":648166,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":165,"num_read_kb":186,"num_write":332,"num_write_kb":3817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":279,"ondisk_log_size":279,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":338672,"kb_used_data":12032,"kb_used_omap":435,"kb_used_meta":325964,"kb_avail":8807699728,"statfs":{"total":9019431321600,"available":9019084521472,"internally_reserved":0,"allocated":12320768,"data_stored":7768796,"data_compressed":113508,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":445756,"internal_metadata":333787844},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":56176,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":51,"num_read_kb":87,"num_write":137,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.041983"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376724+0000","last_change":"2026-02-24T09:17:00.245387+0000","last_active":"2026-02-24T09:17:01.376724+0000","last_peered":"2026-02-24T09:17:01.376724+0000","last_clean":"2026-02-24T09:17:01.376724+0000","last_became_active":"2026-02-24T09:17:00.244938+0000","last_became_peered":"2026-02-24T09:17:00.244938+0000","last_unstale":"2026-02-24T09:17:01.376724+0000","last_undegraded":"2026-02-24T09:17:01.376724+0000","last_fullsized":"2026-02-24T09:17:01.376724+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:35:29.390820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376072+0000","last_change":"2026-02-24T09:17:00.236200+0000","last_active":"2026-02-24T09:17:01.376072+0000","last_peered":"2026-02-24T09:17:01.376072+0000","last_clean":"2026-02-24T09:17:01.376072+0000","last_became_active":"2026-02-24T09:17:00.236029+0000","last_became_peered":"2026-02-24T09:17:00.236029+0000","last_unstale":"2026-02-24T09:17:01.376072+0000","last_undegraded":"2026-02-24T09:17:01.376072+0000","last_fullsized":"2026-02-24T09:17:01.376072+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:06:22.417660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376003+0000","last_change":"2026-02-24T09:17:00.241494+0000","last_active":"2026-02-24T09:17:01.376003+0000","last_peered":"2026-02-24T09:17:01.376003+0000","last_clean":"2026-02-24T09:17:01.376003+0000","last_became_active":"2026-02-24T09:17:00.241220+0000","last_became_peered":"2026-02-24T09:17:00.241220+0000","last_unstale":"2026-02-24T09:17:01.376003+0000","last_undegraded":"2026-02-24T09:17:01.376003+0000","last_fullsized":"2026-02-24T09:17:01.376003+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:34:35.363256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375459+0000","last_change":"2026-02-24T09:17:00.245544+0000","last_active":"2026-02-24T09:17:01.375459+0000","last_peered":"2026-02-24T09:17:01.375459+0000","last_clean":"2026-02-24T09:17:01.375459+0000","last_became_active":"2026-02-24T09:17:00.245316+0000","last_became_peered":"2026-02-24T09:17:00.245316+0000","last_unstale":"2026-02-24T09:17:01.375459+0000","last_undegraded":"2026-02-24T09:17:01.375459+0000","last_fullsized":"2026-02-24T09:17:01.375459+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:44:07.848623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376966+0000","last_change":"2026-02-24T09:17:00.242163+0000","last_active":"2026-02-24T09:17:01.376966+0000","last_peered":"2026-02-24T09:17:01.376966+0000","last_clean":"2026-02-24T09:17:01.376966+0000","last_became_active":"2026-02-24T09:17:00.240475+0000","last_became_peered":"2026-02-24T09:17:00.240475+0000","last_unstale":"2026-02-24T09:17:01.376966+0000","last_undegraded":"2026-02-24T09:17:01.376966+0000","last_fullsized":"2026-02-24T09:17:01.376966+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:08:01.801955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231522+0000","last_change":"2026-02-24T09:17:00.239730+0000","last_active":"2026-02-24T09:17:01.231522+0000","last_peered":"2026-02-24T09:17:01.231522+0000","last_clean":"2026-02-24T09:17:01.231522+0000","last_became_active":"2026-02-24T09:17:00.239571+0000","last_became_peered":"2026-02-24T09:17:00.239571+0000","last_unstale":"2026-02-24T09:17:01.231522+0000","last_undegraded":"2026-02-24T09:17:01.231522+0000","last_fullsized":"2026-02-24T09:17:01.231522+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:44:51.158834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.609629+0000","last_change":"2026-02-24T09:17:00.246826+0000","last_active":"2026-02-24T09:17:01.609629+0000","last_peered":"2026-02-24T09:17:01.609629+0000","last_clean":"2026-02-24T09:17:01.609629+0000","last_became_active":"2026-02-24T09:17:00.246078+0000","last_became_peered":"2026-02-24T09:17:00.246078+0000","last_unstale":"2026-02-24T09:17:01.609629+0000","last_undegraded":"2026-02-24T09:17:01.609629+0000","last_fullsized":"2026-02-24T09:17:01.609629+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:01:08.591060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231860+0000","last_change":"2026-02-24T09:17:00.242859+0000","last_active":"2026-02-24T09:17:01.231860+0000","last_peered":"2026-02-24T09:17:01.231860+0000","last_clean":"2026-02-24T09:17:01.231860+0000","last_became_active":"2026-02-24T09:17:00.242754+0000","last_became_peered":"2026-02-24T09:17:00.242754+0000","last_unstale":"2026-02-24T09:17:01.231860+0000","last_undegraded":"2026-02-24T09:17:01.231860+0000","last_fullsized":"2026-02-24T09:17:01.231860+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:12:54.422166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376465+0000","last_change":"2026-02-24T09:17:00.243145+0000","last_active":"2026-02-24T09:17:01.376465+0000","last_peered":"2026-02-24T09:17:01.376465+0000","last_clean":"2026-02-24T09:17:01.376465+0000","last_became_active":"2026-02-24T09:17:00.242545+0000","last_became_peered":"2026-02-24T09:17:00.242545+0000","last_unstale":"2026-02-24T09:17:01.376465+0000","last_undegraded":"2026-02-24T09:17:01.376465+0000","last_fullsized":"2026-02-24T09:17:01.376465+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:57:48.262867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232059+0000","last_change":"2026-02-24T09:17:00.238410+0000","last_active":"2026-02-24T09:17:01.232059+0000","last_peered":"2026-02-24T09:17:01.232059+0000","last_clean":"2026-02-24T09:17:01.232059+0000","last_became_active":"2026-02-24T09:17:00.238208+0000","last_became_peered":"2026-02-24T09:17:00.238208+0000","last_unstale":"2026-02-24T09:17:01.232059+0000","last_undegraded":"2026-02-24T09:17:01.232059+0000","last_fullsized":"2026-02-24T09:17:01.232059+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:24:40.244153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.609971+0000","last_change":"2026-02-24T09:17:00.240756+0000","last_active":"2026-02-24T09:17:01.609971+0000","last_peered":"2026-02-24T09:17:01.609971+0000","last_clean":"2026-02-24T09:17:01.609971+0000","last_became_active":"2026-02-24T09:17:00.240549+0000","last_became_peered":"2026-02-24T09:17:00.240549+0000","last_unstale":"2026-02-24T09:17:01.609971+0000","last_undegraded":"2026-02-24T09:17:01.609971+0000","last_fullsized":"2026-02-24T09:17:01.609971+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:22:59.840951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375576+0000","last_change":"2026-02-24T09:17:00.244972+0000","last_active":"2026-02-24T09:17:01.375576+0000","last_peered":"2026-02-24T09:17:01.375576+0000","last_clean":"2026-02-24T09:17:01.375576+0000","last_became_active":"2026-02-24T09:17:00.244802+0000","last_became_peered":"2026-02-24T09:17:00.244802+0000","last_unstale":"2026-02-24T09:17:01.375576+0000","last_undegraded":"2026-02-24T09:17:01.375576+0000","last_fullsized":"2026-02-24T09:17:01.375576+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:23:42.961356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232520+0000","last_change":"2026-02-24T09:17:00.242225+0000","last_active":"2026-02-24T09:17:01.232520+0000","last_peered":"2026-02-24T09:17:01.232520+0000","last_clean":"2026-02-24T09:17:01.232520+0000","last_became_active":"2026-02-24T09:17:00.242034+0000","last_became_peered":"2026-02-24T09:17:00.242034+0000","last_unstale":"2026-02-24T09:17:01.232520+0000","last_undegraded":"2026-02-24T09:17:01.232520+0000","last_fullsized":"2026-02-24T09:17:01.232520+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:48:52.291960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375757+0000","last_change":"2026-02-24T09:17:00.236623+0000","last_active":"2026-02-24T09:17:01.375757+0000","last_peered":"2026-02-24T09:17:01.375757+0000","last_clean":"2026-02-24T09:17:01.375757+0000","last_became_active":"2026-02-24T09:17:00.236483+0000","last_became_peered":"2026-02-24T09:17:00.236483+0000","last_unstale":"2026-02-24T09:17:01.375757+0000","last_undegraded":"2026-02-24T09:17:01.375757+0000","last_fullsized":"2026-02-24T09:17:01.375757+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:39:38.003280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375602+0000","last_change":"2026-02-24T09:17:00.244527+0000","last_active":"2026-02-24T09:17:01.375602+0000","last_peered":"2026-02-24T09:17:01.375602+0000","last_clean":"2026-02-24T09:17:01.375602+0000","last_became_active":"2026-02-24T09:17:00.244187+0000","last_became_peered":"2026-02-24T09:17:00.244187+0000","last_unstale":"2026-02-24T09:17:01.375602+0000","last_undegraded":"2026-02-24T09:17:01.375602+0000","last_fullsized":"2026-02-24T09:17:01.375602+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:47:15.468911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375307+0000","last_change":"2026-02-24T09:17:00.243775+0000","last_active":"2026-02-24T09:17:01.375307+0000","last_peered":"2026-02-24T09:17:01.375307+0000","last_clean":"2026-02-24T09:17:01.375307+0000","last_became_active":"2026-02-24T09:17:00.243686+0000","last_became_peered":"2026-02-24T09:17:00.243686+0000","last_unstale":"2026-02-24T09:17:01.375307+0000","last_undegraded":"2026-02-24T09:17:01.375307+0000","last_fullsized":"2026-02-24T09:17:01.375307+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:54:25.237747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376808+0000","last_change":"2026-02-24T09:17:00.245658+0000","last_active":"2026-02-24T09:17:01.376808+0000","last_peered":"2026-02-24T09:17:01.376808+0000","last_clean":"2026-02-24T09:17:01.376808+0000","last_became_active":"2026-02-24T09:17:00.245551+0000","last_became_peered":"2026-02-24T09:17:00.245551+0000","last_unstale":"2026-02-24T09:17:01.376808+0000","last_undegraded":"2026-02-24T09:17:01.376808+0000","last_fullsized":"2026-02-24T09:17:01.376808+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:06:32.658730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376015+0000","last_change":"2026-02-24T09:17:00.241047+0000","last_active":"2026-02-24T09:17:01.376015+0000","last_peered":"2026-02-24T09:17:01.376015+0000","last_clean":"2026-02-24T09:17:01.376015+0000","last_became_active":"2026-02-24T09:17:00.240844+0000","last_became_peered":"2026-02-24T09:17:00.240844+0000","last_unstale":"2026-02-24T09:17:01.376015+0000","last_undegraded":"2026-02-24T09:17:01.376015+0000","last_fullsized":"2026-02-24T09:17:01.376015+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:50:07.221768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.233566+0000","last_change":"2026-02-24T09:17:00.240922+0000","last_active":"2026-02-24T09:17:01.233566+0000","last_peered":"2026-02-24T09:17:01.233566+0000","last_clean":"2026-02-24T09:17:01.233566+0000","last_became_active":"2026-02-24T09:17:00.240548+0000","last_became_peered":"2026-02-24T09:17:00.240548+0000","last_unstale":"2026-02-24T09:17:01.233566+0000","last_undegraded":"2026-02-24T09:17:01.233566+0000","last_fullsized":"2026-02-24T09:17:01.233566+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:30:44.534419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376664+0000","last_change":"2026-02-24T09:17:00.247308+0000","last_active":"2026-02-24T09:17:01.376664+0000","last_peered":"2026-02-24T09:17:01.376664+0000","last_clean":"2026-02-24T09:17:01.376664+0000","last_became_active":"2026-02-24T09:17:00.247135+0000","last_became_peered":"2026-02-24T09:17:00.247135+0000","last_unstale":"2026-02-24T09:17:01.376664+0000","last_undegraded":"2026-02-24T09:17:01.376664+0000","last_fullsized":"2026-02-24T09:17:01.376664+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:05:05.273336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232010+0000","last_change":"2026-02-24T09:17:00.242127+0000","last_active":"2026-02-24T09:17:01.232010+0000","last_peered":"2026-02-24T09:17:01.232010+0000","last_clean":"2026-02-24T09:17:01.232010+0000","last_became_active":"2026-02-24T09:17:00.241873+0000","last_became_peered":"2026-02-24T09:17:00.241873+0000","last_unstale":"2026-02-24T09:17:01.232010+0000","last_undegraded":"2026-02-24T09:17:01.232010+0000","last_fullsized":"2026-02-24T09:17:01.232010+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:36:44.961821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376289+0000","last_change":"2026-02-24T09:17:00.242993+0000","last_active":"2026-02-24T09:17:01.376289+0000","last_peered":"2026-02-24T09:17:01.376289+0000","last_clean":"2026-02-24T09:17:01.376289+0000","last_became_active":"2026-02-24T09:17:00.242422+0000","last_became_peered":"2026-02-24T09:17:00.242422+0000","last_unstale":"2026-02-24T09:17:01.376289+0000","last_undegraded":"2026-02-24T09:17:01.376289+0000","last_fullsized":"2026-02-24T09:17:01.376289+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:26:02.228158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231856+0000","last_change":"2026-02-24T09:17:00.238357+0000","last_active":"2026-02-24T09:17:01.231856+0000","last_peered":"2026-02-24T09:17:01.231856+0000","last_clean":"2026-02-24T09:17:01.231856+0000","last_became_active":"2026-02-24T09:17:00.236985+0000","last_became_peered":"2026-02-24T09:17:00.236985+0000","last_unstale":"2026-02-24T09:17:01.231856+0000","last_undegraded":"2026-02-24T09:17:01.231856+0000","last_fullsized":"2026-02-24T09:17:01.231856+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:21:51.769646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.377634+0000","last_change":"2026-02-24T09:17:00.242262+0000","last_active":"2026-02-24T09:17:01.377634+0000","last_peered":"2026-02-24T09:17:01.377634+0000","last_clean":"2026-02-24T09:17:01.377634+0000","last_became_active":"2026-02-24T09:17:00.240949+0000","last_became_peered":"2026-02-24T09:17:00.240949+0000","last_unstale":"2026-02-24T09:17:01.377634+0000","last_undegraded":"2026-02-24T09:17:01.377634+0000","last_fullsized":"2026-02-24T09:17:01.377634+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:58:56.715059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232175+0000","last_change":"2026-02-24T09:17:00.245461+0000","last_active":"2026-02-24T09:17:01.232175+0000","last_peered":"2026-02-24T09:17:01.232175+0000","last_clean":"2026-02-24T09:17:01.232175+0000","last_became_active":"2026-02-24T09:17:00.245379+0000","last_became_peered":"2026-02-24T09:17:00.245379+0000","last_unstale":"2026-02-24T09:17:01.232175+0000","last_undegraded":"2026-02-24T09:17:01.232175+0000","last_fullsized":"2026-02-24T09:17:01.232175+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:15:17.150043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.233635+0000","last_change":"2026-02-24T09:17:00.241481+0000","last_active":"2026-02-24T09:17:01.233635+0000","last_peered":"2026-02-24T09:17:01.233635+0000","last_clean":"2026-02-24T09:17:01.233635+0000","last_became_active":"2026-02-24T09:17:00.241338+0000","last_became_peered":"2026-02-24T09:17:00.241338+0000","last_unstale":"2026-02-24T09:17:01.233635+0000","last_undegraded":"2026-02-24T09:17:01.233635+0000","last_fullsized":"2026-02-24T09:17:01.233635+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:15:11.802265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376636+0000","last_change":"2026-02-24T09:17:00.244368+0000","last_active":"2026-02-24T09:17:01.376636+0000","last_peered":"2026-02-24T09:17:01.376636+0000","last_clean":"2026-02-24T09:17:01.376636+0000","last_became_active":"2026-02-24T09:17:00.244266+0000","last_became_peered":"2026-02-24T09:17:00.244266+0000","last_unstale":"2026-02-24T09:17:01.376636+0000","last_undegraded":"2026-02-24T09:17:01.376636+0000","last_fullsized":"2026-02-24T09:17:01.376636+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:53:30.615320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232157+0000","last_change":"2026-02-24T09:17:00.246040+0000","last_active":"2026-02-24T09:17:01.232157+0000","last_peered":"2026-02-24T09:17:01.232157+0000","last_clean":"2026-02-24T09:17:01.232157+0000","last_became_active":"2026-02-24T09:17:00.245960+0000","last_became_peered":"2026-02-24T09:17:00.245960+0000","last_unstale":"2026-02-24T09:17:01.232157+0000","last_undegraded":"2026-02-24T09:17:01.232157+0000","last_fullsized":"2026-02-24T09:17:01.232157+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:40:44.935311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375704+0000","last_change":"2026-02-24T09:17:00.237870+0000","last_active":"2026-02-24T09:17:01.375704+0000","last_peered":"2026-02-24T09:17:01.375704+0000","last_clean":"2026-02-24T09:17:01.375704+0000","last_became_active":"2026-02-24T09:17:00.237745+0000","last_became_peered":"2026-02-24T09:17:00.237745+0000","last_unstale":"2026-02-24T09:17:01.375704+0000","last_undegraded":"2026-02-24T09:17:01.375704+0000","last_fullsized":"2026-02-24T09:17:01.375704+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:46:16.173715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.233458+0000","last_change":"2026-02-24T09:17:00.242559+0000","last_active":"2026-02-24T09:17:01.233458+0000","last_peered":"2026-02-24T09:17:01.233458+0000","last_clean":"2026-02-24T09:17:01.233458+0000","last_became_active":"2026-02-24T09:17:00.242457+0000","last_became_peered":"2026-02-24T09:17:00.242457+0000","last_unstale":"2026-02-24T09:17:01.233458+0000","last_undegraded":"2026-02-24T09:17:01.233458+0000","last_fullsized":"2026-02-24T09:17:01.233458+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:20:59.258363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.233170+0000","last_change":"2026-02-24T09:17:00.245177+0000","last_active":"2026-02-24T09:17:01.233170+0000","last_peered":"2026-02-24T09:17:01.233170+0000","last_clean":"2026-02-24T09:17:01.233170+0000","last_became_active":"2026-02-24T09:17:00.245074+0000","last_became_peered":"2026-02-24T09:17:00.245074+0000","last_unstale":"2026-02-24T09:17:01.233170+0000","last_undegraded":"2026-02-24T09:17:01.233170+0000","last_fullsized":"2026-02-24T09:17:01.233170+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:10:45.134678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376730+0000","last_change":"2026-02-24T09:17:00.242875+0000","last_active":"2026-02-24T09:17:01.376730+0000","last_peered":"2026-02-24T09:17:01.376730+0000","last_clean":"2026-02-24T09:17:01.376730+0000","last_became_active":"2026-02-24T09:17:00.242769+0000","last_became_peered":"2026-02-24T09:17:00.242769+0000","last_unstale":"2026-02-24T09:17:01.376730+0000","last_undegraded":"2026-02-24T09:17:01.376730+0000","last_fullsized":"2026-02-24T09:17:01.376730+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:38:25.732620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376955+0000","last_change":"2026-02-24T09:17:00.244244+0000","last_active":"2026-02-24T09:17:01.376955+0000","last_peered":"2026-02-24T09:17:01.376955+0000","last_clean":"2026-02-24T09:17:01.376955+0000","last_became_active":"2026-02-24T09:17:00.244160+0000","last_became_peered":"2026-02-24T09:17:00.244160+0000","last_unstale":"2026-02-24T09:17:01.376955+0000","last_undegraded":"2026-02-24T09:17:01.376955+0000","last_fullsized":"2026-02-24T09:17:01.376955+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:04:37.036726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"92'6","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:06.573798+0000","last_change":"2026-02-24T09:16:59.240672+0000","last_active":"2026-02-24T09:17:06.573798+0000","last_peered":"2026-02-24T09:17:06.573798+0000","last_clean":"2026-02-24T09:17:06.573798+0000","last_became_active":"2026-02-24T09:16:59.240414+0000","last_became_peered":"2026-02-24T09:16:59.240414+0000","last_unstale":"2026-02-24T09:17:06.573798+0000","last_undegraded":"2026-02-24T09:17:06.573798+0000","last_fullsized":"2026-02-24T09:17:06.573798+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:41:36.122890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1032,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.377837+0000","last_change":"2026-02-24T09:17:00.243064+0000","last_active":"2026-02-24T09:17:01.377837+0000","last_peered":"2026-02-24T09:17:01.377837+0000","last_clean":"2026-02-24T09:17:01.377837+0000","last_became_active":"2026-02-24T09:17:00.242916+0000","last_became_peered":"2026-02-24T09:17:00.242916+0000","last_unstale":"2026-02-24T09:17:01.377837+0000","last_undegraded":"2026-02-24T09:17:01.377837+0000","last_fullsized":"2026-02-24T09:17:01.377837+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:54:10.866892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"92'3","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.255220+0000","last_change":"2026-02-24T09:16:59.240197+0000","last_active":"2026-02-24T09:17:05.255220+0000","last_peered":"2026-02-24T09:17:05.255220+0000","last_clean":"2026-02-24T09:17:05.255220+0000","last_became_active":"2026-02-24T09:16:59.240036+0000","last_became_peered":"2026-02-24T09:16:59.240036+0000","last_unstale":"2026-02-24T09:17:05.255220+0000","last_undegraded":"2026-02-24T09:17:05.255220+0000","last_fullsized":"2026-02-24T09:17:05.255220+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:10:20.710884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"92'2","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.256064+0000","last_change":"2026-02-24T09:16:59.235467+0000","last_active":"2026-02-24T09:17:05.256064+0000","last_peered":"2026-02-24T09:17:05.256064+0000","last_clean":"2026-02-24T09:17:05.256064+0000","last_became_active":"2026-02-24T09:16:59.235262+0000","last_became_peered":"2026-02-24T09:16:59.235262+0000","last_unstale":"2026-02-24T09:17:05.256064+0000","last_undegraded":"2026-02-24T09:17:05.256064+0000","last_fullsized":"2026-02-24T09:17:05.256064+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:15:01.906008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231788+0000","last_change":"2026-02-24T09:17:00.237830+0000","last_active":"2026-02-24T09:17:01.231788+0000","last_peered":"2026-02-24T09:17:01.231788+0000","last_clean":"2026-02-24T09:17:01.231788+0000","last_became_active":"2026-02-24T09:17:00.237730+0000","last_became_peered":"2026-02-24T09:17:00.237730+0000","last_unstale":"2026-02-24T09:17:01.231788+0000","last_undegraded":"2026-02-24T09:17:01.231788+0000","last_fullsized":"2026-02-24T09:17:01.231788+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:49:14.120510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"92'1","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:02.469482+0000","last_change":"2026-02-24T09:16:59.238783+0000","last_active":"2026-02-24T09:17:02.469482+0000","last_peered":"2026-02-24T09:17:02.469482+0000","last_clean":"2026-02-24T09:17:02.469482+0000","last_became_active":"2026-02-24T09:16:59.238700+0000","last_became_peered":"2026-02-24T09:16:59.238700+0000","last_unstale":"2026-02-24T09:17:02.469482+0000","last_undegraded":"2026-02-24T09:17:02.469482+0000","last_fullsized":"2026-02-24T09:17:02.469482+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:07:28.426507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375760+0000","last_change":"2026-02-24T09:17:00.240566+0000","last_active":"2026-02-24T09:17:01.375760+0000","last_peered":"2026-02-24T09:17:01.375760+0000","last_clean":"2026-02-24T09:17:01.375760+0000","last_became_active":"2026-02-24T09:17:00.239787+0000","last_became_peered":"2026-02-24T09:17:00.239787+0000","last_unstale":"2026-02-24T09:17:01.375760+0000","last_undegraded":"2026-02-24T09:17:01.375760+0000","last_fullsized":"2026-02-24T09:17:01.375760+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:37:55.629531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"92'3","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:09.574856+0000","last_change":"2026-02-24T09:16:59.239817+0000","last_active":"2026-02-24T09:17:09.574856+0000","last_peered":"2026-02-24T09:17:09.574856+0000","last_clean":"2026-02-24T09:17:09.574856+0000","last_became_active":"2026-02-24T09:16:59.239753+0000","last_became_peered":"2026-02-24T09:16:59.239753+0000","last_unstale":"2026-02-24T09:17:09.574856+0000","last_undegraded":"2026-02-24T09:17:09.574856+0000","last_fullsized":"2026-02-24T09:17:09.574856+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:25:15.726537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376407+0000","last_change":"2026-02-24T09:17:00.242220+0000","last_active":"2026-02-24T09:17:01.376407+0000","last_peered":"2026-02-24T09:17:01.376407+0000","last_clean":"2026-02-24T09:17:01.376407+0000","last_became_active":"2026-02-24T09:17:00.241795+0000","last_became_peered":"2026-02-24T09:17:00.241795+0000","last_unstale":"2026-02-24T09:17:01.376407+0000","last_undegraded":"2026-02-24T09:17:01.376407+0000","last_fullsized":"2026-02-24T09:17:01.376407+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:16:26.952516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"92'2","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:04.250229+0000","last_change":"2026-02-24T09:16:59.237294+0000","last_active":"2026-02-24T09:17:04.250229+0000","last_peered":"2026-02-24T09:17:04.250229+0000","last_clean":"2026-02-24T09:17:04.250229+0000","last_became_active":"2026-02-24T09:16:59.237192+0000","last_became_peered":"2026-02-24T09:16:59.237192+0000","last_unstale":"2026-02-24T09:17:04.250229+0000","last_undegraded":"2026-02-24T09:17:04.250229+0000","last_fullsized":"2026-02-24T09:17:04.250229+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:28:54.216539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375947+0000","last_change":"2026-02-24T09:17:00.244365+0000","last_active":"2026-02-24T09:17:01.375947+0000","last_peered":"2026-02-24T09:17:01.375947+0000","last_clean":"2026-02-24T09:17:01.375947+0000","last_became_active":"2026-02-24T09:17:00.244262+0000","last_became_peered":"2026-02-24T09:17:00.244262+0000","last_unstale":"2026-02-24T09:17:01.375947+0000","last_undegraded":"2026-02-24T09:17:01.375947+0000","last_fullsized":"2026-02-24T09:17:01.375947+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:46:44.145479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"92'4","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:04.250710+0000","last_change":"2026-02-24T09:16:59.240964+0000","last_active":"2026-02-24T09:17:04.250710+0000","last_peered":"2026-02-24T09:17:04.250710+0000","last_clean":"2026-02-24T09:17:04.250710+0000","last_became_active":"2026-02-24T09:16:59.240812+0000","last_became_peered":"2026-02-24T09:16:59.240812+0000","last_unstale":"2026-02-24T09:17:04.250710+0000","last_undegraded":"2026-02-24T09:17:04.250710+0000","last_fullsized":"2026-02-24T09:17:04.250710+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:07:51.752070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376252+0000","last_change":"2026-02-24T09:17:00.245692+0000","last_active":"2026-02-24T09:17:01.376252+0000","last_peered":"2026-02-24T09:17:01.376252+0000","last_clean":"2026-02-24T09:17:01.376252+0000","last_became_active":"2026-02-24T09:17:00.245616+0000","last_became_peered":"2026-02-24T09:17:00.245616+0000","last_unstale":"2026-02-24T09:17:01.376252+0000","last_undegraded":"2026-02-24T09:17:01.376252+0000","last_fullsized":"2026-02-24T09:17:01.376252+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:03:42.649936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"92'22","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:10.579553+0000","last_change":"2026-02-24T09:16:59.243723+0000","last_active":"2026-02-24T09:17:10.579553+0000","last_peered":"2026-02-24T09:17:10.579553+0000","last_clean":"2026-02-24T09:17:10.579553+0000","last_became_active":"2026-02-24T09:16:59.243606+0000","last_became_peered":"2026-02-24T09:16:59.243606+0000","last_unstale":"2026-02-24T09:17:10.579553+0000","last_undegraded":"2026-02-24T09:17:10.579553+0000","last_fullsized":"2026-02-24T09:17:10.579553+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:35:14.333104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53104,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":60,"num_write":23,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.377374+0000","last_change":"2026-02-24T09:17:00.237314+0000","last_active":"2026-02-24T09:17:01.377374+0000","last_peered":"2026-02-24T09:17:01.377374+0000","last_clean":"2026-02-24T09:17:01.377374+0000","last_became_active":"2026-02-24T09:17:00.237210+0000","last_became_peered":"2026-02-24T09:17:00.237210+0000","last_unstale":"2026-02-24T09:17:01.377374+0000","last_undegraded":"2026-02-24T09:17:01.377374+0000","last_fullsized":"2026-02-24T09:17:01.377374+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:03:03.936414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"92'6","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.257112+0000","last_change":"2026-02-24T09:16:59.242567+0000","last_active":"2026-02-24T09:17:05.257112+0000","last_peered":"2026-02-24T09:17:05.257112+0000","last_clean":"2026-02-24T09:17:05.257112+0000","last_became_active":"2026-02-24T09:16:59.242420+0000","last_became_peered":"2026-02-24T09:16:59.242420+0000","last_unstale":"2026-02-24T09:17:05.257112+0000","last_undegraded":"2026-02-24T09:17:05.257112+0000","last_fullsized":"2026-02-24T09:17:05.257112+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:58:16.881321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231844+0000","last_change":"2026-02-24T09:17:00.239405+0000","last_active":"2026-02-24T09:17:01.231844+0000","last_peered":"2026-02-24T09:17:01.231844+0000","last_clean":"2026-02-24T09:17:01.231844+0000","last_became_active":"2026-02-24T09:17:00.239281+0000","last_became_peered":"2026-02-24T09:17:00.239281+0000","last_unstale":"2026-02-24T09:17:01.231844+0000","last_undegraded":"2026-02-24T09:17:01.231844+0000","last_fullsized":"2026-02-24T09:17:01.231844+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:19:48.176289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"92'3","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:04.250578+0000","last_change":"2026-02-24T09:16:59.242394+0000","last_active":"2026-02-24T09:17:04.250578+0000","last_peered":"2026-02-24T09:17:04.250578+0000","last_clean":"2026-02-24T09:17:04.250578+0000","last_became_active":"2026-02-24T09:16:59.242199+0000","last_became_peered":"2026-02-24T09:16:59.242199+0000","last_unstale":"2026-02-24T09:17:04.250578+0000","last_undegraded":"2026-02-24T09:17:04.250578+0000","last_fullsized":"2026-02-24T09:17:04.250578+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:04:12.763715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.610151+0000","last_change":"2026-02-24T09:17:00.237820+0000","last_active":"2026-02-24T09:17:01.610151+0000","last_peered":"2026-02-24T09:17:01.610151+0000","last_clean":"2026-02-24T09:17:01.610151+0000","last_became_active":"2026-02-24T09:17:00.237711+0000","last_became_peered":"2026-02-24T09:17:00.237711+0000","last_unstale":"2026-02-24T09:17:01.610151+0000","last_undegraded":"2026-02-24T09:17:01.610151+0000","last_fullsized":"2026-02-24T09:17:01.610151+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:27:44.269231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"92'4","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:08.576961+0000","last_change":"2026-02-24T09:16:59.239787+0000","last_active":"2026-02-24T09:17:08.576961+0000","last_peered":"2026-02-24T09:17:08.576961+0000","last_clean":"2026-02-24T09:17:08.576961+0000","last_became_active":"2026-02-24T09:16:59.239066+0000","last_became_peered":"2026-02-24T09:16:59.239066+0000","last_unstale":"2026-02-24T09:17:08.576961+0000","last_undegraded":"2026-02-24T09:17:08.576961+0000","last_fullsized":"2026-02-24T09:17:08.576961+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:10:34.992034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.609694+0000","last_change":"2026-02-24T09:17:00.246515+0000","last_active":"2026-02-24T09:17:01.609694+0000","last_peered":"2026-02-24T09:17:01.609694+0000","last_clean":"2026-02-24T09:17:01.609694+0000","last_became_active":"2026-02-24T09:17:00.246222+0000","last_became_peered":"2026-02-24T09:17:00.246222+0000","last_unstale":"2026-02-24T09:17:01.609694+0000","last_undegraded":"2026-02-24T09:17:01.609694+0000","last_fullsized":"2026-02-24T09:17:01.609694+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:28:05.377985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"92'15","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.257255+0000","last_change":"2026-02-24T09:16:59.239752+0000","last_active":"2026-02-24T09:17:05.257255+0000","last_peered":"2026-02-24T09:17:05.257255+0000","last_clean":"2026-02-24T09:17:05.257255+0000","last_became_active":"2026-02-24T09:16:59.239609+0000","last_became_peered":"2026-02-24T09:16:59.239609+0000","last_unstale":"2026-02-24T09:17:05.257255+0000","last_undegraded":"2026-02-24T09:17:05.257255+0000","last_fullsized":"2026-02-24T09:17:05.257255+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:30:54.943423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.378159+0000","last_change":"2026-02-24T09:17:00.246053+0000","last_active":"2026-02-24T09:17:01.378159+0000","last_peered":"2026-02-24T09:17:01.378159+0000","last_clean":"2026-02-24T09:17:01.378159+0000","last_became_active":"2026-02-24T09:17:00.245905+0000","last_became_peered":"2026-02-24T09:17:00.245905+0000","last_unstale":"2026-02-24T09:17:01.378159+0000","last_undegraded":"2026-02-24T09:17:01.378159+0000","last_fullsized":"2026-02-24T09:17:01.378159+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:36:56.843524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"92'2","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.570884+0000","last_change":"2026-02-24T09:16:59.241232+0000","last_active":"2026-02-24T09:17:05.570884+0000","last_peered":"2026-02-24T09:17:05.570884+0000","last_clean":"2026-02-24T09:17:05.570884+0000","last_became_active":"2026-02-24T09:16:59.240754+0000","last_became_peered":"2026-02-24T09:16:59.240754+0000","last_unstale":"2026-02-24T09:17:05.570884+0000","last_undegraded":"2026-02-24T09:17:05.570884+0000","last_fullsized":"2026-02-24T09:17:05.570884+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:57:01.258617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376875+0000","last_change":"2026-02-24T09:17:00.246591+0000","last_active":"2026-02-24T09:17:01.376875+0000","last_peered":"2026-02-24T09:17:01.376875+0000","last_clean":"2026-02-24T09:17:01.376875+0000","last_became_active":"2026-02-24T09:17:00.246487+0000","last_became_peered":"2026-02-24T09:17:00.246487+0000","last_unstale":"2026-02-24T09:17:01.376875+0000","last_undegraded":"2026-02-24T09:17:01.376875+0000","last_fullsized":"2026-02-24T09:17:01.376875+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:58:37.854234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"91'2","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232200+0000","last_change":"2026-02-24T09:16:59.239102+0000","last_active":"2026-02-24T09:17:01.232200+0000","last_peered":"2026-02-24T09:17:01.232200+0000","last_clean":"2026-02-24T09:17:01.232200+0000","last_became_active":"2026-02-24T09:16:59.238978+0000","last_became_peered":"2026-02-24T09:16:59.238978+0000","last_unstale":"2026-02-24T09:17:01.232200+0000","last_undegraded":"2026-02-24T09:17:01.232200+0000","last_fullsized":"2026-02-24T09:17:01.232200+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:57:02.192151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.610201+0000","last_change":"2026-02-24T09:17:00.238578+0000","last_active":"2026-02-24T09:17:01.610201+0000","last_peered":"2026-02-24T09:17:01.610201+0000","last_clean":"2026-02-24T09:17:01.610201+0000","last_became_active":"2026-02-24T09:17:00.238465+0000","last_became_peered":"2026-02-24T09:17:00.238465+0000","last_unstale":"2026-02-24T09:17:01.610201+0000","last_undegraded":"2026-02-24T09:17:01.610201+0000","last_fullsized":"2026-02-24T09:17:01.610201+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:44:35.349567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"91'1","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:02.469552+0000","last_change":"2026-02-24T09:16:59.242643+0000","last_active":"2026-02-24T09:17:02.469552+0000","last_peered":"2026-02-24T09:17:02.469552+0000","last_clean":"2026-02-24T09:17:02.469552+0000","last_became_active":"2026-02-24T09:16:59.242376+0000","last_became_peered":"2026-02-24T09:16:59.242376+0000","last_unstale":"2026-02-24T09:17:02.469552+0000","last_undegraded":"2026-02-24T09:17:02.469552+0000","last_fullsized":"2026-02-24T09:17:02.469552+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:27:11.004972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"92'1","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.609794+0000","last_change":"2026-02-24T09:17:00.246332+0000","last_active":"2026-02-24T09:17:01.609794+0000","last_peered":"2026-02-24T09:17:01.609794+0000","last_clean":"2026-02-24T09:17:01.609794+0000","last_became_active":"2026-02-24T09:17:00.246194+0000","last_became_peered":"2026-02-24T09:17:00.246194+0000","last_unstale":"2026-02-24T09:17:01.609794+0000","last_undegraded":"2026-02-24T09:17:01.609794+0000","last_fullsized":"2026-02-24T09:17:01.609794+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:58:11.173666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"92'3","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.257225+0000","last_change":"2026-02-24T09:16:59.243374+0000","last_active":"2026-02-24T09:17:05.257225+0000","last_peered":"2026-02-24T09:17:05.257225+0000","last_clean":"2026-02-24T09:17:05.257225+0000","last_became_active":"2026-02-24T09:16:59.241003+0000","last_became_peered":"2026-02-24T09:16:59.241003+0000","last_unstale":"2026-02-24T09:17:05.257225+0000","last_undegraded":"2026-02-24T09:17:05.257225+0000","last_fullsized":"2026-02-24T09:17:05.257225+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:26:57.571616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.610188+0000","last_change":"2026-02-24T09:17:00.240655+0000","last_active":"2026-02-24T09:17:01.610188+0000","last_peered":"2026-02-24T09:17:01.610188+0000","last_clean":"2026-02-24T09:17:01.610188+0000","last_became_active":"2026-02-24T09:17:00.240419+0000","last_became_peered":"2026-02-24T09:17:00.240419+0000","last_unstale":"2026-02-24T09:17:01.610188+0000","last_undegraded":"2026-02-24T09:17:01.610188+0000","last_fullsized":"2026-02-24T09:17:01.610188+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:18:34.651497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"25'152","reported_seq":371,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.609797+0000","last_change":"2026-02-24T09:16:23.569634+0000","last_active":"2026-02-24T09:17:01.609797+0000","last_peered":"2026-02-24T09:17:01.609797+0000","last_clean":"2026-02-24T09:17:01.609797+0000","last_became_active":"2026-02-24T09:16:23.569284+0000","last_became_peered":"2026-02-24T09:16:23.569284+0000","last_unstale":"2026-02-24T09:17:01.609797+0000","last_undegraded":"2026-02-24T09:17:01.609797+0000","last_fullsized":"2026-02-24T09:17:01.609797+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:14:34.386267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:14:34.386267+0000","last_clean_scrub_stamp":"2026-02-24T09:14:34.386267+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:03:26.216331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"92'3","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.568942+0000","last_change":"2026-02-24T09:16:59.239216+0000","last_active":"2026-02-24T09:17:05.568942+0000","last_peered":"2026-02-24T09:17:05.568942+0000","last_clean":"2026-02-24T09:17:05.568942+0000","last_became_active":"2026-02-24T09:16:59.239009+0000","last_became_peered":"2026-02-24T09:16:59.239009+0000","last_unstale":"2026-02-24T09:17:05.568942+0000","last_undegraded":"2026-02-24T09:17:05.568942+0000","last_fullsized":"2026-02-24T09:17:05.568942+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:51:32.186590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231677+0000","last_change":"2026-02-24T09:17:00.242943+0000","last_active":"2026-02-24T09:17:01.231677+0000","last_peered":"2026-02-24T09:17:01.231677+0000","last_clean":"2026-02-24T09:17:01.231677+0000","last_became_active":"2026-02-24T09:17:00.242841+0000","last_became_peered":"2026-02-24T09:17:00.242841+0000","last_unstale":"2026-02-24T09:17:01.231677+0000","last_undegraded":"2026-02-24T09:17:01.231677+0000","last_fullsized":"2026-02-24T09:17:01.231677+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:27:23.973327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"92'3","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.254697+0000","last_change":"2026-02-24T09:16:59.239635+0000","last_active":"2026-02-24T09:17:05.254697+0000","last_peered":"2026-02-24T09:17:05.254697+0000","last_clean":"2026-02-24T09:17:05.254697+0000","last_became_active":"2026-02-24T09:16:59.239565+0000","last_became_peered":"2026-02-24T09:16:59.239565+0000","last_unstale":"2026-02-24T09:17:05.254697+0000","last_undegraded":"2026-02-24T09:17:05.254697+0000","last_fullsized":"2026-02-24T09:17:05.254697+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:33:03.541374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231556+0000","last_change":"2026-02-24T09:17:00.244300+0000","last_active":"2026-02-24T09:17:01.231556+0000","last_peered":"2026-02-24T09:17:01.231556+0000","last_clean":"2026-02-24T09:17:01.231556+0000","last_became_active":"2026-02-24T09:17:00.244133+0000","last_became_peered":"2026-02-24T09:17:00.244133+0000","last_unstale":"2026-02-24T09:17:01.231556+0000","last_undegraded":"2026-02-24T09:17:01.231556+0000","last_fullsized":"2026-02-24T09:17:01.231556+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:42:14.299522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"92'4","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.572884+0000","last_change":"2026-02-24T09:16:59.242539+0000","last_active":"2026-02-24T09:17:05.572884+0000","last_peered":"2026-02-24T09:17:05.572884+0000","last_clean":"2026-02-24T09:17:05.572884+0000","last_became_active":"2026-02-24T09:16:59.242210+0000","last_became_peered":"2026-02-24T09:16:59.242210+0000","last_unstale":"2026-02-24T09:17:05.572884+0000","last_undegraded":"2026-02-24T09:17:05.572884+0000","last_fullsized":"2026-02-24T09:17:05.572884+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:47:26.799485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.377784+0000","last_change":"2026-02-24T09:17:00.246745+0000","last_active":"2026-02-24T09:17:01.377784+0000","last_peered":"2026-02-24T09:17:01.377784+0000","last_clean":"2026-02-24T09:17:01.377784+0000","last_became_active":"2026-02-24T09:17:00.246652+0000","last_became_peered":"2026-02-24T09:17:00.246652+0000","last_unstale":"2026-02-24T09:17:01.377784+0000","last_undegraded":"2026-02-24T09:17:01.377784+0000","last_fullsized":"2026-02-24T09:17:01.377784+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:16:56.265530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"92'1","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.610257+0000","last_change":"2026-02-24T09:16:59.235982+0000","last_active":"2026-02-24T09:17:01.610257+0000","last_peered":"2026-02-24T09:17:01.610257+0000","last_clean":"2026-02-24T09:17:01.610257+0000","last_became_active":"2026-02-24T09:16:59.235893+0000","last_became_peered":"2026-02-24T09:16:59.235893+0000","last_unstale":"2026-02-24T09:17:01.610257+0000","last_undegraded":"2026-02-24T09:17:01.610257+0000","last_fullsized":"2026-02-24T09:17:01.610257+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:02:50.906502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231934+0000","last_change":"2026-02-24T09:17:00.237347+0000","last_active":"2026-02-24T09:17:01.231934+0000","last_peered":"2026-02-24T09:17:01.231934+0000","last_clean":"2026-02-24T09:17:01.231934+0000","last_became_active":"2026-02-24T09:17:00.237254+0000","last_became_peered":"2026-02-24T09:17:00.237254+0000","last_unstale":"2026-02-24T09:17:01.231934+0000","last_undegraded":"2026-02-24T09:17:01.231934+0000","last_fullsized":"2026-02-24T09:17:01.231934+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:26:24.955214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375984+0000","last_change":"2026-02-24T09:16:59.244271+0000","last_active":"2026-02-24T09:17:01.375984+0000","last_peered":"2026-02-24T09:17:01.375984+0000","last_clean":"2026-02-24T09:17:01.375984+0000","last_became_active":"2026-02-24T09:16:59.243995+0000","last_became_peered":"2026-02-24T09:16:59.243995+0000","last_unstale":"2026-02-24T09:17:01.375984+0000","last_undegraded":"2026-02-24T09:17:01.375984+0000","last_fullsized":"2026-02-24T09:17:01.375984+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:23:30.140261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"92'1","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231998+0000","last_change":"2026-02-24T09:17:00.238722+0000","last_active":"2026-02-24T09:17:01.231998+0000","last_peered":"2026-02-24T09:17:01.231998+0000","last_clean":"2026-02-24T09:17:01.231998+0000","last_became_active":"2026-02-24T09:17:00.238067+0000","last_became_peered":"2026-02-24T09:17:00.238067+0000","last_unstale":"2026-02-24T09:17:01.231998+0000","last_undegraded":"2026-02-24T09:17:01.231998+0000","last_fullsized":"2026-02-24T09:17:01.231998+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:15:12.608200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"92'1","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:04.250009+0000","last_change":"2026-02-24T09:16:59.240637+0000","last_active":"2026-02-24T09:17:04.250009+0000","last_peered":"2026-02-24T09:17:04.250009+0000","last_clean":"2026-02-24T09:17:04.250009+0000","last_became_active":"2026-02-24T09:16:59.240525+0000","last_became_peered":"2026-02-24T09:16:59.240525+0000","last_unstale":"2026-02-24T09:17:04.250009+0000","last_undegraded":"2026-02-24T09:17:04.250009+0000","last_fullsized":"2026-02-24T09:17:04.250009+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:19:39.812071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232103+0000","last_change":"2026-02-24T09:17:00.242384+0000","last_active":"2026-02-24T09:17:01.232103+0000","last_peered":"2026-02-24T09:17:01.232103+0000","last_clean":"2026-02-24T09:17:01.232103+0000","last_became_active":"2026-02-24T09:17:00.242252+0000","last_became_peered":"2026-02-24T09:17:00.242252+0000","last_unstale":"2026-02-24T09:17:01.232103+0000","last_undegraded":"2026-02-24T09:17:01.232103+0000","last_fullsized":"2026-02-24T09:17:01.232103+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:55:25.276787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"92'3","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.255383+0000","last_change":"2026-02-24T09:16:59.242386+0000","last_active":"2026-02-24T09:17:05.255383+0000","last_peered":"2026-02-24T09:17:05.255383+0000","last_clean":"2026-02-24T09:17:05.255383+0000","last_became_active":"2026-02-24T09:16:59.240737+0000","last_became_peered":"2026-02-24T09:16:59.240737+0000","last_unstale":"2026-02-24T09:17:05.255383+0000","last_undegraded":"2026-02-24T09:17:05.255383+0000","last_fullsized":"2026-02-24T09:17:05.255383+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:35:28.471311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232263+0000","last_change":"2026-02-24T09:17:00.239525+0000","last_active":"2026-02-24T09:17:01.232263+0000","last_peered":"2026-02-24T09:17:01.232263+0000","last_clean":"2026-02-24T09:17:01.232263+0000","last_became_active":"2026-02-24T09:17:00.239161+0000","last_became_peered":"2026-02-24T09:17:00.239161+0000","last_unstale":"2026-02-24T09:17:01.232263+0000","last_undegraded":"2026-02-24T09:17:01.232263+0000","last_fullsized":"2026-02-24T09:17:01.232263+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:35:14.881330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"92'4","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:04.248734+0000","last_change":"2026-02-24T09:16:59.233525+0000","last_active":"2026-02-24T09:17:04.248734+0000","last_peered":"2026-02-24T09:17:04.248734+0000","last_clean":"2026-02-24T09:17:04.248734+0000","last_became_active":"2026-02-24T09:16:59.233370+0000","last_became_peered":"2026-02-24T09:16:59.233370+0000","last_unstale":"2026-02-24T09:17:04.248734+0000","last_undegraded":"2026-02-24T09:17:04.248734+0000","last_fullsized":"2026-02-24T09:17:04.248734+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:49:37.491011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376128+0000","last_change":"2026-02-24T09:17:00.241506+0000","last_active":"2026-02-24T09:17:01.376128+0000","last_peered":"2026-02-24T09:17:01.376128+0000","last_clean":"2026-02-24T09:17:01.376128+0000","last_became_active":"2026-02-24T09:17:00.241385+0000","last_became_peered":"2026-02-24T09:17:00.241385+0000","last_unstale":"2026-02-24T09:17:01.376128+0000","last_undegraded":"2026-02-24T09:17:01.376128+0000","last_fullsized":"2026-02-24T09:17:01.376128+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:17:11.846529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"92'2","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:04.249681+0000","last_change":"2026-02-24T09:16:59.238575+0000","last_active":"2026-02-24T09:17:04.249681+0000","last_peered":"2026-02-24T09:17:04.249681+0000","last_clean":"2026-02-24T09:17:04.249681+0000","last_became_active":"2026-02-24T09:16:59.238286+0000","last_became_peered":"2026-02-24T09:16:59.238286+0000","last_unstale":"2026-02-24T09:17:04.249681+0000","last_undegraded":"2026-02-24T09:17:04.249681+0000","last_fullsized":"2026-02-24T09:17:04.249681+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:18:59.982647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376961+0000","last_change":"2026-02-24T09:17:00.238159+0000","last_active":"2026-02-24T09:17:01.376961+0000","last_peered":"2026-02-24T09:17:01.376961+0000","last_clean":"2026-02-24T09:17:01.376961+0000","last_became_active":"2026-02-24T09:17:00.238069+0000","last_became_peered":"2026-02-24T09:17:00.238069+0000","last_unstale":"2026-02-24T09:17:01.376961+0000","last_undegraded":"2026-02-24T09:17:01.376961+0000","last_fullsized":"2026-02-24T09:17:01.376961+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:45:21.584921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"92'3","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:04.250654+0000","last_change":"2026-02-24T09:16:59.241444+0000","last_active":"2026-02-24T09:17:04.250654+0000","last_peered":"2026-02-24T09:17:04.250654+0000","last_clean":"2026-02-24T09:17:04.250654+0000","last_became_active":"2026-02-24T09:16:59.241253+0000","last_became_peered":"2026-02-24T09:16:59.241253+0000","last_unstale":"2026-02-24T09:17:04.250654+0000","last_undegraded":"2026-02-24T09:17:04.250654+0000","last_fullsized":"2026-02-24T09:17:04.250654+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:07:34.833768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376780+0000","last_change":"2026-02-24T09:17:00.245603+0000","last_active":"2026-02-24T09:17:01.376780+0000","last_peered":"2026-02-24T09:17:01.376780+0000","last_clean":"2026-02-24T09:17:01.376780+0000","last_became_active":"2026-02-24T09:17:00.245409+0000","last_became_peered":"2026-02-24T09:17:00.245409+0000","last_unstale":"2026-02-24T09:17:01.376780+0000","last_undegraded":"2026-02-24T09:17:01.376780+0000","last_fullsized":"2026-02-24T09:17:01.376780+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:24:31.732634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"92'1","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:02.676977+0000","last_change":"2026-02-24T09:16:59.242808+0000","last_active":"2026-02-24T09:17:02.676977+0000","last_peered":"2026-02-24T09:17:02.676977+0000","last_clean":"2026-02-24T09:17:02.676977+0000","last_became_active":"2026-02-24T09:16:59.242717+0000","last_became_peered":"2026-02-24T09:16:59.242717+0000","last_unstale":"2026-02-24T09:17:02.676977+0000","last_undegraded":"2026-02-24T09:17:02.676977+0000","last_fullsized":"2026-02-24T09:17:02.676977+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:55:54.008569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231613+0000","last_change":"2026-02-24T09:17:00.239253+0000","last_active":"2026-02-24T09:17:01.231613+0000","last_peered":"2026-02-24T09:17:01.231613+0000","last_clean":"2026-02-24T09:17:01.231613+0000","last_became_active":"2026-02-24T09:17:00.238983+0000","last_became_peered":"2026-02-24T09:17:00.238983+0000","last_unstale":"2026-02-24T09:17:01.231613+0000","last_undegraded":"2026-02-24T09:17:01.231613+0000","last_fullsized":"2026-02-24T09:17:01.231613+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:15:35.939863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"92'4","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:04.250062+0000","last_change":"2026-02-24T09:16:59.238537+0000","last_active":"2026-02-24T09:17:04.250062+0000","last_peered":"2026-02-24T09:17:04.250062+0000","last_clean":"2026-02-24T09:17:04.250062+0000","last_became_active":"2026-02-24T09:16:59.238413+0000","last_became_peered":"2026-02-24T09:16:59.238413+0000","last_unstale":"2026-02-24T09:17:04.250062+0000","last_undegraded":"2026-02-24T09:17:04.250062+0000","last_fullsized":"2026-02-24T09:17:04.250062+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:18:35.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.609986+0000","last_change":"2026-02-24T09:17:00.241138+0000","last_active":"2026-02-24T09:17:01.609986+0000","last_peered":"2026-02-24T09:17:01.609986+0000","last_clean":"2026-02-24T09:17:01.609986+0000","last_became_active":"2026-02-24T09:17:00.240131+0000","last_became_peered":"2026-02-24T09:17:00.240131+0000","last_unstale":"2026-02-24T09:17:01.609986+0000","last_undegraded":"2026-02-24T09:17:01.609986+0000","last_fullsized":"2026-02-24T09:17:01.609986+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:30:04.572939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.378006+0000","last_change":"2026-02-24T09:17:00.247807+0000","last_active":"2026-02-24T09:17:01.378006+0000","last_peered":"2026-02-24T09:17:01.378006+0000","last_clean":"2026-02-24T09:17:01.378006+0000","last_became_active":"2026-02-24T09:17:00.247294+0000","last_became_peered":"2026-02-24T09:17:00.247294+0000","last_unstale":"2026-02-24T09:17:01.378006+0000","last_undegraded":"2026-02-24T09:17:01.378006+0000","last_fullsized":"2026-02-24T09:17:01.378006+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:40:19.082811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"91'2","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.377087+0000","last_change":"2026-02-24T09:16:59.241010+0000","last_active":"2026-02-24T09:17:01.377087+0000","last_peered":"2026-02-24T09:17:01.377087+0000","last_clean":"2026-02-24T09:17:01.377087+0000","last_became_active":"2026-02-24T09:16:59.240857+0000","last_became_peered":"2026-02-24T09:16:59.240857+0000","last_unstale":"2026-02-24T09:17:01.377087+0000","last_undegraded":"2026-02-24T09:17:01.377087+0000","last_fullsized":"2026-02-24T09:17:01.377087+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:00:21.995413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376275+0000","last_change":"2026-02-24T09:17:00.239878+0000","last_active":"2026-02-24T09:17:01.376275+0000","last_peered":"2026-02-24T09:17:01.376275+0000","last_clean":"2026-02-24T09:17:01.376275+0000","last_became_active":"2026-02-24T09:17:00.239782+0000","last_became_peered":"2026-02-24T09:17:00.239782+0000","last_unstale":"2026-02-24T09:17:01.376275+0000","last_undegraded":"2026-02-24T09:17:01.376275+0000","last_fullsized":"2026-02-24T09:17:01.376275+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:20:28.594190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"92'4","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.255383+0000","last_change":"2026-02-24T09:16:59.238466+0000","last_active":"2026-02-24T09:17:05.255383+0000","last_peered":"2026-02-24T09:17:05.255383+0000","last_clean":"2026-02-24T09:17:05.255383+0000","last_became_active":"2026-02-24T09:16:59.238371+0000","last_became_peered":"2026-02-24T09:16:59.238371+0000","last_unstale":"2026-02-24T09:17:05.255383+0000","last_undegraded":"2026-02-24T09:17:05.255383+0000","last_fullsized":"2026-02-24T09:17:05.255383+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:25:57.207215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375857+0000","last_change":"2026-02-24T09:17:00.242538+0000","last_active":"2026-02-24T09:17:01.375857+0000","last_peered":"2026-02-24T09:17:01.375857+0000","last_clean":"2026-02-24T09:17:01.375857+0000","last_became_active":"2026-02-24T09:17:00.241119+0000","last_became_peered":"2026-02-24T09:17:00.241119+0000","last_unstale":"2026-02-24T09:17:01.375857+0000","last_undegraded":"2026-02-24T09:17:01.375857+0000","last_fullsized":"2026-02-24T09:17:01.375857+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:03:23.360618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"92'2","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.545231+0000","last_change":"2026-02-24T09:16:59.243406+0000","last_active":"2026-02-24T09:17:01.545231+0000","last_peered":"2026-02-24T09:17:01.545231+0000","last_clean":"2026-02-24T09:17:01.545231+0000","last_became_active":"2026-02-24T09:16:59.243275+0000","last_became_peered":"2026-02-24T09:16:59.243275+0000","last_unstale":"2026-02-24T09:17:01.545231+0000","last_undegraded":"2026-02-24T09:17:01.545231+0000","last_fullsized":"2026-02-24T09:17:01.545231+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:11:58.812932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232102+0000","last_change":"2026-02-24T09:17:00.242628+0000","last_active":"2026-02-24T09:17:01.232102+0000","last_peered":"2026-02-24T09:17:01.232102+0000","last_clean":"2026-02-24T09:17:01.232102+0000","last_became_active":"2026-02-24T09:17:00.242482+0000","last_became_peered":"2026-02-24T09:17:00.242482+0000","last_unstale":"2026-02-24T09:17:01.232102+0000","last_undegraded":"2026-02-24T09:17:01.232102+0000","last_fullsized":"2026-02-24T09:17:01.232102+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:28:11.567636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"92'9","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.255500+0000","last_change":"2026-02-24T09:16:59.238503+0000","last_active":"2026-02-24T09:17:05.255500+0000","last_peered":"2026-02-24T09:17:05.255500+0000","last_clean":"2026-02-24T09:17:05.255500+0000","last_became_active":"2026-02-24T09:16:59.238321+0000","last_became_peered":"2026-02-24T09:16:59.238321+0000","last_unstale":"2026-02-24T09:17:05.255500+0000","last_undegraded":"2026-02-24T09:17:05.255500+0000","last_fullsized":"2026-02-24T09:17:05.255500+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:25:06.302717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":57564,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":51,"num_read_kb":87,"num_write":141,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":323584,"data_stored":100103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":122867,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":261676,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":87,"seq":373662154760,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28188,"kb_used_data":968,"kb_used_omap":10,"kb_used_meta":27189,"kb_avail":733975012,"statfs":{"total":751619276800,"available":751590412288,"internally_reserved":0,"allocated":991232,"data_stored":492629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10767,"internal_metadata":27842033},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":79,"seq":339302416395,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28328,"kb_used_data":1108,"kb_used_omap":28,"kb_used_meta":27171,"kb_avail":733974872,"statfs":{"total":751619276800,"available":751590268928,"internally_reserved":0,"allocated":1134592,"data_stored":1137624,"data_compressed":37836,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":28890,"internal_metadata":27823910},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":74,"seq":317827579918,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28204,"kb_used_data":984,"kb_used_omap":24,"kb_used_meta":27175,"kb_avail":733974996,"statfs":{"total":751619276800,"available":751590395904,"internally_reserved":0,"allocated":1007616,"data_stored":492865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25310,"internal_metadata":27827490},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":66,"seq":283467841552,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28204,"kb_used_data":984,"kb_used_omap":14,"kb_used_meta":27185,"kb_avail":733974996,"statfs":{"total":751619276800,"available":751590395904,"internally_reserved":0,"allocated":1007616,"data_stored":492785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15050,"internal_metadata":27837750},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":58,"seq":249108103187,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28252,"kb_used_data":1032,"kb_used_omap":35,"kb_used_meta":27164,"kb_avail":733974948,"statfs":{"total":751619276800,"available":751590346752,"internally_reserved":0,"allocated":1056768,"data_stored":1085144,"data_compressed":37836,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":36450,"internal_metadata":27816350},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":53,"seq":227633266709,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28188,"kb_used_data":968,"kb_used_omap":32,"kb_used_meta":27167,"kb_avail":733975012,"statfs":{"total":751619276800,"available":751590412288,"internally_reserved":0,"allocated":991232,"data_stored":492127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33261,"internal_metadata":27819539},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":45,"seq":193273528344,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28260,"kb_used_data":1040,"kb_used_omap":36,"kb_used_meta":27163,"kb_avail":733974940,"statfs":{"total":751619276800,"available":751590338560,"internally_reserved":0,"allocated":1064960,"data_stored":1084301,"data_compressed":37836,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":37621,"internal_metadata":27815179},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":38,"seq":163208757275,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28196,"kb_used_data":976,"kb_used_omap":44,"kb_used_meta":27155,"kb_avail":733975004,"statfs":{"total":751619276800,"available":751590404096,"internally_reserved":0,"allocated":999424,"data_stored":493091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45564,"internal_metadata":27807236},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":30,"seq":128849018909,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28200,"kb_used_data":980,"kb_used_omap":52,"kb_used_meta":27147,"kb_avail":733975000,"statfs":{"total":751619276800,"available":751590400000,"internally_reserved":0,"allocated":1003520,"data_stored":492321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53910,"internal_metadata":27798890},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280544,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28220,"kb_used_data":1000,"kb_used_omap":65,"kb_used_meta":27134,"kb_avail":733974980,"statfs":{"total":751619276800,"available":751590379520,"internally_reserved":0,"allocated":1024000,"data_stored":495019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":66689,"internal_metadata":27786111},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476771,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28220,"kb_used_data":1000,"kb_used_omap":54,"kb_used_meta":27145,"kb_avail":733974980,"statfs":{"total":751619276800,"available":751590379520,"internally_reserved":0,"allocated":1024000,"data_stored":517355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":55708,"internal_metadata":27797092},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949672999,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28212,"kb_used_data":992,"kb_used_omap":35,"kb_used_meta":27164,"kb_avail":733974988,"statfs":{"total":751619276800,"available":751590387712,"internally_reserved":0,"allocated":1015808,"data_stored":493535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36536,"internal_metadata":27816264},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37836,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37836,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37836,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37836,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37836,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1431,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":25318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1713,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":10071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12982,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12227,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12139,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3482,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4590,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33104,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4278,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12678,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":55102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22881,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1362,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T09:17:11.544 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T09:17:11.728 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:11.768 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:11 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/469656514' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:17:11.768 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:11 trial028 ceph-mon[40371]: pgmap v186: 97 pgs: 97 active+clean; 633 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 9.8 KiB/s wr, 18 op/s 2026-02-24T09:17:11.769 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:11 trial028 ceph-mon[40371]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:17:11.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:11 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/469656514' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:17:11.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:11 trial074 ceph-mon[44412]: pgmap v186: 97 pgs: 97 active+clean; 633 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 9.8 KiB/s wr, 18 op/s 2026-02-24T09:17:11.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:11 trial074 ceph-mon[44412]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:17:11.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.898+0000 7fd1be2df640 1 -- 10.20.193.28:0/933590061 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd1b8111540 msgr2=0x7fd1b81119e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:11.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.898+0000 7fd1be2df640 1 --2- 10.20.193.28:0/933590061 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd1b8111540 0x7fd1b81119e0 secure :-1 s=READY pgs=265 gs=1 cs=0 l=1 c_cookie=7234001611349458518 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd1ac00aa60 tx=0x7fd1ac0302b0 comp rx=0 tx=0).stop 2026-02-24T09:17:11.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.898+0000 7fd1be2df640 1 -- 10.20.193.28:0/933590061 shutdown_connections 2026-02-24T09:17:11.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.898+0000 7fd1be2df640 1 --2- 10.20.193.28:0/933590061 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd1b8111540 0x7fd1b81119e0 unknown :-1 s=CLOSED pgs=265 gs=1 cs=0 l=1 c_cookie=7234001611349458518 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:11.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.898+0000 7fd1be2df640 1 --2- 10.20.193.28:0/933590061 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fd1b810c950 0x7fd1b8110f20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:11.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.898+0000 7fd1be2df640 1 --2- 10.20.193.28:0/933590061 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fd1b810bf60 0x7fd1b810c330 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:11.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.898+0000 7fd1be2df640 1 -- 10.20.193.28:0/933590061 >> 10.20.193.28:0/933590061 conn(0x7fd1b80e9bf0 msgr2=0x7fd1b810a000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:11.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.898+0000 7fd1be2df640 1 -- 10.20.193.28:0/933590061 shutdown_connections 2026-02-24T09:17:11.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.898+0000 7fd1be2df640 1 -- 10.20.193.28:0/933590061 wait complete. 2026-02-24T09:17:11.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.899+0000 7fd1be2df640 1 Processor -- start 2026-02-24T09:17:11.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.899+0000 7fd1be2df640 1 -- start start 2026-02-24T09:17:11.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.899+0000 7fd1be2df640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fd1b810bf60 0x7fd1b8122960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:11.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.899+0000 7fd1be2df640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd1b810c950 0x7fd1b8122ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:11.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.899+0000 7fd1be2df640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fd1b8111540 0x7fd1b8128270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:11.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.899+0000 7fd1be2df640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b8128890 con 0x7fd1b810c950 2026-02-24T09:17:11.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.899+0000 7fd1be2df640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b8128a00 con 0x7fd1b810bf60 2026-02-24T09:17:11.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.899+0000 7fd1be2df640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b8128bc0 con 0x7fd1b8111540 2026-02-24T09:17:11.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.900+0000 7fd1b77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd1b810c950 0x7fd1b8122ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:11.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.900+0000 7fd1b7fff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fd1b810bf60 0x7fd1b8122960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:11.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.900+0000 7fd1b77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd1b810c950 0x7fd1b8122ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39344/0 (socket says 10.20.193.28:39344) 2026-02-24T09:17:11.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.900+0000 7fd1b77fe640 1 -- 10.20.193.28:0/3330206985 learned_addr learned my addr 10.20.193.28:0/3330206985 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:11.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.900+0000 7fd1bc855640 1 --2- 10.20.193.28:0/3330206985 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fd1b8111540 0x7fd1b8128270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:11.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.900+0000 7fd1b77fe640 1 -- 10.20.193.28:0/3330206985 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fd1b8111540 msgr2=0x7fd1b8128270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:11.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.900+0000 7fd1b77fe640 1 --2- 10.20.193.28:0/3330206985 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fd1b8111540 0x7fd1b8128270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:11.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.900+0000 7fd1b77fe640 1 -- 10.20.193.28:0/3330206985 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fd1b810bf60 msgr2=0x7fd1b8122960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:11.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.900+0000 7fd1b77fe640 1 --2- 10.20.193.28:0/3330206985 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fd1b810bf60 0x7fd1b8122960 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:11.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.900+0000 7fd1b77fe640 1 -- 10.20.193.28:0/3330206985 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1ac00a650 con 0x7fd1b810c950 2026-02-24T09:17:11.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.900+0000 7fd1b77fe640 1 --2- 10.20.193.28:0/3330206985 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd1b810c950 0x7fd1b8122ea0 secure :-1 s=READY pgs=266 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd1a8005db0 tx=0x7fd1a800ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:11.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.900+0000 7fd1b57fa640 1 -- 10.20.193.28:0/3330206985 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd1a8004500 con 0x7fd1b810c950 2026-02-24T09:17:11.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.900+0000 7fd1b57fa640 1 -- 10.20.193.28:0/3330206985 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd1a8004d10 con 0x7fd1b810c950 2026-02-24T09:17:11.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.900+0000 7fd1b57fa640 1 -- 10.20.193.28:0/3330206985 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd1a8005280 con 0x7fd1b810c950 2026-02-24T09:17:11.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.900+0000 7fd1be2df640 1 -- 10.20.193.28:0/3330206985 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1b8128ea0 con 0x7fd1b810c950 2026-02-24T09:17:11.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.901+0000 7fd1be2df640 1 -- 10.20.193.28:0/3330206985 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1b81695a0 con 0x7fd1b810c950 2026-02-24T09:17:11.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.901+0000 7fd1be2df640 1 -- 10.20.193.28:0/3330206985 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1b81290c0 con 0x7fd1b810c950 2026-02-24T09:17:11.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.903+0000 7fd1b57fa640 1 -- 10.20.193.28:0/3330206985 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7fd1a8005410 con 0x7fd1b810c950 2026-02-24T09:17:11.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.905+0000 7fd1b57fa640 1 --2- 10.20.193.28:0/3330206985 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fd18c0b5840 0x7fd18c0d5cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:11.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.905+0000 7fd1b57fa640 1 -- 10.20.193.28:0/3330206985 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7fd1a80e7190 con 0x7fd1b810c950 2026-02-24T09:17:11.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.905+0000 7fd1b7fff640 1 --2- 10.20.193.28:0/3330206985 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fd18c0b5840 0x7fd18c0d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:11.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.905+0000 7fd1b57fa640 1 -- 10.20.193.28:0/3330206985 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fd1a80e7610 con 0x7fd1b810c950 2026-02-24T09:17:11.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:11.906+0000 7fd1b7fff640 1 --2- 10.20.193.28:0/3330206985 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fd18c0b5840 0x7fd18c0d5cf0 secure :-1 s=READY pgs=151 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd1a4004740 tx=0x7fd1a4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:12.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.019+0000 7fd1be2df640 1 -- 10.20.193.28:0/3330206985 --> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd1b8123ac0 con 0x7fd18c0b5840 2026-02-24T09:17:12.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.022+0000 7fd1b57fa640 1 -- 10.20.193.28:0/3330206985 <== mgr.14223 v2:10.20.193.28:6800/906910473 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258954 (secure 0 0 0) 0x7fd1b8123ac0 con 0x7fd18c0b5840 2026-02-24T09:17:12.026 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:17:12.026 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-24T09:17:12.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.025+0000 7fd1be2df640 1 -- 10.20.193.28:0/3330206985 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fd18c0b5840 msgr2=0x7fd18c0d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:12.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.025+0000 7fd1be2df640 1 --2- 10.20.193.28:0/3330206985 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fd18c0b5840 0x7fd18c0d5cf0 secure :-1 s=READY pgs=151 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd1a4004740 tx=0x7fd1a4005f90 comp rx=0 tx=0).stop 2026-02-24T09:17:12.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.025+0000 7fd1be2df640 1 -- 10.20.193.28:0/3330206985 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd1b810c950 msgr2=0x7fd1b8122ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:12.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.025+0000 7fd1be2df640 1 --2- 10.20.193.28:0/3330206985 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd1b810c950 0x7fd1b8122ea0 secure :-1 s=READY pgs=266 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd1a8005db0 tx=0x7fd1a800ddf0 comp rx=0 tx=0).stop 2026-02-24T09:17:12.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.025+0000 7fd1be2df640 1 -- 10.20.193.28:0/3330206985 shutdown_connections 2026-02-24T09:17:12.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.025+0000 7fd1be2df640 1 --2- 10.20.193.28:0/3330206985 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fd18c0b5840 0x7fd18c0d5cf0 unknown :-1 s=CLOSED pgs=151 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:12.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.025+0000 7fd1be2df640 1 --2- 10.20.193.28:0/3330206985 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fd1b8111540 0x7fd1b8128270 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:12.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.025+0000 7fd1be2df640 1 --2- 10.20.193.28:0/3330206985 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd1b810c950 0x7fd1b8122ea0 unknown :-1 s=CLOSED pgs=266 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:12.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.025+0000 7fd1be2df640 1 --2- 10.20.193.28:0/3330206985 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fd1b810bf60 0x7fd1b8122960 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:12.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.025+0000 7fd1be2df640 1 -- 10.20.193.28:0/3330206985 >> 10.20.193.28:0/3330206985 conn(0x7fd1b80e9bf0 msgr2=0x7fd1b8109fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:12.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.025+0000 7fd1be2df640 1 -- 10.20.193.28:0/3330206985 shutdown_connections 2026-02-24T09:17:12.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.025+0000 7fd1be2df640 1 -- 10.20.193.28:0/3330206985 wait complete. 2026-02-24T09:17:12.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:11 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/469656514' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:17:12.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:11 trial159 ceph-mon[44242]: pgmap v186: 97 pgs: 97 active+clean; 633 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 9.8 KiB/s wr, 18 op/s 2026-02-24T09:17:12.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:11 trial159 ceph-mon[44242]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:17:12.125 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2026-02-24T09:17:11.272688+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":648166,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":165,"num_read_kb":186,"num_write":332,"num_write_kb":3817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":279,"ondisk_log_size":279,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":338672,"kb_used_data":12032,"kb_used_omap":435,"kb_used_meta":325964,"kb_avail":8807699728,"statfs":{"total":9019431321600,"available":9019084521472,"internally_reserved":0,"allocated":12320768,"data_stored":7768796,"data_compressed":113508,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":445756,"internal_metadata":333787844},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":56176,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":51,"num_read_kb":87,"num_write":137,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.041983"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376724+0000","last_change":"2026-02-24T09:17:00.245387+0000","last_active":"2026-02-24T09:17:01.376724+0000","last_peered":"2026-02-24T09:17:01.376724+0000","last_clean":"2026-02-24T09:17:01.376724+0000","last_became_active":"2026-02-24T09:17:00.244938+0000","last_became_peered":"2026-02-24T09:17:00.244938+0000","last_unstale":"2026-02-24T09:17:01.376724+0000","last_undegraded":"2026-02-24T09:17:01.376724+0000","last_fullsized":"2026-02-24T09:17:01.376724+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:35:29.390820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376072+0000","last_change":"2026-02-24T09:17:00.236200+0000","last_active":"2026-02-24T09:17:01.376072+0000","last_peered":"2026-02-24T09:17:01.376072+0000","last_clean":"2026-02-24T09:17:01.376072+0000","last_became_active":"2026-02-24T09:17:00.236029+0000","last_became_peered":"2026-02-24T09:17:00.236029+0000","last_unstale":"2026-02-24T09:17:01.376072+0000","last_undegraded":"2026-02-24T09:17:01.376072+0000","last_fullsized":"2026-02-24T09:17:01.376072+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:06:22.417660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376003+0000","last_change":"2026-02-24T09:17:00.241494+0000","last_active":"2026-02-24T09:17:01.376003+0000","last_peered":"2026-02-24T09:17:01.376003+0000","last_clean":"2026-02-24T09:17:01.376003+0000","last_became_active":"2026-02-24T09:17:00.241220+0000","last_became_peered":"2026-02-24T09:17:00.241220+0000","last_unstale":"2026-02-24T09:17:01.376003+0000","last_undegraded":"2026-02-24T09:17:01.376003+0000","last_fullsized":"2026-02-24T09:17:01.376003+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:34:35.363256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375459+0000","last_change":"2026-02-24T09:17:00.245544+0000","last_active":"2026-02-24T09:17:01.375459+0000","last_peered":"2026-02-24T09:17:01.375459+0000","last_clean":"2026-02-24T09:17:01.375459+0000","last_became_active":"2026-02-24T09:17:00.245316+0000","last_became_peered":"2026-02-24T09:17:00.245316+0000","last_unstale":"2026-02-24T09:17:01.375459+0000","last_undegraded":"2026-02-24T09:17:01.375459+0000","last_fullsized":"2026-02-24T09:17:01.375459+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:44:07.848623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376966+0000","last_change":"2026-02-24T09:17:00.242163+0000","last_active":"2026-02-24T09:17:01.376966+0000","last_peered":"2026-02-24T09:17:01.376966+0000","last_clean":"2026-02-24T09:17:01.376966+0000","last_became_active":"2026-02-24T09:17:00.240475+0000","last_became_peered":"2026-02-24T09:17:00.240475+0000","last_unstale":"2026-02-24T09:17:01.376966+0000","last_undegraded":"2026-02-24T09:17:01.376966+0000","last_fullsized":"2026-02-24T09:17:01.376966+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:08:01.801955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231522+0000","last_change":"2026-02-24T09:17:00.239730+0000","last_active":"2026-02-24T09:17:01.231522+0000","last_peered":"2026-02-24T09:17:01.231522+0000","last_clean":"2026-02-24T09:17:01.231522+0000","last_became_active":"2026-02-24T09:17:00.239571+0000","last_became_peered":"2026-02-24T09:17:00.239571+0000","last_unstale":"2026-02-24T09:17:01.231522+0000","last_undegraded":"2026-02-24T09:17:01.231522+0000","last_fullsized":"2026-02-24T09:17:01.231522+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:44:51.158834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.609629+0000","last_change":"2026-02-24T09:17:00.246826+0000","last_active":"2026-02-24T09:17:01.609629+0000","last_peered":"2026-02-24T09:17:01.609629+0000","last_clean":"2026-02-24T09:17:01.609629+0000","last_became_active":"2026-02-24T09:17:00.246078+0000","last_became_peered":"2026-02-24T09:17:00.246078+0000","last_unstale":"2026-02-24T09:17:01.609629+0000","last_undegraded":"2026-02-24T09:17:01.609629+0000","last_fullsized":"2026-02-24T09:17:01.609629+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:01:08.591060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231860+0000","last_change":"2026-02-24T09:17:00.242859+0000","last_active":"2026-02-24T09:17:01.231860+0000","last_peered":"2026-02-24T09:17:01.231860+0000","last_clean":"2026-02-24T09:17:01.231860+0000","last_became_active":"2026-02-24T09:17:00.242754+0000","last_became_peered":"2026-02-24T09:17:00.242754+0000","last_unstale":"2026-02-24T09:17:01.231860+0000","last_undegraded":"2026-02-24T09:17:01.231860+0000","last_fullsized":"2026-02-24T09:17:01.231860+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:12:54.422166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376465+0000","last_change":"2026-02-24T09:17:00.243145+0000","last_active":"2026-02-24T09:17:01.376465+0000","last_peered":"2026-02-24T09:17:01.376465+0000","last_clean":"2026-02-24T09:17:01.376465+0000","last_became_active":"2026-02-24T09:17:00.242545+0000","last_became_peered":"2026-02-24T09:17:00.242545+0000","last_unstale":"2026-02-24T09:17:01.376465+0000","last_undegraded":"2026-02-24T09:17:01.376465+0000","last_fullsized":"2026-02-24T09:17:01.376465+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:57:48.262867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232059+0000","last_change":"2026-02-24T09:17:00.238410+0000","last_active":"2026-02-24T09:17:01.232059+0000","last_peered":"2026-02-24T09:17:01.232059+0000","last_clean":"2026-02-24T09:17:01.232059+0000","last_became_active":"2026-02-24T09:17:00.238208+0000","last_became_peered":"2026-02-24T09:17:00.238208+0000","last_unstale":"2026-02-24T09:17:01.232059+0000","last_undegraded":"2026-02-24T09:17:01.232059+0000","last_fullsized":"2026-02-24T09:17:01.232059+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:24:40.244153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.609971+0000","last_change":"2026-02-24T09:17:00.240756+0000","last_active":"2026-02-24T09:17:01.609971+0000","last_peered":"2026-02-24T09:17:01.609971+0000","last_clean":"2026-02-24T09:17:01.609971+0000","last_became_active":"2026-02-24T09:17:00.240549+0000","last_became_peered":"2026-02-24T09:17:00.240549+0000","last_unstale":"2026-02-24T09:17:01.609971+0000","last_undegraded":"2026-02-24T09:17:01.609971+0000","last_fullsized":"2026-02-24T09:17:01.609971+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:22:59.840951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375576+0000","last_change":"2026-02-24T09:17:00.244972+0000","last_active":"2026-02-24T09:17:01.375576+0000","last_peered":"2026-02-24T09:17:01.375576+0000","last_clean":"2026-02-24T09:17:01.375576+0000","last_became_active":"2026-02-24T09:17:00.244802+0000","last_became_peered":"2026-02-24T09:17:00.244802+0000","last_unstale":"2026-02-24T09:17:01.375576+0000","last_undegraded":"2026-02-24T09:17:01.375576+0000","last_fullsized":"2026-02-24T09:17:01.375576+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:23:42.961356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232520+0000","last_change":"2026-02-24T09:17:00.242225+0000","last_active":"2026-02-24T09:17:01.232520+0000","last_peered":"2026-02-24T09:17:01.232520+0000","last_clean":"2026-02-24T09:17:01.232520+0000","last_became_active":"2026-02-24T09:17:00.242034+0000","last_became_peered":"2026-02-24T09:17:00.242034+0000","last_unstale":"2026-02-24T09:17:01.232520+0000","last_undegraded":"2026-02-24T09:17:01.232520+0000","last_fullsized":"2026-02-24T09:17:01.232520+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:48:52.291960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375757+0000","last_change":"2026-02-24T09:17:00.236623+0000","last_active":"2026-02-24T09:17:01.375757+0000","last_peered":"2026-02-24T09:17:01.375757+0000","last_clean":"2026-02-24T09:17:01.375757+0000","last_became_active":"2026-02-24T09:17:00.236483+0000","last_became_peered":"2026-02-24T09:17:00.236483+0000","last_unstale":"2026-02-24T09:17:01.375757+0000","last_undegraded":"2026-02-24T09:17:01.375757+0000","last_fullsized":"2026-02-24T09:17:01.375757+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:39:38.003280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375602+0000","last_change":"2026-02-24T09:17:00.244527+0000","last_active":"2026-02-24T09:17:01.375602+0000","last_peered":"2026-02-24T09:17:01.375602+0000","last_clean":"2026-02-24T09:17:01.375602+0000","last_became_active":"2026-02-24T09:17:00.244187+0000","last_became_peered":"2026-02-24T09:17:00.244187+0000","last_unstale":"2026-02-24T09:17:01.375602+0000","last_undegraded":"2026-02-24T09:17:01.375602+0000","last_fullsized":"2026-02-24T09:17:01.375602+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:47:15.468911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375307+0000","last_change":"2026-02-24T09:17:00.243775+0000","last_active":"2026-02-24T09:17:01.375307+0000","last_peered":"2026-02-24T09:17:01.375307+0000","last_clean":"2026-02-24T09:17:01.375307+0000","last_became_active":"2026-02-24T09:17:00.243686+0000","last_became_peered":"2026-02-24T09:17:00.243686+0000","last_unstale":"2026-02-24T09:17:01.375307+0000","last_undegraded":"2026-02-24T09:17:01.375307+0000","last_fullsized":"2026-02-24T09:17:01.375307+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:54:25.237747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376808+0000","last_change":"2026-02-24T09:17:00.245658+0000","last_active":"2026-02-24T09:17:01.376808+0000","last_peered":"2026-02-24T09:17:01.376808+0000","last_clean":"2026-02-24T09:17:01.376808+0000","last_became_active":"2026-02-24T09:17:00.245551+0000","last_became_peered":"2026-02-24T09:17:00.245551+0000","last_unstale":"2026-02-24T09:17:01.376808+0000","last_undegraded":"2026-02-24T09:17:01.376808+0000","last_fullsized":"2026-02-24T09:17:01.376808+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:06:32.658730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376015+0000","last_change":"2026-02-24T09:17:00.241047+0000","last_active":"2026-02-24T09:17:01.376015+0000","last_peered":"2026-02-24T09:17:01.376015+0000","last_clean":"2026-02-24T09:17:01.376015+0000","last_became_active":"2026-02-24T09:17:00.240844+0000","last_became_peered":"2026-02-24T09:17:00.240844+0000","last_unstale":"2026-02-24T09:17:01.376015+0000","last_undegraded":"2026-02-24T09:17:01.376015+0000","last_fullsized":"2026-02-24T09:17:01.376015+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:50:07.221768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.233566+0000","last_change":"2026-02-24T09:17:00.240922+0000","last_active":"2026-02-24T09:17:01.233566+0000","last_peered":"2026-02-24T09:17:01.233566+0000","last_clean":"2026-02-24T09:17:01.233566+0000","last_became_active":"2026-02-24T09:17:00.240548+0000","last_became_peered":"2026-02-24T09:17:00.240548+0000","last_unstale":"2026-02-24T09:17:01.233566+0000","last_undegraded":"2026-02-24T09:17:01.233566+0000","last_fullsized":"2026-02-24T09:17:01.233566+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:30:44.534419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376664+0000","last_change":"2026-02-24T09:17:00.247308+0000","last_active":"2026-02-24T09:17:01.376664+0000","last_peered":"2026-02-24T09:17:01.376664+0000","last_clean":"2026-02-24T09:17:01.376664+0000","last_became_active":"2026-02-24T09:17:00.247135+0000","last_became_peered":"2026-02-24T09:17:00.247135+0000","last_unstale":"2026-02-24T09:17:01.376664+0000","last_undegraded":"2026-02-24T09:17:01.376664+0000","last_fullsized":"2026-02-24T09:17:01.376664+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:05:05.273336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232010+0000","last_change":"2026-02-24T09:17:00.242127+0000","last_active":"2026-02-24T09:17:01.232010+0000","last_peered":"2026-02-24T09:17:01.232010+0000","last_clean":"2026-02-24T09:17:01.232010+0000","last_became_active":"2026-02-24T09:17:00.241873+0000","last_became_peered":"2026-02-24T09:17:00.241873+0000","last_unstale":"2026-02-24T09:17:01.232010+0000","last_undegraded":"2026-02-24T09:17:01.232010+0000","last_fullsized":"2026-02-24T09:17:01.232010+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:36:44.961821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376289+0000","last_change":"2026-02-24T09:17:00.242993+0000","last_active":"2026-02-24T09:17:01.376289+0000","last_peered":"2026-02-24T09:17:01.376289+0000","last_clean":"2026-02-24T09:17:01.376289+0000","last_became_active":"2026-02-24T09:17:00.242422+0000","last_became_peered":"2026-02-24T09:17:00.242422+0000","last_unstale":"2026-02-24T09:17:01.376289+0000","last_undegraded":"2026-02-24T09:17:01.376289+0000","last_fullsized":"2026-02-24T09:17:01.376289+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:26:02.228158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231856+0000","last_change":"2026-02-24T09:17:00.238357+0000","last_active":"2026-02-24T09:17:01.231856+0000","last_peered":"2026-02-24T09:17:01.231856+0000","last_clean":"2026-02-24T09:17:01.231856+0000","last_became_active":"2026-02-24T09:17:00.236985+0000","last_became_peered":"2026-02-24T09:17:00.236985+0000","last_unstale":"2026-02-24T09:17:01.231856+0000","last_undegraded":"2026-02-24T09:17:01.231856+0000","last_fullsized":"2026-02-24T09:17:01.231856+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:21:51.769646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.377634+0000","last_change":"2026-02-24T09:17:00.242262+0000","last_active":"2026-02-24T09:17:01.377634+0000","last_peered":"2026-02-24T09:17:01.377634+0000","last_clean":"2026-02-24T09:17:01.377634+0000","last_became_active":"2026-02-24T09:17:00.240949+0000","last_became_peered":"2026-02-24T09:17:00.240949+0000","last_unstale":"2026-02-24T09:17:01.377634+0000","last_undegraded":"2026-02-24T09:17:01.377634+0000","last_fullsized":"2026-02-24T09:17:01.377634+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:58:56.715059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232175+0000","last_change":"2026-02-24T09:17:00.245461+0000","last_active":"2026-02-24T09:17:01.232175+0000","last_peered":"2026-02-24T09:17:01.232175+0000","last_clean":"2026-02-24T09:17:01.232175+0000","last_became_active":"2026-02-24T09:17:00.245379+0000","last_became_peered":"2026-02-24T09:17:00.245379+0000","last_unstale":"2026-02-24T09:17:01.232175+0000","last_undegraded":"2026-02-24T09:17:01.232175+0000","last_fullsized":"2026-02-24T09:17:01.232175+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:15:17.150043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.233635+0000","last_change":"2026-02-24T09:17:00.241481+0000","last_active":"2026-02-24T09:17:01.233635+0000","last_peered":"2026-02-24T09:17:01.233635+0000","last_clean":"2026-02-24T09:17:01.233635+0000","last_became_active":"2026-02-24T09:17:00.241338+0000","last_became_peered":"2026-02-24T09:17:00.241338+0000","last_unstale":"2026-02-24T09:17:01.233635+0000","last_undegraded":"2026-02-24T09:17:01.233635+0000","last_fullsized":"2026-02-24T09:17:01.233635+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:15:11.802265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376636+0000","last_change":"2026-02-24T09:17:00.244368+0000","last_active":"2026-02-24T09:17:01.376636+0000","last_peered":"2026-02-24T09:17:01.376636+0000","last_clean":"2026-02-24T09:17:01.376636+0000","last_became_active":"2026-02-24T09:17:00.244266+0000","last_became_peered":"2026-02-24T09:17:00.244266+0000","last_unstale":"2026-02-24T09:17:01.376636+0000","last_undegraded":"2026-02-24T09:17:01.376636+0000","last_fullsized":"2026-02-24T09:17:01.376636+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:53:30.615320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232157+0000","last_change":"2026-02-24T09:17:00.246040+0000","last_active":"2026-02-24T09:17:01.232157+0000","last_peered":"2026-02-24T09:17:01.232157+0000","last_clean":"2026-02-24T09:17:01.232157+0000","last_became_active":"2026-02-24T09:17:00.245960+0000","last_became_peered":"2026-02-24T09:17:00.245960+0000","last_unstale":"2026-02-24T09:17:01.232157+0000","last_undegraded":"2026-02-24T09:17:01.232157+0000","last_fullsized":"2026-02-24T09:17:01.232157+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:40:44.935311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375704+0000","last_change":"2026-02-24T09:17:00.237870+0000","last_active":"2026-02-24T09:17:01.375704+0000","last_peered":"2026-02-24T09:17:01.375704+0000","last_clean":"2026-02-24T09:17:01.375704+0000","last_became_active":"2026-02-24T09:17:00.237745+0000","last_became_peered":"2026-02-24T09:17:00.237745+0000","last_unstale":"2026-02-24T09:17:01.375704+0000","last_undegraded":"2026-02-24T09:17:01.375704+0000","last_fullsized":"2026-02-24T09:17:01.375704+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:46:16.173715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.233458+0000","last_change":"2026-02-24T09:17:00.242559+0000","last_active":"2026-02-24T09:17:01.233458+0000","last_peered":"2026-02-24T09:17:01.233458+0000","last_clean":"2026-02-24T09:17:01.233458+0000","last_became_active":"2026-02-24T09:17:00.242457+0000","last_became_peered":"2026-02-24T09:17:00.242457+0000","last_unstale":"2026-02-24T09:17:01.233458+0000","last_undegraded":"2026-02-24T09:17:01.233458+0000","last_fullsized":"2026-02-24T09:17:01.233458+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:20:59.258363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.233170+0000","last_change":"2026-02-24T09:17:00.245177+0000","last_active":"2026-02-24T09:17:01.233170+0000","last_peered":"2026-02-24T09:17:01.233170+0000","last_clean":"2026-02-24T09:17:01.233170+0000","last_became_active":"2026-02-24T09:17:00.245074+0000","last_became_peered":"2026-02-24T09:17:00.245074+0000","last_unstale":"2026-02-24T09:17:01.233170+0000","last_undegraded":"2026-02-24T09:17:01.233170+0000","last_fullsized":"2026-02-24T09:17:01.233170+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:10:45.134678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376730+0000","last_change":"2026-02-24T09:17:00.242875+0000","last_active":"2026-02-24T09:17:01.376730+0000","last_peered":"2026-02-24T09:17:01.376730+0000","last_clean":"2026-02-24T09:17:01.376730+0000","last_became_active":"2026-02-24T09:17:00.242769+0000","last_became_peered":"2026-02-24T09:17:00.242769+0000","last_unstale":"2026-02-24T09:17:01.376730+0000","last_undegraded":"2026-02-24T09:17:01.376730+0000","last_fullsized":"2026-02-24T09:17:01.376730+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:38:25.732620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376955+0000","last_change":"2026-02-24T09:17:00.244244+0000","last_active":"2026-02-24T09:17:01.376955+0000","last_peered":"2026-02-24T09:17:01.376955+0000","last_clean":"2026-02-24T09:17:01.376955+0000","last_became_active":"2026-02-24T09:17:00.244160+0000","last_became_peered":"2026-02-24T09:17:00.244160+0000","last_unstale":"2026-02-24T09:17:01.376955+0000","last_undegraded":"2026-02-24T09:17:01.376955+0000","last_fullsized":"2026-02-24T09:17:01.376955+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:04:37.036726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"92'6","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:06.573798+0000","last_change":"2026-02-24T09:16:59.240672+0000","last_active":"2026-02-24T09:17:06.573798+0000","last_peered":"2026-02-24T09:17:06.573798+0000","last_clean":"2026-02-24T09:17:06.573798+0000","last_became_active":"2026-02-24T09:16:59.240414+0000","last_became_peered":"2026-02-24T09:16:59.240414+0000","last_unstale":"2026-02-24T09:17:06.573798+0000","last_undegraded":"2026-02-24T09:17:06.573798+0000","last_fullsized":"2026-02-24T09:17:06.573798+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:41:36.122890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1032,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.377837+0000","last_change":"2026-02-24T09:17:00.243064+0000","last_active":"2026-02-24T09:17:01.377837+0000","last_peered":"2026-02-24T09:17:01.377837+0000","last_clean":"2026-02-24T09:17:01.377837+0000","last_became_active":"2026-02-24T09:17:00.242916+0000","last_became_peered":"2026-02-24T09:17:00.242916+0000","last_unstale":"2026-02-24T09:17:01.377837+0000","last_undegraded":"2026-02-24T09:17:01.377837+0000","last_fullsized":"2026-02-24T09:17:01.377837+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:54:10.866892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"92'3","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.255220+0000","last_change":"2026-02-24T09:16:59.240197+0000","last_active":"2026-02-24T09:17:05.255220+0000","last_peered":"2026-02-24T09:17:05.255220+0000","last_clean":"2026-02-24T09:17:05.255220+0000","last_became_active":"2026-02-24T09:16:59.240036+0000","last_became_peered":"2026-02-24T09:16:59.240036+0000","last_unstale":"2026-02-24T09:17:05.255220+0000","last_undegraded":"2026-02-24T09:17:05.255220+0000","last_fullsized":"2026-02-24T09:17:05.255220+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:10:20.710884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"92'2","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.256064+0000","last_change":"2026-02-24T09:16:59.235467+0000","last_active":"2026-02-24T09:17:05.256064+0000","last_peered":"2026-02-24T09:17:05.256064+0000","last_clean":"2026-02-24T09:17:05.256064+0000","last_became_active":"2026-02-24T09:16:59.235262+0000","last_became_peered":"2026-02-24T09:16:59.235262+0000","last_unstale":"2026-02-24T09:17:05.256064+0000","last_undegraded":"2026-02-24T09:17:05.256064+0000","last_fullsized":"2026-02-24T09:17:05.256064+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:15:01.906008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231788+0000","last_change":"2026-02-24T09:17:00.237830+0000","last_active":"2026-02-24T09:17:01.231788+0000","last_peered":"2026-02-24T09:17:01.231788+0000","last_clean":"2026-02-24T09:17:01.231788+0000","last_became_active":"2026-02-24T09:17:00.237730+0000","last_became_peered":"2026-02-24T09:17:00.237730+0000","last_unstale":"2026-02-24T09:17:01.231788+0000","last_undegraded":"2026-02-24T09:17:01.231788+0000","last_fullsized":"2026-02-24T09:17:01.231788+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:49:14.120510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"92'1","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:02.469482+0000","last_change":"2026-02-24T09:16:59.238783+0000","last_active":"2026-02-24T09:17:02.469482+0000","last_peered":"2026-02-24T09:17:02.469482+0000","last_clean":"2026-02-24T09:17:02.469482+0000","last_became_active":"2026-02-24T09:16:59.238700+0000","last_became_peered":"2026-02-24T09:16:59.238700+0000","last_unstale":"2026-02-24T09:17:02.469482+0000","last_undegraded":"2026-02-24T09:17:02.469482+0000","last_fullsized":"2026-02-24T09:17:02.469482+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:07:28.426507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375760+0000","last_change":"2026-02-24T09:17:00.240566+0000","last_active":"2026-02-24T09:17:01.375760+0000","last_peered":"2026-02-24T09:17:01.375760+0000","last_clean":"2026-02-24T09:17:01.375760+0000","last_became_active":"2026-02-24T09:17:00.239787+0000","last_became_peered":"2026-02-24T09:17:00.239787+0000","last_unstale":"2026-02-24T09:17:01.375760+0000","last_undegraded":"2026-02-24T09:17:01.375760+0000","last_fullsized":"2026-02-24T09:17:01.375760+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:37:55.629531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"92'3","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:09.574856+0000","last_change":"2026-02-24T09:16:59.239817+0000","last_active":"2026-02-24T09:17:09.574856+0000","last_peered":"2026-02-24T09:17:09.574856+0000","last_clean":"2026-02-24T09:17:09.574856+0000","last_became_active":"2026-02-24T09:16:59.239753+0000","last_became_peered":"2026-02-24T09:16:59.239753+0000","last_unstale":"2026-02-24T09:17:09.574856+0000","last_undegraded":"2026-02-24T09:17:09.574856+0000","last_fullsized":"2026-02-24T09:17:09.574856+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:25:15.726537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376407+0000","last_change":"2026-02-24T09:17:00.242220+0000","last_active":"2026-02-24T09:17:01.376407+0000","last_peered":"2026-02-24T09:17:01.376407+0000","last_clean":"2026-02-24T09:17:01.376407+0000","last_became_active":"2026-02-24T09:17:00.241795+0000","last_became_peered":"2026-02-24T09:17:00.241795+0000","last_unstale":"2026-02-24T09:17:01.376407+0000","last_undegraded":"2026-02-24T09:17:01.376407+0000","last_fullsized":"2026-02-24T09:17:01.376407+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:16:26.952516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"92'2","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:04.250229+0000","last_change":"2026-02-24T09:16:59.237294+0000","last_active":"2026-02-24T09:17:04.250229+0000","last_peered":"2026-02-24T09:17:04.250229+0000","last_clean":"2026-02-24T09:17:04.250229+0000","last_became_active":"2026-02-24T09:16:59.237192+0000","last_became_peered":"2026-02-24T09:16:59.237192+0000","last_unstale":"2026-02-24T09:17:04.250229+0000","last_undegraded":"2026-02-24T09:17:04.250229+0000","last_fullsized":"2026-02-24T09:17:04.250229+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:28:54.216539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375947+0000","last_change":"2026-02-24T09:17:00.244365+0000","last_active":"2026-02-24T09:17:01.375947+0000","last_peered":"2026-02-24T09:17:01.375947+0000","last_clean":"2026-02-24T09:17:01.375947+0000","last_became_active":"2026-02-24T09:17:00.244262+0000","last_became_peered":"2026-02-24T09:17:00.244262+0000","last_unstale":"2026-02-24T09:17:01.375947+0000","last_undegraded":"2026-02-24T09:17:01.375947+0000","last_fullsized":"2026-02-24T09:17:01.375947+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:46:44.145479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"92'4","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:04.250710+0000","last_change":"2026-02-24T09:16:59.240964+0000","last_active":"2026-02-24T09:17:04.250710+0000","last_peered":"2026-02-24T09:17:04.250710+0000","last_clean":"2026-02-24T09:17:04.250710+0000","last_became_active":"2026-02-24T09:16:59.240812+0000","last_became_peered":"2026-02-24T09:16:59.240812+0000","last_unstale":"2026-02-24T09:17:04.250710+0000","last_undegraded":"2026-02-24T09:17:04.250710+0000","last_fullsized":"2026-02-24T09:17:04.250710+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:07:51.752070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376252+0000","last_change":"2026-02-24T09:17:00.245692+0000","last_active":"2026-02-24T09:17:01.376252+0000","last_peered":"2026-02-24T09:17:01.376252+0000","last_clean":"2026-02-24T09:17:01.376252+0000","last_became_active":"2026-02-24T09:17:00.245616+0000","last_became_peered":"2026-02-24T09:17:00.245616+0000","last_unstale":"2026-02-24T09:17:01.376252+0000","last_undegraded":"2026-02-24T09:17:01.376252+0000","last_fullsized":"2026-02-24T09:17:01.376252+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:03:42.649936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"92'22","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:10.579553+0000","last_change":"2026-02-24T09:16:59.243723+0000","last_active":"2026-02-24T09:17:10.579553+0000","last_peered":"2026-02-24T09:17:10.579553+0000","last_clean":"2026-02-24T09:17:10.579553+0000","last_became_active":"2026-02-24T09:16:59.243606+0000","last_became_peered":"2026-02-24T09:16:59.243606+0000","last_unstale":"2026-02-24T09:17:10.579553+0000","last_undegraded":"2026-02-24T09:17:10.579553+0000","last_fullsized":"2026-02-24T09:17:10.579553+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:35:14.333104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53104,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":60,"num_write":23,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.377374+0000","last_change":"2026-02-24T09:17:00.237314+0000","last_active":"2026-02-24T09:17:01.377374+0000","last_peered":"2026-02-24T09:17:01.377374+0000","last_clean":"2026-02-24T09:17:01.377374+0000","last_became_active":"2026-02-24T09:17:00.237210+0000","last_became_peered":"2026-02-24T09:17:00.237210+0000","last_unstale":"2026-02-24T09:17:01.377374+0000","last_undegraded":"2026-02-24T09:17:01.377374+0000","last_fullsized":"2026-02-24T09:17:01.377374+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:03:03.936414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"92'6","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.257112+0000","last_change":"2026-02-24T09:16:59.242567+0000","last_active":"2026-02-24T09:17:05.257112+0000","last_peered":"2026-02-24T09:17:05.257112+0000","last_clean":"2026-02-24T09:17:05.257112+0000","last_became_active":"2026-02-24T09:16:59.242420+0000","last_became_peered":"2026-02-24T09:16:59.242420+0000","last_unstale":"2026-02-24T09:17:05.257112+0000","last_undegraded":"2026-02-24T09:17:05.257112+0000","last_fullsized":"2026-02-24T09:17:05.257112+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:58:16.881321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231844+0000","last_change":"2026-02-24T09:17:00.239405+0000","last_active":"2026-02-24T09:17:01.231844+0000","last_peered":"2026-02-24T09:17:01.231844+0000","last_clean":"2026-02-24T09:17:01.231844+0000","last_became_active":"2026-02-24T09:17:00.239281+0000","last_became_peered":"2026-02-24T09:17:00.239281+0000","last_unstale":"2026-02-24T09:17:01.231844+0000","last_undegraded":"2026-02-24T09:17:01.231844+0000","last_fullsized":"2026-02-24T09:17:01.231844+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:19:48.176289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"92'3","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:04.250578+0000","last_change":"2026-02-24T09:16:59.242394+0000","last_active":"2026-02-24T09:17:04.250578+0000","last_peered":"2026-02-24T09:17:04.250578+0000","last_clean":"2026-02-24T09:17:04.250578+0000","last_became_active":"2026-02-24T09:16:59.242199+0000","last_became_peered":"2026-02-24T09:16:59.242199+0000","last_unstale":"2026-02-24T09:17:04.250578+0000","last_undegraded":"2026-02-24T09:17:04.250578+0000","last_fullsized":"2026-02-24T09:17:04.250578+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:04:12.763715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.610151+0000","last_change":"2026-02-24T09:17:00.237820+0000","last_active":"2026-02-24T09:17:01.610151+0000","last_peered":"2026-02-24T09:17:01.610151+0000","last_clean":"2026-02-24T09:17:01.610151+0000","last_became_active":"2026-02-24T09:17:00.237711+0000","last_became_peered":"2026-02-24T09:17:00.237711+0000","last_unstale":"2026-02-24T09:17:01.610151+0000","last_undegraded":"2026-02-24T09:17:01.610151+0000","last_fullsized":"2026-02-24T09:17:01.610151+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:27:44.269231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"92'4","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:08.576961+0000","last_change":"2026-02-24T09:16:59.239787+0000","last_active":"2026-02-24T09:17:08.576961+0000","last_peered":"2026-02-24T09:17:08.576961+0000","last_clean":"2026-02-24T09:17:08.576961+0000","last_became_active":"2026-02-24T09:16:59.239066+0000","last_became_peered":"2026-02-24T09:16:59.239066+0000","last_unstale":"2026-02-24T09:17:08.576961+0000","last_undegraded":"2026-02-24T09:17:08.576961+0000","last_fullsized":"2026-02-24T09:17:08.576961+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:10:34.992034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.609694+0000","last_change":"2026-02-24T09:17:00.246515+0000","last_active":"2026-02-24T09:17:01.609694+0000","last_peered":"2026-02-24T09:17:01.609694+0000","last_clean":"2026-02-24T09:17:01.609694+0000","last_became_active":"2026-02-24T09:17:00.246222+0000","last_became_peered":"2026-02-24T09:17:00.246222+0000","last_unstale":"2026-02-24T09:17:01.609694+0000","last_undegraded":"2026-02-24T09:17:01.609694+0000","last_fullsized":"2026-02-24T09:17:01.609694+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:28:05.377985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"92'15","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.257255+0000","last_change":"2026-02-24T09:16:59.239752+0000","last_active":"2026-02-24T09:17:05.257255+0000","last_peered":"2026-02-24T09:17:05.257255+0000","last_clean":"2026-02-24T09:17:05.257255+0000","last_became_active":"2026-02-24T09:16:59.239609+0000","last_became_peered":"2026-02-24T09:16:59.239609+0000","last_unstale":"2026-02-24T09:17:05.257255+0000","last_undegraded":"2026-02-24T09:17:05.257255+0000","last_fullsized":"2026-02-24T09:17:05.257255+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:30:54.943423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.378159+0000","last_change":"2026-02-24T09:17:00.246053+0000","last_active":"2026-02-24T09:17:01.378159+0000","last_peered":"2026-02-24T09:17:01.378159+0000","last_clean":"2026-02-24T09:17:01.378159+0000","last_became_active":"2026-02-24T09:17:00.245905+0000","last_became_peered":"2026-02-24T09:17:00.245905+0000","last_unstale":"2026-02-24T09:17:01.378159+0000","last_undegraded":"2026-02-24T09:17:01.378159+0000","last_fullsized":"2026-02-24T09:17:01.378159+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:36:56.843524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"92'2","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.570884+0000","last_change":"2026-02-24T09:16:59.241232+0000","last_active":"2026-02-24T09:17:05.570884+0000","last_peered":"2026-02-24T09:17:05.570884+0000","last_clean":"2026-02-24T09:17:05.570884+0000","last_became_active":"2026-02-24T09:16:59.240754+0000","last_became_peered":"2026-02-24T09:16:59.240754+0000","last_unstale":"2026-02-24T09:17:05.570884+0000","last_undegraded":"2026-02-24T09:17:05.570884+0000","last_fullsized":"2026-02-24T09:17:05.570884+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:57:01.258617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376875+0000","last_change":"2026-02-24T09:17:00.246591+0000","last_active":"2026-02-24T09:17:01.376875+0000","last_peered":"2026-02-24T09:17:01.376875+0000","last_clean":"2026-02-24T09:17:01.376875+0000","last_became_active":"2026-02-24T09:17:00.246487+0000","last_became_peered":"2026-02-24T09:17:00.246487+0000","last_unstale":"2026-02-24T09:17:01.376875+0000","last_undegraded":"2026-02-24T09:17:01.376875+0000","last_fullsized":"2026-02-24T09:17:01.376875+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:58:37.854234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"91'2","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232200+0000","last_change":"2026-02-24T09:16:59.239102+0000","last_active":"2026-02-24T09:17:01.232200+0000","last_peered":"2026-02-24T09:17:01.232200+0000","last_clean":"2026-02-24T09:17:01.232200+0000","last_became_active":"2026-02-24T09:16:59.238978+0000","last_became_peered":"2026-02-24T09:16:59.238978+0000","last_unstale":"2026-02-24T09:17:01.232200+0000","last_undegraded":"2026-02-24T09:17:01.232200+0000","last_fullsized":"2026-02-24T09:17:01.232200+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:57:02.192151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.610201+0000","last_change":"2026-02-24T09:17:00.238578+0000","last_active":"2026-02-24T09:17:01.610201+0000","last_peered":"2026-02-24T09:17:01.610201+0000","last_clean":"2026-02-24T09:17:01.610201+0000","last_became_active":"2026-02-24T09:17:00.238465+0000","last_became_peered":"2026-02-24T09:17:00.238465+0000","last_unstale":"2026-02-24T09:17:01.610201+0000","last_undegraded":"2026-02-24T09:17:01.610201+0000","last_fullsized":"2026-02-24T09:17:01.610201+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:44:35.349567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"91'1","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:02.469552+0000","last_change":"2026-02-24T09:16:59.242643+0000","last_active":"2026-02-24T09:17:02.469552+0000","last_peered":"2026-02-24T09:17:02.469552+0000","last_clean":"2026-02-24T09:17:02.469552+0000","last_became_active":"2026-02-24T09:16:59.242376+0000","last_became_peered":"2026-02-24T09:16:59.242376+0000","last_unstale":"2026-02-24T09:17:02.469552+0000","last_undegraded":"2026-02-24T09:17:02.469552+0000","last_fullsized":"2026-02-24T09:17:02.469552+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:27:11.004972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"92'1","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.609794+0000","last_change":"2026-02-24T09:17:00.246332+0000","last_active":"2026-02-24T09:17:01.609794+0000","last_peered":"2026-02-24T09:17:01.609794+0000","last_clean":"2026-02-24T09:17:01.609794+0000","last_became_active":"2026-02-24T09:17:00.246194+0000","last_became_peered":"2026-02-24T09:17:00.246194+0000","last_unstale":"2026-02-24T09:17:01.609794+0000","last_undegraded":"2026-02-24T09:17:01.609794+0000","last_fullsized":"2026-02-24T09:17:01.609794+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:58:11.173666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"92'3","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.257225+0000","last_change":"2026-02-24T09:16:59.243374+0000","last_active":"2026-02-24T09:17:05.257225+0000","last_peered":"2026-02-24T09:17:05.257225+0000","last_clean":"2026-02-24T09:17:05.257225+0000","last_became_active":"2026-02-24T09:16:59.241003+0000","last_became_peered":"2026-02-24T09:16:59.241003+0000","last_unstale":"2026-02-24T09:17:05.257225+0000","last_undegraded":"2026-02-24T09:17:05.257225+0000","last_fullsized":"2026-02-24T09:17:05.257225+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:26:57.571616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.610188+0000","last_change":"2026-02-24T09:17:00.240655+0000","last_active":"2026-02-24T09:17:01.610188+0000","last_peered":"2026-02-24T09:17:01.610188+0000","last_clean":"2026-02-24T09:17:01.610188+0000","last_became_active":"2026-02-24T09:17:00.240419+0000","last_became_peered":"2026-02-24T09:17:00.240419+0000","last_unstale":"2026-02-24T09:17:01.610188+0000","last_undegraded":"2026-02-24T09:17:01.610188+0000","last_fullsized":"2026-02-24T09:17:01.610188+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:18:34.651497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"25'152","reported_seq":371,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.609797+0000","last_change":"2026-02-24T09:16:23.569634+0000","last_active":"2026-02-24T09:17:01.609797+0000","last_peered":"2026-02-24T09:17:01.609797+0000","last_clean":"2026-02-24T09:17:01.609797+0000","last_became_active":"2026-02-24T09:16:23.569284+0000","last_became_peered":"2026-02-24T09:16:23.569284+0000","last_unstale":"2026-02-24T09:17:01.609797+0000","last_undegraded":"2026-02-24T09:17:01.609797+0000","last_fullsized":"2026-02-24T09:17:01.609797+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:14:34.386267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:14:34.386267+0000","last_clean_scrub_stamp":"2026-02-24T09:14:34.386267+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:03:26.216331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"92'3","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.568942+0000","last_change":"2026-02-24T09:16:59.239216+0000","last_active":"2026-02-24T09:17:05.568942+0000","last_peered":"2026-02-24T09:17:05.568942+0000","last_clean":"2026-02-24T09:17:05.568942+0000","last_became_active":"2026-02-24T09:16:59.239009+0000","last_became_peered":"2026-02-24T09:16:59.239009+0000","last_unstale":"2026-02-24T09:17:05.568942+0000","last_undegraded":"2026-02-24T09:17:05.568942+0000","last_fullsized":"2026-02-24T09:17:05.568942+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:51:32.186590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231677+0000","last_change":"2026-02-24T09:17:00.242943+0000","last_active":"2026-02-24T09:17:01.231677+0000","last_peered":"2026-02-24T09:17:01.231677+0000","last_clean":"2026-02-24T09:17:01.231677+0000","last_became_active":"2026-02-24T09:17:00.242841+0000","last_became_peered":"2026-02-24T09:17:00.242841+0000","last_unstale":"2026-02-24T09:17:01.231677+0000","last_undegraded":"2026-02-24T09:17:01.231677+0000","last_fullsized":"2026-02-24T09:17:01.231677+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:27:23.973327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"92'3","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.254697+0000","last_change":"2026-02-24T09:16:59.239635+0000","last_active":"2026-02-24T09:17:05.254697+0000","last_peered":"2026-02-24T09:17:05.254697+0000","last_clean":"2026-02-24T09:17:05.254697+0000","last_became_active":"2026-02-24T09:16:59.239565+0000","last_became_peered":"2026-02-24T09:16:59.239565+0000","last_unstale":"2026-02-24T09:17:05.254697+0000","last_undegraded":"2026-02-24T09:17:05.254697+0000","last_fullsized":"2026-02-24T09:17:05.254697+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:33:03.541374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231556+0000","last_change":"2026-02-24T09:17:00.244300+0000","last_active":"2026-02-24T09:17:01.231556+0000","last_peered":"2026-02-24T09:17:01.231556+0000","last_clean":"2026-02-24T09:17:01.231556+0000","last_became_active":"2026-02-24T09:17:00.244133+0000","last_became_peered":"2026-02-24T09:17:00.244133+0000","last_unstale":"2026-02-24T09:17:01.231556+0000","last_undegraded":"2026-02-24T09:17:01.231556+0000","last_fullsized":"2026-02-24T09:17:01.231556+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:42:14.299522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"92'4","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.572884+0000","last_change":"2026-02-24T09:16:59.242539+0000","last_active":"2026-02-24T09:17:05.572884+0000","last_peered":"2026-02-24T09:17:05.572884+0000","last_clean":"2026-02-24T09:17:05.572884+0000","last_became_active":"2026-02-24T09:16:59.242210+0000","last_became_peered":"2026-02-24T09:16:59.242210+0000","last_unstale":"2026-02-24T09:17:05.572884+0000","last_undegraded":"2026-02-24T09:17:05.572884+0000","last_fullsized":"2026-02-24T09:17:05.572884+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:47:26.799485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.377784+0000","last_change":"2026-02-24T09:17:00.246745+0000","last_active":"2026-02-24T09:17:01.377784+0000","last_peered":"2026-02-24T09:17:01.377784+0000","last_clean":"2026-02-24T09:17:01.377784+0000","last_became_active":"2026-02-24T09:17:00.246652+0000","last_became_peered":"2026-02-24T09:17:00.246652+0000","last_unstale":"2026-02-24T09:17:01.377784+0000","last_undegraded":"2026-02-24T09:17:01.377784+0000","last_fullsized":"2026-02-24T09:17:01.377784+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:16:56.265530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"92'1","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.610257+0000","last_change":"2026-02-24T09:16:59.235982+0000","last_active":"2026-02-24T09:17:01.610257+0000","last_peered":"2026-02-24T09:17:01.610257+0000","last_clean":"2026-02-24T09:17:01.610257+0000","last_became_active":"2026-02-24T09:16:59.235893+0000","last_became_peered":"2026-02-24T09:16:59.235893+0000","last_unstale":"2026-02-24T09:17:01.610257+0000","last_undegraded":"2026-02-24T09:17:01.610257+0000","last_fullsized":"2026-02-24T09:17:01.610257+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:02:50.906502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231934+0000","last_change":"2026-02-24T09:17:00.237347+0000","last_active":"2026-02-24T09:17:01.231934+0000","last_peered":"2026-02-24T09:17:01.231934+0000","last_clean":"2026-02-24T09:17:01.231934+0000","last_became_active":"2026-02-24T09:17:00.237254+0000","last_became_peered":"2026-02-24T09:17:00.237254+0000","last_unstale":"2026-02-24T09:17:01.231934+0000","last_undegraded":"2026-02-24T09:17:01.231934+0000","last_fullsized":"2026-02-24T09:17:01.231934+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:26:24.955214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375984+0000","last_change":"2026-02-24T09:16:59.244271+0000","last_active":"2026-02-24T09:17:01.375984+0000","last_peered":"2026-02-24T09:17:01.375984+0000","last_clean":"2026-02-24T09:17:01.375984+0000","last_became_active":"2026-02-24T09:16:59.243995+0000","last_became_peered":"2026-02-24T09:16:59.243995+0000","last_unstale":"2026-02-24T09:17:01.375984+0000","last_undegraded":"2026-02-24T09:17:01.375984+0000","last_fullsized":"2026-02-24T09:17:01.375984+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:23:30.140261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"92'1","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231998+0000","last_change":"2026-02-24T09:17:00.238722+0000","last_active":"2026-02-24T09:17:01.231998+0000","last_peered":"2026-02-24T09:17:01.231998+0000","last_clean":"2026-02-24T09:17:01.231998+0000","last_became_active":"2026-02-24T09:17:00.238067+0000","last_became_peered":"2026-02-24T09:17:00.238067+0000","last_unstale":"2026-02-24T09:17:01.231998+0000","last_undegraded":"2026-02-24T09:17:01.231998+0000","last_fullsized":"2026-02-24T09:17:01.231998+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:15:12.608200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"92'1","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:04.250009+0000","last_change":"2026-02-24T09:16:59.240637+0000","last_active":"2026-02-24T09:17:04.250009+0000","last_peered":"2026-02-24T09:17:04.250009+0000","last_clean":"2026-02-24T09:17:04.250009+0000","last_became_active":"2026-02-24T09:16:59.240525+0000","last_became_peered":"2026-02-24T09:16:59.240525+0000","last_unstale":"2026-02-24T09:17:04.250009+0000","last_undegraded":"2026-02-24T09:17:04.250009+0000","last_fullsized":"2026-02-24T09:17:04.250009+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:19:39.812071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232103+0000","last_change":"2026-02-24T09:17:00.242384+0000","last_active":"2026-02-24T09:17:01.232103+0000","last_peered":"2026-02-24T09:17:01.232103+0000","last_clean":"2026-02-24T09:17:01.232103+0000","last_became_active":"2026-02-24T09:17:00.242252+0000","last_became_peered":"2026-02-24T09:17:00.242252+0000","last_unstale":"2026-02-24T09:17:01.232103+0000","last_undegraded":"2026-02-24T09:17:01.232103+0000","last_fullsized":"2026-02-24T09:17:01.232103+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:55:25.276787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"92'3","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.255383+0000","last_change":"2026-02-24T09:16:59.242386+0000","last_active":"2026-02-24T09:17:05.255383+0000","last_peered":"2026-02-24T09:17:05.255383+0000","last_clean":"2026-02-24T09:17:05.255383+0000","last_became_active":"2026-02-24T09:16:59.240737+0000","last_became_peered":"2026-02-24T09:16:59.240737+0000","last_unstale":"2026-02-24T09:17:05.255383+0000","last_undegraded":"2026-02-24T09:17:05.255383+0000","last_fullsized":"2026-02-24T09:17:05.255383+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:35:28.471311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232263+0000","last_change":"2026-02-24T09:17:00.239525+0000","last_active":"2026-02-24T09:17:01.232263+0000","last_peered":"2026-02-24T09:17:01.232263+0000","last_clean":"2026-02-24T09:17:01.232263+0000","last_became_active":"2026-02-24T09:17:00.239161+0000","last_became_peered":"2026-02-24T09:17:00.239161+0000","last_unstale":"2026-02-24T09:17:01.232263+0000","last_undegraded":"2026-02-24T09:17:01.232263+0000","last_fullsized":"2026-02-24T09:17:01.232263+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:35:14.881330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"92'4","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:04.248734+0000","last_change":"2026-02-24T09:16:59.233525+0000","last_active":"2026-02-24T09:17:04.248734+0000","last_peered":"2026-02-24T09:17:04.248734+0000","last_clean":"2026-02-24T09:17:04.248734+0000","last_became_active":"2026-02-24T09:16:59.233370+0000","last_became_peered":"2026-02-24T09:16:59.233370+0000","last_unstale":"2026-02-24T09:17:04.248734+0000","last_undegraded":"2026-02-24T09:17:04.248734+0000","last_fullsized":"2026-02-24T09:17:04.248734+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:49:37.491011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376128+0000","last_change":"2026-02-24T09:17:00.241506+0000","last_active":"2026-02-24T09:17:01.376128+0000","last_peered":"2026-02-24T09:17:01.376128+0000","last_clean":"2026-02-24T09:17:01.376128+0000","last_became_active":"2026-02-24T09:17:00.241385+0000","last_became_peered":"2026-02-24T09:17:00.241385+0000","last_unstale":"2026-02-24T09:17:01.376128+0000","last_undegraded":"2026-02-24T09:17:01.376128+0000","last_fullsized":"2026-02-24T09:17:01.376128+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:17:11.846529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"92'2","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:04.249681+0000","last_change":"2026-02-24T09:16:59.238575+0000","last_active":"2026-02-24T09:17:04.249681+0000","last_peered":"2026-02-24T09:17:04.249681+0000","last_clean":"2026-02-24T09:17:04.249681+0000","last_became_active":"2026-02-24T09:16:59.238286+0000","last_became_peered":"2026-02-24T09:16:59.238286+0000","last_unstale":"2026-02-24T09:17:04.249681+0000","last_undegraded":"2026-02-24T09:17:04.249681+0000","last_fullsized":"2026-02-24T09:17:04.249681+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:18:59.982647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376961+0000","last_change":"2026-02-24T09:17:00.238159+0000","last_active":"2026-02-24T09:17:01.376961+0000","last_peered":"2026-02-24T09:17:01.376961+0000","last_clean":"2026-02-24T09:17:01.376961+0000","last_became_active":"2026-02-24T09:17:00.238069+0000","last_became_peered":"2026-02-24T09:17:00.238069+0000","last_unstale":"2026-02-24T09:17:01.376961+0000","last_undegraded":"2026-02-24T09:17:01.376961+0000","last_fullsized":"2026-02-24T09:17:01.376961+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:45:21.584921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"92'3","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:04.250654+0000","last_change":"2026-02-24T09:16:59.241444+0000","last_active":"2026-02-24T09:17:04.250654+0000","last_peered":"2026-02-24T09:17:04.250654+0000","last_clean":"2026-02-24T09:17:04.250654+0000","last_became_active":"2026-02-24T09:16:59.241253+0000","last_became_peered":"2026-02-24T09:16:59.241253+0000","last_unstale":"2026-02-24T09:17:04.250654+0000","last_undegraded":"2026-02-24T09:17:04.250654+0000","last_fullsized":"2026-02-24T09:17:04.250654+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:07:34.833768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376780+0000","last_change":"2026-02-24T09:17:00.245603+0000","last_active":"2026-02-24T09:17:01.376780+0000","last_peered":"2026-02-24T09:17:01.376780+0000","last_clean":"2026-02-24T09:17:01.376780+0000","last_became_active":"2026-02-24T09:17:00.245409+0000","last_became_peered":"2026-02-24T09:17:00.245409+0000","last_unstale":"2026-02-24T09:17:01.376780+0000","last_undegraded":"2026-02-24T09:17:01.376780+0000","last_fullsized":"2026-02-24T09:17:01.376780+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:24:31.732634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"92'1","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:02.676977+0000","last_change":"2026-02-24T09:16:59.242808+0000","last_active":"2026-02-24T09:17:02.676977+0000","last_peered":"2026-02-24T09:17:02.676977+0000","last_clean":"2026-02-24T09:17:02.676977+0000","last_became_active":"2026-02-24T09:16:59.242717+0000","last_became_peered":"2026-02-24T09:16:59.242717+0000","last_unstale":"2026-02-24T09:17:02.676977+0000","last_undegraded":"2026-02-24T09:17:02.676977+0000","last_fullsized":"2026-02-24T09:17:02.676977+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:55:54.008569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231613+0000","last_change":"2026-02-24T09:17:00.239253+0000","last_active":"2026-02-24T09:17:01.231613+0000","last_peered":"2026-02-24T09:17:01.231613+0000","last_clean":"2026-02-24T09:17:01.231613+0000","last_became_active":"2026-02-24T09:17:00.238983+0000","last_became_peered":"2026-02-24T09:17:00.238983+0000","last_unstale":"2026-02-24T09:17:01.231613+0000","last_undegraded":"2026-02-24T09:17:01.231613+0000","last_fullsized":"2026-02-24T09:17:01.231613+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:15:35.939863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"92'4","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:04.250062+0000","last_change":"2026-02-24T09:16:59.238537+0000","last_active":"2026-02-24T09:17:04.250062+0000","last_peered":"2026-02-24T09:17:04.250062+0000","last_clean":"2026-02-24T09:17:04.250062+0000","last_became_active":"2026-02-24T09:16:59.238413+0000","last_became_peered":"2026-02-24T09:16:59.238413+0000","last_unstale":"2026-02-24T09:17:04.250062+0000","last_undegraded":"2026-02-24T09:17:04.250062+0000","last_fullsized":"2026-02-24T09:17:04.250062+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:18:35.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.609986+0000","last_change":"2026-02-24T09:17:00.241138+0000","last_active":"2026-02-24T09:17:01.609986+0000","last_peered":"2026-02-24T09:17:01.609986+0000","last_clean":"2026-02-24T09:17:01.609986+0000","last_became_active":"2026-02-24T09:17:00.240131+0000","last_became_peered":"2026-02-24T09:17:00.240131+0000","last_unstale":"2026-02-24T09:17:01.609986+0000","last_undegraded":"2026-02-24T09:17:01.609986+0000","last_fullsized":"2026-02-24T09:17:01.609986+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:30:04.572939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.378006+0000","last_change":"2026-02-24T09:17:00.247807+0000","last_active":"2026-02-24T09:17:01.378006+0000","last_peered":"2026-02-24T09:17:01.378006+0000","last_clean":"2026-02-24T09:17:01.378006+0000","last_became_active":"2026-02-24T09:17:00.247294+0000","last_became_peered":"2026-02-24T09:17:00.247294+0000","last_unstale":"2026-02-24T09:17:01.378006+0000","last_undegraded":"2026-02-24T09:17:01.378006+0000","last_fullsized":"2026-02-24T09:17:01.378006+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:40:19.082811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"91'2","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.377087+0000","last_change":"2026-02-24T09:16:59.241010+0000","last_active":"2026-02-24T09:17:01.377087+0000","last_peered":"2026-02-24T09:17:01.377087+0000","last_clean":"2026-02-24T09:17:01.377087+0000","last_became_active":"2026-02-24T09:16:59.240857+0000","last_became_peered":"2026-02-24T09:16:59.240857+0000","last_unstale":"2026-02-24T09:17:01.377087+0000","last_undegraded":"2026-02-24T09:17:01.377087+0000","last_fullsized":"2026-02-24T09:17:01.377087+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:00:21.995413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376275+0000","last_change":"2026-02-24T09:17:00.239878+0000","last_active":"2026-02-24T09:17:01.376275+0000","last_peered":"2026-02-24T09:17:01.376275+0000","last_clean":"2026-02-24T09:17:01.376275+0000","last_became_active":"2026-02-24T09:17:00.239782+0000","last_became_peered":"2026-02-24T09:17:00.239782+0000","last_unstale":"2026-02-24T09:17:01.376275+0000","last_undegraded":"2026-02-24T09:17:01.376275+0000","last_fullsized":"2026-02-24T09:17:01.376275+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:20:28.594190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"92'4","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.255383+0000","last_change":"2026-02-24T09:16:59.238466+0000","last_active":"2026-02-24T09:17:05.255383+0000","last_peered":"2026-02-24T09:17:05.255383+0000","last_clean":"2026-02-24T09:17:05.255383+0000","last_became_active":"2026-02-24T09:16:59.238371+0000","last_became_peered":"2026-02-24T09:16:59.238371+0000","last_unstale":"2026-02-24T09:17:05.255383+0000","last_undegraded":"2026-02-24T09:17:05.255383+0000","last_fullsized":"2026-02-24T09:17:05.255383+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:25:57.207215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375857+0000","last_change":"2026-02-24T09:17:00.242538+0000","last_active":"2026-02-24T09:17:01.375857+0000","last_peered":"2026-02-24T09:17:01.375857+0000","last_clean":"2026-02-24T09:17:01.375857+0000","last_became_active":"2026-02-24T09:17:00.241119+0000","last_became_peered":"2026-02-24T09:17:00.241119+0000","last_unstale":"2026-02-24T09:17:01.375857+0000","last_undegraded":"2026-02-24T09:17:01.375857+0000","last_fullsized":"2026-02-24T09:17:01.375857+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:03:23.360618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"92'2","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.545231+0000","last_change":"2026-02-24T09:16:59.243406+0000","last_active":"2026-02-24T09:17:01.545231+0000","last_peered":"2026-02-24T09:17:01.545231+0000","last_clean":"2026-02-24T09:17:01.545231+0000","last_became_active":"2026-02-24T09:16:59.243275+0000","last_became_peered":"2026-02-24T09:16:59.243275+0000","last_unstale":"2026-02-24T09:17:01.545231+0000","last_undegraded":"2026-02-24T09:17:01.545231+0000","last_fullsized":"2026-02-24T09:17:01.545231+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:11:58.812932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232102+0000","last_change":"2026-02-24T09:17:00.242628+0000","last_active":"2026-02-24T09:17:01.232102+0000","last_peered":"2026-02-24T09:17:01.232102+0000","last_clean":"2026-02-24T09:17:01.232102+0000","last_became_active":"2026-02-24T09:17:00.242482+0000","last_became_peered":"2026-02-24T09:17:00.242482+0000","last_unstale":"2026-02-24T09:17:01.232102+0000","last_undegraded":"2026-02-24T09:17:01.232102+0000","last_fullsized":"2026-02-24T09:17:01.232102+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:28:11.567636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"92'9","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.255500+0000","last_change":"2026-02-24T09:16:59.238503+0000","last_active":"2026-02-24T09:17:05.255500+0000","last_peered":"2026-02-24T09:17:05.255500+0000","last_clean":"2026-02-24T09:17:05.255500+0000","last_became_active":"2026-02-24T09:16:59.238321+0000","last_became_peered":"2026-02-24T09:16:59.238321+0000","last_unstale":"2026-02-24T09:17:05.255500+0000","last_undegraded":"2026-02-24T09:17:05.255500+0000","last_fullsized":"2026-02-24T09:17:05.255500+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:25:06.302717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":57564,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":51,"num_read_kb":87,"num_write":141,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":323584,"data_stored":100103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":122867,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":261676,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":87,"seq":373662154760,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28188,"kb_used_data":968,"kb_used_omap":10,"kb_used_meta":27189,"kb_avail":733975012,"statfs":{"total":751619276800,"available":751590412288,"internally_reserved":0,"allocated":991232,"data_stored":492629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10767,"internal_metadata":27842033},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":79,"seq":339302416395,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28328,"kb_used_data":1108,"kb_used_omap":28,"kb_used_meta":27171,"kb_avail":733974872,"statfs":{"total":751619276800,"available":751590268928,"internally_reserved":0,"allocated":1134592,"data_stored":1137624,"data_compressed":37836,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":28890,"internal_metadata":27823910},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":74,"seq":317827579918,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28204,"kb_used_data":984,"kb_used_omap":24,"kb_used_meta":27175,"kb_avail":733974996,"statfs":{"total":751619276800,"available":751590395904,"internally_reserved":0,"allocated":1007616,"data_stored":492865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25310,"internal_metadata":27827490},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":66,"seq":283467841552,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28204,"kb_used_data":984,"kb_used_omap":14,"kb_used_meta":27185,"kb_avail":733974996,"statfs":{"total":751619276800,"available":751590395904,"internally_reserved":0,"allocated":1007616,"data_stored":492785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15050,"internal_metadata":27837750},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":58,"seq":249108103187,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28252,"kb_used_data":1032,"kb_used_omap":35,"kb_used_meta":27164,"kb_avail":733974948,"statfs":{"total":751619276800,"available":751590346752,"internally_reserved":0,"allocated":1056768,"data_stored":1085144,"data_compressed":37836,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":36450,"internal_metadata":27816350},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":53,"seq":227633266709,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28188,"kb_used_data":968,"kb_used_omap":32,"kb_used_meta":27167,"kb_avail":733975012,"statfs":{"total":751619276800,"available":751590412288,"internally_reserved":0,"allocated":991232,"data_stored":492127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33261,"internal_metadata":27819539},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":45,"seq":193273528344,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28260,"kb_used_data":1040,"kb_used_omap":36,"kb_used_meta":27163,"kb_avail":733974940,"statfs":{"total":751619276800,"available":751590338560,"internally_reserved":0,"allocated":1064960,"data_stored":1084301,"data_compressed":37836,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":37621,"internal_metadata":27815179},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":38,"seq":163208757275,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28196,"kb_used_data":976,"kb_used_omap":44,"kb_used_meta":27155,"kb_avail":733975004,"statfs":{"total":751619276800,"available":751590404096,"internally_reserved":0,"allocated":999424,"data_stored":493091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45564,"internal_metadata":27807236},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":30,"seq":128849018909,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28200,"kb_used_data":980,"kb_used_omap":52,"kb_used_meta":27147,"kb_avail":733975000,"statfs":{"total":751619276800,"available":751590400000,"internally_reserved":0,"allocated":1003520,"data_stored":492321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53910,"internal_metadata":27798890},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280544,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28220,"kb_used_data":1000,"kb_used_omap":65,"kb_used_meta":27134,"kb_avail":733974980,"statfs":{"total":751619276800,"available":751590379520,"internally_reserved":0,"allocated":1024000,"data_stored":495019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":66689,"internal_metadata":27786111},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476771,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28220,"kb_used_data":1000,"kb_used_omap":54,"kb_used_meta":27145,"kb_avail":733974980,"statfs":{"total":751619276800,"available":751590379520,"internally_reserved":0,"allocated":1024000,"data_stored":517355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":55708,"internal_metadata":27797092},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949672999,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28212,"kb_used_data":992,"kb_used_omap":35,"kb_used_meta":27164,"kb_avail":733974988,"statfs":{"total":751619276800,"available":751590387712,"internally_reserved":0,"allocated":1015808,"data_stored":493535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36536,"internal_metadata":27816264},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37836,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37836,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37836,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37836,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37836,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1431,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":25318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1713,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":10071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12982,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12227,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12139,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3482,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4590,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33104,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4278,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12678,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":55102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22881,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1362,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T09:17:12.128 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-24T09:17:12.128 INFO:tasks.cephadm:Setting up client nodes... 2026-02-24T09:17:12.128 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-24T09:17:12.311 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:12.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.500+0000 7ff33eb4a640 1 -- 10.20.193.28:0/253440892 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff33810d9c0 msgr2=0x7ff338112a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:12.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.500+0000 7ff33eb4a640 1 --2- 10.20.193.28:0/253440892 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff33810d9c0 0x7ff338112a10 secure :-1 s=READY pgs=267 gs=1 cs=0 l=1 c_cookie=2915828271099404976 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff32c009950 tx=0x7ff32c02f190 comp rx=0 tx=0).stop 2026-02-24T09:17:12.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.500+0000 7ff33eb4a640 1 -- 10.20.193.28:0/253440892 shutdown_connections 2026-02-24T09:17:12.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.500+0000 7ff33eb4a640 1 --2- 10.20.193.28:0/253440892 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff3381131c0 0x7ff338173b90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:12.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.500+0000 7ff33eb4a640 1 --2- 10.20.193.28:0/253440892 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff33810d9c0 0x7ff338112a10 unknown :-1 s=CLOSED pgs=267 gs=1 cs=0 l=1 c_cookie=2915828271099404976 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:12.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.500+0000 7ff33eb4a640 1 --2- 10.20.193.28:0/253440892 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff33810cfd0 0x7ff33810d3a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:12.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.500+0000 7ff33eb4a640 1 -- 10.20.193.28:0/253440892 >> 10.20.193.28:0/253440892 conn(0x7ff3380ea900 msgr2=0x7ff33810ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:12.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.501+0000 7ff33eb4a640 1 -- 10.20.193.28:0/253440892 shutdown_connections 2026-02-24T09:17:12.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.501+0000 7ff33eb4a640 1 -- 10.20.193.28:0/253440892 wait complete. 2026-02-24T09:17:12.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.501+0000 7ff33eb4a640 1 Processor -- start 2026-02-24T09:17:12.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.501+0000 7ff33eb4a640 1 -- start start 2026-02-24T09:17:12.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.502+0000 7ff33eb4a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff33810cfd0 0x7ff3380f3340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:12.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.502+0000 7ff33eb4a640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff33810d9c0 0x7ff338173a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:12.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.502+0000 7ff33eb4a640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff3381131c0 0x7ff3380f3a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:12.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.502+0000 7ff33eb4a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff3380f8c50 con 0x7ff33810cfd0 2026-02-24T09:17:12.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.502+0000 7ff33eb4a640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7ff3380f8dc0 con 0x7ff3381131c0 2026-02-24T09:17:12.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.502+0000 7ff33eb4a640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff3380f8f80 con 0x7ff33810d9c0 2026-02-24T09:17:12.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.502+0000 7ff33db48640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff33810cfd0 0x7ff3380f3340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:12.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.502+0000 7ff33db48640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff33810cfd0 0x7ff3380f3340 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39364/0 (socket says 10.20.193.28:39364) 2026-02-24T09:17:12.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.502+0000 7ff33db48640 1 -- 10.20.193.28:0/2793883527 learned_addr learned my addr 10.20.193.28:0/2793883527 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:12.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.502+0000 7ff33e349640 1 --2- 10.20.193.28:0/2793883527 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff3381131c0 0x7ff3380f3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:12.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.502+0000 7ff33d347640 1 --2- 10.20.193.28:0/2793883527 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff33810d9c0 0x7ff338173a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:12.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.502+0000 7ff33db48640 1 -- 10.20.193.28:0/2793883527 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff33810d9c0 msgr2=0x7ff338173a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:12.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.502+0000 7ff33db48640 1 --2- 10.20.193.28:0/2793883527 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff33810d9c0 0x7ff338173a90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:12.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.502+0000 7ff33db48640 1 -- 10.20.193.28:0/2793883527 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff3381131c0 msgr2=0x7ff3380f3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:12.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.502+0000 7ff33db48640 1 --2- 10.20.193.28:0/2793883527 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff3381131c0 0x7ff3380f3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:12.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.502+0000 7ff33db48640 1 -- 10.20.193.28:0/2793883527 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff32c009570 con 0x7ff33810cfd0 2026-02-24T09:17:12.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.502+0000 7ff33db48640 1 --2- 10.20.193.28:0/2793883527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff33810cfd0 0x7ff3380f3340 secure :-1 s=READY pgs=268 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff32800c9b0 tx=0x7ff32800ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:12.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.502+0000 7ff326ffd640 1 -- 10.20.193.28:0/2793883527 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff3280044a0 con 0x7ff33810cfd0 2026-02-24T09:17:12.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.502+0000 7ff326ffd640 1 -- 10.20.193.28:0/2793883527 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff328007d80 con 0x7ff33810cfd0 2026-02-24T09:17:12.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.502+0000 7ff326ffd640 1 -- 10.20.193.28:0/2793883527 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff32800f6d0 con 0x7ff33810cfd0 2026-02-24T09:17:12.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.503+0000 7ff33eb4a640 1 -- 10.20.193.28:0/2793883527 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3380f9200 con 0x7ff33810cfd0 2026-02-24T09:17:12.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.503+0000 7ff33eb4a640 1 -- 10.20.193.28:0/2793883527 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3380f9680 con 0x7ff33810cfd0 2026-02-24T09:17:12.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.503+0000 7ff33eb4a640 1 -- 10.20.193.28:0/2793883527 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff33810e2b0 con 0x7ff33810cfd0 2026-02-24T09:17:12.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.505+0000 7ff326ffd640 1 -- 10.20.193.28:0/2793883527 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7ff3280078c0 con 0x7ff33810cfd0 2026-02-24T09:17:12.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.507+0000 7ff326ffd640 1 --2- 10.20.193.28:0/2793883527 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff3140b9d50 0x7ff3140da200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:12.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.507+0000 7ff326ffd640 1 -- 10.20.193.28:0/2793883527 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7ff3280e7020 con 0x7ff33810cfd0 2026-02-24T09:17:12.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.507+0000 7ff33d347640 1 --2- 10.20.193.28:0/2793883527 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff3140b9d50 0x7ff3140da200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:12.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.507+0000 7ff326ffd640 1 -- 10.20.193.28:0/2793883527 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7ff3280e7510 con 0x7ff33810cfd0 2026-02-24T09:17:12.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.508+0000 7ff33d347640 1 --2- 10.20.193.28:0/2793883527 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff3140b9d50 0x7ff3140da200 secure :-1 s=READY pgs=152 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff32c0023d0 tx=0x7ff32c031040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:12.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:12 trial028 ceph-mon[40371]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:17:12.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.662+0000 7ff33eb4a640 1 -- 10.20.193.28:0/2793883527 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7ff33810d3a0 con 0x7ff33810cfd0 2026-02-24T09:17:12.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.663+0000 7ff326ffd640 1 -- 10.20.193.28:0/2793883527 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) ==== 170+0+59 (secure 0 0 0) 0x7ff3280a98f0 con 0x7ff33810cfd0 2026-02-24T09:17:12.665 INFO:teuthology.orchestra.run.trial028.stdout:[client.0] 2026-02-24T09:17:12.666 INFO:teuthology.orchestra.run.trial028.stdout: key = AQCYbJ1pDMKSJxAAX8Su3NWTj5mp3jJRoukpIA== 2026-02-24T09:17:12.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.665+0000 7ff33eb4a640 1 -- 10.20.193.28:0/2793883527 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff3140b9d50 msgr2=0x7ff3140da200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:12.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.665+0000 7ff33eb4a640 1 --2- 10.20.193.28:0/2793883527 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff3140b9d50 0x7ff3140da200 secure :-1 s=READY pgs=152 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff32c0023d0 tx=0x7ff32c031040 comp rx=0 tx=0).stop 2026-02-24T09:17:12.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.665+0000 7ff33eb4a640 1 -- 10.20.193.28:0/2793883527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff33810cfd0 msgr2=0x7ff3380f3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:12.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.665+0000 7ff33eb4a640 1 --2- 10.20.193.28:0/2793883527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff33810cfd0 0x7ff3380f3340 secure :-1 s=READY pgs=268 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff32800c9b0 tx=0x7ff32800ce80 comp rx=0 tx=0).stop 2026-02-24T09:17:12.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.665+0000 7ff33eb4a640 1 -- 10.20.193.28:0/2793883527 shutdown_connections 2026-02-24T09:17:12.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.665+0000 7ff33eb4a640 1 --2- 10.20.193.28:0/2793883527 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff3140b9d50 0x7ff3140da200 unknown :-1 s=CLOSED pgs=152 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:12.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.665+0000 7ff33eb4a640 1 --2- 10.20.193.28:0/2793883527 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff3381131c0 0x7ff3380f3a40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:12.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.665+0000 7ff33eb4a640 1 --2- 10.20.193.28:0/2793883527 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff33810d9c0 0x7ff338173a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:12.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.665+0000 7ff33eb4a640 1 --2- 10.20.193.28:0/2793883527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff33810cfd0 0x7ff3380f3340 unknown :-1 s=CLOSED pgs=268 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:12.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.665+0000 7ff33eb4a640 1 -- 10.20.193.28:0/2793883527 >> 10.20.193.28:0/2793883527 conn(0x7ff3380ea900 msgr2=0x7ff33810f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:12.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.665+0000 7ff33eb4a640 1 -- 10.20.193.28:0/2793883527 shutdown_connections 2026-02-24T09:17:12.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:12.665+0000 7ff33eb4a640 1 -- 10.20.193.28:0/2793883527 wait complete. 2026-02-24T09:17:12.773 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-24T09:17:12.774 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-02-24T09:17:12.774 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-24T09:17:12.852 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph config log 1 --format=json 2026-02-24T09:17:12.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:12 trial074 ceph-mon[44412]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:17:13.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:12 trial159 ceph-mon[44242]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:17:13.076 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:13.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.255+0000 7f460f577640 1 -- 10.20.193.28:0/4056322456 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f461010f600 msgr2=0x7f461010f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:13.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.255+0000 7f460f577640 1 --2- 10.20.193.28:0/4056322456 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f461010f600 0x7f461010f9d0 secure :-1 s=READY pgs=269 gs=1 cs=0 l=1 c_cookie=2907119027176713906 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4604009950 tx=0x7f460402f190 comp rx=0 tx=0).stop 2026-02-24T09:17:13.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.255+0000 7f460f577640 1 -- 10.20.193.28:0/4056322456 shutdown_connections 2026-02-24T09:17:13.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.255+0000 7f460f577640 1 --2- 10.20.193.28:0/4056322456 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f46101157f0 0x7f46101761c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:13.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.255+0000 7f460f577640 1 --2- 10.20.193.28:0/4056322456 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f461010fff0 0x7f4610115040 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:13.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.255+0000 7f460f577640 1 --2- 10.20.193.28:0/4056322456 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f461010f600 0x7f461010f9d0 unknown :-1 s=CLOSED pgs=269 gs=1 cs=0 l=1 c_cookie=2907119027176713906 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:13.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.255+0000 7f460f577640 1 -- 10.20.193.28:0/4056322456 >> 10.20.193.28:0/4056322456 conn(0x7f46100ecef0 msgr2=0x7f461010d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:13.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.255+0000 7f460f577640 1 -- 10.20.193.28:0/4056322456 shutdown_connections 2026-02-24T09:17:13.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.255+0000 7f460f577640 1 -- 10.20.193.28:0/4056322456 wait complete. 2026-02-24T09:17:13.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.256+0000 7f460f577640 1 Processor -- start 2026-02-24T09:17:13.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.256+0000 7f460f577640 1 -- start start 2026-02-24T09:17:13.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.257+0000 7f460f577640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f461010f600 0x7f461011df60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:13.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.257+0000 7f460f577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f461010fff0 0x7f461011e4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:13.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.257+0000 7f460f577640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f46101157f0 0x7f4610123870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:13.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.257+0000 7f460f577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4610123e90 con 0x7f461010fff0 2026-02-24T09:17:13.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.257+0000 7f460f577640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f4610124000 con 0x7f46101157f0 2026-02-24T09:17:13.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.257+0000 7f460f577640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f46101241c0 con 0x7f461010f600 2026-02-24T09:17:13.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.257+0000 7f460e575640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f461010f600 0x7f461011df60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:13.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.257+0000 7f460e575640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f461010f600 0x7f461011df60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:38946/0 (socket says 10.20.193.28:38946) 2026-02-24T09:17:13.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.257+0000 7f460e575640 1 -- 10.20.193.28:0/2631880005 learned_addr learned my addr 10.20.193.28:0/2631880005 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:13.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.257+0000 7f460dd74640 1 --2- 10.20.193.28:0/2631880005 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f461010fff0 0x7f461011e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:13.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.257+0000 7f460ed76640 1 --2- 10.20.193.28:0/2631880005 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f46101157f0 0x7f4610123870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:13.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.257+0000 7f460e575640 1 -- 10.20.193.28:0/2631880005 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f46101157f0 msgr2=0x7f4610123870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:13.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.257+0000 7f460e575640 1 --2- 10.20.193.28:0/2631880005 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f46101157f0 0x7f4610123870 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:13.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.257+0000 7f460e575640 1 -- 10.20.193.28:0/2631880005 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f461010fff0 msgr2=0x7f461011e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:13.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.257+0000 7f460e575640 1 --2- 10.20.193.28:0/2631880005 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f461010fff0 0x7f461011e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:13.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.257+0000 7f460e575640 1 -- 10.20.193.28:0/2631880005 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4604009570 con 0x7f461010f600 2026-02-24T09:17:13.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.257+0000 7f460ed76640 1 --2- 10.20.193.28:0/2631880005 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f46101157f0 0x7f4610123870 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:17:13.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.257+0000 7f460dd74640 1 --2- 10.20.193.28:0/2631880005 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f461010fff0 0x7f461011e4a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:17:13.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.258+0000 7f460e575640 1 --2- 10.20.193.28:0/2631880005 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f461010f600 0x7f461011df60 secure :-1 s=READY pgs=82 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46040098a0 tx=0x7f46040028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:13.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.258+0000 7f45f77fe640 1 -- 10.20.193.28:0/2631880005 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f460403d070 con 0x7f461010f600 2026-02-24T09:17:13.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.258+0000 7f460f577640 1 -- 10.20.193.28:0/2631880005 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4610124440 con 0x7f461010f600 2026-02-24T09:17:13.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.258+0000 7f460f577640 1 -- 10.20.193.28:0/2631880005 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4610164ba0 con 0x7f461010f600 2026-02-24T09:17:13.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.258+0000 7f45f77fe640 1 -- 10.20.193.28:0/2631880005 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f4604002a40 con 0x7f461010f600 2026-02-24T09:17:13.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.258+0000 7f45f77fe640 1 -- 10.20.193.28:0/2631880005 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4604041720 con 0x7f461010f600 2026-02-24T09:17:13.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.258+0000 7f460f577640 1 -- 10.20.193.28:0/2631880005 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46101108e0 con 0x7f461010f600 2026-02-24T09:17:13.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.261+0000 7f45f77fe640 1 -- 10.20.193.28:0/2631880005 <== mon.1 v2:10.20.193.159:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f46040386a0 con 0x7f461010f600 2026-02-24T09:17:13.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.263+0000 7f45f77fe640 1 --2- 10.20.193.28:0/2631880005 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f45e80b5840 0x7f45e80d5cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:13.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.263+0000 7f45f77fe640 1 -- 10.20.193.28:0/2631880005 <== mon.1 v2:10.20.193.159:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f460410b420 con 0x7f461010f600 2026-02-24T09:17:13.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.263+0000 7f460dd74640 1 --2- 10.20.193.28:0/2631880005 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f45e80b5840 0x7f45e80d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:13.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.263+0000 7f45f77fe640 1 -- 10.20.193.28:0/2631880005 <== mon.1 v2:10.20.193.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f46040cde00 con 0x7f461010f600 2026-02-24T09:17:13.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.264+0000 7f460dd74640 1 --2- 10.20.193.28:0/2631880005 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f45e80b5840 0x7f45e80d5cf0 secure :-1 s=READY pgs=153 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4610124900 tx=0x7f45f8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:13.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.377+0000 7f460f577640 1 -- 10.20.193.28:0/2631880005 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f461011f0c0 con 0x7f461010f600 2026-02-24T09:17:13.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.378+0000 7f45f77fe640 1 -- 10.20.193.28:0/2631880005 <== mon.1 v2:10.20.193.159:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v51) ==== 86+0+133 (secure 0 0 0) 0x7f46040d0fb0 con 0x7f461010f600 2026-02-24T09:17:13.380 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:17:13.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.379+0000 7f460f577640 1 -- 10.20.193.28:0/2631880005 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f45e80b5840 msgr2=0x7f45e80d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:13.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.379+0000 7f460f577640 1 --2- 10.20.193.28:0/2631880005 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f45e80b5840 0x7f45e80d5cf0 secure :-1 s=READY pgs=153 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4610124900 tx=0x7f45f8005f90 comp rx=0 tx=0).stop 2026-02-24T09:17:13.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.379+0000 7f460f577640 1 -- 10.20.193.28:0/2631880005 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f461010f600 msgr2=0x7f461011df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:13.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.379+0000 7f460f577640 1 --2- 10.20.193.28:0/2631880005 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f461010f600 0x7f461011df60 secure :-1 s=READY pgs=82 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46040098a0 tx=0x7f46040028d0 comp rx=0 tx=0).stop 2026-02-24T09:17:13.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.379+0000 7f460f577640 1 -- 10.20.193.28:0/2631880005 shutdown_connections 2026-02-24T09:17:13.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.379+0000 7f460f577640 1 --2- 10.20.193.28:0/2631880005 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f45e80b5840 0x7f45e80d5cf0 unknown :-1 s=CLOSED pgs=153 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:13.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.379+0000 7f460f577640 1 --2- 10.20.193.28:0/2631880005 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f46101157f0 0x7f4610123870 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:13.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.379+0000 7f460f577640 1 --2- 10.20.193.28:0/2631880005 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f461010fff0 0x7f461011e4a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:13.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.379+0000 7f460f577640 1 --2- 10.20.193.28:0/2631880005 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f461010f600 0x7f461011df60 unknown :-1 s=CLOSED pgs=82 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:13.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.379+0000 7f460f577640 1 -- 10.20.193.28:0/2631880005 >> 10.20.193.28:0/2631880005 conn(0x7f46100ecef0 msgr2=0x7f461010d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:13.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.379+0000 7f460f577640 1 -- 10.20.193.28:0/2631880005 shutdown_connections 2026-02-24T09:17:13.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.379+0000 7f460f577640 1 -- 10.20.193.28:0/2631880005 wait complete. 2026-02-24T09:17:13.478 INFO:teuthology.orchestra.run.trial028.stdout:[{"version":51,"timestamp":"2026-02-24T09:16:54.178427+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2026-02-24T09:17:13.478 INFO:tasks.ceph_manager:config epoch is 51 2026-02-24T09:17:13.478 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-24T09:17:13.478 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-02-24T09:17:13.478 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph mgr dump --format=json 2026-02-24T09:17:13.660 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:13.734 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:13 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/2793883527' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-24T09:17:13.734 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:13 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/2793883527' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-24T09:17:13.734 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:13 trial028 ceph-mon[40371]: pgmap v187: 97 pgs: 97 active+clean; 633 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 7.7 KiB/s rd, 8.4 KiB/s wr, 17 op/s 2026-02-24T09:17:13.734 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:13 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/2631880005' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-24T09:17:13.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.836+0000 7f4a9b06e640 1 -- 10.20.193.28:0/391977607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a9410f6c0 msgr2=0x7f4a9410fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:13.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.836+0000 7f4a9b06e640 1 --2- 10.20.193.28:0/391977607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a9410f6c0 0x7f4a9410fa90 secure :-1 s=READY pgs=270 gs=1 cs=0 l=1 c_cookie=9168447569560605156 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4a84009950 tx=0x7f4a8402f190 comp rx=0 tx=0).stop 2026-02-24T09:17:13.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.836+0000 7f4a9b06e640 1 -- 10.20.193.28:0/391977607 shutdown_connections 2026-02-24T09:17:13.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.836+0000 7f4a9b06e640 1 --2- 10.20.193.28:0/391977607 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f4a941158b0 0x7f4a94176280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:13.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.836+0000 7f4a9b06e640 1 --2- 10.20.193.28:0/391977607 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f4a941100b0 0x7f4a94115100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:13.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.836+0000 7f4a9b06e640 1 --2- 10.20.193.28:0/391977607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a9410f6c0 0x7f4a9410fa90 unknown :-1 s=CLOSED pgs=270 gs=1 cs=0 l=1 c_cookie=9168447569560605156 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:13.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.836+0000 7f4a9b06e640 1 -- 10.20.193.28:0/391977607 >> 10.20.193.28:0/391977607 conn(0x7f4a940ecfd0 msgr2=0x7f4a9410d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:13.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.836+0000 7f4a9b06e640 1 -- 10.20.193.28:0/391977607 shutdown_connections 2026-02-24T09:17:13.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.836+0000 7f4a9b06e640 1 -- 10.20.193.28:0/391977607 wait complete. 2026-02-24T09:17:13.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.837+0000 7f4a9b06e640 1 Processor -- start 2026-02-24T09:17:13.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.837+0000 7f4a9b06e640 1 -- start start 2026-02-24T09:17:13.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.837+0000 7f4a9b06e640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f4a9410f6c0 0x7f4a9411e040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:13.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.837+0000 7f4a9b06e640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f4a941100b0 0x7f4a9411e580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:13.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.837+0000 7f4a9b06e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a941158b0 0x7f4a94123950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:13.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.837+0000 7f4a9b06e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4a94123f70 con 0x7f4a941158b0 2026-02-24T09:17:13.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.837+0000 7f4a9b06e640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f4a941240e0 con 0x7f4a941100b0 2026-02-24T09:17:13.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.837+0000 7f4a9b06e640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4a941242a0 con 0x7f4a9410f6c0 2026-02-24T09:17:13.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.837+0000 7f4a98de3640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f4a9410f6c0 0x7f4a9411e040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:13.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.837+0000 7f4a995e4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a941158b0 0x7f4a94123950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:13.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.837+0000 7f4a98de3640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f4a9410f6c0 0x7f4a9411e040 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:38968/0 (socket says 10.20.193.28:38968) 2026-02-24T09:17:13.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.837+0000 7f4a98de3640 1 -- 10.20.193.28:0/2689608386 learned_addr learned my addr 10.20.193.28:0/2689608386 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:13.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.837+0000 7f4a8bfff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f4a941100b0 0x7f4a9411e580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:13.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.838+0000 7f4a98de3640 1 -- 10.20.193.28:0/2689608386 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f4a941100b0 msgr2=0x7f4a9411e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:13.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.838+0000 7f4a98de3640 1 --2- 10.20.193.28:0/2689608386 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f4a941100b0 0x7f4a9411e580 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:13.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.838+0000 7f4a98de3640 1 -- 10.20.193.28:0/2689608386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a941158b0 msgr2=0x7f4a94123950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:13.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.838+0000 7f4a98de3640 1 --2- 10.20.193.28:0/2689608386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a941158b0 0x7f4a94123950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:13.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.838+0000 7f4a98de3640 1 -- 10.20.193.28:0/2689608386 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a84009570 con 0x7f4a9410f6c0 2026-02-24T09:17:13.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.838+0000 7f4a98de3640 1 --2- 10.20.193.28:0/2689608386 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f4a9410f6c0 0x7f4a9411e040 secure :-1 s=READY pgs=83 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4a840098a0 tx=0x7f4a840028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:13.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.838+0000 7f4a89ffb640 1 -- 10.20.193.28:0/2689608386 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4a8403d070 con 0x7f4a9410f6c0 2026-02-24T09:17:13.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.838+0000 7f4a89ffb640 1 -- 10.20.193.28:0/2689608386 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f4a84002a40 con 0x7f4a9410f6c0 2026-02-24T09:17:13.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.838+0000 7f4a9b06e640 1 -- 10.20.193.28:0/2689608386 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a94124520 con 0x7f4a9410f6c0 2026-02-24T09:17:13.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.838+0000 7f4a89ffb640 1 -- 10.20.193.28:0/2689608386 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4a84041720 con 0x7f4a9410f6c0 2026-02-24T09:17:13.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.839+0000 7f4a9b06e640 1 -- 10.20.193.28:0/2689608386 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a94164c80 con 0x7f4a9410f6c0 2026-02-24T09:17:13.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.839+0000 7f4a9b06e640 1 -- 10.20.193.28:0/2689608386 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a941109a0 con 0x7f4a9410f6c0 2026-02-24T09:17:13.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.841+0000 7f4a89ffb640 1 -- 10.20.193.28:0/2689608386 <== mon.1 v2:10.20.193.159:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f4a840386a0 con 0x7f4a9410f6c0 2026-02-24T09:17:13.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.843+0000 7f4a89ffb640 1 --2- 10.20.193.28:0/2689608386 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f4a700b57c0 0x7f4a700d5c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:13.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.843+0000 7f4a89ffb640 1 -- 10.20.193.28:0/2689608386 <== mon.1 v2:10.20.193.159:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f4a8410b030 con 0x7f4a9410f6c0 2026-02-24T09:17:13.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.843+0000 7f4a8bfff640 1 --2- 10.20.193.28:0/2689608386 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f4a700b57c0 0x7f4a700d5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:13.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.843+0000 7f4a89ffb640 1 -- 10.20.193.28:0/2689608386 <== mon.1 v2:10.20.193.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f4a8410b520 con 0x7f4a9410f6c0 2026-02-24T09:17:13.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.844+0000 7f4a8bfff640 1 --2- 10.20.193.28:0/2689608386 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f4a700b57c0 0x7f4a700d5c70 secure :-1 s=READY pgs=154 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4a941249e0 tx=0x7f4a7c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:13.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:13 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/2793883527' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-24T09:17:13.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:13 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/2793883527' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-24T09:17:13.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:13 trial074 ceph-mon[44412]: pgmap v187: 97 pgs: 97 active+clean; 633 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 7.7 KiB/s rd, 8.4 KiB/s wr, 17 op/s 2026-02-24T09:17:13.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:13 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/2631880005' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-24T09:17:13.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.989+0000 7f4a9b06e640 1 -- 10.20.193.28:0/2689608386 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f4a9411f1a0 con 0x7f4a9410f6c0 2026-02-24T09:17:13.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.993+0000 7f4a89ffb640 1 -- 10.20.193.28:0/2689608386 <== mon.1 v2:10.20.193.159:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v20) ==== 74+0+297637 (secure 0 0 0) 0x7f4a840cdac0 con 0x7f4a9410f6c0 2026-02-24T09:17:13.999 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:17:14.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.996+0000 7f4a9b06e640 1 -- 10.20.193.28:0/2689608386 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f4a700b57c0 msgr2=0x7f4a700d5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:14.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.996+0000 7f4a9b06e640 1 --2- 10.20.193.28:0/2689608386 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f4a700b57c0 0x7f4a700d5c70 secure :-1 s=READY pgs=154 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4a941249e0 tx=0x7f4a7c005f90 comp rx=0 tx=0).stop 2026-02-24T09:17:14.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.996+0000 7f4a9b06e640 1 -- 10.20.193.28:0/2689608386 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f4a9410f6c0 msgr2=0x7f4a9411e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:14.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.996+0000 7f4a9b06e640 1 --2- 10.20.193.28:0/2689608386 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f4a9410f6c0 0x7f4a9411e040 secure :-1 s=READY pgs=83 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4a840098a0 tx=0x7f4a840028d0 comp rx=0 tx=0).stop 2026-02-24T09:17:14.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.996+0000 7f4a9b06e640 1 -- 10.20.193.28:0/2689608386 shutdown_connections 2026-02-24T09:17:14.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.996+0000 7f4a9b06e640 1 --2- 10.20.193.28:0/2689608386 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f4a700b57c0 0x7f4a700d5c70 unknown :-1 s=CLOSED pgs=154 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:14.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.996+0000 7f4a9b06e640 1 --2- 10.20.193.28:0/2689608386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a941158b0 0x7f4a94123950 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:14.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.996+0000 7f4a9b06e640 1 --2- 10.20.193.28:0/2689608386 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f4a941100b0 0x7f4a9411e580 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:14.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.996+0000 7f4a9b06e640 1 --2- 10.20.193.28:0/2689608386 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f4a9410f6c0 0x7f4a9411e040 unknown :-1 s=CLOSED pgs=83 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:14.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.996+0000 7f4a9b06e640 1 -- 10.20.193.28:0/2689608386 >> 10.20.193.28:0/2689608386 conn(0x7f4a940ecfd0 msgr2=0x7f4a9410d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:14.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.996+0000 7f4a9b06e640 1 -- 10.20.193.28:0/2689608386 shutdown_connections 2026-02-24T09:17:14.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:13.996+0000 7f4a9b06e640 1 -- 10.20.193.28:0/2689608386 wait complete. 2026-02-24T09:17:14.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:13 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/2793883527' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-24T09:17:14.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:13 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/2793883527' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-24T09:17:14.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:13 trial159 ceph-mon[44242]: pgmap v187: 97 pgs: 97 active+clean; 633 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 7.7 KiB/s rd, 8.4 KiB/s wr, 17 op/s 2026-02-24T09:17:14.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:13 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/2631880005' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-24T09:17:14.095 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":20,"flags":0,"active_gid":14223,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6800","nonce":906910473},{"type":"v1","addr":"10.20.193.28:6801","nonce":906910473}]},"active_addr":"10.20.193.28:6801/906910473","active_change":"2026-02-24T09:13:39.242818+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[{"gid":24271,"name":"y","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24281,"name":"z","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://10.20.193.28:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.28:0","nonce":72216770}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.28:0","nonce":948036878}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.28:0","nonce":15788326}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.28:0","nonce":94081171}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.28:0","nonce":2564242640}]}]} 2026-02-24T09:17:14.107 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-02-24T09:17:14.107 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-24T09:17:14.108 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T09:17:14.291 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:14.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.462+0000 7f6419f3d640 1 -- 10.20.193.28:0/4137203058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f641410f6c0 msgr2=0x7f641410fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:14.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.462+0000 7f6419f3d640 1 --2- 10.20.193.28:0/4137203058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f641410f6c0 0x7f641410fa90 secure :-1 s=READY pgs=271 gs=3 cs=0 l=1 c_cookie=17583376086990574424 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6400009950 tx=0x7f640002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:17:14.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.462+0000 7f6419f3d640 1 -- 10.20.193.28:0/4137203058 shutdown_connections 2026-02-24T09:17:14.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.462+0000 7f6419f3d640 1 --2- 10.20.193.28:0/4137203058 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f64141158b0 0x7f6414176280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:14.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.462+0000 7f6419f3d640 1 --2- 10.20.193.28:0/4137203058 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f64141100b0 0x7f6414115100 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:14.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.462+0000 7f6419f3d640 1 --2- 10.20.193.28:0/4137203058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f641410f6c0 0x7f641410fa90 unknown :-1 s=CLOSED pgs=271 gs=3 cs=0 l=1 c_cookie=17583376086990574424 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:14.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.462+0000 7f6419f3d640 1 -- 10.20.193.28:0/4137203058 >> 10.20.193.28:0/4137203058 conn(0x7f64140ecfd0 msgr2=0x7f641410d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:14.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.463+0000 7f6419f3d640 1 -- 10.20.193.28:0/4137203058 shutdown_connections 2026-02-24T09:17:14.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.463+0000 7f6419f3d640 1 -- 10.20.193.28:0/4137203058 wait complete. 2026-02-24T09:17:14.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.463+0000 7f6419f3d640 1 Processor -- start 2026-02-24T09:17:14.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.463+0000 7f6419f3d640 1 -- start start 2026-02-24T09:17:14.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.464+0000 7f6419f3d640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f641410f6c0 0x7f64140fe950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:14.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.464+0000 7f6419f3d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f64141100b0 0x7f6414176180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:14.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.464+0000 7f6419f3d640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f64141158b0 0x7f64140ff050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:14.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.464+0000 7f6419f3d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6414100b00 con 0x7f64141100b0 2026-02-24T09:17:14.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.464+0000 7f6419f3d640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f6414100c70 con 0x7f64141158b0 2026-02-24T09:17:14.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.464+0000 7f6419f3d640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6414100e30 con 0x7f641410f6c0 2026-02-24T09:17:14.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.464+0000 7f6412ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f64141100b0 0x7f6414176180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:14.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.464+0000 7f6412ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f64141100b0 0x7f6414176180 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39406/0 (socket says 10.20.193.28:39406) 2026-02-24T09:17:14.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.464+0000 7f6412ffd640 1 -- 10.20.193.28:0/1248813634 learned_addr learned my addr 10.20.193.28:0/1248813634 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:14.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.464+0000 7f64137fe640 1 --2- 10.20.193.28:0/1248813634 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f641410f6c0 0x7f64140fe950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:14.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.464+0000 7f6413fff640 1 --2- 10.20.193.28:0/1248813634 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f64141158b0 0x7f64140ff050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:14.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.464+0000 7f6412ffd640 1 -- 10.20.193.28:0/1248813634 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f641410f6c0 msgr2=0x7f64140fe950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:14.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.464+0000 7f6412ffd640 1 --2- 10.20.193.28:0/1248813634 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f641410f6c0 0x7f64140fe950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:14.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.464+0000 7f6412ffd640 1 -- 10.20.193.28:0/1248813634 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f64141158b0 msgr2=0x7f64140ff050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:14.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.464+0000 7f6412ffd640 1 --2- 10.20.193.28:0/1248813634 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f64141158b0 0x7f64140ff050 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:14.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.464+0000 7f6412ffd640 1 -- 10.20.193.28:0/1248813634 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6400009570 con 0x7f64141100b0 2026-02-24T09:17:14.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.464+0000 7f6412ffd640 1 --2- 10.20.193.28:0/1248813634 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f64141100b0 0x7f6414176180 secure :-1 s=READY pgs=272 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6404009480 tx=0x7f640400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:14.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.464+0000 7f6410ff9640 1 -- 10.20.193.28:0/1248813634 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f640400cd40 con 0x7f64141100b0 2026-02-24T09:17:14.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.465+0000 7f6410ff9640 1 -- 10.20.193.28:0/1248813634 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6404004d10 con 0x7f64141100b0 2026-02-24T09:17:14.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.465+0000 7f6410ff9640 1 -- 10.20.193.28:0/1248813634 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f64040106b0 con 0x7f64141100b0 2026-02-24T09:17:14.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.465+0000 7f6419f3d640 1 -- 10.20.193.28:0/1248813634 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6414101110 con 0x7f64141100b0 2026-02-24T09:17:14.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.465+0000 7f6419f3d640 1 -- 10.20.193.28:0/1248813634 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6414101630 con 0x7f64141100b0 2026-02-24T09:17:14.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.465+0000 7f6419f3d640 1 -- 10.20.193.28:0/1248813634 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64141109a0 con 0x7f64141100b0 2026-02-24T09:17:14.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.467+0000 7f6410ff9640 1 -- 10.20.193.28:0/1248813634 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f640401f060 con 0x7f64141100b0 2026-02-24T09:17:14.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.469+0000 7f6410ff9640 1 --2- 10.20.193.28:0/1248813634 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f63e80b5830 0x7f63e80d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:14.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.469+0000 7f6410ff9640 1 -- 10.20.193.28:0/1248813634 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f6404014070 con 0x7f64141100b0 2026-02-24T09:17:14.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.469+0000 7f6410ff9640 1 -- 10.20.193.28:0/1248813634 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f6404120890 con 0x7f64141100b0 2026-02-24T09:17:14.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.469+0000 7f64137fe640 1 --2- 10.20.193.28:0/1248813634 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f63e80b5830 0x7f63e80d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:14.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.470+0000 7f64137fe640 1 --2- 10.20.193.28:0/1248813634 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f63e80b5830 0x7f63e80d5ce0 secure :-1 s=READY pgs=155 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64000098a0 tx=0x7f640003a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:14.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.584+0000 7f6419f3d640 1 -- 10.20.193.28:0/1248813634 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f641405eae0 con 0x7f64141100b0 2026-02-24T09:17:14.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.585+0000 7f6410ff9640 1 -- 10.20.193.28:0/1248813634 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+22632 (secure 0 0 0) 0x7f641405eae0 con 0x7f64141100b0 2026-02-24T09:17:14.588 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:17:14.588 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":92,"fsid":"e9ad50af-1160-11f1-800e-d404e6e7d460","created":"2026-02-24T09:12:33.966733+0000","modified":"2026-02-24T09:17:01.228853+0000","last_up_change":"2026-02-24T09:16:34.222008+0000","last_in_change":"2026-02-24T09:16:20.530109+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":38,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T09:14:33.468078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-24T09:16:57.259549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-24T09:16:58.835796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7836f68-f25a-4aea-830a-3c2ce8ac79e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6803","nonce":2124354447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6805","nonce":2124354447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6809","nonce":2124354447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6807","nonce":2124354447}]},"public_addr":"10.20.193.28:6803/2124354447","cluster_addr":"10.20.193.28:6805/2124354447","heartbeat_back_addr":"10.20.193.28:6809/2124354447","heartbeat_front_addr":"10.20.193.28:6807/2124354447","state":["exists","up"]},{"osd":1,"uuid":"04273ff8-91e3-4e70-8041-cc8c205b9a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6800","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6801","nonce":267363486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6802","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6803","nonce":267363486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6806","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6807","nonce":267363486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6804","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6805","nonce":267363486}]},"public_addr":"10.20.193.74:6801/267363486","cluster_addr":"10.20.193.74:6803/267363486","heartbeat_back_addr":"10.20.193.74:6807/267363486","heartbeat_front_addr":"10.20.193.74:6805/267363486","state":["exists","up"]},{"osd":2,"uuid":"dea96db1-588b-4d08-8e52-52c4c995bdc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6800","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6801","nonce":3320466721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6802","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6803","nonce":3320466721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6806","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6807","nonce":3320466721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6804","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6805","nonce":3320466721}]},"public_addr":"10.20.193.159:6801/3320466721","cluster_addr":"10.20.193.159:6803/3320466721","heartbeat_back_addr":"10.20.193.159:6807/3320466721","heartbeat_front_addr":"10.20.193.159:6805/3320466721","state":["exists","up"]},{"osd":3,"uuid":"c785c244-eb3f-4af5-83c6-cd492459f75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6811","nonce":1790609615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6813","nonce":1790609615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6817","nonce":1790609615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6815","nonce":1790609615}]},"public_addr":"10.20.193.28:6811/1790609615","cluster_addr":"10.20.193.28:6813/1790609615","heartbeat_back_addr":"10.20.193.28:6817/1790609615","heartbeat_front_addr":"10.20.193.28:6815/1790609615","state":["exists","up"]},{"osd":4,"uuid":"041239c2-6187-4154-9557-b1b5846f9e0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6808","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6809","nonce":610990618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6810","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6811","nonce":610990618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6814","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6815","nonce":610990618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6812","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6813","nonce":610990618}]},"public_addr":"10.20.193.74:6809/610990618","cluster_addr":"10.20.193.74:6811/610990618","heartbeat_back_addr":"10.20.193.74:6815/610990618","heartbeat_front_addr":"10.20.193.74:6813/610990618","state":["exists","up"]},{"osd":5,"uuid":"ffeeb021-0924-4421-aecf-bac2e74364a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6808","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6809","nonce":1653417923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6810","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6811","nonce":1653417923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6814","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6815","nonce":1653417923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6812","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6813","nonce":1653417923}]},"public_addr":"10.20.193.159:6809/1653417923","cluster_addr":"10.20.193.159:6811/1653417923","heartbeat_back_addr":"10.20.193.159:6815/1653417923","heartbeat_front_addr":"10.20.193.159:6813/1653417923","state":["exists","up"]},{"osd":6,"uuid":"f3736156-4951-4901-9323-7930fb73b8dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6819","nonce":1891043856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6821","nonce":1891043856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6825","nonce":1891043856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6823","nonce":1891043856}]},"public_addr":"10.20.193.28:6819/1891043856","cluster_addr":"10.20.193.28:6821/1891043856","heartbeat_back_addr":"10.20.193.28:6825/1891043856","heartbeat_front_addr":"10.20.193.28:6823/1891043856","state":["exists","up"]},{"osd":7,"uuid":"214b27ee-75f9-4a54-a59b-e8bfbb895903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6816","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6817","nonce":2328869739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6818","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6819","nonce":2328869739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6822","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6823","nonce":2328869739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6820","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6821","nonce":2328869739}]},"public_addr":"10.20.193.74:6817/2328869739","cluster_addr":"10.20.193.74:6819/2328869739","heartbeat_back_addr":"10.20.193.74:6823/2328869739","heartbeat_front_addr":"10.20.193.74:6821/2328869739","state":["exists","up"]},{"osd":8,"uuid":"76599c26-6778-4fa2-b85d-feea8baac7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6816","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6817","nonce":3877834753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6818","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6819","nonce":3877834753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6822","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6823","nonce":3877834753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6820","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6821","nonce":3877834753}]},"public_addr":"10.20.193.159:6817/3877834753","cluster_addr":"10.20.193.159:6819/3877834753","heartbeat_back_addr":"10.20.193.159:6823/3877834753","heartbeat_front_addr":"10.20.193.159:6821/3877834753","state":["exists","up"]},{"osd":9,"uuid":"52b52b35-2d65-4e53-b7d8-fd7385d5ae88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6827","nonce":4207785690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6829","nonce":4207785690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6833","nonce":4207785690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6831","nonce":4207785690}]},"public_addr":"10.20.193.28:6827/4207785690","cluster_addr":"10.20.193.28:6829/4207785690","heartbeat_back_addr":"10.20.193.28:6833/4207785690","heartbeat_front_addr":"10.20.193.28:6831/4207785690","state":["exists","up"]},{"osd":10,"uuid":"65c8e576-a1c7-4c03-bbf6-57c775f2860f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6824","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6825","nonce":2590408209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6826","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6827","nonce":2590408209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6830","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6831","nonce":2590408209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6828","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6829","nonce":2590408209}]},"public_addr":"10.20.193.74:6825/2590408209","cluster_addr":"10.20.193.74:6827/2590408209","heartbeat_back_addr":"10.20.193.74:6831/2590408209","heartbeat_front_addr":"10.20.193.74:6829/2590408209","state":["exists","up"]},{"osd":11,"uuid":"e2305377-fadb-4cf0-8384-87387f116255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":87,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6824","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6825","nonce":709820718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6826","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6827","nonce":709820718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6830","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6831","nonce":709820718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6828","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6829","nonce":709820718}]},"public_addr":"10.20.193.159:6825/709820718","cluster_addr":"10.20.193.159:6827/709820718","heartbeat_back_addr":"10.20.193.159:6831/709820718","heartbeat_front_addr":"10.20.193.159:6829/709820718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:02.414561+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:16.784172+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:30.639920+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:44.510387+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:58.186053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:11.714819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:25.188981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:38.602303+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:51.899864+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:16:05.444224+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:16:18.900719+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:16:32.290361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:0/3696280830":"2026-02-25T09:13:39.242729+0000","10.20.193.28:6801/3539300247":"2026-02-25T09:13:39.242729+0000","10.20.193.28:0/3799405177":"2026-02-25T09:12:46.171932+0000","10.20.193.28:0/1189576634":"2026-02-25T09:12:46.171932+0000","10.20.193.28:6800/1682009277":"2026-02-25T09:12:46.171932+0000","10.20.193.28:6800/3539300247":"2026-02-25T09:13:39.242729+0000","10.20.193.28:6801/1682009277":"2026-02-25T09:12:46.171932+0000","10.20.193.28:0/673213915":"2026-02-25T09:12:59.028609+0000","10.20.193.28:0/857248143":"2026-02-25T09:13:39.242729+0000","10.20.193.28:0/1541006046":"2026-02-25T09:12:46.171932+0000","10.20.193.28:0/264576041":"2026-02-25T09:12:59.028609+0000","10.20.193.28:6800/2303472235":"2026-02-25T09:12:59.028609+0000","10.20.193.28:6801/2303472235":"2026-02-25T09:12:59.028609+0000","10.20.193.28:0/2622827224":"2026-02-25T09:12:59.028609+0000","10.20.193.28:0/3614117448":"2026-02-25T09:13:39.242729+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T09:17:14.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.587+0000 7f6419f3d640 1 -- 10.20.193.28:0/1248813634 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f63e80b5830 msgr2=0x7f63e80d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:14.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.587+0000 7f6419f3d640 1 --2- 10.20.193.28:0/1248813634 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f63e80b5830 0x7f63e80d5ce0 secure :-1 s=READY pgs=155 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64000098a0 tx=0x7f640003a040 comp rx=0 tx=0).stop 2026-02-24T09:17:14.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.587+0000 7f6419f3d640 1 -- 10.20.193.28:0/1248813634 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f64141100b0 msgr2=0x7f6414176180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:14.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.587+0000 7f6419f3d640 1 --2- 10.20.193.28:0/1248813634 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f64141100b0 0x7f6414176180 secure :-1 s=READY pgs=272 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6404009480 tx=0x7f640400ee60 comp rx=0 tx=0).stop 2026-02-24T09:17:14.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.587+0000 7f6419f3d640 1 -- 10.20.193.28:0/1248813634 shutdown_connections 2026-02-24T09:17:14.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.587+0000 7f6419f3d640 1 --2- 10.20.193.28:0/1248813634 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f63e80b5830 0x7f63e80d5ce0 unknown :-1 s=CLOSED pgs=155 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:14.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.587+0000 7f6419f3d640 1 --2- 10.20.193.28:0/1248813634 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f64141158b0 0x7f64140ff050 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:14.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.587+0000 7f6419f3d640 1 --2- 10.20.193.28:0/1248813634 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f64141100b0 0x7f6414176180 unknown :-1 s=CLOSED pgs=272 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:14.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.587+0000 7f6419f3d640 1 --2- 10.20.193.28:0/1248813634 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f641410f6c0 0x7f64140fe950 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:14.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.587+0000 7f6419f3d640 1 -- 10.20.193.28:0/1248813634 >> 10.20.193.28:0/1248813634 conn(0x7f64140ecfd0 msgr2=0x7f6414112cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:14.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.587+0000 7f6419f3d640 1 -- 10.20.193.28:0/1248813634 shutdown_connections 2026-02-24T09:17:14.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:14.587+0000 7f6419f3d640 1 -- 10.20.193.28:0/1248813634 wait complete. 2026-02-24T09:17:14.688 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-24T09:17:14.688 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T09:17:14.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:14 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/2689608386' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-24T09:17:14.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:14 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/1248813634' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:17:14.871 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:15.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:14 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/2689608386' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-24T09:17:15.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:14 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/1248813634' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:17:15.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.039+0000 7f83a1990640 1 -- 10.20.193.28:0/3034496743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f839c115440 msgr2=0x7f839c175e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.039+0000 7f83a1990640 1 --2- 10.20.193.28:0/3034496743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f839c115440 0x7f839c175e10 secure :-1 s=READY pgs=273 gs=1 cs=0 l=1 c_cookie=13321765634473023191 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f839800aa30 tx=0x7f8398030270 comp rx=0 tx=0).stop 2026-02-24T09:17:15.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.039+0000 7f83a1990640 1 -- 10.20.193.28:0/3034496743 shutdown_connections 2026-02-24T09:17:15.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.039+0000 7f83a1990640 1 --2- 10.20.193.28:0/3034496743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f839c115440 0x7f839c175e10 unknown :-1 s=CLOSED pgs=273 gs=1 cs=0 l=1 c_cookie=13321765634473023191 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.039+0000 7f83a1990640 1 --2- 10.20.193.28:0/3034496743 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f839c10fc40 0x7f839c114c90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.039+0000 7f83a1990640 1 --2- 10.20.193.28:0/3034496743 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f839c10f250 0x7f839c10f620 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.039+0000 7f83a1990640 1 -- 10.20.193.28:0/3034496743 >> 10.20.193.28:0/3034496743 conn(0x7f839c0ecb40 msgr2=0x7f839c10cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:15.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.039+0000 7f83a1990640 1 -- 10.20.193.28:0/3034496743 shutdown_connections 2026-02-24T09:17:15.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.039+0000 7f83a1990640 1 -- 10.20.193.28:0/3034496743 wait complete. 2026-02-24T09:17:15.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.040+0000 7f83a1990640 1 Processor -- start 2026-02-24T09:17:15.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.040+0000 7f83a1990640 1 -- start start 2026-02-24T09:17:15.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.040+0000 7f83a1990640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f839c10f250 0x7f839c11dca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.040+0000 7f83a1990640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f839c10fc40 0x7f839c11e1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.040+0000 7f83a1990640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f839c115440 0x7f839c1235b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.040+0000 7f83a1990640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f839c123bd0 con 0x7f839c115440 2026-02-24T09:17:15.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.040+0000 7f83a1990640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f839c123d40 con 0x7f839c10f250 2026-02-24T09:17:15.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.040+0000 7f83a1990640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f839c123f00 con 0x7f839c10fc40 2026-02-24T09:17:15.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.040+0000 7f83a118f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f839c115440 0x7f839c1235b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.040+0000 7f83a118f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f839c115440 0x7f839c1235b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39426/0 (socket says 10.20.193.28:39426) 2026-02-24T09:17:15.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.040+0000 7f83a118f640 1 -- 10.20.193.28:0/2468428007 learned_addr learned my addr 10.20.193.28:0/2468428007 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:15.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.040+0000 7f8393fff640 1 --2- 10.20.193.28:0/2468428007 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f839c10fc40 0x7f839c11e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.041+0000 7f83a098e640 1 --2- 10.20.193.28:0/2468428007 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f839c10f250 0x7f839c11dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.041+0000 7f83a118f640 1 -- 10.20.193.28:0/2468428007 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f839c10fc40 msgr2=0x7f839c11e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.041+0000 7f83a118f640 1 --2- 10.20.193.28:0/2468428007 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f839c10fc40 0x7f839c11e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.041+0000 7f83a118f640 1 -- 10.20.193.28:0/2468428007 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f839c10f250 msgr2=0x7f839c11dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.041+0000 7f83a118f640 1 --2- 10.20.193.28:0/2468428007 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f839c10f250 0x7f839c11dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.041+0000 7f83a118f640 1 -- 10.20.193.28:0/2468428007 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839800a650 con 0x7f839c115440 2026-02-24T09:17:15.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.041+0000 7f83a118f640 1 --2- 10.20.193.28:0/2468428007 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f839c115440 0x7f839c1235b0 secure :-1 s=READY pgs=274 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8398006a50 tx=0x7f8398003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.041+0000 7f8391ffb640 1 -- 10.20.193.28:0/2468428007 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f839803e070 con 0x7f839c115440 2026-02-24T09:17:15.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.041+0000 7f8391ffb640 1 -- 10.20.193.28:0/2468428007 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8398003ad0 con 0x7f839c115440 2026-02-24T09:17:15.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.041+0000 7f8391ffb640 1 -- 10.20.193.28:0/2468428007 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f83980428c0 con 0x7f839c115440 2026-02-24T09:17:15.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.041+0000 7f83a1990640 1 -- 10.20.193.28:0/2468428007 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f839c124180 con 0x7f839c115440 2026-02-24T09:17:15.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.041+0000 7f83a1990640 1 -- 10.20.193.28:0/2468428007 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f839c164740 con 0x7f839c115440 2026-02-24T09:17:15.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.042+0000 7f83a1990640 1 -- 10.20.193.28:0/2468428007 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f839c110530 con 0x7f839c115440 2026-02-24T09:17:15.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.044+0000 7f8391ffb640 1 -- 10.20.193.28:0/2468428007 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f83980050c0 con 0x7f839c115440 2026-02-24T09:17:15.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.045+0000 7f8391ffb640 1 --2- 10.20.193.28:0/2468428007 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f83780b5910 0x7f83780d5dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.045+0000 7f8391ffb640 1 -- 10.20.193.28:0/2468428007 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f839810c840 con 0x7f839c115440 2026-02-24T09:17:15.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.045+0000 7f8391ffb640 1 -- 10.20.193.28:0/2468428007 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f8398145930 con 0x7f839c115440 2026-02-24T09:17:15.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.046+0000 7f83a098e640 1 --2- 10.20.193.28:0/2468428007 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f83780b5910 0x7f83780d5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.046+0000 7f83a098e640 1 --2- 10.20.193.28:0/2468428007 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f83780b5910 0x7f83780d5dc0 secure :-1 s=READY pgs=156 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f838c004740 tx=0x7f838c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:14 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/2689608386' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-24T09:17:15.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:14 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/1248813634' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:17:15.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.161+0000 7f83a1990640 1 -- 10.20.193.28:0/2468428007 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f839c11ee00 con 0x7f839c115440 2026-02-24T09:17:15.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.162+0000 7f8391ffb640 1 -- 10.20.193.28:0/2468428007 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+22632 (secure 0 0 0) 0x7f83980cf220 con 0x7f839c115440 2026-02-24T09:17:15.164 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:17:15.164 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":92,"fsid":"e9ad50af-1160-11f1-800e-d404e6e7d460","created":"2026-02-24T09:12:33.966733+0000","modified":"2026-02-24T09:17:01.228853+0000","last_up_change":"2026-02-24T09:16:34.222008+0000","last_in_change":"2026-02-24T09:16:20.530109+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":38,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T09:14:33.468078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-24T09:16:57.259549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-24T09:16:58.835796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7836f68-f25a-4aea-830a-3c2ce8ac79e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6803","nonce":2124354447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6805","nonce":2124354447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6809","nonce":2124354447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6807","nonce":2124354447}]},"public_addr":"10.20.193.28:6803/2124354447","cluster_addr":"10.20.193.28:6805/2124354447","heartbeat_back_addr":"10.20.193.28:6809/2124354447","heartbeat_front_addr":"10.20.193.28:6807/2124354447","state":["exists","up"]},{"osd":1,"uuid":"04273ff8-91e3-4e70-8041-cc8c205b9a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6800","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6801","nonce":267363486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6802","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6803","nonce":267363486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6806","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6807","nonce":267363486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6804","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6805","nonce":267363486}]},"public_addr":"10.20.193.74:6801/267363486","cluster_addr":"10.20.193.74:6803/267363486","heartbeat_back_addr":"10.20.193.74:6807/267363486","heartbeat_front_addr":"10.20.193.74:6805/267363486","state":["exists","up"]},{"osd":2,"uuid":"dea96db1-588b-4d08-8e52-52c4c995bdc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6800","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6801","nonce":3320466721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6802","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6803","nonce":3320466721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6806","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6807","nonce":3320466721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6804","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6805","nonce":3320466721}]},"public_addr":"10.20.193.159:6801/3320466721","cluster_addr":"10.20.193.159:6803/3320466721","heartbeat_back_addr":"10.20.193.159:6807/3320466721","heartbeat_front_addr":"10.20.193.159:6805/3320466721","state":["exists","up"]},{"osd":3,"uuid":"c785c244-eb3f-4af5-83c6-cd492459f75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6811","nonce":1790609615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6813","nonce":1790609615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6817","nonce":1790609615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6815","nonce":1790609615}]},"public_addr":"10.20.193.28:6811/1790609615","cluster_addr":"10.20.193.28:6813/1790609615","heartbeat_back_addr":"10.20.193.28:6817/1790609615","heartbeat_front_addr":"10.20.193.28:6815/1790609615","state":["exists","up"]},{"osd":4,"uuid":"041239c2-6187-4154-9557-b1b5846f9e0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6808","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6809","nonce":610990618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6810","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6811","nonce":610990618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6814","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6815","nonce":610990618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6812","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6813","nonce":610990618}]},"public_addr":"10.20.193.74:6809/610990618","cluster_addr":"10.20.193.74:6811/610990618","heartbeat_back_addr":"10.20.193.74:6815/610990618","heartbeat_front_addr":"10.20.193.74:6813/610990618","state":["exists","up"]},{"osd":5,"uuid":"ffeeb021-0924-4421-aecf-bac2e74364a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6808","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6809","nonce":1653417923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6810","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6811","nonce":1653417923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6814","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6815","nonce":1653417923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6812","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6813","nonce":1653417923}]},"public_addr":"10.20.193.159:6809/1653417923","cluster_addr":"10.20.193.159:6811/1653417923","heartbeat_back_addr":"10.20.193.159:6815/1653417923","heartbeat_front_addr":"10.20.193.159:6813/1653417923","state":["exists","up"]},{"osd":6,"uuid":"f3736156-4951-4901-9323-7930fb73b8dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6819","nonce":1891043856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6821","nonce":1891043856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6825","nonce":1891043856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6823","nonce":1891043856}]},"public_addr":"10.20.193.28:6819/1891043856","cluster_addr":"10.20.193.28:6821/1891043856","heartbeat_back_addr":"10.20.193.28:6825/1891043856","heartbeat_front_addr":"10.20.193.28:6823/1891043856","state":["exists","up"]},{"osd":7,"uuid":"214b27ee-75f9-4a54-a59b-e8bfbb895903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6816","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6817","nonce":2328869739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6818","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6819","nonce":2328869739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6822","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6823","nonce":2328869739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6820","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6821","nonce":2328869739}]},"public_addr":"10.20.193.74:6817/2328869739","cluster_addr":"10.20.193.74:6819/2328869739","heartbeat_back_addr":"10.20.193.74:6823/2328869739","heartbeat_front_addr":"10.20.193.74:6821/2328869739","state":["exists","up"]},{"osd":8,"uuid":"76599c26-6778-4fa2-b85d-feea8baac7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6816","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6817","nonce":3877834753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6818","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6819","nonce":3877834753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6822","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6823","nonce":3877834753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6820","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6821","nonce":3877834753}]},"public_addr":"10.20.193.159:6817/3877834753","cluster_addr":"10.20.193.159:6819/3877834753","heartbeat_back_addr":"10.20.193.159:6823/3877834753","heartbeat_front_addr":"10.20.193.159:6821/3877834753","state":["exists","up"]},{"osd":9,"uuid":"52b52b35-2d65-4e53-b7d8-fd7385d5ae88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6827","nonce":4207785690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6829","nonce":4207785690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6833","nonce":4207785690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6831","nonce":4207785690}]},"public_addr":"10.20.193.28:6827/4207785690","cluster_addr":"10.20.193.28:6829/4207785690","heartbeat_back_addr":"10.20.193.28:6833/4207785690","heartbeat_front_addr":"10.20.193.28:6831/4207785690","state":["exists","up"]},{"osd":10,"uuid":"65c8e576-a1c7-4c03-bbf6-57c775f2860f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6824","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6825","nonce":2590408209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6826","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6827","nonce":2590408209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6830","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6831","nonce":2590408209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6828","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6829","nonce":2590408209}]},"public_addr":"10.20.193.74:6825/2590408209","cluster_addr":"10.20.193.74:6827/2590408209","heartbeat_back_addr":"10.20.193.74:6831/2590408209","heartbeat_front_addr":"10.20.193.74:6829/2590408209","state":["exists","up"]},{"osd":11,"uuid":"e2305377-fadb-4cf0-8384-87387f116255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":87,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6824","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6825","nonce":709820718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6826","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6827","nonce":709820718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6830","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6831","nonce":709820718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6828","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6829","nonce":709820718}]},"public_addr":"10.20.193.159:6825/709820718","cluster_addr":"10.20.193.159:6827/709820718","heartbeat_back_addr":"10.20.193.159:6831/709820718","heartbeat_front_addr":"10.20.193.159:6829/709820718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:02.414561+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:16.784172+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:30.639920+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:44.510387+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:58.186053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:11.714819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:25.188981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:38.602303+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:51.899864+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:16:05.444224+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:16:18.900719+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:16:32.290361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:0/3696280830":"2026-02-25T09:13:39.242729+0000","10.20.193.28:6801/3539300247":"2026-02-25T09:13:39.242729+0000","10.20.193.28:0/3799405177":"2026-02-25T09:12:46.171932+0000","10.20.193.28:0/1189576634":"2026-02-25T09:12:46.171932+0000","10.20.193.28:6800/1682009277":"2026-02-25T09:12:46.171932+0000","10.20.193.28:6800/3539300247":"2026-02-25T09:13:39.242729+0000","10.20.193.28:6801/1682009277":"2026-02-25T09:12:46.171932+0000","10.20.193.28:0/673213915":"2026-02-25T09:12:59.028609+0000","10.20.193.28:0/857248143":"2026-02-25T09:13:39.242729+0000","10.20.193.28:0/1541006046":"2026-02-25T09:12:46.171932+0000","10.20.193.28:0/264576041":"2026-02-25T09:12:59.028609+0000","10.20.193.28:6800/2303472235":"2026-02-25T09:12:59.028609+0000","10.20.193.28:6801/2303472235":"2026-02-25T09:12:59.028609+0000","10.20.193.28:0/2622827224":"2026-02-25T09:12:59.028609+0000","10.20.193.28:0/3614117448":"2026-02-25T09:13:39.242729+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T09:17:15.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.163+0000 7f83a1990640 1 -- 10.20.193.28:0/2468428007 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f83780b5910 msgr2=0x7f83780d5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.163+0000 7f83a1990640 1 --2- 10.20.193.28:0/2468428007 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f83780b5910 0x7f83780d5dc0 secure :-1 s=READY pgs=156 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f838c004740 tx=0x7f838c005f90 comp rx=0 tx=0).stop 2026-02-24T09:17:15.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.163+0000 7f83a1990640 1 -- 10.20.193.28:0/2468428007 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f839c115440 msgr2=0x7f839c1235b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.163+0000 7f83a1990640 1 --2- 10.20.193.28:0/2468428007 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f839c115440 0x7f839c1235b0 secure :-1 s=READY pgs=274 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8398006a50 tx=0x7f8398003f60 comp rx=0 tx=0).stop 2026-02-24T09:17:15.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.164+0000 7f83a1990640 1 -- 10.20.193.28:0/2468428007 shutdown_connections 2026-02-24T09:17:15.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.164+0000 7f83a1990640 1 --2- 10.20.193.28:0/2468428007 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f83780b5910 0x7f83780d5dc0 unknown :-1 s=CLOSED pgs=156 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.164+0000 7f83a1990640 1 --2- 10.20.193.28:0/2468428007 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f839c115440 0x7f839c1235b0 unknown :-1 s=CLOSED pgs=274 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.164+0000 7f83a1990640 1 --2- 10.20.193.28:0/2468428007 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f839c10fc40 0x7f839c11e1e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.164+0000 7f83a1990640 1 --2- 10.20.193.28:0/2468428007 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f839c10f250 0x7f839c11dca0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.164+0000 7f83a1990640 1 -- 10.20.193.28:0/2468428007 >> 10.20.193.28:0/2468428007 conn(0x7f839c0ecb40 msgr2=0x7f839c10cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:15.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.164+0000 7f83a1990640 1 -- 10.20.193.28:0/2468428007 shutdown_connections 2026-02-24T09:17:15.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.164+0000 7f83a1990640 1 -- 10.20.193.28:0/2468428007 wait complete. 2026-02-24T09:17:15.267 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-24T09:17:15.267 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-24T09:17:15.267 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph tell osd.2 flush_pg_stats 2026-02-24T09:17:15.268 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph tell osd.3 flush_pg_stats 2026-02-24T09:17:15.268 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph tell osd.4 flush_pg_stats 2026-02-24T09:17:15.268 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph tell osd.5 flush_pg_stats 2026-02-24T09:17:15.268 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph tell osd.6 flush_pg_stats 2026-02-24T09:17:15.268 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph tell osd.7 flush_pg_stats 2026-02-24T09:17:15.268 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph tell osd.8 flush_pg_stats 2026-02-24T09:17:15.268 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph tell osd.9 flush_pg_stats 2026-02-24T09:17:15.269 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph tell osd.10 flush_pg_stats 2026-02-24T09:17:15.269 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph tell osd.11 flush_pg_stats 2026-02-24T09:17:15.544 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:15.547 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:15.555 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:15.570 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:15.577 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:15.587 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:15.605 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:15.607 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:15.627 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:15.680 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:15.731 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:15.731 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:15.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.824+0000 7f3d4e455640 1 -- 10.20.193.28:0/2477079778 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d400b7ba0 msgr2=0x7f3d400bcbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.824+0000 7f3d4e455640 1 --2- 10.20.193.28:0/2477079778 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d400b7ba0 0x7f3d400bcbf0 secure :-1 s=READY pgs=275 gs=2 cs=0 l=1 c_cookie=17358494059377023649 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d38009950 tx=0x7f3d3802f1b0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.825+0000 7f3d4e455640 1 -- 10.20.193.28:0/2477079778 shutdown_connections 2026-02-24T09:17:15.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.825+0000 7f3d4e455640 1 --2- 10.20.193.28:0/2477079778 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3d400bd3a0 0x7f3d4011dd70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.825+0000 7f3d4e455640 1 --2- 10.20.193.28:0/2477079778 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d400b7ba0 0x7f3d400bcbf0 unknown :-1 s=CLOSED pgs=275 gs=2 cs=0 l=1 c_cookie=17358494059377023649 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.825+0000 7f3d4e455640 1 --2- 10.20.193.28:0/2477079778 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3d400b71b0 0x7f3d400b7580 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.825+0000 7f3d4e455640 1 -- 10.20.193.28:0/2477079778 >> 10.20.193.28:0/2477079778 conn(0x7f3d40094aa0 msgr2=0x7f3d400b4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:15.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.826+0000 7f3d4e455640 1 -- 10.20.193.28:0/2477079778 shutdown_connections 2026-02-24T09:17:15.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.826+0000 7f3d4e455640 1 -- 10.20.193.28:0/2477079778 wait complete. 2026-02-24T09:17:15.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.830+0000 7f3d4e455640 1 Processor -- start 2026-02-24T09:17:15.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.831+0000 7f3d4e455640 1 -- start start 2026-02-24T09:17:15.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.832+0000 7f3d4e455640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d400b71b0 0x7f3d4000ccc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.832+0000 7f3d4e455640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3d400b7ba0 0x7f3d4011dc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.832+0000 7f3d4e455640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3d400bd3a0 0x7f3d40008f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.832+0000 7f3d4e455640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3d40009720 con 0x7f3d400b71b0 2026-02-24T09:17:15.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.832+0000 7f3d4e455640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f3d40009890 con 0x7f3d400b7ba0 2026-02-24T09:17:15.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.832+0000 7f3d4e455640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3d40009a50 con 0x7f3d400bd3a0 2026-02-24T09:17:15.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.832+0000 7f3d4d453640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d400b71b0 0x7f3d4000ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.832+0000 7f3d4cc52640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3d400b7ba0 0x7f3d4011dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.832+0000 7f3d4d453640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d400b71b0 0x7f3d4000ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39438/0 (socket says 10.20.193.28:39438) 2026-02-24T09:17:15.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.832+0000 7f3d4d453640 1 -- 10.20.193.28:0/3966267130 learned_addr learned my addr 10.20.193.28:0/3966267130 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:15.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.833+0000 7f3d4d453640 1 -- 10.20.193.28:0/3966267130 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3d400bd3a0 msgr2=0x7f3d40008f90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:17:15.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.833+0000 7f3d4d453640 1 --2- 10.20.193.28:0/3966267130 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3d400bd3a0 0x7f3d40008f90 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.833+0000 7f3d4d453640 1 -- 10.20.193.28:0/3966267130 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3d400b7ba0 msgr2=0x7f3d4011dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.833+0000 7f3d4d453640 1 --2- 10.20.193.28:0/3966267130 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3d400b7ba0 0x7f3d4011dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.833+0000 7f3d4d453640 1 -- 10.20.193.28:0/3966267130 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d38009570 con 0x7f3d400b71b0 2026-02-24T09:17:15.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.833+0000 7f3d4d453640 1 --2- 10.20.193.28:0/3966267130 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d400b71b0 0x7f3d4000ccc0 secure :-1 s=READY pgs=276 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d4400dcb0 tx=0x7f3d44008590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.834+0000 7f3d367fc640 1 -- 10.20.193.28:0/3966267130 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3d4400de70 con 0x7f3d400b71b0 2026-02-24T09:17:15.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.834+0000 7f3d367fc640 1 -- 10.20.193.28:0/3966267130 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3d44005530 con 0x7f3d400b71b0 2026-02-24T09:17:15.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.834+0000 7f3d367fc640 1 -- 10.20.193.28:0/3966267130 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3d440106d0 con 0x7f3d400b71b0 2026-02-24T09:17:15.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.834+0000 7f3d4e455640 1 -- 10.20.193.28:0/3966267130 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d40009d30 con 0x7f3d400b71b0 2026-02-24T09:17:15.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.834+0000 7f3d4e455640 1 -- 10.20.193.28:0/3966267130 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d4009cb20 con 0x7f3d400b71b0 2026-02-24T09:17:15.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.834+0000 7f3d4e455640 1 -- 10.20.193.28:0/3966267130 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3d40000e20 con 0x7f3d400b71b0 2026-02-24T09:17:15.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.838+0000 7f3d367fc640 1 -- 10.20.193.28:0/3966267130 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f3d44005070 con 0x7f3d400b71b0 2026-02-24T09:17:15.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.839+0000 7f3d367fc640 1 --2- 10.20.193.28:0/3966267130 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3d240b58c0 0x7f3d240d5d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.840+0000 7f3d367fc640 1 -- 10.20.193.28:0/3966267130 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f3d440e83d0 con 0x7f3d400b71b0 2026-02-24T09:17:15.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.840+0000 7f3d367fc640 1 --2- 10.20.193.28:0/3966267130 >> [v2:10.20.193.74:6824/2590408209,v1:10.20.193.74:6825/2590408209] conn(0x7f3d240dd2b0 0x7f3d240fd6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.840+0000 7f3d367fc640 1 -- 10.20.193.28:0/3966267130 --> [v2:10.20.193.74:6824/2590408209,v1:10.20.193.74:6825/2590408209] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d240fdd70 con 0x7f3d240dd2b0 2026-02-24T09:17:15.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.840+0000 7f3d367fc640 1 -- 10.20.193.28:0/3966267130 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f3d440e8700 con 0x7f3d400b71b0 2026-02-24T09:17:15.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.842+0000 7f3d4dc54640 1 --2- 10.20.193.28:0/3966267130 >> [v2:10.20.193.74:6824/2590408209,v1:10.20.193.74:6825/2590408209] conn(0x7f3d240dd2b0 0x7f3d240fd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.844+0000 7f3d4dc54640 1 --2- 10.20.193.28:0/3966267130 >> [v2:10.20.193.74:6824/2590408209,v1:10.20.193.74:6825/2590408209] conn(0x7f3d240dd2b0 0x7f3d240fd6c0 crc :-1 s=READY pgs=12 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.844+0000 7f3d4cc52640 1 --2- 10.20.193.28:0/3966267130 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3d240b58c0 0x7f3d240d5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.844+0000 7f3d4cc52640 1 --2- 10.20.193.28:0/3966267130 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3d240b58c0 0x7f3d240d5d70 secure :-1 s=READY pgs=157 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d400b8c00 tx=0x7f3d3803a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.845+0000 7f3d367fc640 1 -- 10.20.193.28:0/3966267130 <== osd.10 v2:10.20.193.74:6824/2590408209 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f3d240fdd70 con 0x7f3d240dd2b0 2026-02-24T09:17:15.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.855+0000 7f69d75ef640 1 -- 10.20.193.28:0/326343744 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f69d015e4c0 msgr2=0x7f69d017e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.855+0000 7f69d75ef640 1 --2- 10.20.193.28:0/326343744 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f69d015e4c0 0x7f69d017e8a0 secure :-1 s=READY pgs=277 gs=2 cs=0 l=1 c_cookie=17020989130037079519 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69cc00a970 tx=0x7f69cc0301d0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.855+0000 7f69d75ef640 1 -- 10.20.193.28:0/326343744 shutdown_connections 2026-02-24T09:17:15.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.855+0000 7f69d75ef640 1 --2- 10.20.193.28:0/326343744 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f69d015e4c0 0x7f69d017e8a0 unknown :-1 s=CLOSED pgs=277 gs=2 cs=0 l=1 c_cookie=17020989130037079519 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.855+0000 7f69d75ef640 1 --2- 10.20.193.28:0/326343744 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f69d0114f60 0x7f69d015df80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.855+0000 7f69d75ef640 1 --2- 10.20.193.28:0/326343744 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f69d0114650 0x7f69d0114a20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.855+0000 7f69d75ef640 1 -- 10.20.193.28:0/326343744 >> 10.20.193.28:0/326343744 conn(0x7f69d0057af0 msgr2=0x7f69d0057ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:15.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.855+0000 7f69d75ef640 1 -- 10.20.193.28:0/326343744 shutdown_connections 2026-02-24T09:17:15.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.855+0000 7f69d75ef640 1 -- 10.20.193.28:0/326343744 wait complete. 2026-02-24T09:17:15.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.856+0000 7f69d75ef640 1 Processor -- start 2026-02-24T09:17:15.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.858+0000 7f3d4e455640 1 -- 10.20.193.28:0/3966267130 --> [v2:10.20.193.74:6824/2590408209,v1:10.20.193.74:6825/2590408209] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3d40121290 con 0x7f3d240dd2b0 2026-02-24T09:17:15.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.858+0000 7f3d367fc640 1 -- 10.20.193.28:0/3966267130 <== osd.10 v2:10.20.193.74:6824/2590408209 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3d40121290 con 0x7f3d240dd2b0 2026-02-24T09:17:15.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.858+0000 7f3d4e455640 1 -- 10.20.193.28:0/3966267130 >> [v2:10.20.193.74:6824/2590408209,v1:10.20.193.74:6825/2590408209] conn(0x7f3d240dd2b0 msgr2=0x7f3d240fd6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.858+0000 7f3d4e455640 1 --2- 10.20.193.28:0/3966267130 >> [v2:10.20.193.74:6824/2590408209,v1:10.20.193.74:6825/2590408209] conn(0x7f3d240dd2b0 0x7f3d240fd6c0 crc :-1 s=READY pgs=12 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.859+0000 7f3d4e455640 1 -- 10.20.193.28:0/3966267130 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3d240b58c0 msgr2=0x7f3d240d5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.859+0000 7f3d4e455640 1 --2- 10.20.193.28:0/3966267130 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3d240b58c0 0x7f3d240d5d70 secure :-1 s=READY pgs=157 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d400b8c00 tx=0x7f3d3803a040 comp rx=0 tx=0).stop 2026-02-24T09:17:15.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.859+0000 7f3d4e455640 1 -- 10.20.193.28:0/3966267130 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d400b71b0 msgr2=0x7f3d4000ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.859+0000 7f3d4e455640 1 --2- 10.20.193.28:0/3966267130 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d400b71b0 0x7f3d4000ccc0 secure :-1 s=READY pgs=276 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d4400dcb0 tx=0x7f3d44008590 comp rx=0 tx=0).stop 2026-02-24T09:17:15.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.859+0000 7f3d4dc54640 1 -- 10.20.193.28:0/3966267130 reap_dead start 2026-02-24T09:17:15.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.859+0000 7f3d4e455640 1 -- 10.20.193.28:0/3966267130 shutdown_connections 2026-02-24T09:17:15.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.859+0000 7f3d4e455640 1 -- 10.20.193.28:0/3966267130 >> 10.20.193.28:0/3966267130 conn(0x7f3d40094aa0 msgr2=0x7f3d400b9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:15.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.859+0000 7f3d4e455640 1 -- 10.20.193.28:0/3966267130 shutdown_connections 2026-02-24T09:17:15.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.860+0000 7f3d4e455640 1 -- 10.20.193.28:0/3966267130 wait complete. 2026-02-24T09:17:15.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.857+0000 7f69d75ef640 1 -- start start 2026-02-24T09:17:15.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.861+0000 7f69d75ef640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f69d0114650 0x7f69d00fe1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.861+0000 7f69d75ef640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f69d0114f60 0x7f69d00fe730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.861+0000 7f69d75ef640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f69d015e4c0 0x7f69d0103b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.861+0000 7f69d75ef640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f69d0104090 con 0x7f69d0114650 2026-02-24T09:17:15.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.860+0000 7f7ace2dd640 1 -- 10.20.193.28:0/1996852473 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7ac8116fe0 msgr2=0x7f7ac817ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.860+0000 7f7ace2dd640 1 --2- 10.20.193.28:0/1996852473 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7ac8116fe0 0x7f7ac817ac20 secure :-1 s=READY pgs=84 gs=1 cs=0 l=1 c_cookie=13596535055398007890 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ab8007490 tx=0x7f7ab802fe60 comp rx=0 tx=0).stop 2026-02-24T09:17:15.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.861+0000 7f69d75ef640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f69d0104200 con 0x7f69d015e4c0 2026-02-24T09:17:15.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.861+0000 7f69d75ef640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f69d01043c0 con 0x7f69d0114f60 2026-02-24T09:17:15.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.861+0000 7f69d65ed640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f69d0114650 0x7f69d00fe1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.861+0000 7f69d65ed640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f69d0114650 0x7f69d00fe1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39462/0 (socket says 10.20.193.28:39462) 2026-02-24T09:17:15.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.861+0000 7f69d65ed640 1 -- 10.20.193.28:0/2310366257 learned_addr learned my addr 10.20.193.28:0/2310366257 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:15.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.861+0000 7f7ace2dd640 1 -- 10.20.193.28:0/1996852473 shutdown_connections 2026-02-24T09:17:15.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.861+0000 7f7ace2dd640 1 --2- 10.20.193.28:0/1996852473 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7ac8116fe0 0x7f7ac817ac20 unknown :-1 s=CLOSED pgs=84 gs=1 cs=0 l=1 c_cookie=13596535055398007890 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.861+0000 7f7ace2dd640 1 --2- 10.20.193.28:0/1996852473 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7ac8115270 0x7f7ac8116860 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.861+0000 7f7ace2dd640 1 --2- 10.20.193.28:0/1996852473 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7ac8114880 0x7f7ac8114c50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.861+0000 7f7ace2dd640 1 -- 10.20.193.28:0/1996852473 >> 10.20.193.28:0/1996852473 conn(0x7f7ac8057f50 msgr2=0x7f7ac8058350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:15.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.861+0000 7f7ace2dd640 1 -- 10.20.193.28:0/1996852473 shutdown_connections 2026-02-24T09:17:15.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.861+0000 7f7ace2dd640 1 -- 10.20.193.28:0/1996852473 wait complete. 2026-02-24T09:17:15.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.862+0000 7f7ace2dd640 1 Processor -- start 2026-02-24T09:17:15.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.863+0000 7f7ace2dd640 1 -- start start 2026-02-24T09:17:15.867 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:15 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/2468428007' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:17:15.867 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:15 trial028 ceph-mon[40371]: pgmap v188: 97 pgs: 97 active+clean; 633 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 7.7 KiB/s rd, 7.6 KiB/s wr, 16 op/s 2026-02-24T09:17:15.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.864+0000 7f7ace2dd640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7ac8114880 0x7f7ac811f580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.864+0000 7f7ace2dd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7ac8115270 0x7f7ac811fac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.864+0000 7f7ace2dd640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7ac8116fe0 0x7f7ac8124e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.864+0000 7f7ace2dd640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac81254b0 con 0x7f7ac8115270 2026-02-24T09:17:15.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.864+0000 7f7ace2dd640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac8125620 con 0x7f7ac8114880 2026-02-24T09:17:15.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.864+0000 7f7ace2dd640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac81257e0 con 0x7f7ac8116fe0 2026-02-24T09:17:15.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.865+0000 7f7ac7fff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7ac8114880 0x7f7ac811f580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.865+0000 7f7acc853640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7ac8116fe0 0x7f7ac8124e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.865+0000 7f7ac7fff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7ac8114880 0x7f7ac811f580 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:42616/0 (socket says 10.20.193.28:42616) 2026-02-24T09:17:15.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.865+0000 7f7ac7fff640 1 -- 10.20.193.28:0/3561900953 learned_addr learned my addr 10.20.193.28:0/3561900953 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:15.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.866+0000 7f7ac77fe640 1 --2- 10.20.193.28:0/3561900953 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7ac8115270 0x7f7ac811fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.866+0000 7f7ac7fff640 1 -- 10.20.193.28:0/3561900953 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7ac8116fe0 msgr2=0x7f7ac8124e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.866+0000 7f7ac7fff640 1 --2- 10.20.193.28:0/3561900953 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7ac8116fe0 0x7f7ac8124e90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.866+0000 7f7ac7fff640 1 -- 10.20.193.28:0/3561900953 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7ac8115270 msgr2=0x7f7ac811fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.867+0000 7f7ac7fff640 1 --2- 10.20.193.28:0/3561900953 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7ac8115270 0x7f7ac811fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.867+0000 7f7ac7fff640 1 -- 10.20.193.28:0/3561900953 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7abc00a590 con 0x7f7ac8114880 2026-02-24T09:17:15.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.867+0000 7f7ac77fe640 1 --2- 10.20.193.28:0/3561900953 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7ac8115270 0x7f7ac811fac0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:15.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.868+0000 7f7ac7fff640 1 --2- 10.20.193.28:0/3561900953 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7ac8114880 0x7f7ac811f580 secure :-1 s=READY pgs=87 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7abc003800 tx=0x7f7abc003cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.868+0000 7f7ac57fa640 1 -- 10.20.193.28:0/3561900953 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7abc00fd60 con 0x7f7ac8114880 2026-02-24T09:17:15.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.868+0000 7f7ac57fa640 1 -- 10.20.193.28:0/3561900953 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7abc0118f0 con 0x7f7ac8114880 2026-02-24T09:17:15.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.868+0000 7f7ac57fa640 1 -- 10.20.193.28:0/3561900953 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7abc019950 con 0x7f7ac8114880 2026-02-24T09:17:15.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.869+0000 7f7ace2dd640 1 -- 10.20.193.28:0/3561900953 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ab80071c0 con 0x7f7ac8114880 2026-02-24T09:17:15.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.869+0000 7f7ace2dd640 1 -- 10.20.193.28:0/3561900953 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ac8166020 con 0x7f7ac8114880 2026-02-24T09:17:15.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.872+0000 7f7ac57fa640 1 -- 10.20.193.28:0/3561900953 <== mon.2 v2:10.20.193.74:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f7abc020060 con 0x7f7ac8114880 2026-02-24T09:17:15.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.873+0000 7f7ac57fa640 1 --2- 10.20.193.28:0/3561900953 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f7a980b57c0 0x7f7a980d5c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.874+0000 7f7ac57fa640 1 -- 10.20.193.28:0/3561900953 <== mon.2 v2:10.20.193.74:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f7abc0ae660 con 0x7f7ac8114880 2026-02-24T09:17:15.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.874+0000 7f72bffff640 1 -- 10.20.193.28:0/2194604000 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f72c0064c20 msgr2=0x7f72c0065560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.874+0000 7f72bffff640 1 --2- 10.20.193.28:0/2194604000 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f72c0064c20 0x7f72c0065560 secure :-1 s=READY pgs=278 gs=3 cs=0 l=1 c_cookie=8067060126715770979 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72b800a9c0 tx=0x7f72b8030ab0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.875+0000 7f7ac77fe640 1 --2- 10.20.193.28:0/3561900953 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f7a980b57c0 0x7f7a980d5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.864+0000 7f69d65ed640 1 -- 10.20.193.28:0/2310366257 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f69d0114f60 msgr2=0x7f69d00fe730 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:17:15.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.865+0000 7f69d5dec640 1 --2- 10.20.193.28:0/2310366257 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f69d0114f60 0x7f69d00fe730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.865+0000 7f69d6dee640 1 --2- 10.20.193.28:0/2310366257 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f69d015e4c0 0x7f69d0103b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.876+0000 7f69d65ed640 1 --2- 10.20.193.28:0/2310366257 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f69d0114f60 0x7f69d00fe730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.876+0000 7f69d65ed640 1 -- 10.20.193.28:0/2310366257 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f69d015e4c0 msgr2=0x7f69d0103b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.876+0000 7f69d65ed640 1 --2- 10.20.193.28:0/2310366257 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f69d015e4c0 0x7f69d0103b00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.876+0000 7f69d65ed640 1 -- 10.20.193.28:0/2310366257 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69cc00a590 con 0x7f69d0114650 2026-02-24T09:17:15.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.876+0000 7f69d6dee640 1 --2- 10.20.193.28:0/2310366257 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f69d015e4c0 0x7f69d0103b00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:15.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.876+0000 7f69d5dec640 1 --2- 10.20.193.28:0/2310366257 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f69d0114f60 0x7f69d00fe730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:15.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.875+0000 7f72bffff640 1 -- 10.20.193.28:0/2194604000 shutdown_connections 2026-02-24T09:17:15.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.875+0000 7f72bffff640 1 --2- 10.20.193.28:0/2194604000 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f72c0064c20 0x7f72c0065560 unknown :-1 s=CLOSED pgs=278 gs=3 cs=0 l=1 c_cookie=8067060126715770979 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.875+0000 7f72bffff640 1 --2- 10.20.193.28:0/2194604000 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f72c0060090 0x7f72c00644c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.875+0000 7f72bffff640 1 --2- 10.20.193.28:0/2194604000 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f72c005f6a0 0x7f72c005fa70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.875+0000 7f72bffff640 1 -- 10.20.193.28:0/2194604000 >> 10.20.193.28:0/2194604000 conn(0x7f72c0057af0 msgr2=0x7f72c0057ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:15.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.875+0000 7f72bffff640 1 -- 10.20.193.28:0/2194604000 shutdown_connections 2026-02-24T09:17:15.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.875+0000 7f72bffff640 1 -- 10.20.193.28:0/2194604000 wait complete. 2026-02-24T09:17:15.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.877+0000 7f69d65ed640 1 --2- 10.20.193.28:0/2310366257 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f69d0114650 0x7f69d00fe1f0 secure :-1 s=READY pgs=279 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69c800c9b0 tx=0x7f69c800ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.876+0000 7f72bffff640 1 Processor -- start 2026-02-24T09:17:15.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.877+0000 7f72bffff640 1 -- start start 2026-02-24T09:17:15.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.877+0000 7f72bffff640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f72c005f6a0 0x7f72c01bfbd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.877+0000 7f72bffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f72c0060090 0x7f72c01c0110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.877+0000 7f72bffff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f72c0064c20 0x7f72c01c54e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.877+0000 7f72bffff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f72c01c5b30 con 0x7f72c0060090 2026-02-24T09:17:15.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.877+0000 7f72bffff640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f72c01c5ca0 con 0x7f72c0064c20 2026-02-24T09:17:15.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.877+0000 7f72bffff640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f72c01c5e60 con 0x7f72c005f6a0 2026-02-24T09:17:15.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.878+0000 7f72beffd640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f72c005f6a0 0x7f72c01bfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.878+0000 7f72be7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f72c0060090 0x7f72c01c0110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.878+0000 7f72beffd640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f72c005f6a0 0x7f72c01bfbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:39084/0 (socket says 10.20.193.28:39084) 2026-02-24T09:17:15.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.878+0000 7f72beffd640 1 -- 10.20.193.28:0/2622660472 learned_addr learned my addr 10.20.193.28:0/2622660472 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:15.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.878+0000 7f72be7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f72c0060090 0x7f72c01c0110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39472/0 (socket says 10.20.193.28:39472) 2026-02-24T09:17:15.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.879+0000 7f69bb7fe640 1 -- 10.20.193.28:0/2310366257 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f69c80044a0 con 0x7f69d0114650 2026-02-24T09:17:15.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.880+0000 7f69bb7fe640 1 -- 10.20.193.28:0/2310366257 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f69c8007d80 con 0x7f69d0114650 2026-02-24T09:17:15.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.879+0000 7f7ac77fe640 1 --2- 10.20.193.28:0/3561900953 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f7a980b57c0 0x7f7a980d5c70 secure :-1 s=READY pgs=158 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ac8125f20 tx=0x7f7ab4008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.880+0000 7f7ace2dd640 1 --2- 10.20.193.28:0/3561900953 >> [v2:10.20.193.28:6818/1891043856,v1:10.20.193.28:6819/1891043856] conn(0x7f7ac817cfa0 0x7f7ac804cfd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.880+0000 7f7ace2dd640 1 -- 10.20.193.28:0/3561900953 --> [v2:10.20.193.28:6818/1891043856,v1:10.20.193.28:6819/1891043856] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7ac8052010 con 0x7f7ac817cfa0 2026-02-24T09:17:15.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.878+0000 7f72bf7fe640 1 --2- 10.20.193.28:0/2622660472 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f72c0064c20 0x7f72c01c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.880+0000 7f7acc853640 1 --2- 10.20.193.28:0/3561900953 >> [v2:10.20.193.28:6818/1891043856,v1:10.20.193.28:6819/1891043856] conn(0x7f7ac817cfa0 0x7f7ac804cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.880+0000 7f72be7fc640 1 -- 10.20.193.28:0/2622660472 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f72c005f6a0 msgr2=0x7f72c01bfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.880+0000 7f72be7fc640 1 --2- 10.20.193.28:0/2622660472 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f72c005f6a0 0x7f72c01bfbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.880+0000 7f72be7fc640 1 -- 10.20.193.28:0/2622660472 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f72c0064c20 msgr2=0x7f72c01c54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.880+0000 7f72be7fc640 1 --2- 10.20.193.28:0/2622660472 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f72c0064c20 0x7f72c01c54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.880+0000 7f72be7fc640 1 -- 10.20.193.28:0/2622660472 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b800a590 con 0x7f72c0060090 2026-02-24T09:17:15.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.882+0000 7f72be7fc640 1 --2- 10.20.193.28:0/2622660472 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f72c0060090 0x7f72c01c0110 secure :-1 s=READY pgs=280 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72b4004740 tx=0x7f72b4009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.882+0000 7f729ffff640 1 -- 10.20.193.28:0/2622660472 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f72b400ccf0 con 0x7f72c0060090 2026-02-24T09:17:15.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.882+0000 7f729ffff640 1 -- 10.20.193.28:0/2622660472 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f72b400ce50 con 0x7f72c0060090 2026-02-24T09:17:15.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.882+0000 7f729ffff640 1 -- 10.20.193.28:0/2622660472 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f72b40106b0 con 0x7f72c0060090 2026-02-24T09:17:15.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.883+0000 7f72bffff640 1 -- 10.20.193.28:0/2622660472 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72c01c6140 con 0x7f72c0060090 2026-02-24T09:17:15.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.882+0000 7f7acc853640 1 --2- 10.20.193.28:0/3561900953 >> [v2:10.20.193.28:6818/1891043856,v1:10.20.193.28:6819/1891043856] conn(0x7f7ac817cfa0 0x7f7ac804cfd0 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.880+0000 7f69bb7fe640 1 -- 10.20.193.28:0/2310366257 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f69c800f6d0 con 0x7f69d0114650 2026-02-24T09:17:15.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.882+0000 7f69d75ef640 1 -- 10.20.193.28:0/2310366257 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69d01046a0 con 0x7f69d0114650 2026-02-24T09:17:15.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.884+0000 7f7ac57fa640 1 -- 10.20.193.28:0/3561900953 <== osd.6 v2:10.20.193.28:6818/1891043856 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f7ac8052010 con 0x7f7ac817cfa0 2026-02-24T09:17:15.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.885+0000 7f72bffff640 1 -- 10.20.193.28:0/2622660472 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72c0069230 con 0x7f72c0060090 2026-02-24T09:17:15.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.884+0000 7f69d75ef640 1 -- 10.20.193.28:0/2310366257 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69d0158a50 con 0x7f69d0114650 2026-02-24T09:17:15.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.889+0000 7f729ffff640 1 -- 10.20.193.28:0/2622660472 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f72b401f060 con 0x7f72c0060090 2026-02-24T09:17:15.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.889+0000 7f69d75ef640 1 -- 10.20.193.28:0/2310366257 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f69d0052010 con 0x7f69d0114650 2026-02-24T09:17:15.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.891+0000 7f729ffff640 1 --2- 10.20.193.28:0/2622660472 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f72940b5990 0x7f72940d5e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.891+0000 7f729ffff640 1 -- 10.20.193.28:0/2622660472 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f72b4014070 con 0x7f72c0060090 2026-02-24T09:17:15.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.891+0000 7f72beffd640 1 --2- 10.20.193.28:0/2622660472 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f72940b5990 0x7f72940d5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.892+0000 7f72beffd640 1 --2- 10.20.193.28:0/2622660472 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f72940b5990 0x7f72940d5e40 secure :-1 s=READY pgs=159 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72b00095d0 tx=0x7f72b0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.895+0000 7fb39ffff640 1 -- 10.20.193.28:0/1240472600 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb3ac030d30 con 0x7fb3b0119930 2026-02-24T09:17:15.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.896+0000 7fb3b640a640 1 -- 10.20.193.28:0/1240472600 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb3b0119930 msgr2=0x7fb3b017a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.896+0000 7fb3b640a640 1 --2- 10.20.193.28:0/1240472600 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb3b0119930 0x7fb3b017a300 secure :-1 s=READY pgs=281 gs=1 cs=0 l=1 c_cookie=10670527851195824105 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3ac00a970 tx=0x7fb3ac0301f0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.896+0000 7fb3b640a640 1 -- 10.20.193.28:0/1240472600 shutdown_connections 2026-02-24T09:17:15.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.896+0000 7fb3b640a640 1 --2- 10.20.193.28:0/1240472600 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb3b0119930 0x7fb3b017a300 unknown :-1 s=CLOSED pgs=281 gs=1 cs=0 l=1 c_cookie=10670527851195824105 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.896+0000 7fb3b640a640 1 --2- 10.20.193.28:0/1240472600 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb3b0114220 0x7fb3b0119180 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.896+0000 7fb3b640a640 1 --2- 10.20.193.28:0/1240472600 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb3b0113830 0x7fb3b0113c00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.896+0000 7fb3b640a640 1 -- 10.20.193.28:0/1240472600 >> 10.20.193.28:0/1240472600 conn(0x7fb3b0060810 msgr2=0x7fb3b0064c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:15.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.897+0000 7fb3b640a640 1 -- 10.20.193.28:0/1240472600 shutdown_connections 2026-02-24T09:17:15.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.897+0000 7fb3b640a640 1 -- 10.20.193.28:0/1240472600 wait complete. 2026-02-24T09:17:15.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.897+0000 7fb3b640a640 1 Processor -- start 2026-02-24T09:17:15.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.898+0000 7f72bffff640 1 --2- 10.20.193.28:0/2622660472 >> [v2:10.20.193.159:6816/3877834753,v1:10.20.193.159:6817/3877834753] conn(0x7f72c004cac0 0x7f72c004ce90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.898+0000 7f72bffff640 1 -- 10.20.193.28:0/2622660472 --> [v2:10.20.193.159:6816/3877834753,v1:10.20.193.159:6817/3877834753] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f72c005d010 con 0x7f72c004cac0 2026-02-24T09:17:15.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.898+0000 7fb3b640a640 1 -- start start 2026-02-24T09:17:15.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.899+0000 7fb3b640a640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb3b0113830 0x7fb3b0104a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.899+0000 7fb3b640a640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb3b0114220 0x7fb3b017a200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.899+0000 7fb3b640a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb3b0119930 0x7fb3b0104f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.899+0000 7fb3b5c09640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb3b0119930 0x7fb3b0104f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.899+0000 7fb3b5c09640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb3b0119930 0x7fb3b0104f40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39480/0 (socket says 10.20.193.28:39480) 2026-02-24T09:17:15.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.900+0000 7f72bf7fe640 1 --2- 10.20.193.28:0/2622660472 >> [v2:10.20.193.159:6816/3877834753,v1:10.20.193.159:6817/3877834753] conn(0x7f72c004cac0 0x7f72c004ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.899+0000 7fb3b5c09640 1 -- 10.20.193.28:0/2760487220 learned_addr learned my addr 10.20.193.28:0/2760487220 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:15.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.899+0000 7fb3b640a640 1 -- 10.20.193.28:0/2760487220 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b01055e0 con 0x7fb3b0119930 2026-02-24T09:17:15.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.899+0000 7fb3b640a640 1 -- 10.20.193.28:0/2760487220 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b0105750 con 0x7fb3b0114220 2026-02-24T09:17:15.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.899+0000 7fb3b640a640 1 -- 10.20.193.28:0/2760487220 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b0109a50 con 0x7fb3b0113830 2026-02-24T09:17:15.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.900+0000 7fb3b5408640 1 --2- 10.20.193.28:0/2760487220 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb3b0113830 0x7fb3b0104a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.900+0000 7fb3b4c07640 1 --2- 10.20.193.28:0/2760487220 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb3b0114220 0x7fb3b017a200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.898+0000 7f69bb7fe640 1 -- 10.20.193.28:0/2310366257 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f69c80078c0 con 0x7f69d0114650 2026-02-24T09:17:15.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.902+0000 7fb3b5c09640 1 -- 10.20.193.28:0/2760487220 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb3b0113830 msgr2=0x7fb3b0104a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.902+0000 7fb3b5c09640 1 --2- 10.20.193.28:0/2760487220 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb3b0113830 0x7fb3b0104a00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.902+0000 7fb3b5c09640 1 -- 10.20.193.28:0/2760487220 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb3b0114220 msgr2=0x7fb3b017a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.902+0000 7fb3b5c09640 1 --2- 10.20.193.28:0/2760487220 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb3b0114220 0x7fb3b017a200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.902+0000 7fb3b5c09640 1 -- 10.20.193.28:0/2760487220 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3ac00a590 con 0x7fb3b0119930 2026-02-24T09:17:15.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.902+0000 7fb3b4c07640 1 --2- 10.20.193.28:0/2760487220 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb3b0114220 0x7fb3b017a200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:17:15.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.903+0000 7fb3b5c09640 1 --2- 10.20.193.28:0/2760487220 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb3b0119930 0x7fb3b0104f40 secure :-1 s=READY pgs=282 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3ac007010 tx=0x7fb3ac005310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.903+0000 7fb39e7fc640 1 -- 10.20.193.28:0/2760487220 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb3ac046070 con 0x7fb3b0119930 2026-02-24T09:17:15.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.904+0000 7fb3b640a640 1 -- 10.20.193.28:0/2760487220 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3b0109cd0 con 0x7fb3b0119930 2026-02-24T09:17:15.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.904+0000 7fb3b640a640 1 -- 10.20.193.28:0/2760487220 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3b010a140 con 0x7fb3b0119930 2026-02-24T09:17:15.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.904+0000 7fb39e7fc640 1 -- 10.20.193.28:0/2760487220 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb3ac0064e0 con 0x7fb3b0119930 2026-02-24T09:17:15.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.904+0000 7fb39e7fc640 1 -- 10.20.193.28:0/2760487220 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb3ac039880 con 0x7fb3b0119930 2026-02-24T09:17:15.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.905+0000 7f72bf7fe640 1 --2- 10.20.193.28:0/2622660472 >> [v2:10.20.193.159:6816/3877834753,v1:10.20.193.159:6817/3877834753] conn(0x7f72c004cac0 0x7f72c004ce90 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.906+0000 7fb3b640a640 1 -- 10.20.193.28:0/2760487220 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb378000fd0 con 0x7fb3b0119930 2026-02-24T09:17:15.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.909+0000 7fb39e7fc640 1 -- 10.20.193.28:0/2760487220 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7fb3ac006650 con 0x7fb3b0119930 2026-02-24T09:17:15.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.910+0000 7fb39e7fc640 1 --2- 10.20.193.28:0/2760487220 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb3880b58c0 0x7fb3880d5d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.910+0000 7fb39e7fc640 1 -- 10.20.193.28:0/2760487220 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7fb3ac10c550 con 0x7fb3b0119930 2026-02-24T09:17:15.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.910+0000 7fb39e7fc640 1 --2- 10.20.193.28:0/2760487220 >> [v2:10.20.193.28:6810/1790609615,v1:10.20.193.28:6811/1790609615] conn(0x7fb3880dd2b0 0x7fb3880fd6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.910+0000 7fb39e7fc640 1 -- 10.20.193.28:0/2760487220 --> [v2:10.20.193.28:6810/1790609615,v1:10.20.193.28:6811/1790609615] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb3880fdd70 con 0x7fb3880dd2b0 2026-02-24T09:17:15.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.911+0000 7fb39e7fc640 1 -- 10.20.193.28:0/2760487220 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7fb3ac0cef80 con 0x7fb3b0119930 2026-02-24T09:17:15.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.911+0000 7fb3b4c07640 1 --2- 10.20.193.28:0/2760487220 >> [v2:10.20.193.28:6810/1790609615,v1:10.20.193.28:6811/1790609615] conn(0x7fb3880dd2b0 0x7fb3880fd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.911+0000 7fb3b5408640 1 --2- 10.20.193.28:0/2760487220 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb3880b58c0 0x7fb3880d5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.911+0000 7fb3b4c07640 1 --2- 10.20.193.28:0/2760487220 >> [v2:10.20.193.28:6810/1790609615,v1:10.20.193.28:6811/1790609615] conn(0x7fb3880dd2b0 0x7fb3880fd6c0 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.912+0000 7fb3b5408640 1 --2- 10.20.193.28:0/2760487220 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb3880b58c0 0x7fb3880d5d70 secure :-1 s=READY pgs=160 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3a0005e70 tx=0x7fb3a00073d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.912+0000 7fb39e7fc640 1 -- 10.20.193.28:0/2760487220 <== osd.3 v2:10.20.193.28:6810/1790609615 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7fb3880fdd70 con 0x7fb3880dd2b0 2026-02-24T09:17:15.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.912+0000 7f69bb7fe640 1 --2- 10.20.193.28:0/2310366257 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f69b00b5940 0x7f69b00d5df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.912+0000 7f69bb7fe640 1 -- 10.20.193.28:0/2310366257 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f69c80ef400 con 0x7f69d0114650 2026-02-24T09:17:15.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.913+0000 7f69d5dec640 1 --2- 10.20.193.28:0/2310366257 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f69b00b5940 0x7f69b00d5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.913+0000 7f69d5dec640 1 --2- 10.20.193.28:0/2310366257 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f69b00b5940 0x7f69b00d5df0 secure :-1 s=READY pgs=161 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69bc005b30 tx=0x7f69bc009310 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.913+0000 7f69bb7fe640 1 --2- 10.20.193.28:0/2310366257 >> [v2:10.20.193.28:6802/2124354447,v1:10.20.193.28:6803/2124354447] conn(0x7f69b00dd330 0x7f69b00fd740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.913+0000 7f69bb7fe640 1 -- 10.20.193.28:0/2310366257 --> [v2:10.20.193.28:6802/2124354447,v1:10.20.193.28:6803/2124354447] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f69b00fddf0 con 0x7f69b00dd330 2026-02-24T09:17:15.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.913+0000 7f69bb7fe640 1 -- 10.20.193.28:0/2310366257 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f69c80ef700 con 0x7f69d0114650 2026-02-24T09:17:15.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.918+0000 7f69d6dee640 1 --2- 10.20.193.28:0/2310366257 >> [v2:10.20.193.28:6802/2124354447,v1:10.20.193.28:6803/2124354447] conn(0x7f69b00dd330 0x7f69b00fd740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.919+0000 7f69d6dee640 1 --2- 10.20.193.28:0/2310366257 >> [v2:10.20.193.28:6802/2124354447,v1:10.20.193.28:6803/2124354447] conn(0x7f69b00dd330 0x7f69b00fd740 crc :-1 s=READY pgs=8 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.920+0000 7f69bb7fe640 1 -- 10.20.193.28:0/2310366257 <== osd.0 v2:10.20.193.28:6802/2124354447 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f69b00fddf0 con 0x7f69b00dd330 2026-02-24T09:17:15.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.925+0000 7fb3b640a640 1 -- 10.20.193.28:0/2760487220 --> [v2:10.20.193.28:6810/1790609615,v1:10.20.193.28:6811/1790609615] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb378002d10 con 0x7fb3880dd2b0 2026-02-24T09:17:15.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.925+0000 7fb39e7fc640 1 -- 10.20.193.28:0/2760487220 <== osd.3 v2:10.20.193.28:6810/1790609615 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb378002d10 con 0x7fb3880dd2b0 2026-02-24T09:17:15.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.926+0000 7fb3b640a640 1 -- 10.20.193.28:0/2760487220 >> [v2:10.20.193.28:6810/1790609615,v1:10.20.193.28:6811/1790609615] conn(0x7fb3880dd2b0 msgr2=0x7fb3880fd6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.926+0000 7fb3b640a640 1 --2- 10.20.193.28:0/2760487220 >> [v2:10.20.193.28:6810/1790609615,v1:10.20.193.28:6811/1790609615] conn(0x7fb3880dd2b0 0x7fb3880fd6c0 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.926+0000 7fb3b640a640 1 -- 10.20.193.28:0/2760487220 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb3880b58c0 msgr2=0x7fb3880d5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.926+0000 7fb3b640a640 1 --2- 10.20.193.28:0/2760487220 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb3880b58c0 0x7fb3880d5d70 secure :-1 s=READY pgs=160 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3a0005e70 tx=0x7fb3a00073d0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.926+0000 7fb3b640a640 1 -- 10.20.193.28:0/2760487220 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb3b0119930 msgr2=0x7fb3b0104f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.926+0000 7fb3b640a640 1 --2- 10.20.193.28:0/2760487220 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb3b0119930 0x7fb3b0104f40 secure :-1 s=READY pgs=282 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3ac007010 tx=0x7fb3ac005310 comp rx=0 tx=0).stop 2026-02-24T09:17:15.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.927+0000 7fb3b5c09640 1 -- 10.20.193.28:0/2760487220 reap_dead start 2026-02-24T09:17:15.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.927+0000 7fb3b640a640 1 -- 10.20.193.28:0/2760487220 shutdown_connections 2026-02-24T09:17:15.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.927+0000 7fb3b640a640 1 -- 10.20.193.28:0/2760487220 >> 10.20.193.28:0/2760487220 conn(0x7fb3b0060810 msgr2=0x7fb3b0065630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:15.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.927+0000 7fb3b640a640 1 -- 10.20.193.28:0/2760487220 shutdown_connections 2026-02-24T09:17:15.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.927+0000 7fb3b640a640 1 -- 10.20.193.28:0/2760487220 wait complete. 2026-02-24T09:17:15.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.925+0000 7f729ffff640 1 -- 10.20.193.28:0/2622660472 <== osd.8 v2:10.20.193.159:6816/3877834753 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f72c005d010 con 0x7f72c004cac0 2026-02-24T09:17:15.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.939+0000 7f72bffff640 1 -- 10.20.193.28:0/2622660472 --> [v2:10.20.193.159:6816/3877834753,v1:10.20.193.159:6817/3877834753] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f72c005a500 con 0x7f72c004cac0 2026-02-24T09:17:15.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.941+0000 7f3cb7053640 1 -- 10.20.193.28:0/2013449815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3cb01173a0 msgr2=0x7f3cb017abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.941+0000 7f3cb7053640 1 --2- 10.20.193.28:0/2013449815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3cb01173a0 0x7f3cb017abb0 secure :-1 s=READY pgs=286 gs=1 cs=0 l=1 c_cookie=2279200692313339462 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ca400aaa0 tx=0x7f3ca4030600 comp rx=0 tx=0).stop 2026-02-24T09:17:15.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.941+0000 7f3cb7053640 1 -- 10.20.193.28:0/2013449815 shutdown_connections 2026-02-24T09:17:15.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.942+0000 7f3cb7053640 1 --2- 10.20.193.28:0/2013449815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3cb01173a0 0x7f3cb017abb0 unknown :-1 s=CLOSED pgs=286 gs=1 cs=0 l=1 c_cookie=2279200692313339462 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.942+0000 7f3cb7053640 1 --2- 10.20.193.28:0/2013449815 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3cb0115130 0x7f3cb0116d30 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.942+0000 7f3cb7053640 1 --2- 10.20.193.28:0/2013449815 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3cb00599c0 0x7f3cb01167f0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.942+0000 7f3cb7053640 1 -- 10.20.193.28:0/2013449815 >> 10.20.193.28:0/2013449815 conn(0x7f3cb0057af0 msgr2=0x7f3cb0057ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:15.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.943+0000 7f3cb7053640 1 -- 10.20.193.28:0/2013449815 shutdown_connections 2026-02-24T09:17:15.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.943+0000 7f3cb7053640 1 -- 10.20.193.28:0/2013449815 wait complete. 2026-02-24T09:17:15.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.938+0000 7f1a85597640 1 -- 10.20.193.28:0/2260337783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a80118300 msgr2=0x7f1a80115660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.938+0000 7f1a85597640 1 --2- 10.20.193.28:0/2260337783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a80118300 0x7f1a80115660 secure :-1 s=READY pgs=285 gs=1 cs=0 l=1 c_cookie=14964520918316241482 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a68009950 tx=0x7f1a6802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.938+0000 7f1a85597640 1 -- 10.20.193.28:0/2260337783 shutdown_connections 2026-02-24T09:17:15.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.938+0000 7f1a85597640 1 --2- 10.20.193.28:0/2260337783 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f1a80115e10 0x7f1a8017aa50 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.938+0000 7f1a85597640 1 --2- 10.20.193.28:0/2260337783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a80118300 0x7f1a80115660 unknown :-1 s=CLOSED pgs=285 gs=1 cs=0 l=1 c_cookie=14964520918316241482 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.938+0000 7f1a85597640 1 --2- 10.20.193.28:0/2260337783 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1a80117910 0x7f1a80117ce0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.938+0000 7f1a85597640 1 -- 10.20.193.28:0/2260337783 >> 10.20.193.28:0/2260337783 conn(0x7f1a80057950 msgr2=0x7f1a80057d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:15.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.939+0000 7f1a85597640 1 -- 10.20.193.28:0/2260337783 shutdown_connections 2026-02-24T09:17:15.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.939+0000 7f1a85597640 1 -- 10.20.193.28:0/2260337783 wait complete. 2026-02-24T09:17:15.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.932+0000 7f2bfaf30640 1 -- 10.20.193.28:0/2118515211 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bf4115440 msgr2=0x7f2bf4175e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.932+0000 7f2bfaf30640 1 --2- 10.20.193.28:0/2118515211 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bf4115440 0x7f2bf4175e10 secure :-1 s=READY pgs=283 gs=1 cs=0 l=1 c_cookie=3768907327595135529 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2bf000aa30 tx=0x7f2bf00302b0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.932+0000 7f2bfaf30640 1 -- 10.20.193.28:0/2118515211 shutdown_connections 2026-02-24T09:17:15.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.932+0000 7f2bfaf30640 1 --2- 10.20.193.28:0/2118515211 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bf4115440 0x7f2bf4175e10 unknown :-1 s=CLOSED pgs=283 gs=1 cs=0 l=1 c_cookie=3768907327595135529 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.932+0000 7f2bfaf30640 1 --2- 10.20.193.28:0/2118515211 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2bf410fc40 0x7f2bf4114c90 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.932+0000 7f2bfaf30640 1 --2- 10.20.193.28:0/2118515211 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f2bf410f250 0x7f2bf410f620 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.932+0000 7f2bfaf30640 1 -- 10.20.193.28:0/2118515211 >> 10.20.193.28:0/2118515211 conn(0x7f2bf40ecb40 msgr2=0x7f2bf410cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:15.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.932+0000 7f2bfaf30640 1 -- 10.20.193.28:0/2118515211 shutdown_connections 2026-02-24T09:17:15.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.932+0000 7f2bfaf30640 1 -- 10.20.193.28:0/2118515211 wait complete. 2026-02-24T09:17:15.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.933+0000 7f2bfaf30640 1 Processor -- start 2026-02-24T09:17:15.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.933+0000 7f2bfaf30640 1 -- start start 2026-02-24T09:17:15.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.934+0000 7f2bfaf30640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bf410f250 0x7f2bf417d2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.934+0000 7f2bfaf30640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f2bf410fc40 0x7f2bf417d810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.934+0000 7f2bfaf30640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2bf4115440 0x7f2bf417dd50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.934+0000 7f2bfaf30640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf4059360 con 0x7f2bf410f250 2026-02-24T09:17:15.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.934+0000 7f2bfaf30640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf40594d0 con 0x7f2bf4115440 2026-02-24T09:17:15.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.934+0000 7f2bfaf30640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf4059690 con 0x7f2bf410fc40 2026-02-24T09:17:15.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.934+0000 7f2bf9f2e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bf410f250 0x7f2bf417d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.934+0000 7f2bf9f2e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bf410f250 0x7f2bf417d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39492/0 (socket says 10.20.193.28:39492) 2026-02-24T09:17:15.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.934+0000 7f2bf9f2e640 1 -- 10.20.193.28:0/834555553 learned_addr learned my addr 10.20.193.28:0/834555553 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:15.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.934+0000 7f2bf9f2e640 1 -- 10.20.193.28:0/834555553 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f2bf410fc40 msgr2=0x7f2bf417d810 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:17:15.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.934+0000 7f2bf9f2e640 1 --2- 10.20.193.28:0/834555553 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f2bf410fc40 0x7f2bf417d810 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.934+0000 7f2bf9f2e640 1 -- 10.20.193.28:0/834555553 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2bf4115440 msgr2=0x7f2bf417dd50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:17:15.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.934+0000 7f2bf9f2e640 1 --2- 10.20.193.28:0/834555553 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2bf4115440 0x7f2bf417dd50 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.934+0000 7f2bf9f2e640 1 -- 10.20.193.28:0/834555553 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf000a650 con 0x7f2bf410f250 2026-02-24T09:17:15.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.935+0000 7f2bf9f2e640 1 --2- 10.20.193.28:0/834555553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bf410f250 0x7f2bf417d2d0 secure :-1 s=READY pgs=284 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2be4009fd0 tx=0x7f2be400bbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.935+0000 7f2be2ffd640 1 -- 10.20.193.28:0/834555553 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2be4004290 con 0x7f2bf410f250 2026-02-24T09:17:15.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.935+0000 7f2bfaf30640 1 -- 10.20.193.28:0/834555553 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bf4059970 con 0x7f2bf410f250 2026-02-24T09:17:15.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.935+0000 7f2bfaf30640 1 -- 10.20.193.28:0/834555553 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bf4059ec0 con 0x7f2bf410f250 2026-02-24T09:17:15.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.935+0000 7f2be2ffd640 1 -- 10.20.193.28:0/834555553 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2be40043f0 con 0x7f2bf410f250 2026-02-24T09:17:15.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.935+0000 7f2be2ffd640 1 -- 10.20.193.28:0/834555553 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2be4004290 con 0x7f2bf410f250 2026-02-24T09:17:15.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.939+0000 7f2bfaf30640 1 -- 10.20.193.28:0/834555553 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2bc8000fd0 con 0x7f2bf410f250 2026-02-24T09:17:15.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.940+0000 7f2be2ffd640 1 -- 10.20.193.28:0/834555553 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f2be4002740 con 0x7f2bf410f250 2026-02-24T09:17:15.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.941+0000 7f2be2ffd640 1 --2- 10.20.193.28:0/834555553 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f2bd00b5920 0x7f2bd00d5dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.942+0000 7f2be2ffd640 1 -- 10.20.193.28:0/834555553 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f2be40e5980 con 0x7f2bf410f250 2026-02-24T09:17:15.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.942+0000 7f2be2ffd640 1 --2- 10.20.193.28:0/834555553 >> [v2:10.20.193.74:6808/610990618,v1:10.20.193.74:6809/610990618] conn(0x7f2bd00dd300 0x7f2bd00fd710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.942+0000 7f2be2ffd640 1 -- 10.20.193.28:0/834555553 --> [v2:10.20.193.74:6808/610990618,v1:10.20.193.74:6809/610990618] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2bd00fddc0 con 0x7f2bd00dd300 2026-02-24T09:17:15.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.942+0000 7f2be2ffd640 1 -- 10.20.193.28:0/834555553 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f2be40ea2a0 con 0x7f2bf410f250 2026-02-24T09:17:15.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.945+0000 7f3cb7053640 1 Processor -- start 2026-02-24T09:17:15.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.945+0000 7f3cb7053640 1 -- start start 2026-02-24T09:17:15.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.946+0000 7f2bf972d640 1 --2- 10.20.193.28:0/834555553 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f2bd00b5920 0x7f2bd00d5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.946+0000 7f3cb7053640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3cb00599c0 0x7f3cb01224c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.946+0000 7f3cb7053640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3cb0115130 0x7f3cb0122a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.946+0000 7f3cb6051640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3cb00599c0 0x7f3cb01224c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.946+0000 7f3cb6051640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3cb00599c0 0x7f3cb01224c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39508/0 (socket says 10.20.193.28:39508) 2026-02-24T09:17:15.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.947+0000 7f3cb6051640 1 -- 10.20.193.28:0/3025782497 learned_addr learned my addr 10.20.193.28:0/3025782497 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:15.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.947+0000 7f3cb7053640 1 --2- 10.20.193.28:0/3025782497 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3cb01173a0 0x7f3cb0127dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.947+0000 7f729ffff640 1 -- 10.20.193.28:0/2622660472 <== osd.8 v2:10.20.193.159:6816/3877834753 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f72c005a500 con 0x7f72c004cac0 2026-02-24T09:17:15.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.947+0000 7f3cb7053640 1 -- 10.20.193.28:0/3025782497 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb01283f0 con 0x7f3cb00599c0 2026-02-24T09:17:15.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.947+0000 7f3cb7053640 1 -- 10.20.193.28:0/3025782497 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb0128560 con 0x7f3cb0115130 2026-02-24T09:17:15.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.947+0000 7f3cb7053640 1 -- 10.20.193.28:0/3025782497 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb0128720 con 0x7f3cb01173a0 2026-02-24T09:17:15.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.948+0000 7f3cb6852640 1 --2- 10.20.193.28:0/3025782497 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3cb01173a0 0x7f3cb0127dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.947+0000 7f2bfa72f640 1 --2- 10.20.193.28:0/834555553 >> [v2:10.20.193.74:6808/610990618,v1:10.20.193.74:6809/610990618] conn(0x7f2bd00dd300 0x7f2bd00fd710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.947+0000 7f7ace2dd640 1 -- 10.20.193.28:0/3561900953 --> [v2:10.20.193.28:6818/1891043856,v1:10.20.193.28:6819/1891043856] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7ac804d810 con 0x7f7ac817cfa0 2026-02-24T09:17:15.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.948+0000 7f69d75ef640 1 -- 10.20.193.28:0/2310366257 --> [v2:10.20.193.28:6802/2124354447,v1:10.20.193.28:6803/2124354447] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f69d004cd10 con 0x7f69b00dd330 2026-02-24T09:17:15.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.948+0000 7f7ac57fa640 1 -- 10.20.193.28:0/3561900953 <== osd.6 v2:10.20.193.28:6818/1891043856 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7ac804d810 con 0x7f7ac817cfa0 2026-02-24T09:17:15.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.949+0000 7f69bb7fe640 1 -- 10.20.193.28:0/2310366257 <== osd.0 v2:10.20.193.28:6802/2124354447 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f69d004cd10 con 0x7f69b00dd330 2026-02-24T09:17:15.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.949+0000 7f72bffff640 1 -- 10.20.193.28:0/2622660472 >> [v2:10.20.193.159:6816/3877834753,v1:10.20.193.159:6817/3877834753] conn(0x7f72c004cac0 msgr2=0x7f72c004ce90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.949+0000 7f7ace2dd640 1 -- 10.20.193.28:0/3561900953 >> [v2:10.20.193.28:6818/1891043856,v1:10.20.193.28:6819/1891043856] conn(0x7f7ac817cfa0 msgr2=0x7f7ac804cfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.949+0000 7f72bffff640 1 --2- 10.20.193.28:0/2622660472 >> [v2:10.20.193.159:6816/3877834753,v1:10.20.193.159:6817/3877834753] conn(0x7f72c004cac0 0x7f72c004ce90 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.949+0000 7f7ace2dd640 1 --2- 10.20.193.28:0/3561900953 >> [v2:10.20.193.28:6818/1891043856,v1:10.20.193.28:6819/1891043856] conn(0x7f7ac817cfa0 0x7f7ac804cfd0 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.949+0000 7f69d75ef640 1 -- 10.20.193.28:0/2310366257 >> [v2:10.20.193.28:6802/2124354447,v1:10.20.193.28:6803/2124354447] conn(0x7f69b00dd330 msgr2=0x7f69b00fd740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.949+0000 7f69d75ef640 1 --2- 10.20.193.28:0/2310366257 >> [v2:10.20.193.28:6802/2124354447,v1:10.20.193.28:6803/2124354447] conn(0x7f69b00dd330 0x7f69b00fd740 crc :-1 s=READY pgs=8 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.950+0000 7f7ace2dd640 1 -- 10.20.193.28:0/3561900953 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f7a980b57c0 msgr2=0x7f7a980d5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.950+0000 7f7ace2dd640 1 --2- 10.20.193.28:0/3561900953 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f7a980b57c0 0x7f7a980d5c70 secure :-1 s=READY pgs=158 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ac8125f20 tx=0x7f7ab4008040 comp rx=0 tx=0).stop 2026-02-24T09:17:15.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.950+0000 7f69d75ef640 1 -- 10.20.193.28:0/2310366257 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f69b00b5940 msgr2=0x7f69b00d5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.950+0000 7f69d75ef640 1 --2- 10.20.193.28:0/2310366257 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f69b00b5940 0x7f69b00d5df0 secure :-1 s=READY pgs=161 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69bc005b30 tx=0x7f69bc009310 comp rx=0 tx=0).stop 2026-02-24T09:17:15.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.950+0000 7f69d75ef640 1 -- 10.20.193.28:0/2310366257 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f69d0114650 msgr2=0x7f69d00fe1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.950+0000 7f69d75ef640 1 --2- 10.20.193.28:0/2310366257 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f69d0114650 0x7f69d00fe1f0 secure :-1 s=READY pgs=279 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69c800c9b0 tx=0x7f69c800ce80 comp rx=0 tx=0).stop 2026-02-24T09:17:15.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.950+0000 7f69d6dee640 1 -- 10.20.193.28:0/2310366257 reap_dead start 2026-02-24T09:17:15.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.950+0000 7f7ace2dd640 1 -- 10.20.193.28:0/3561900953 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7ac8114880 msgr2=0x7f7ac811f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.949+0000 7f3cb5850640 1 --2- 10.20.193.28:0/3025782497 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3cb0115130 0x7f3cb0122a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.949+0000 7f3cb6051640 1 -- 10.20.193.28:0/3025782497 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3cb01173a0 msgr2=0x7f3cb0127dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.949+0000 7f3cb6051640 1 --2- 10.20.193.28:0/3025782497 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3cb01173a0 0x7f3cb0127dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.949+0000 7f3cb6051640 1 -- 10.20.193.28:0/3025782497 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3cb0115130 msgr2=0x7f3cb0122a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.949+0000 7f3cb6051640 1 --2- 10.20.193.28:0/3025782497 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3cb0115130 0x7f3cb0122a00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.949+0000 7f3cb6051640 1 -- 10.20.193.28:0/3025782497 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ca400a6c0 con 0x7f3cb00599c0 2026-02-24T09:17:15.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.950+0000 7f3cb6852640 1 --2- 10.20.193.28:0/3025782497 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3cb01173a0 0x7f3cb0127dd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:15.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.950+0000 7f7ace2dd640 1 --2- 10.20.193.28:0/3561900953 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7ac8114880 0x7f7ac811f580 secure :-1 s=READY pgs=87 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7abc003800 tx=0x7f7abc003cd0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.948+0000 7f2bf972d640 1 --2- 10.20.193.28:0/834555553 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f2bd00b5920 0x7f2bd00d5dd0 secure :-1 s=READY pgs=162 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2bf417fdd0 tx=0x7f2be8006c50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.948+0000 7f2bfa72f640 1 --2- 10.20.193.28:0/834555553 >> [v2:10.20.193.74:6808/610990618,v1:10.20.193.74:6809/610990618] conn(0x7f2bd00dd300 0x7f2bd00fd710 crc :-1 s=READY pgs=11 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.951+0000 7f7acc853640 1 -- 10.20.193.28:0/3561900953 reap_dead start 2026-02-24T09:17:15.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.951+0000 7f7ace2dd640 1 -- 10.20.193.28:0/3561900953 shutdown_connections 2026-02-24T09:17:15.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.951+0000 7f7ace2dd640 1 -- 10.20.193.28:0/3561900953 >> 10.20.193.28:0/3561900953 conn(0x7f7ac8057f50 msgr2=0x7f7ac8118000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:15.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.951+0000 7f69d75ef640 1 -- 10.20.193.28:0/2310366257 shutdown_connections 2026-02-24T09:17:15.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.951+0000 7f69d75ef640 1 -- 10.20.193.28:0/2310366257 >> 10.20.193.28:0/2310366257 conn(0x7f69d0057af0 msgr2=0x7f69d00f4e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:15.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.951+0000 7f7ace2dd640 1 -- 10.20.193.28:0/3561900953 shutdown_connections 2026-02-24T09:17:15.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.952+0000 7f7ace2dd640 1 -- 10.20.193.28:0/3561900953 wait complete. 2026-02-24T09:17:15.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.952+0000 7f69d75ef640 1 -- 10.20.193.28:0/2310366257 shutdown_connections 2026-02-24T09:17:15.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.952+0000 7f69d75ef640 1 -- 10.20.193.28:0/2310366257 wait complete. 2026-02-24T09:17:15.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.952+0000 7f3cb6051640 1 --2- 10.20.193.28:0/3025782497 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3cb00599c0 0x7f3cb01224c0 secure :-1 s=READY pgs=287 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3cac00aee0 tx=0x7f3cac00caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.953+0000 7f3c977fe640 1 -- 10.20.193.28:0/3025782497 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3cac011d90 con 0x7f3cb00599c0 2026-02-24T09:17:15.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.953+0000 7f3cb7053640 1 -- 10.20.193.28:0/3025782497 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cb0128a00 con 0x7f3cb00599c0 2026-02-24T09:17:15.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.953+0000 7f3c977fe640 1 -- 10.20.193.28:0/3025782497 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3cac005590 con 0x7f3cb00599c0 2026-02-24T09:17:15.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.953+0000 7f3cb7053640 1 -- 10.20.193.28:0/3025782497 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cb0169180 con 0x7f3cb00599c0 2026-02-24T09:17:15.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.953+0000 7f3c977fe640 1 -- 10.20.193.28:0/3025782497 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3cac01a6f0 con 0x7f3cb00599c0 2026-02-24T09:17:15.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.954+0000 7f2be2ffd640 1 -- 10.20.193.28:0/834555553 <== osd.4 v2:10.20.193.74:6808/610990618 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f2bd00fddc0 con 0x7f2bd00dd300 2026-02-24T09:17:15.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.950+0000 7f1a85597640 1 Processor -- start 2026-02-24T09:17:15.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.951+0000 7f1a85597640 1 -- start start 2026-02-24T09:17:15.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.951+0000 7f1a85597640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f1a80115e10 0x7f1a80101cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.951+0000 7f1a85597640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1a80117910 0x7f1a8017a950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.951+0000 7f1a85597640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a80118300 0x7f1a801023c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.951+0000 7f1a85597640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1a801075d0 con 0x7f1a80118300 2026-02-24T09:17:15.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.952+0000 7f1a85597640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f1a80107740 con 0x7f1a80115e10 2026-02-24T09:17:15.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.952+0000 7f1a85597640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1a80107900 con 0x7f1a80117910 2026-02-24T09:17:15.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.952+0000 7f1a7effd640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f1a80115e10 0x7f1a80101cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.952+0000 7f1a7ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a80118300 0x7f1a801023c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.952+0000 7f1a7effd640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f1a80115e10 0x7f1a80101cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:42698/0 (socket says 10.20.193.28:42698) 2026-02-24T09:17:15.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.952+0000 7f1a7effd640 1 -- 10.20.193.28:0/2705164041 learned_addr learned my addr 10.20.193.28:0/2705164041 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:15.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.952+0000 7f1a7effd640 1 -- 10.20.193.28:0/2705164041 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1a80117910 msgr2=0x7f1a8017a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.952+0000 7f1a7effd640 1 --2- 10.20.193.28:0/2705164041 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1a80117910 0x7f1a8017a950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.952+0000 7f1a7effd640 1 -- 10.20.193.28:0/2705164041 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a80118300 msgr2=0x7f1a801023c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.952+0000 7f1a7effd640 1 --2- 10.20.193.28:0/2705164041 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a80118300 0x7f1a801023c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.952+0000 7f1a7effd640 1 -- 10.20.193.28:0/2705164041 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a68009570 con 0x7f1a80115e10 2026-02-24T09:17:15.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.953+0000 7f1a7ffff640 1 --2- 10.20.193.28:0/2705164041 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a80118300 0x7f1a801023c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:17:15.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.953+0000 7f1a7effd640 1 --2- 10.20.193.28:0/2705164041 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f1a80115e10 0x7f1a80101cc0 secure :-1 s=READY pgs=88 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a7400b520 tx=0x7f1a7400b9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.953+0000 7f1a5ffff640 1 -- 10.20.193.28:0/2705164041 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1a740044a0 con 0x7f1a80115e10 2026-02-24T09:17:15.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.953+0000 7f1a85597640 1 -- 10.20.193.28:0/2705164041 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a80107be0 con 0x7f1a80115e10 2026-02-24T09:17:15.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.953+0000 7f1a85597640 1 -- 10.20.193.28:0/2705164041 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a80108100 con 0x7f1a80115e10 2026-02-24T09:17:15.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.953+0000 7f1a5ffff640 1 -- 10.20.193.28:0/2705164041 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f1a74002c00 con 0x7f1a80115e10 2026-02-24T09:17:15.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.953+0000 7f1a5ffff640 1 -- 10.20.193.28:0/2705164041 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1a740044a0 con 0x7f1a80115e10 2026-02-24T09:17:15.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.954+0000 7f1a5dffb640 1 -- 10.20.193.28:0/2705164041 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1a48000fd0 con 0x7f1a80115e10 2026-02-24T09:17:15.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.954+0000 7f3c957fa640 1 -- 10.20.193.28:0/3025782497 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3c7c000fd0 con 0x7f3cb00599c0 2026-02-24T09:17:15.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.953+0000 7f72bffff640 1 -- 10.20.193.28:0/2622660472 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f72940b5990 msgr2=0x7f72940d5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.953+0000 7f72bffff640 1 --2- 10.20.193.28:0/2622660472 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f72940b5990 0x7f72940d5e40 secure :-1 s=READY pgs=159 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72b00095d0 tx=0x7f72b0005f90 comp rx=0 tx=0).stop 2026-02-24T09:17:15.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.953+0000 7f72bffff640 1 -- 10.20.193.28:0/2622660472 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f72c0060090 msgr2=0x7f72c01c0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.953+0000 7f72bffff640 1 --2- 10.20.193.28:0/2622660472 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f72c0060090 0x7f72c01c0110 secure :-1 s=READY pgs=280 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72b4004740 tx=0x7f72b4009f60 comp rx=0 tx=0).stop 2026-02-24T09:17:15.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.955+0000 7f72bf7fe640 1 -- 10.20.193.28:0/2622660472 reap_dead start 2026-02-24T09:17:15.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.955+0000 7f72bffff640 1 -- 10.20.193.28:0/2622660472 shutdown_connections 2026-02-24T09:17:15.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.955+0000 7f72bffff640 1 -- 10.20.193.28:0/2622660472 >> 10.20.193.28:0/2622660472 conn(0x7f72c0057af0 msgr2=0x7f72c0061550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:15.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.955+0000 7f72bffff640 1 -- 10.20.193.28:0/2622660472 shutdown_connections 2026-02-24T09:17:15.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.955+0000 7f72bffff640 1 -- 10.20.193.28:0/2622660472 wait complete. 2026-02-24T09:17:15.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.957+0000 7f1a5ffff640 1 -- 10.20.193.28:0/2705164041 <== mon.2 v2:10.20.193.74:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f1a74002740 con 0x7f1a80115e10 2026-02-24T09:17:15.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.959+0000 7f1a5ffff640 1 --2- 10.20.193.28:0/2705164041 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f1a540b5910 0x7f1a540d5dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.960+0000 7f1a7e7fc640 1 --2- 10.20.193.28:0/2705164041 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f1a540b5910 0x7f1a540d5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.960+0000 7f1a5ffff640 1 -- 10.20.193.28:0/2705164041 <== mon.2 v2:10.20.193.74:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f1a740e6390 con 0x7f1a80115e10 2026-02-24T09:17:15.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.960+0000 7f1a5ffff640 1 --2- 10.20.193.28:0/2705164041 >> [v2:10.20.193.159:6800/3320466721,v1:10.20.193.159:6801/3320466721] conn(0x7f1a540dd300 0x7f1a540fd710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.960+0000 7f1a5ffff640 1 -- 10.20.193.28:0/2705164041 --> [v2:10.20.193.159:6800/3320466721,v1:10.20.193.159:6801/3320466721] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1a540fddc0 con 0x7f1a540dd300 2026-02-24T09:17:15.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.960+0000 7f1a5ffff640 1 -- 10.20.193.28:0/2705164041 <== mon.2 v2:10.20.193.74:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f1a740e66c0 con 0x7f1a80115e10 2026-02-24T09:17:15.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.961+0000 7f1a7e7fc640 1 --2- 10.20.193.28:0/2705164041 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f1a540b5910 0x7f1a540d5dc0 secure :-1 s=READY pgs=163 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a680098a0 tx=0x7f1a68005bf0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.961+0000 7f1a7ffff640 1 --2- 10.20.193.28:0/2705164041 >> [v2:10.20.193.159:6800/3320466721,v1:10.20.193.159:6801/3320466721] conn(0x7f1a540dd300 0x7f1a540fd710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.961+0000 7f1a7ffff640 1 --2- 10.20.193.28:0/2705164041 >> [v2:10.20.193.159:6800/3320466721,v1:10.20.193.159:6801/3320466721] conn(0x7f1a540dd300 0x7f1a540fd710 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.963+0000 7f1a5ffff640 1 -- 10.20.193.28:0/2705164041 <== osd.2 v2:10.20.193.159:6800/3320466721 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f1a540fddc0 con 0x7f1a540dd300 2026-02-24T09:17:15.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.964+0000 7f3c977fe640 1 -- 10.20.193.28:0/3025782497 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f3cac005080 con 0x7f3cb00599c0 2026-02-24T09:17:15.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.965+0000 7f3c977fe640 1 --2- 10.20.193.28:0/3025782497 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3c900b58c0 0x7f3c900d5d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.969+0000 7f3c977fe640 1 -- 10.20.193.28:0/3025782497 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f3cac0eb700 con 0x7f3cb00599c0 2026-02-24T09:17:15.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.969+0000 7f3c977fe640 1 --2- 10.20.193.28:0/3025782497 >> [v2:10.20.193.74:6800/267363486,v1:10.20.193.74:6801/267363486] conn(0x7f3c900dd2b0 0x7f3c900fd6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.969+0000 7f3c977fe640 1 -- 10.20.193.28:0/3025782497 --> [v2:10.20.193.74:6800/267363486,v1:10.20.193.74:6801/267363486] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3c900fdd70 con 0x7f3c900dd2b0 2026-02-24T09:17:15.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.969+0000 7f3c977fe640 1 -- 10.20.193.28:0/3025782497 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f3cac0eba30 con 0x7f3cb00599c0 2026-02-24T09:17:15.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.969+0000 7f3cb5850640 1 --2- 10.20.193.28:0/3025782497 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3c900b58c0 0x7f3c900d5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.969+0000 7f3cb6852640 1 --2- 10.20.193.28:0/3025782497 >> [v2:10.20.193.74:6800/267363486,v1:10.20.193.74:6801/267363486] conn(0x7f3c900dd2b0 0x7f3c900fd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.970+0000 7f3cb5850640 1 --2- 10.20.193.28:0/3025782497 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3c900b58c0 0x7f3c900d5d70 secure :-1 s=READY pgs=164 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3cb0128e60 tx=0x7f3ca0008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.972+0000 7f3cb6852640 1 --2- 10.20.193.28:0/3025782497 >> [v2:10.20.193.74:6800/267363486,v1:10.20.193.74:6801/267363486] conn(0x7f3c900dd2b0 0x7f3c900fd6c0 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.973+0000 7f3c977fe640 1 -- 10.20.193.28:0/3025782497 <== osd.1 v2:10.20.193.74:6800/267363486 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f3c900fdd70 con 0x7f3c900dd2b0 2026-02-24T09:17:15.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.978+0000 7f1a5dffb640 1 -- 10.20.193.28:0/2705164041 --> [v2:10.20.193.159:6800/3320466721,v1:10.20.193.159:6801/3320466721] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1a48002d10 con 0x7f1a540dd300 2026-02-24T09:17:15.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.979+0000 7f1a5ffff640 1 -- 10.20.193.28:0/2705164041 <== osd.2 v2:10.20.193.159:6800/3320466721 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1a48002d10 con 0x7f1a540dd300 2026-02-24T09:17:15.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.980+0000 7f1a5dffb640 1 -- 10.20.193.28:0/2705164041 >> [v2:10.20.193.159:6800/3320466721,v1:10.20.193.159:6801/3320466721] conn(0x7f1a540dd300 msgr2=0x7f1a540fd710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.980+0000 7f1a5dffb640 1 --2- 10.20.193.28:0/2705164041 >> [v2:10.20.193.159:6800/3320466721,v1:10.20.193.159:6801/3320466721] conn(0x7f1a540dd300 0x7f1a540fd710 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.983+0000 7f1a5dffb640 1 -- 10.20.193.28:0/2705164041 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f1a540b5910 msgr2=0x7f1a540d5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.983+0000 7f1a5dffb640 1 --2- 10.20.193.28:0/2705164041 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f1a540b5910 0x7f1a540d5dc0 secure :-1 s=READY pgs=163 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a680098a0 tx=0x7f1a68005bf0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.983+0000 7f1a5dffb640 1 -- 10.20.193.28:0/2705164041 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f1a80115e10 msgr2=0x7f1a80101cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.983+0000 7f1a5dffb640 1 --2- 10.20.193.28:0/2705164041 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f1a80115e10 0x7f1a80101cc0 secure :-1 s=READY pgs=88 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a7400b520 tx=0x7f1a7400b9f0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.983+0000 7f1a7ffff640 1 -- 10.20.193.28:0/2705164041 reap_dead start 2026-02-24T09:17:15.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.985+0000 7f1a5dffb640 1 -- 10.20.193.28:0/2705164041 shutdown_connections 2026-02-24T09:17:15.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.985+0000 7f1a5dffb640 1 -- 10.20.193.28:0/2705164041 >> 10.20.193.28:0/2705164041 conn(0x7f1a80057950 msgr2=0x7f1a80058cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:15.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.985+0000 7f1a5dffb640 1 -- 10.20.193.28:0/2705164041 shutdown_connections 2026-02-24T09:17:15.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.985+0000 7f1a5dffb640 1 -- 10.20.193.28:0/2705164041 wait complete. 2026-02-24T09:17:15.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.994+0000 7f2bfaf30640 1 -- 10.20.193.28:0/834555553 --> [v2:10.20.193.74:6808/610990618,v1:10.20.193.74:6809/610990618] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2bc8002d10 con 0x7f2bd00dd300 2026-02-24T09:17:15.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.994+0000 7f2be2ffd640 1 -- 10.20.193.28:0/834555553 <== osd.4 v2:10.20.193.74:6808/610990618 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2bc8002d10 con 0x7f2bd00dd300 2026-02-24T09:17:15.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.994+0000 7f2bfaf30640 1 -- 10.20.193.28:0/834555553 >> [v2:10.20.193.74:6808/610990618,v1:10.20.193.74:6809/610990618] conn(0x7f2bd00dd300 msgr2=0x7f2bd00fd710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.994+0000 7f2bfaf30640 1 --2- 10.20.193.28:0/834555553 >> [v2:10.20.193.74:6808/610990618,v1:10.20.193.74:6809/610990618] conn(0x7f2bd00dd300 0x7f2bd00fd710 crc :-1 s=READY pgs=11 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.995+0000 7f2bfaf30640 1 -- 10.20.193.28:0/834555553 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f2bd00b5920 msgr2=0x7f2bd00d5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.995+0000 7f2bfaf30640 1 --2- 10.20.193.28:0/834555553 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f2bd00b5920 0x7f2bd00d5dd0 secure :-1 s=READY pgs=162 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2bf417fdd0 tx=0x7f2be8006c50 comp rx=0 tx=0).stop 2026-02-24T09:17:15.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.995+0000 7f2bfaf30640 1 -- 10.20.193.28:0/834555553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bf410f250 msgr2=0x7f2bf417d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.995+0000 7f2bfaf30640 1 --2- 10.20.193.28:0/834555553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bf410f250 0x7f2bf417d2d0 secure :-1 s=READY pgs=284 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2be4009fd0 tx=0x7f2be400bbf0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.995+0000 7f2bfa72f640 1 -- 10.20.193.28:0/834555553 reap_dead start 2026-02-24T09:17:15.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.995+0000 7f2bfaf30640 1 -- 10.20.193.28:0/834555553 shutdown_connections 2026-02-24T09:17:15.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.995+0000 7f2bfaf30640 1 -- 10.20.193.28:0/834555553 >> 10.20.193.28:0/834555553 conn(0x7f2bf40ecb40 msgr2=0x7f2bf4113390 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:15.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.998+0000 7f2bfaf30640 1 -- 10.20.193.28:0/834555553 shutdown_connections 2026-02-24T09:17:15.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:15.998+0000 7f2bfaf30640 1 -- 10.20.193.28:0/834555553 wait complete. 2026-02-24T09:17:16.002 INFO:teuthology.orchestra.run.trial028.stdout:339302416396 2026-02-24T09:17:16.003 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd last-stat-seq osd.10 2026-02-24T09:17:16.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.002+0000 7f3c957fa640 1 -- 10.20.193.28:0/3025782497 --> [v2:10.20.193.74:6800/267363486,v1:10.20.193.74:6801/267363486] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3c7c002d10 con 0x7f3c900dd2b0 2026-02-24T09:17:16.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.002+0000 7f3c977fe640 1 -- 10.20.193.28:0/3025782497 <== osd.1 v2:10.20.193.74:6800/267363486 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3c7c002d10 con 0x7f3c900dd2b0 2026-02-24T09:17:16.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.003+0000 7f3c957fa640 1 -- 10.20.193.28:0/3025782497 >> [v2:10.20.193.74:6800/267363486,v1:10.20.193.74:6801/267363486] conn(0x7f3c900dd2b0 msgr2=0x7f3c900fd6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.003+0000 7f3c957fa640 1 --2- 10.20.193.28:0/3025782497 >> [v2:10.20.193.74:6800/267363486,v1:10.20.193.74:6801/267363486] conn(0x7f3c900dd2b0 0x7f3c900fd6c0 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.003+0000 7f3c957fa640 1 -- 10.20.193.28:0/3025782497 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3c900b58c0 msgr2=0x7f3c900d5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.003+0000 7f3c957fa640 1 --2- 10.20.193.28:0/3025782497 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3c900b58c0 0x7f3c900d5d70 secure :-1 s=READY pgs=164 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3cb0128e60 tx=0x7f3ca0008040 comp rx=0 tx=0).stop 2026-02-24T09:17:16.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.003+0000 7f3c957fa640 1 -- 10.20.193.28:0/3025782497 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3cb00599c0 msgr2=0x7f3cb01224c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.003+0000 7f3c957fa640 1 --2- 10.20.193.28:0/3025782497 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3cb00599c0 0x7f3cb01224c0 secure :-1 s=READY pgs=287 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3cac00aee0 tx=0x7f3cac00caa0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.003+0000 7f3cb6852640 1 -- 10.20.193.28:0/3025782497 reap_dead start 2026-02-24T09:17:16.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.004+0000 7f3c957fa640 1 -- 10.20.193.28:0/3025782497 shutdown_connections 2026-02-24T09:17:16.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.004+0000 7f3c957fa640 1 -- 10.20.193.28:0/3025782497 >> 10.20.193.28:0/3025782497 conn(0x7f3cb0057af0 msgr2=0x7f3cb0058880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:16.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.004+0000 7f3c957fa640 1 -- 10.20.193.28:0/3025782497 shutdown_connections 2026-02-24T09:17:16.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.004+0000 7f3c957fa640 1 -- 10.20.193.28:0/3025782497 wait complete. 2026-02-24T09:17:16.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.018+0000 7fa8f6e0b640 1 -- 10.20.193.28:0/3386947073 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa8f0067220 msgr2=0x7fa8f0063240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.018+0000 7fa8f6e0b640 1 --2- 10.20.193.28:0/3386947073 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa8f0067220 0x7fa8f0063240 secure :-1 s=READY pgs=85 gs=1 cs=0 l=1 c_cookie=6856983826879637585 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8e0009950 tx=0x7fa8e002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.019+0000 7fa8f6e0b640 1 -- 10.20.193.28:0/3386947073 shutdown_connections 2026-02-24T09:17:16.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.019+0000 7fa8f6e0b640 1 --2- 10.20.193.28:0/3386947073 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa8f0159e80 0x7fa8f017a310 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.019+0000 7fa8f6e0b640 1 --2- 10.20.193.28:0/3386947073 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa8f0063860 0x7fa8f0063c70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.020+0000 7fa8f6e0b640 1 --2- 10.20.193.28:0/3386947073 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa8f0067220 0x7fa8f0063240 unknown :-1 s=CLOSED pgs=85 gs=1 cs=0 l=1 c_cookie=6856983826879637585 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.020+0000 7fa8f6e0b640 1 -- 10.20.193.28:0/3386947073 >> 10.20.193.28:0/3386947073 conn(0x7fa8f00ecf40 msgr2=0x7fa8f010d350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:16.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.020+0000 7fa8f6e0b640 1 -- 10.20.193.28:0/3386947073 shutdown_connections 2026-02-24T09:17:16.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.020+0000 7fa8f6e0b640 1 -- 10.20.193.28:0/3386947073 wait complete. 2026-02-24T09:17:16.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.021+0000 7fa8f6e0b640 1 Processor -- start 2026-02-24T09:17:16.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:15 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/2468428007' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:17:16.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:15 trial159 ceph-mon[44242]: pgmap v188: 97 pgs: 97 active+clean; 633 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 7.7 KiB/s rd, 7.6 KiB/s wr, 16 op/s 2026-02-24T09:17:16.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.029+0000 7fa8f6e0b640 1 -- start start 2026-02-24T09:17:16.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.031+0000 7fa8f6e0b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa8f0063860 0x7fa8f0164230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.031+0000 7fa8f6e0b640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa8f0067220 0x7fa8f0164770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.031+0000 7fa8f6e0b640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa8f0159e80 0x7fa8f0169b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.031+0000 7fa8f6e0b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f016a160 con 0x7fa8f0063860 2026-02-24T09:17:16.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.031+0000 7fa8f6e0b640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f016a2d0 con 0x7fa8f0067220 2026-02-24T09:17:16.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.031+0000 7fa8f6e0b640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f016a490 con 0x7fa8f0159e80 2026-02-24T09:17:16.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.031+0000 7fa8f5608640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa8f0067220 0x7fa8f0164770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.033+0000 7fa8f660a640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa8f0159e80 0x7fa8f0169b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.033+0000 7fa8f660a640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa8f0159e80 0x7fa8f0169b40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:39192/0 (socket says 10.20.193.28:39192) 2026-02-24T09:17:16.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.033+0000 7fa8f660a640 1 -- 10.20.193.28:0/37816958 learned_addr learned my addr 10.20.193.28:0/37816958 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:16.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.035+0000 7fa8f660a640 1 -- 10.20.193.28:0/37816958 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa8f0067220 msgr2=0x7fa8f0164770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.035+0000 7fa8f660a640 1 --2- 10.20.193.28:0/37816958 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa8f0067220 0x7fa8f0164770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.035+0000 7fa8f660a640 1 -- 10.20.193.28:0/37816958 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa8f0063860 msgr2=0x7fa8f0164230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.035+0000 7fa8f660a640 1 --2- 10.20.193.28:0/37816958 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa8f0063860 0x7fa8f0164230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.035+0000 7fa8f660a640 1 -- 10.20.193.28:0/37816958 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8ec00a590 con 0x7fa8f0159e80 2026-02-24T09:17:16.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.036+0000 7fa8f5608640 1 --2- 10.20.193.28:0/37816958 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa8f0067220 0x7fa8f0164770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:17:16.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.036+0000 7fa8f660a640 1 --2- 10.20.193.28:0/37816958 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa8f0159e80 0x7fa8f0169b40 secure :-1 s=READY pgs=86 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8ec005790 tx=0x7fa8ec003c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:16.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.039+0000 7fa8deffd640 1 -- 10.20.193.28:0/37816958 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa8ec00fd60 con 0x7fa8f0159e80 2026-02-24T09:17:16.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.039+0000 7fa8f6e0b640 1 -- 10.20.193.28:0/37816958 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8e0009570 con 0x7fa8f0159e80 2026-02-24T09:17:16.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.039+0000 7fa8deffd640 1 -- 10.20.193.28:0/37816958 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fa8ec003e80 con 0x7fa8f0159e80 2026-02-24T09:17:16.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.039+0000 7fa8deffd640 1 -- 10.20.193.28:0/37816958 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa8ec019930 con 0x7fa8f0159e80 2026-02-24T09:17:16.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.039+0000 7fa8f6e0b640 1 -- 10.20.193.28:0/37816958 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8f0157d30 con 0x7fa8f0159e80 2026-02-24T09:17:16.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.040+0000 7fa8f6e0b640 1 -- 10.20.193.28:0/37816958 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa8f0052010 con 0x7fa8f0159e80 2026-02-24T09:17:16.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.043+0000 7fa8deffd640 1 -- 10.20.193.28:0/37816958 <== mon.1 v2:10.20.193.159:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7fa8ec017020 con 0x7fa8f0159e80 2026-02-24T09:17:16.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.045+0000 7fa8deffd640 1 --2- 10.20.193.28:0/37816958 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa8cc0b5910 0x7fa8cc0d5dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.045+0000 7fa8deffd640 1 -- 10.20.193.28:0/37816958 <== mon.1 v2:10.20.193.159:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7fa8ec0e8080 con 0x7fa8f0159e80 2026-02-24T09:17:16.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.046+0000 7fa8f5e09640 1 --2- 10.20.193.28:0/37816958 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa8cc0b5910 0x7fa8cc0d5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.046+0000 7fa8deffd640 1 --2- 10.20.193.28:0/37816958 >> [v2:10.20.193.74:6816/2328869739,v1:10.20.193.74:6817/2328869739] conn(0x7fa8cc0dd300 0x7fa8cc0fd710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.046+0000 7fa8deffd640 1 -- 10.20.193.28:0/37816958 --> [v2:10.20.193.74:6816/2328869739,v1:10.20.193.74:6817/2328869739] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa8cc0fddc0 con 0x7fa8cc0dd300 2026-02-24T09:17:16.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.047+0000 7fa8deffd640 1 -- 10.20.193.28:0/37816958 <== mon.1 v2:10.20.193.159:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7fa8ec0e8430 con 0x7fa8f0159e80 2026-02-24T09:17:16.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.047+0000 7fa8f5608640 1 --2- 10.20.193.28:0/37816958 >> [v2:10.20.193.74:6816/2328869739,v1:10.20.193.74:6817/2328869739] conn(0x7fa8cc0dd300 0x7fa8cc0fd710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.047+0000 7fa8f5e09640 1 --2- 10.20.193.28:0/37816958 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa8cc0b5910 0x7fa8cc0d5dc0 secure :-1 s=READY pgs=165 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8e002f6e0 tx=0x7fa8e0005c30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:16.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.048+0000 7fa8f5608640 1 --2- 10.20.193.28:0/37816958 >> [v2:10.20.193.74:6816/2328869739,v1:10.20.193.74:6817/2328869739] conn(0x7fa8cc0dd300 0x7fa8cc0fd710 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:16.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.049+0000 7fa8deffd640 1 -- 10.20.193.28:0/37816958 <== osd.7 v2:10.20.193.74:6816/2328869739 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7fa8cc0fddc0 con 0x7fa8cc0dd300 2026-02-24T09:17:16.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.063+0000 7ff110c85640 1 -- 10.20.193.28:0/1468260783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff10c1145a0 msgr2=0x7ff10c1195f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.063+0000 7ff110c85640 1 --2- 10.20.193.28:0/1468260783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff10c1145a0 0x7ff10c1195f0 secure :-1 s=READY pgs=288 gs=1 cs=0 l=1 c_cookie=10541323452073156231 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0f4009950 tx=0x7ff0f402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.063+0000 7ff110c85640 1 -- 10.20.193.28:0/1468260783 shutdown_connections 2026-02-24T09:17:16.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.063+0000 7ff110c85640 1 --2- 10.20.193.28:0/1468260783 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff10c119da0 0x7ff10c17a770 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.064+0000 7ff110c85640 1 --2- 10.20.193.28:0/1468260783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff10c1145a0 0x7ff10c1195f0 unknown :-1 s=CLOSED pgs=288 gs=1 cs=0 l=1 c_cookie=10541323452073156231 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.064+0000 7ff110c85640 1 --2- 10.20.193.28:0/1468260783 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff10c113bb0 0x7ff10c113f80 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.064+0000 7ff110c85640 1 -- 10.20.193.28:0/1468260783 >> 10.20.193.28:0/1468260783 conn(0x7ff10c064cc0 msgr2=0x7ff10c0650c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:16.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.064+0000 7ff110c85640 1 -- 10.20.193.28:0/1468260783 shutdown_connections 2026-02-24T09:17:16.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.064+0000 7ff110c85640 1 -- 10.20.193.28:0/1468260783 wait complete. 2026-02-24T09:17:16.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.065+0000 7ff110c85640 1 Processor -- start 2026-02-24T09:17:16.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.066+0000 7ff110c85640 1 -- start start 2026-02-24T09:17:16.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.066+0000 7ff110c85640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff10c113bb0 0x7ff10c11c0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.066+0000 7ff110c85640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff10c1145a0 0x7ff10c11c5f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.061+0000 7fa8f6e0b640 1 -- 10.20.193.28:0/37816958 --> [v2:10.20.193.74:6816/2328869739,v1:10.20.193.74:6817/2328869739] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa8f017dc30 con 0x7fa8cc0dd300 2026-02-24T09:17:16.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.066+0000 7ff110c85640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff10c119da0 0x7ff10c1219c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.066+0000 7ff110c85640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff10c121fe0 con 0x7ff10c1145a0 2026-02-24T09:17:16.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.066+0000 7ff110c85640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7ff10c122150 con 0x7ff10c119da0 2026-02-24T09:17:16.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.066+0000 7ff110c85640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff10c122310 con 0x7ff10c113bb0 2026-02-24T09:17:16.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.067+0000 7ff109d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff10c1145a0 0x7ff10c11c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.067+0000 7ff109d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff10c1145a0 0x7ff10c11c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39546/0 (socket says 10.20.193.28:39546) 2026-02-24T09:17:16.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.067+0000 7ff109d74640 1 -- 10.20.193.28:0/783044141 learned_addr learned my addr 10.20.193.28:0/783044141 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:16.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.067+0000 7ff109d74640 1 -- 10.20.193.28:0/783044141 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff10c113bb0 msgr2=0x7ff10c11c0b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:17:16.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.068+0000 7fa8deffd640 1 -- 10.20.193.28:0/37816958 <== osd.7 v2:10.20.193.74:6816/2328869739 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa8f017dc30 con 0x7fa8cc0dd300 2026-02-24T09:17:16.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.067+0000 7ff109d74640 1 --2- 10.20.193.28:0/783044141 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff10c113bb0 0x7ff10c11c0b0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.067+0000 7ff109d74640 1 -- 10.20.193.28:0/783044141 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff10c119da0 msgr2=0x7ff10c1219c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:17:16.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.067+0000 7ff109d74640 1 --2- 10.20.193.28:0/783044141 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff10c119da0 0x7ff10c1219c0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.067+0000 7ff109d74640 1 -- 10.20.193.28:0/783044141 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f4009570 con 0x7ff10c1145a0 2026-02-24T09:17:16.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.068+0000 7ff109d74640 1 --2- 10.20.193.28:0/783044141 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff10c1145a0 0x7ff10c11c5f0 secure :-1 s=READY pgs=289 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0f4005b30 tx=0x7ff0f4005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:16.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.068+0000 7ff0f37fe640 1 -- 10.20.193.28:0/783044141 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff0f402fc50 con 0x7ff10c1145a0 2026-02-24T09:17:16.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.068+0000 7ff0f37fe640 1 -- 10.20.193.28:0/783044141 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff0f4038bc0 con 0x7ff10c1145a0 2026-02-24T09:17:16.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.068+0000 7ff0f37fe640 1 -- 10.20.193.28:0/783044141 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff0f402fc50 con 0x7ff10c1145a0 2026-02-24T09:17:16.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.068+0000 7ff110c85640 1 -- 10.20.193.28:0/783044141 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff10c122590 con 0x7ff10c1145a0 2026-02-24T09:17:16.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.068+0000 7ff110c85640 1 -- 10.20.193.28:0/783044141 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff10c162b50 con 0x7ff10c1145a0 2026-02-24T09:17:16.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.073+0000 7fa8f6e0b640 1 -- 10.20.193.28:0/37816958 >> [v2:10.20.193.74:6816/2328869739,v1:10.20.193.74:6817/2328869739] conn(0x7fa8cc0dd300 msgr2=0x7fa8cc0fd710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.073+0000 7fa8f6e0b640 1 --2- 10.20.193.28:0/37816958 >> [v2:10.20.193.74:6816/2328869739,v1:10.20.193.74:6817/2328869739] conn(0x7fa8cc0dd300 0x7fa8cc0fd710 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.073+0000 7fa8f6e0b640 1 -- 10.20.193.28:0/37816958 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa8cc0b5910 msgr2=0x7fa8cc0d5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.073+0000 7fa8f6e0b640 1 --2- 10.20.193.28:0/37816958 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa8cc0b5910 0x7fa8cc0d5dc0 secure :-1 s=READY pgs=165 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8e002f6e0 tx=0x7fa8e0005c30 comp rx=0 tx=0).stop 2026-02-24T09:17:16.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.073+0000 7fa8f6e0b640 1 -- 10.20.193.28:0/37816958 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa8f0159e80 msgr2=0x7fa8f0169b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.073+0000 7fa8f6e0b640 1 --2- 10.20.193.28:0/37816958 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa8f0159e80 0x7fa8f0169b40 secure :-1 s=READY pgs=86 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8ec005790 tx=0x7fa8ec003c20 comp rx=0 tx=0).stop 2026-02-24T09:17:16.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.074+0000 7fa8f660a640 1 -- 10.20.193.28:0/37816958 reap_dead start 2026-02-24T09:17:16.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.074+0000 7fa8f6e0b640 1 -- 10.20.193.28:0/37816958 shutdown_connections 2026-02-24T09:17:16.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.074+0000 7fa8f6e0b640 1 -- 10.20.193.28:0/37816958 >> 10.20.193.28:0/37816958 conn(0x7fa8f00ecf40 msgr2=0x7fa8f010d320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:16.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.074+0000 7ff110c85640 1 -- 10.20.193.28:0/783044141 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff0d0000fd0 con 0x7ff10c1145a0 2026-02-24T09:17:16.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.075+0000 7ff0f37fe640 1 -- 10.20.193.28:0/783044141 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7ff0f4041b90 con 0x7ff10c1145a0 2026-02-24T09:17:16.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.074+0000 7fa8f6e0b640 1 -- 10.20.193.28:0/37816958 shutdown_connections 2026-02-24T09:17:16.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.074+0000 7fa8f6e0b640 1 -- 10.20.193.28:0/37816958 wait complete. 2026-02-24T09:17:16.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.076+0000 7ff0f37fe640 1 --2- 10.20.193.28:0/783044141 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff0e40b58a0 0x7ff0e40d5d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.077+0000 7ff0f37fe640 1 -- 10.20.193.28:0/783044141 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7ff0f410b230 con 0x7ff10c1145a0 2026-02-24T09:17:16.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.077+0000 7ff10a575640 1 --2- 10.20.193.28:0/783044141 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff0e40b58a0 0x7ff0e40d5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.077+0000 7ff0f37fe640 1 --2- 10.20.193.28:0/783044141 >> [v2:10.20.193.159:6808/1653417923,v1:10.20.193.159:6809/1653417923] conn(0x7ff0e40dd290 0x7ff0e40fd6a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.077+0000 7ff0f37fe640 1 -- 10.20.193.28:0/783044141 --> [v2:10.20.193.159:6808/1653417923,v1:10.20.193.159:6809/1653417923] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff0e40fdd50 con 0x7ff0e40dd290 2026-02-24T09:17:16.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.078+0000 7f6bba63f640 1 -- 10.20.193.28:0/2621560347 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6bb41199a0 msgr2=0x7f6bb417a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.078+0000 7f6bba63f640 1 --2- 10.20.193.28:0/2621560347 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6bb41199a0 0x7f6bb417a370 secure :-1 s=READY pgs=290 gs=1 cs=0 l=1 c_cookie=15929329445482352023 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6bb000aa80 tx=0x7f6bb0030310 comp rx=0 tx=0).stop 2026-02-24T09:17:16.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.078+0000 7f6bba63f640 1 -- 10.20.193.28:0/2621560347 shutdown_connections 2026-02-24T09:17:16.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.078+0000 7f6bba63f640 1 --2- 10.20.193.28:0/2621560347 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6bb41199a0 0x7f6bb417a370 unknown :-1 s=CLOSED pgs=290 gs=1 cs=0 l=1 c_cookie=15929329445482352023 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.078+0000 7f6bba63f640 1 --2- 10.20.193.28:0/2621560347 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f6bb4114a10 0x7f6bb41191f0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.078+0000 7f6bba63f640 1 --2- 10.20.193.28:0/2621560347 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f6bb4114020 0x7f6bb41143f0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.078+0000 7f6bba63f640 1 -- 10.20.193.28:0/2621560347 >> 10.20.193.28:0/2621560347 conn(0x7f6bb4064810 msgr2=0x7f6bb4064c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:16.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.078+0000 7f6bba63f640 1 -- 10.20.193.28:0/2621560347 shutdown_connections 2026-02-24T09:17:16.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.078+0000 7f6bba63f640 1 -- 10.20.193.28:0/2621560347 wait complete. 2026-02-24T09:17:16.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.079+0000 7f6bba63f640 1 Processor -- start 2026-02-24T09:17:16.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.081+0000 7ff0f37fe640 1 -- 10.20.193.28:0/783044141 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7ff0f40cdbd0 con 0x7ff10c1145a0 2026-02-24T09:17:16.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.081+0000 7ff10a575640 1 --2- 10.20.193.28:0/783044141 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff0e40b58a0 0x7ff0e40d5d50 secure :-1 s=READY pgs=166 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff100004760 tx=0x7ff100006c80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:16.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.080+0000 7f6bba63f640 1 -- start start 2026-02-24T09:17:16.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.080+0000 7f6bba63f640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f6bb4114020 0x7f6bb411a3e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.080+0000 7f6bba63f640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f6bb4114a10 0x7f6bb411a920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.080+0000 7f6bba63f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6bb41199a0 0x7f6bb415f2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.081+0000 7f6bb9e3e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6bb41199a0 0x7f6bb415f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.081+0000 7f6bb9e3e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6bb41199a0 0x7f6bb415f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39558/0 (socket says 10.20.193.28:39558) 2026-02-24T09:17:16.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.081+0000 7f6bb9e3e640 1 -- 10.20.193.28:0/247016844 learned_addr learned my addr 10.20.193.28:0/247016844 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:16.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.081+0000 7f6bba63f640 1 -- 10.20.193.28:0/247016844 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb415f7f0 con 0x7f6bb41199a0 2026-02-24T09:17:16.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.081+0000 7f6bba63f640 1 -- 10.20.193.28:0/247016844 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb415f960 con 0x7f6bb4114020 2026-02-24T09:17:16.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.081+0000 7f6bba63f640 1 -- 10.20.193.28:0/247016844 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb415fb20 con 0x7f6bb4114a10 2026-02-24T09:17:16.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.081+0000 7f6bb9e3e640 1 -- 10.20.193.28:0/247016844 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f6bb4114a10 msgr2=0x7f6bb411a920 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:17:16.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.081+0000 7f6bb9e3e640 1 --2- 10.20.193.28:0/247016844 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f6bb4114a10 0x7f6bb411a920 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.081+0000 7f6bb9e3e640 1 -- 10.20.193.28:0/247016844 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f6bb4114020 msgr2=0x7f6bb411a3e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:17:16.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.081+0000 7f6bb9e3e640 1 --2- 10.20.193.28:0/247016844 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f6bb4114020 0x7f6bb411a3e0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.081+0000 7f6bb9e3e640 1 -- 10.20.193.28:0/247016844 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb000a650 con 0x7f6bb41199a0 2026-02-24T09:17:16.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.081+0000 7f6bb9e3e640 1 --2- 10.20.193.28:0/247016844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6bb41199a0 0x7f6bb415f2b0 secure :-1 s=READY pgs=291 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6bb000a360 tx=0x7f6bb0032e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:16.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.082+0000 7f6ba27fc640 1 -- 10.20.193.28:0/247016844 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6bb0030d90 con 0x7f6bb41199a0 2026-02-24T09:17:16.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.082+0000 7f6bba63f640 1 -- 10.20.193.28:0/247016844 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bb415fda0 con 0x7f6bb41199a0 2026-02-24T09:17:16.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.082+0000 7f6bba63f640 1 -- 10.20.193.28:0/247016844 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bb4160210 con 0x7f6bb41199a0 2026-02-24T09:17:16.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.082+0000 7f6b83fff640 1 -- 10.20.193.28:0/247016844 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6bb4052010 con 0x7f6bb41199a0 2026-02-24T09:17:16.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.084+0000 7f6ba27fc640 1 -- 10.20.193.28:0/247016844 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6bb0039960 con 0x7f6bb41199a0 2026-02-24T09:17:16.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.084+0000 7f6ba27fc640 1 -- 10.20.193.28:0/247016844 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6bb0005c20 con 0x7f6bb41199a0 2026-02-24T09:17:16.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.087+0000 7f6ba27fc640 1 -- 10.20.193.28:0/247016844 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f6bb0039ad0 con 0x7f6bb41199a0 2026-02-24T09:17:16.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.088+0000 7f6ba27fc640 1 --2- 10.20.193.28:0/247016844 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f6b900b5830 0x7f6b900d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.088+0000 7f6ba27fc640 1 -- 10.20.193.28:0/247016844 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f6bb010cba0 con 0x7f6bb41199a0 2026-02-24T09:17:16.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.088+0000 7f6bb963d640 1 --2- 10.20.193.28:0/247016844 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f6b900b5830 0x7f6b900d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.088+0000 7f6ba27fc640 1 --2- 10.20.193.28:0/247016844 >> [v2:10.20.193.28:6826/4207785690,v1:10.20.193.28:6827/4207785690] conn(0x7f6b900dd220 0x7f6b900fd630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.088+0000 7f6ba27fc640 1 -- 10.20.193.28:0/247016844 --> [v2:10.20.193.28:6826/4207785690,v1:10.20.193.28:6827/4207785690] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6b900fdce0 con 0x7f6b900dd220 2026-02-24T09:17:16.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.088+0000 7f6ba27fc640 1 -- 10.20.193.28:0/247016844 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f6bb010cf50 con 0x7f6bb41199a0 2026-02-24T09:17:16.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.089+0000 7f6bb8e3c640 1 --2- 10.20.193.28:0/247016844 >> [v2:10.20.193.28:6826/4207785690,v1:10.20.193.28:6827/4207785690] conn(0x7f6b900dd220 0x7f6b900fd630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.089+0000 7f6bb963d640 1 --2- 10.20.193.28:0/247016844 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f6b900b5830 0x7f6b900d5ce0 secure :-1 s=READY pgs=167 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ba4004760 tx=0x7f6ba4006c80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:16.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.089+0000 7f6bb8e3c640 1 --2- 10.20.193.28:0/247016844 >> [v2:10.20.193.28:6826/4207785690,v1:10.20.193.28:6827/4207785690] conn(0x7f6b900dd220 0x7f6b900fd630 crc :-1 s=READY pgs=9 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:16.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.090+0000 7f6ba27fc640 1 -- 10.20.193.28:0/247016844 <== osd.9 v2:10.20.193.28:6826/4207785690 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f6b900fdce0 con 0x7f6b900dd220 2026-02-24T09:17:16.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.092+0000 7ff10ad76640 1 --2- 10.20.193.28:0/783044141 >> [v2:10.20.193.159:6808/1653417923,v1:10.20.193.159:6809/1653417923] conn(0x7ff0e40dd290 0x7ff0e40fd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.093+0000 7ff10ad76640 1 --2- 10.20.193.28:0/783044141 >> [v2:10.20.193.159:6808/1653417923,v1:10.20.193.159:6809/1653417923] conn(0x7ff0e40dd290 0x7ff0e40fd6a0 crc :-1 s=READY pgs=10 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:16.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.095+0000 7ff0f37fe640 1 -- 10.20.193.28:0/783044141 <== osd.5 v2:10.20.193.159:6808/1653417923 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7ff0e40fdd50 con 0x7ff0e40dd290 2026-02-24T09:17:16.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7ff110c85640 1 -- 10.20.193.28:0/783044141 --> [v2:10.20.193.159:6808/1653417923,v1:10.20.193.159:6809/1653417923] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff0d0002ce0 con 0x7ff0e40dd290 2026-02-24T09:17:16.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7ff0f37fe640 1 -- 10.20.193.28:0/783044141 <== osd.5 v2:10.20.193.159:6808/1653417923 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff0d0002ce0 con 0x7ff0e40dd290 2026-02-24T09:17:16.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7ff110c85640 1 -- 10.20.193.28:0/783044141 >> [v2:10.20.193.159:6808/1653417923,v1:10.20.193.159:6809/1653417923] conn(0x7ff0e40dd290 msgr2=0x7ff0e40fd6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7ff110c85640 1 --2- 10.20.193.28:0/783044141 >> [v2:10.20.193.159:6808/1653417923,v1:10.20.193.159:6809/1653417923] conn(0x7ff0e40dd290 0x7ff0e40fd6a0 crc :-1 s=READY pgs=10 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7ff110c85640 1 -- 10.20.193.28:0/783044141 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff0e40b58a0 msgr2=0x7ff0e40d5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7ff110c85640 1 --2- 10.20.193.28:0/783044141 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff0e40b58a0 0x7ff0e40d5d50 secure :-1 s=READY pgs=166 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff100004760 tx=0x7ff100006c80 comp rx=0 tx=0).stop 2026-02-24T09:17:16.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7ff110c85640 1 -- 10.20.193.28:0/783044141 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff10c1145a0 msgr2=0x7ff10c11c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7ff110c85640 1 --2- 10.20.193.28:0/783044141 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff10c1145a0 0x7ff10c11c5f0 secure :-1 s=READY pgs=289 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0f4005b30 tx=0x7ff0f4005db0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7ff10ad76640 1 -- 10.20.193.28:0/783044141 reap_dead start 2026-02-24T09:17:16.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7ff110c85640 1 -- 10.20.193.28:0/783044141 shutdown_connections 2026-02-24T09:17:16.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7ff110c85640 1 -- 10.20.193.28:0/783044141 >> 10.20.193.28:0/783044141 conn(0x7ff10c064cc0 msgr2=0x7ff10c117780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:16.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7ff110c85640 1 -- 10.20.193.28:0/783044141 shutdown_connections 2026-02-24T09:17:16.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.111+0000 7ff110c85640 1 -- 10.20.193.28:0/783044141 wait complete. 2026-02-24T09:17:16.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7f99f0ff7640 1 -- 10.20.193.28:0/2750201308 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f99ec10f6c0 msgr2=0x7f99ec10fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7f99f0ff7640 1 --2- 10.20.193.28:0/2750201308 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f99ec10f6c0 0x7f99ec10fa90 secure :-1 s=READY pgs=87 gs=1 cs=0 l=1 c_cookie=1514127765619772966 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99e0009950 tx=0x7f99e002f190 comp rx=0 tx=0).stop 2026-02-24T09:17:16.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7f99f0ff7640 1 -- 10.20.193.28:0/2750201308 shutdown_connections 2026-02-24T09:17:16.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7f99f0ff7640 1 --2- 10.20.193.28:0/2750201308 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f99ec1158b0 0x7f99ec176280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7f99f0ff7640 1 --2- 10.20.193.28:0/2750201308 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f99ec1100b0 0x7f99ec115100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7f99f0ff7640 1 --2- 10.20.193.28:0/2750201308 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f99ec10f6c0 0x7f99ec10fa90 unknown :-1 s=CLOSED pgs=87 gs=1 cs=0 l=1 c_cookie=1514127765619772966 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7f99f0ff7640 1 -- 10.20.193.28:0/2750201308 >> 10.20.193.28:0/2750201308 conn(0x7f99ec0ecfd0 msgr2=0x7f99ec10d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:16.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7f99f0ff7640 1 -- 10.20.193.28:0/2750201308 shutdown_connections 2026-02-24T09:17:16.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7f99f0ff7640 1 -- 10.20.193.28:0/2750201308 wait complete. 2026-02-24T09:17:16.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7f99f0ff7640 1 Processor -- start 2026-02-24T09:17:16.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7f99f0ff7640 1 -- start start 2026-02-24T09:17:16.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7f99f0ff7640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f99ec10f6c0 0x7f99ec0f5a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7f99f0ff7640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f99ec1100b0 0x7f99ec176180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7f99f0ff7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f99ec1158b0 0x7f99ec0f6120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7f99ea575640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f99ec10f6c0 0x7f99ec0f5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7f99f0ff7640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f99ec0fb330 con 0x7f99ec1158b0 2026-02-24T09:17:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7f99f0ff7640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f99ec0fb4a0 con 0x7f99ec1100b0 2026-02-24T09:17:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7f99f0ff7640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f99ec0fb660 con 0x7f99ec10f6c0 2026-02-24T09:17:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7f99ea575640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f99ec10f6c0 0x7f99ec0f5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:39268/0 (socket says 10.20.193.28:39268) 2026-02-24T09:17:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7f99ea575640 1 -- 10.20.193.28:0/4126027271 learned_addr learned my addr 10.20.193.28:0/4126027271 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7f99ead76640 1 --2- 10.20.193.28:0/4126027271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f99ec1158b0 0x7f99ec0f6120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7f99e9d74640 1 --2- 10.20.193.28:0/4126027271 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f99ec1100b0 0x7f99ec176180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7f99ea575640 1 -- 10.20.193.28:0/4126027271 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f99ec1100b0 msgr2=0x7f99ec176180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7f99ea575640 1 --2- 10.20.193.28:0/4126027271 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f99ec1100b0 0x7f99ec176180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7f99ea575640 1 -- 10.20.193.28:0/4126027271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f99ec1158b0 msgr2=0x7f99ec0f6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7f99ea575640 1 --2- 10.20.193.28:0/4126027271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f99ec1158b0 0x7f99ec0f6120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7f99ea575640 1 -- 10.20.193.28:0/4126027271 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99dc00a590 con 0x7f99ec10f6c0 2026-02-24T09:17:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7f99ead76640 1 --2- 10.20.193.28:0/4126027271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f99ec1158b0 0x7f99ec0f6120 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:17:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.106+0000 7f99ea575640 1 --2- 10.20.193.28:0/4126027271 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f99ec10f6c0 0x7f99ec0f5a20 secure :-1 s=READY pgs=88 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99e00098a0 tx=0x7f99e0002c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.111+0000 7f99d37fe640 1 -- 10.20.193.28:0/4126027271 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f99e002fc10 con 0x7f99ec10f6c0 2026-02-24T09:17:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.111+0000 7f99d37fe640 1 -- 10.20.193.28:0/4126027271 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f99e0005dd0 con 0x7f99ec10f6c0 2026-02-24T09:17:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.111+0000 7f99d37fe640 1 -- 10.20.193.28:0/4126027271 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f99e0041b60 con 0x7f99ec10f6c0 2026-02-24T09:17:16.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.114+0000 7f6b83fff640 1 -- 10.20.193.28:0/247016844 --> [v2:10.20.193.28:6826/4207785690,v1:10.20.193.28:6827/4207785690] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6bb404cd90 con 0x7f6b900dd220 2026-02-24T09:17:16.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.114+0000 7f6ba27fc640 1 -- 10.20.193.28:0/247016844 <== osd.9 v2:10.20.193.28:6826/4207785690 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6bb404cd90 con 0x7f6b900dd220 2026-02-24T09:17:16.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.114+0000 7f6b83fff640 1 -- 10.20.193.28:0/247016844 >> [v2:10.20.193.28:6826/4207785690,v1:10.20.193.28:6827/4207785690] conn(0x7f6b900dd220 msgr2=0x7f6b900fd630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.114+0000 7f6b83fff640 1 --2- 10.20.193.28:0/247016844 >> [v2:10.20.193.28:6826/4207785690,v1:10.20.193.28:6827/4207785690] conn(0x7f6b900dd220 0x7f6b900fd630 crc :-1 s=READY pgs=9 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.114+0000 7f6b83fff640 1 -- 10.20.193.28:0/247016844 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f6b900b5830 msgr2=0x7f6b900d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.114+0000 7f6b83fff640 1 --2- 10.20.193.28:0/247016844 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f6b900b5830 0x7f6b900d5ce0 secure :-1 s=READY pgs=167 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ba4004760 tx=0x7f6ba4006c80 comp rx=0 tx=0).stop 2026-02-24T09:17:16.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.114+0000 7f6b83fff640 1 -- 10.20.193.28:0/247016844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6bb41199a0 msgr2=0x7f6bb415f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.114+0000 7f6b83fff640 1 --2- 10.20.193.28:0/247016844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6bb41199a0 0x7f6bb415f2b0 secure :-1 s=READY pgs=291 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6bb000a360 tx=0x7f6bb0032e30 comp rx=0 tx=0).stop 2026-02-24T09:17:16.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.114+0000 7f6bb9e3e640 1 -- 10.20.193.28:0/247016844 reap_dead start 2026-02-24T09:17:16.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.114+0000 7f6b83fff640 1 -- 10.20.193.28:0/247016844 shutdown_connections 2026-02-24T09:17:16.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.114+0000 7f6b83fff640 1 -- 10.20.193.28:0/247016844 >> 10.20.193.28:0/247016844 conn(0x7f6bb4064810 msgr2=0x7f6bb4065420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:16.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.119+0000 7f99f0ff7640 1 -- 10.20.193.28:0/4126027271 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99e0009570 con 0x7f99ec10f6c0 2026-02-24T09:17:16.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.119+0000 7f99f0ff7640 1 -- 10.20.193.28:0/4126027271 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99ec0fbb40 con 0x7f99ec10f6c0 2026-02-24T09:17:16.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.121+0000 7f6b83fff640 1 -- 10.20.193.28:0/247016844 shutdown_connections 2026-02-24T09:17:16.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.121+0000 7f6b83fff640 1 -- 10.20.193.28:0/247016844 wait complete. 2026-02-24T09:17:16.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:15 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/2468428007' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:17:16.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:15 trial074 ceph-mon[44412]: pgmap v188: 97 pgs: 97 active+clean; 633 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 7.7 KiB/s rd, 7.6 KiB/s wr, 16 op/s 2026-02-24T09:17:16.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.121+0000 7f99d17fa640 1 -- 10.20.193.28:0/4126027271 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f99b4000fd0 con 0x7f99ec10f6c0 2026-02-24T09:17:16.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.121+0000 7f99d37fe640 1 -- 10.20.193.28:0/4126027271 <== mon.1 v2:10.20.193.159:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f99e0038680 con 0x7f99ec10f6c0 2026-02-24T09:17:16.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.127+0000 7f99d37fe640 1 --2- 10.20.193.28:0/4126027271 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f99c40b57b0 0x7f99c40d5c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.127+0000 7f99d37fe640 1 -- 10.20.193.28:0/4126027271 <== mon.1 v2:10.20.193.159:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f99e010ba40 con 0x7f99ec10f6c0 2026-02-24T09:17:16.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.127+0000 7f99d37fe640 1 --2- 10.20.193.28:0/4126027271 >> [v2:10.20.193.159:6824/709820718,v1:10.20.193.159:6825/709820718] conn(0x7f99c40dd1a0 0x7f99c40fd5b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.127+0000 7f99d37fe640 1 -- 10.20.193.28:0/4126027271 --> [v2:10.20.193.159:6824/709820718,v1:10.20.193.159:6825/709820718] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f99c40fdc60 con 0x7f99c40dd1a0 2026-02-24T09:17:16.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.127+0000 7f99d37fe640 1 -- 10.20.193.28:0/4126027271 <== mon.1 v2:10.20.193.159:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f99e010bdf0 con 0x7f99ec10f6c0 2026-02-24T09:17:16.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.127+0000 7f99e9d74640 1 --2- 10.20.193.28:0/4126027271 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f99c40b57b0 0x7f99c40d5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.127+0000 7f99ead76640 1 --2- 10.20.193.28:0/4126027271 >> [v2:10.20.193.159:6824/709820718,v1:10.20.193.159:6825/709820718] conn(0x7f99c40dd1a0 0x7f99c40fd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.127+0000 7f99e9d74640 1 --2- 10.20.193.28:0/4126027271 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f99c40b57b0 0x7f99c40d5c60 secure :-1 s=READY pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99ec0fc3c0 tx=0x7f99d4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:16.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.129+0000 7f99ead76640 1 --2- 10.20.193.28:0/4126027271 >> [v2:10.20.193.159:6824/709820718,v1:10.20.193.159:6825/709820718] conn(0x7f99c40dd1a0 0x7f99c40fd5b0 crc :-1 s=READY pgs=6 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:16.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.129+0000 7f99d37fe640 1 -- 10.20.193.28:0/4126027271 <== osd.11 v2:10.20.193.159:6824/709820718 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f99c40fdc60 con 0x7f99c40dd1a0 2026-02-24T09:17:16.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.142+0000 7f99d17fa640 1 -- 10.20.193.28:0/4126027271 --> [v2:10.20.193.159:6824/709820718,v1:10.20.193.159:6825/709820718] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f99b4002d10 con 0x7f99c40dd1a0 2026-02-24T09:17:16.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.147+0000 7f99d37fe640 1 -- 10.20.193.28:0/4126027271 <== osd.11 v2:10.20.193.159:6824/709820718 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f99b4002d10 con 0x7f99c40dd1a0 2026-02-24T09:17:16.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.147+0000 7f99d17fa640 1 -- 10.20.193.28:0/4126027271 >> [v2:10.20.193.159:6824/709820718,v1:10.20.193.159:6825/709820718] conn(0x7f99c40dd1a0 msgr2=0x7f99c40fd5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.147+0000 7f99d17fa640 1 --2- 10.20.193.28:0/4126027271 >> [v2:10.20.193.159:6824/709820718,v1:10.20.193.159:6825/709820718] conn(0x7f99c40dd1a0 0x7f99c40fd5b0 crc :-1 s=READY pgs=6 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.148+0000 7f99d17fa640 1 -- 10.20.193.28:0/4126027271 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f99c40b57b0 msgr2=0x7f99c40d5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.148+0000 7f99d17fa640 1 --2- 10.20.193.28:0/4126027271 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f99c40b57b0 0x7f99c40d5c60 secure :-1 s=READY pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99ec0fc3c0 tx=0x7f99d4005f90 comp rx=0 tx=0).stop 2026-02-24T09:17:16.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.148+0000 7f99d17fa640 1 -- 10.20.193.28:0/4126027271 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f99ec10f6c0 msgr2=0x7f99ec0f5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.148+0000 7f99d17fa640 1 --2- 10.20.193.28:0/4126027271 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f99ec10f6c0 0x7f99ec0f5a20 secure :-1 s=READY pgs=88 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99e00098a0 tx=0x7f99e0002c80 comp rx=0 tx=0).stop 2026-02-24T09:17:16.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.148+0000 7f99ead76640 1 -- 10.20.193.28:0/4126027271 reap_dead start 2026-02-24T09:17:16.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.150+0000 7f99d17fa640 1 -- 10.20.193.28:0/4126027271 shutdown_connections 2026-02-24T09:17:16.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.150+0000 7f99d17fa640 1 -- 10.20.193.28:0/4126027271 >> 10.20.193.28:0/4126027271 conn(0x7f99ec0ecfd0 msgr2=0x7f99ec111bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:16.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.150+0000 7f99d17fa640 1 -- 10.20.193.28:0/4126027271 shutdown_connections 2026-02-24T09:17:16.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.151+0000 7f99d17fa640 1 -- 10.20.193.28:0/4126027271 wait complete. 2026-02-24T09:17:16.308 INFO:teuthology.orchestra.run.trial028.stdout:128849018911 2026-02-24T09:17:16.308 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-24T09:17:16.397 INFO:teuthology.orchestra.run.trial028.stdout:163208757277 2026-02-24T09:17:16.398 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-24T09:17:16.407 INFO:teuthology.orchestra.run.trial028.stdout:68719476773 2026-02-24T09:17:16.408 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-24T09:17:16.476 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:16.498 INFO:teuthology.orchestra.run.trial028.stdout:227633266711 2026-02-24T09:17:16.498 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd last-stat-seq osd.6 2026-02-24T09:17:16.581 INFO:teuthology.orchestra.run.trial028.stdout:42949673001 2026-02-24T09:17:16.581 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-24T09:17:16.583 INFO:teuthology.orchestra.run.trial028.stdout:94489280546 2026-02-24T09:17:16.583 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-24T09:17:16.584 INFO:teuthology.orchestra.run.trial028.stdout:283467841554 2026-02-24T09:17:16.585 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd last-stat-seq osd.8 2026-02-24T09:17:16.591 INFO:teuthology.orchestra.run.trial028.stdout:249108103189 2026-02-24T09:17:16.591 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-24T09:17:16.599 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:16.600 INFO:teuthology.orchestra.run.trial028.stdout:193273528346 2026-02-24T09:17:16.600 INFO:teuthology.orchestra.run.trial028.stdout:373662154762 2026-02-24T09:17:16.601 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd last-stat-seq osd.5 2026-02-24T09:17:16.602 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd last-stat-seq osd.11 2026-02-24T09:17:16.603 INFO:teuthology.orchestra.run.trial028.stdout:317827579920 2026-02-24T09:17:16.603 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd last-stat-seq osd.9 2026-02-24T09:17:16.639 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:16.699 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:16.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.733+0000 7f2d037d4640 1 -- 10.20.193.28:0/1472564635 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2cfc114880 msgr2=0x7f2cfc114c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.733+0000 7f2d037d4640 1 --2- 10.20.193.28:0/1472564635 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2cfc114880 0x7f2cfc114c50 secure :-1 s=READY pgs=292 gs=1 cs=0 l=1 c_cookie=9438234557504312036 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2cf800aa30 tx=0x7f2cf8032500 comp rx=0 tx=0).stop 2026-02-24T09:17:16.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.734+0000 7f2d037d4640 1 -- 10.20.193.28:0/1472564635 shutdown_connections 2026-02-24T09:17:16.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.734+0000 7f2d037d4640 1 --2- 10.20.193.28:0/1472564635 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2cfc116fe0 0x7f2cfc17ac20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.734+0000 7f2d037d4640 1 --2- 10.20.193.28:0/1472564635 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f2cfc115270 0x7f2cfc116860 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.734+0000 7f2d037d4640 1 --2- 10.20.193.28:0/1472564635 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2cfc114880 0x7f2cfc114c50 unknown :-1 s=CLOSED pgs=292 gs=1 cs=0 l=1 c_cookie=9438234557504312036 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.734+0000 7f2d037d4640 1 -- 10.20.193.28:0/1472564635 >> 10.20.193.28:0/1472564635 conn(0x7f2cfc057af0 msgr2=0x7f2cfc057ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:16.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.735+0000 7f2d037d4640 1 -- 10.20.193.28:0/1472564635 shutdown_connections 2026-02-24T09:17:16.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.736+0000 7f2d037d4640 1 -- 10.20.193.28:0/1472564635 wait complete. 2026-02-24T09:17:16.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.736+0000 7f2d037d4640 1 Processor -- start 2026-02-24T09:17:16.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.737+0000 7f2d037d4640 1 -- start start 2026-02-24T09:17:16.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.737+0000 7f2d037d4640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2cfc114880 0x7f2cfc1229f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.737+0000 7f2d037d4640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f2cfc115270 0x7f2cfc122f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.737+0000 7f2d037d4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2cfc116fe0 0x7f2cfc128300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.737+0000 7f2d037d4640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2cfc128920 con 0x7f2cfc116fe0 2026-02-24T09:17:16.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.737+0000 7f2d037d4640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f2cfc128a90 con 0x7f2cfc114880 2026-02-24T09:17:16.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.737+0000 7f2d037d4640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2cfc128c50 con 0x7f2cfc115270 2026-02-24T09:17:16.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.738+0000 7f2d00d48640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f2cfc115270 0x7f2cfc122f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.738+0000 7f2d01549640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2cfc114880 0x7f2cfc1229f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.738+0000 7f2d01549640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2cfc114880 0x7f2cfc1229f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:42798/0 (socket says 10.20.193.28:42798) 2026-02-24T09:17:16.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.738+0000 7f2d01549640 1 -- 10.20.193.28:0/1464022515 learned_addr learned my addr 10.20.193.28:0/1464022515 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:16.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.738+0000 7f2d01d4a640 1 --2- 10.20.193.28:0/1464022515 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2cfc116fe0 0x7f2cfc128300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.738+0000 7f2d01d4a640 1 -- 10.20.193.28:0/1464022515 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f2cfc115270 msgr2=0x7f2cfc122f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.738+0000 7f2d01d4a640 1 --2- 10.20.193.28:0/1464022515 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f2cfc115270 0x7f2cfc122f30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.738+0000 7f2d01d4a640 1 -- 10.20.193.28:0/1464022515 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2cfc114880 msgr2=0x7f2cfc1229f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.738+0000 7f2d01d4a640 1 --2- 10.20.193.28:0/1464022515 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2cfc114880 0x7f2cfc1229f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.738+0000 7f2d01d4a640 1 -- 10.20.193.28:0/1464022515 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cf800a650 con 0x7f2cfc116fe0 2026-02-24T09:17:16.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.739+0000 7f2d01d4a640 1 --2- 10.20.193.28:0/1464022515 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2cfc116fe0 0x7f2cfc128300 secure :-1 s=READY pgs=293 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2cec00e730 tx=0x7f2cec00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:16.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.739+0000 7f2cea7fc640 1 -- 10.20.193.28:0/1464022515 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2cec00cce0 con 0x7f2cfc116fe0 2026-02-24T09:17:16.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.739+0000 7f2cea7fc640 1 -- 10.20.193.28:0/1464022515 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2cec00ee60 con 0x7f2cfc116fe0 2026-02-24T09:17:16.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.739+0000 7f2cea7fc640 1 -- 10.20.193.28:0/1464022515 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2cec0052a0 con 0x7f2cfc116fe0 2026-02-24T09:17:16.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.739+0000 7f2d037d4640 1 -- 10.20.193.28:0/1464022515 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cfc128f30 con 0x7f2cfc116fe0 2026-02-24T09:17:16.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.739+0000 7f2d037d4640 1 -- 10.20.193.28:0/1464022515 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cfc16db40 con 0x7f2cfc116fe0 2026-02-24T09:17:16.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.743+0000 7f2d037d4640 1 -- 10.20.193.28:0/1464022515 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cfc05a940 con 0x7f2cfc116fe0 2026-02-24T09:17:16.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.744+0000 7f2cea7fc640 1 -- 10.20.193.28:0/1464022515 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f2cec004770 con 0x7f2cfc116fe0 2026-02-24T09:17:16.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.745+0000 7f2cea7fc640 1 --2- 10.20.193.28:0/1464022515 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f2ccc0b57c0 0x7f2ccc0d5c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.745+0000 7f2cea7fc640 1 -- 10.20.193.28:0/1464022515 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f2cec014070 con 0x7f2cfc116fe0 2026-02-24T09:17:16.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.747+0000 7f2d01549640 1 --2- 10.20.193.28:0/1464022515 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f2ccc0b57c0 0x7f2ccc0d5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.747+0000 7f2cea7fc640 1 -- 10.20.193.28:0/1464022515 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f2cec0a8b80 con 0x7f2cfc116fe0 2026-02-24T09:17:16.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.747+0000 7f2d01549640 1 --2- 10.20.193.28:0/1464022515 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f2ccc0b57c0 0x7f2ccc0d5c70 secure :-1 s=READY pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2cf80034b0 tx=0x7f2cf80393d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:16.819 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:16.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.862+0000 7f7439fa6640 1 -- 10.20.193.28:0/1198771350 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7434115270 msgr2=0x7f7434119a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.862+0000 7f7439fa6640 1 --2- 10.20.193.28:0/1198771350 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7434115270 0x7f7434119a50 secure :-1 s=READY pgs=89 gs=1 cs=0 l=1 c_cookie=14979528712347936788 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7424007490 tx=0x7f742402fe60 comp rx=0 tx=0).stop 2026-02-24T09:17:16.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.862+0000 7f7439fa6640 1 -- 10.20.193.28:0/1198771350 shutdown_connections 2026-02-24T09:17:16.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.863+0000 7f7439fa6640 1 --2- 10.20.193.28:0/1198771350 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f743411a200 0x7f743417abd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.863+0000 7f7439fa6640 1 --2- 10.20.193.28:0/1198771350 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7434115270 0x7f7434119a50 unknown :-1 s=CLOSED pgs=89 gs=1 cs=0 l=1 c_cookie=14979528712347936788 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.863+0000 7f7439fa6640 1 --2- 10.20.193.28:0/1198771350 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7434114880 0x7f7434114c50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.863+0000 7f7439fa6640 1 -- 10.20.193.28:0/1198771350 >> 10.20.193.28:0/1198771350 conn(0x7f7434057b30 msgr2=0x7f7434057f30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:16.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.864+0000 7f7439fa6640 1 -- 10.20.193.28:0/1198771350 shutdown_connections 2026-02-24T09:17:16.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.864+0000 7f7439fa6640 1 -- 10.20.193.28:0/1198771350 wait complete. 2026-02-24T09:17:16.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.865+0000 7f7439fa6640 1 Processor -- start 2026-02-24T09:17:16.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.865+0000 7f7439fa6640 1 -- start start 2026-02-24T09:17:16.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.866+0000 7f7439fa6640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7434114880 0x7f7434100910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.866+0000 7f7439fa6640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7434115270 0x7f743417aad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.866+0000 7f74337fe640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7434114880 0x7f7434100910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.866+0000 7f74337fe640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7434114880 0x7f7434100910 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:34770/0 (socket says 10.20.193.28:34770) 2026-02-24T09:17:16.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.866+0000 7f74337fe640 1 -- 10.20.193.28:0/3910235105 learned_addr learned my addr 10.20.193.28:0/3910235105 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:16.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.866+0000 7f7432ffd640 1 --2- 10.20.193.28:0/3910235105 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7434115270 0x7f743417aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.867+0000 7f7439fa6640 1 --2- 10.20.193.28:0/3910235105 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f743411a200 0x7f7434101010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.867+0000 7f7439fa6640 1 -- 10.20.193.28:0/3910235105 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f74341061d0 con 0x7f743411a200 2026-02-24T09:17:16.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.867+0000 7f7439fa6640 1 -- 10.20.193.28:0/3910235105 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f7434106340 con 0x7f7434115270 2026-02-24T09:17:16.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.867+0000 7f7439fa6640 1 -- 10.20.193.28:0/3910235105 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7434106500 con 0x7f7434114880 2026-02-24T09:17:16.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.868+0000 7f74337fe640 1 -- 10.20.193.28:0/3910235105 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7434115270 msgr2=0x7f743417aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.868+0000 7f7433fff640 1 --2- 10.20.193.28:0/3910235105 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f743411a200 0x7f7434101010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.868+0000 7f74337fe640 1 --2- 10.20.193.28:0/3910235105 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7434115270 0x7f743417aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.868+0000 7f74337fe640 1 -- 10.20.193.28:0/3910235105 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f743411a200 msgr2=0x7f7434101010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.868+0000 7f74337fe640 1 --2- 10.20.193.28:0/3910235105 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f743411a200 0x7f7434101010 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.868+0000 7f74337fe640 1 -- 10.20.193.28:0/3910235105 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74240071c0 con 0x7f7434114880 2026-02-24T09:17:16.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.868+0000 7f7433fff640 1 --2- 10.20.193.28:0/3910235105 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f743411a200 0x7f7434101010 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:16.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.869+0000 7f74337fe640 1 --2- 10.20.193.28:0/3910235105 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7434114880 0x7f7434100910 secure :-1 s=READY pgs=90 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7420009480 tx=0x7f742000ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:16.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.869+0000 7f7430ff9640 1 -- 10.20.193.28:0/3910235105 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f742000cd40 con 0x7f7434114880 2026-02-24T09:17:16.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.869+0000 7f7430ff9640 1 -- 10.20.193.28:0/3910235105 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7420004d10 con 0x7f7434114880 2026-02-24T09:17:16.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.869+0000 7f7430ff9640 1 -- 10.20.193.28:0/3910235105 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f74200106b0 con 0x7f7434114880 2026-02-24T09:17:16.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.869+0000 7f7439fa6640 1 -- 10.20.193.28:0/3910235105 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74341067e0 con 0x7f7434114880 2026-02-24T09:17:16.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.869+0000 7f7439fa6640 1 -- 10.20.193.28:0/3910235105 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7434106c60 con 0x7f7434114880 2026-02-24T09:17:16.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.870+0000 7f7439fa6640 1 -- 10.20.193.28:0/3910235105 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f743405d010 con 0x7f7434114880 2026-02-24T09:17:16.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.872+0000 7f7430ff9640 1 -- 10.20.193.28:0/3910235105 <== mon.1 v2:10.20.193.159:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f742001f060 con 0x7f7434114880 2026-02-24T09:17:16.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.874+0000 7f7430ff9640 1 --2- 10.20.193.28:0/3910235105 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f74040b58b0 0x7f74040d5d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.874+0000 7f7430ff9640 1 -- 10.20.193.28:0/3910235105 <== mon.1 v2:10.20.193.159:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f7420014070 con 0x7f7434114880 2026-02-24T09:17:16.898 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:16.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.874+0000 7f7430ff9640 1 -- 10.20.193.28:0/3910235105 <== mon.1 v2:10.20.193.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f742011f930 con 0x7f7434114880 2026-02-24T09:17:16.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.875+0000 7f7432ffd640 1 --2- 10.20.193.28:0/3910235105 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f74040b58b0 0x7f74040d5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.876+0000 7f7432ffd640 1 --2- 10.20.193.28:0/3910235105 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f74040b58b0 0x7f74040d5d60 secure :-1 s=READY pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7434107260 tx=0x7f742403b040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:16.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.901+0000 7f5b32b4b640 1 -- 10.20.193.28:0/3392109365 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5b2c114880 msgr2=0x7f5b2c114c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.901+0000 7f5b32b4b640 1 --2- 10.20.193.28:0/3392109365 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5b2c114880 0x7f5b2c114c50 secure :-1 s=READY pgs=89 gs=1 cs=0 l=1 c_cookie=16216207575629822575 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b2800aa60 tx=0x7f5b28030290 comp rx=0 tx=0).stop 2026-02-24T09:17:16.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.901+0000 7f5b32b4b640 1 -- 10.20.193.28:0/3392109365 shutdown_connections 2026-02-24T09:17:16.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.901+0000 7f5b32b4b640 1 --2- 10.20.193.28:0/3392109365 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5b2c119e80 0x7f5b2c11a760 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.901+0000 7f5b32b4b640 1 --2- 10.20.193.28:0/3392109365 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5b2c115270 0x7f5b2c1196a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.901+0000 7f5b32b4b640 1 --2- 10.20.193.28:0/3392109365 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5b2c114880 0x7f5b2c114c50 unknown :-1 s=CLOSED pgs=89 gs=1 cs=0 l=1 c_cookie=16216207575629822575 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.901+0000 7f5b32b4b640 1 -- 10.20.193.28:0/3392109365 >> 10.20.193.28:0/3392109365 conn(0x7f5b2c057af0 msgr2=0x7f5b2c057ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:16.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.901+0000 7f5b32b4b640 1 -- 10.20.193.28:0/3392109365 shutdown_connections 2026-02-24T09:17:16.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.901+0000 7f5b32b4b640 1 -- 10.20.193.28:0/3392109365 wait complete. 2026-02-24T09:17:16.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.902+0000 7f5b32b4b640 1 Processor -- start 2026-02-24T09:17:16.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.902+0000 7f5b32b4b640 1 -- start start 2026-02-24T09:17:16.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.905+0000 7f5b32b4b640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5b2c114880 0x7f5b2c113da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.905+0000 7f5b32b4b640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5b2c115270 0x7f5b2c10d000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.905+0000 7f5b32b4b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5b2c119e80 0x7f5b2c10d540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.905+0000 7f5b32b4b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2c10dc10 con 0x7f5b2c119e80 2026-02-24T09:17:16.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.905+0000 7f5b31b49640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5b2c114880 0x7f5b2c113da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.906+0000 7f5b32b4b640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2c10dd80 con 0x7f5b2c115270 2026-02-24T09:17:16.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.906+0000 7f5b32b4b640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2c112a40 con 0x7f5b2c114880 2026-02-24T09:17:16.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.906+0000 7f5b31b49640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5b2c114880 0x7f5b2c113da0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:34792/0 (socket says 10.20.193.28:34792) 2026-02-24T09:17:16.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.906+0000 7f5b31b49640 1 -- 10.20.193.28:0/751524845 learned_addr learned my addr 10.20.193.28:0/751524845 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:16.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.906+0000 7f5b31348640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5b2c115270 0x7f5b2c10d000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.906+0000 7f5b3234a640 1 --2- 10.20.193.28:0/751524845 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5b2c119e80 0x7f5b2c10d540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.906+0000 7f5b31b49640 1 -- 10.20.193.28:0/751524845 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5b2c115270 msgr2=0x7f5b2c10d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.906+0000 7f5b31b49640 1 --2- 10.20.193.28:0/751524845 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5b2c115270 0x7f5b2c10d000 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.906+0000 7f5b31b49640 1 -- 10.20.193.28:0/751524845 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5b2c119e80 msgr2=0x7f5b2c10d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.906+0000 7f5b31b49640 1 --2- 10.20.193.28:0/751524845 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5b2c119e80 0x7f5b2c10d540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.906+0000 7f5b31b49640 1 -- 10.20.193.28:0/751524845 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b200094b0 con 0x7f5b2c114880 2026-02-24T09:17:16.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.906+0000 7f5b3234a640 1 --2- 10.20.193.28:0/751524845 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5b2c119e80 0x7f5b2c10d540 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:17:16.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.907+0000 7f5b31b49640 1 --2- 10.20.193.28:0/751524845 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5b2c114880 0x7f5b2c113da0 secure :-1 s=READY pgs=91 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b28039820 tx=0x7f5b280039b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:16.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.907+0000 7f5b1effd640 1 -- 10.20.193.28:0/751524845 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5b2803e070 con 0x7f5b2c114880 2026-02-24T09:17:16.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.907+0000 7f5b32b4b640 1 -- 10.20.193.28:0/751524845 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b2800a650 con 0x7f5b2c114880 2026-02-24T09:17:16.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.907+0000 7f5b32b4b640 1 -- 10.20.193.28:0/751524845 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b2c112ff0 con 0x7f5b2c114880 2026-02-24T09:17:16.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.908+0000 7f5b1effd640 1 -- 10.20.193.28:0/751524845 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f5b28003aa0 con 0x7f5b2c114880 2026-02-24T09:17:16.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.908+0000 7f5b1effd640 1 -- 10.20.193.28:0/751524845 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5b28042aa0 con 0x7f5b2c114880 2026-02-24T09:17:16.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.908+0000 7f5b32b4b640 1 -- 10.20.193.28:0/751524845 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5af0005300 con 0x7f5b2c114880 2026-02-24T09:17:16.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.910+0000 7f5b1effd640 1 -- 10.20.193.28:0/751524845 <== mon.1 v2:10.20.193.159:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f5b280050c0 con 0x7f5b2c114880 2026-02-24T09:17:16.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.912+0000 7f5b1effd640 1 --2- 10.20.193.28:0/751524845 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5b000b5840 0x7f5b000d5cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.912+0000 7f5b1effd640 1 -- 10.20.193.28:0/751524845 <== mon.1 v2:10.20.193.159:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f5b2810c660 con 0x7f5b2c114880 2026-02-24T09:17:16.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.912+0000 7f5b31348640 1 --2- 10.20.193.28:0/751524845 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5b000b5840 0x7f5b000d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.913+0000 7f5b31348640 1 --2- 10.20.193.28:0/751524845 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5b000b5840 0x7f5b000d5cf0 secure :-1 s=READY pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b2c119400 tx=0x7f5b18009190 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:16.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.913+0000 7f5b1effd640 1 -- 10.20.193.28:0/751524845 <== mon.1 v2:10.20.193.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f5b280cf000 con 0x7f5b2c114880 2026-02-24T09:17:16.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.918+0000 7f2d037d4640 1 -- 10.20.193.28:0/1464022515 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f2cfc114c50 con 0x7f2cfc116fe0 2026-02-24T09:17:16.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.918+0000 7f2cea7fc640 1 -- 10.20.193.28:0/1464022515 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f2cec005400 con 0x7f2cfc116fe0 2026-02-24T09:17:16.922 INFO:teuthology.orchestra.run.trial028.stdout:339302416395 2026-02-24T09:17:16.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.923+0000 7f2d037d4640 1 -- 10.20.193.28:0/1464022515 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f2ccc0b57c0 msgr2=0x7f2ccc0d5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.924+0000 7f2d037d4640 1 --2- 10.20.193.28:0/1464022515 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f2ccc0b57c0 0x7f2ccc0d5c70 secure :-1 s=READY pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2cf80034b0 tx=0x7f2cf80393d0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.924+0000 7f2d037d4640 1 -- 10.20.193.28:0/1464022515 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2cfc116fe0 msgr2=0x7f2cfc128300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.924+0000 7f2d037d4640 1 --2- 10.20.193.28:0/1464022515 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2cfc116fe0 0x7f2cfc128300 secure :-1 s=READY pgs=293 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2cec00e730 tx=0x7f2cec00ec00 comp rx=0 tx=0).stop 2026-02-24T09:17:16.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.924+0000 7f2d037d4640 1 -- 10.20.193.28:0/1464022515 shutdown_connections 2026-02-24T09:17:16.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.924+0000 7f2d037d4640 1 --2- 10.20.193.28:0/1464022515 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f2ccc0b57c0 0x7f2ccc0d5c70 unknown :-1 s=CLOSED pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.924+0000 7f2d037d4640 1 --2- 10.20.193.28:0/1464022515 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2cfc116fe0 0x7f2cfc128300 unknown :-1 s=CLOSED pgs=293 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.924+0000 7f2d037d4640 1 --2- 10.20.193.28:0/1464022515 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f2cfc115270 0x7f2cfc122f30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.924+0000 7f2d037d4640 1 --2- 10.20.193.28:0/1464022515 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2cfc114880 0x7f2cfc1229f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.924+0000 7f2d037d4640 1 -- 10.20.193.28:0/1464022515 >> 10.20.193.28:0/1464022515 conn(0x7f2cfc057af0 msgr2=0x7f2cfc118000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:16.939 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:16.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.935+0000 7f2d037d4640 1 -- 10.20.193.28:0/1464022515 shutdown_connections 2026-02-24T09:17:16.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.935+0000 7f2d037d4640 1 -- 10.20.193.28:0/1464022515 wait complete. 2026-02-24T09:17:16.965 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:16.966 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:16.966 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:16.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.983+0000 7f87140ff640 1 -- 10.20.193.28:0/2280808356 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f870c115270 msgr2=0x7f870c116860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.983+0000 7f87140ff640 1 --2- 10.20.193.28:0/2280808356 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f870c115270 0x7f870c116860 secure :-1 s=READY pgs=90 gs=3 cs=0 l=1 c_cookie=2774604505215597408 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86f4009380 tx=0x7f86f40303b0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.984+0000 7f87140ff640 1 -- 10.20.193.28:0/2280808356 shutdown_connections 2026-02-24T09:17:16.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.984+0000 7f87140ff640 1 --2- 10.20.193.28:0/2280808356 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f870c116fe0 0x7f870c17ac20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.984+0000 7f87140ff640 1 --2- 10.20.193.28:0/2280808356 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f870c115270 0x7f870c116860 unknown :-1 s=CLOSED pgs=90 gs=3 cs=0 l=1 c_cookie=2774604505215597408 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.984+0000 7f87140ff640 1 --2- 10.20.193.28:0/2280808356 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f870c114880 0x7f870c114c50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.984+0000 7f87140ff640 1 -- 10.20.193.28:0/2280808356 >> 10.20.193.28:0/2280808356 conn(0x7f870c057af0 msgr2=0x7f870c057ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:16.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.984+0000 7f87140ff640 1 -- 10.20.193.28:0/2280808356 shutdown_connections 2026-02-24T09:17:16.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.984+0000 7f87140ff640 1 -- 10.20.193.28:0/2280808356 wait complete. 2026-02-24T09:17:16.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.985+0000 7f87140ff640 1 Processor -- start 2026-02-24T09:17:16.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.986+0000 7f87140ff640 1 -- start start 2026-02-24T09:17:16.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.986+0000 7f87140ff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f870c114880 0x7f870c124d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.986+0000 7f87140ff640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f870c115270 0x7f870c1252a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.986+0000 7f87140ff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f870c116fe0 0x7f870c12a670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.987+0000 7f87140ff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f870c12ac90 con 0x7f870c114880 2026-02-24T09:17:16.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.987+0000 7f87140ff640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f870c12ae00 con 0x7f870c116fe0 2026-02-24T09:17:16.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.987+0000 7f87140ff640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f870c12afc0 con 0x7f870c115270 2026-02-24T09:17:16.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.987+0000 7f8711673640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f870c115270 0x7f870c1252a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.987+0000 7f8711673640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f870c115270 0x7f870c1252a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:34810/0 (socket says 10.20.193.28:34810) 2026-02-24T09:17:16.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.987+0000 7f8711673640 1 -- 10.20.193.28:0/2982523016 learned_addr learned my addr 10.20.193.28:0/2982523016 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:16.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.987+0000 7f8712675640 1 --2- 10.20.193.28:0/2982523016 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f870c116fe0 0x7f870c12a670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.987+0000 7f8711e74640 1 --2- 10.20.193.28:0/2982523016 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f870c114880 0x7f870c124d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.987+0000 7f8712675640 1 -- 10.20.193.28:0/2982523016 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f870c115270 msgr2=0x7f870c1252a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.987+0000 7f8712675640 1 --2- 10.20.193.28:0/2982523016 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f870c115270 0x7f870c1252a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.987+0000 7f8712675640 1 -- 10.20.193.28:0/2982523016 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f870c114880 msgr2=0x7f870c124d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.988+0000 7f8712675640 1 --2- 10.20.193.28:0/2982523016 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f870c114880 0x7f870c124d60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.988+0000 7f8712675640 1 -- 10.20.193.28:0/2982523016 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86fc009570 con 0x7f870c116fe0 2026-02-24T09:17:16.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.988+0000 7f8711673640 1 --2- 10.20.193.28:0/2982523016 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f870c115270 0x7f870c1252a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:17:16.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.988+0000 7f8712675640 1 --2- 10.20.193.28:0/2982523016 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f870c116fe0 0x7f870c12a670 secure :-1 s=READY pgs=91 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f870400f940 tx=0x7f870400fe10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:16.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.988+0000 7f870affd640 1 -- 10.20.193.28:0/2982523016 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f870400dce0 con 0x7f870c116fe0 2026-02-24T09:17:16.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.988+0000 7f870affd640 1 -- 10.20.193.28:0/2982523016 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f870400de40 con 0x7f870c116fe0 2026-02-24T09:17:16.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.988+0000 7f870affd640 1 -- 10.20.193.28:0/2982523016 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f87040116b0 con 0x7f870c116fe0 2026-02-24T09:17:16.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.988+0000 7f87140ff640 1 -- 10.20.193.28:0/2982523016 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86f4009d60 con 0x7f870c116fe0 2026-02-24T09:17:16.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.989+0000 7f87140ff640 1 -- 10.20.193.28:0/2982523016 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f870c122810 con 0x7f870c116fe0 2026-02-24T09:17:16.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.990+0000 7f87140ff640 1 -- 10.20.193.28:0/2982523016 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f870c05a940 con 0x7f870c116fe0 2026-02-24T09:17:16.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:16.995+0000 7f870affd640 1 -- 10.20.193.28:0/2982523016 <== mon.2 v2:10.20.193.74:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f8704020060 con 0x7f870c116fe0 2026-02-24T09:17:17.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.000+0000 7f870affd640 1 --2- 10.20.193.28:0/2982523016 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f86e80b58c0 0x7f86e80d5d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.000+0000 7f870affd640 1 -- 10.20.193.28:0/2982523016 <== mon.2 v2:10.20.193.74:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f8704015070 con 0x7f870c116fe0 2026-02-24T09:17:17.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.000+0000 7f870affd640 1 -- 10.20.193.28:0/2982523016 <== mon.2 v2:10.20.193.74:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f87040eb2a0 con 0x7f870c116fe0 2026-02-24T09:17:17.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.000+0000 7f8711e74640 1 --2- 10.20.193.28:0/2982523016 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f86e80b58c0 0x7f86e80d5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.004+0000 7f8711e74640 1 --2- 10.20.193.28:0/2982523016 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f86e80b58c0 0x7f86e80d5d70 secure :-1 s=READY pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86fc005b30 tx=0x7f86fc009310 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:17.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.030+0000 7f7439fa6640 1 -- 10.20.193.28:0/3910235105 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f743405a940 con 0x7f7434114880 2026-02-24T09:17:17.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.030+0000 7f7430ff9640 1 -- 10.20.193.28:0/3910235105 <== mon.1 v2:10.20.193.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f74200a9680 con 0x7f7434114880 2026-02-24T09:17:17.036 INFO:teuthology.orchestra.run.trial028.stdout:128849018910 2026-02-24T09:17:17.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.038+0000 7f7439fa6640 1 -- 10.20.193.28:0/3910235105 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f74040b58b0 msgr2=0x7f74040d5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.038+0000 7f7439fa6640 1 --2- 10.20.193.28:0/3910235105 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f74040b58b0 0x7f74040d5d60 secure :-1 s=READY pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7434107260 tx=0x7f742403b040 comp rx=0 tx=0).stop 2026-02-24T09:17:17.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.038+0000 7f7439fa6640 1 -- 10.20.193.28:0/3910235105 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7434114880 msgr2=0x7f7434100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.038+0000 7f7439fa6640 1 --2- 10.20.193.28:0/3910235105 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7434114880 0x7f7434100910 secure :-1 s=READY pgs=90 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7420009480 tx=0x7f742000ee60 comp rx=0 tx=0).stop 2026-02-24T09:17:17.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.038+0000 7f7439fa6640 1 -- 10.20.193.28:0/3910235105 shutdown_connections 2026-02-24T09:17:17.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.038+0000 7f7439fa6640 1 --2- 10.20.193.28:0/3910235105 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f74040b58b0 0x7f74040d5d60 unknown :-1 s=CLOSED pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.038+0000 7f7439fa6640 1 --2- 10.20.193.28:0/3910235105 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f743411a200 0x7f7434101010 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.038+0000 7f7439fa6640 1 --2- 10.20.193.28:0/3910235105 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7434115270 0x7f743417aad0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.038+0000 7f7439fa6640 1 --2- 10.20.193.28:0/3910235105 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7434114880 0x7f7434100910 unknown :-1 s=CLOSED pgs=90 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.038+0000 7f7439fa6640 1 -- 10.20.193.28:0/3910235105 >> 10.20.193.28:0/3910235105 conn(0x7f7434057b30 msgr2=0x7f74340588c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:17.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.039+0000 7f7439fa6640 1 -- 10.20.193.28:0/3910235105 shutdown_connections 2026-02-24T09:17:17.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.039+0000 7f7439fa6640 1 -- 10.20.193.28:0/3910235105 wait complete. 2026-02-24T09:17:17.044 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:17.071 INFO:teuthology.orchestra.run.trial028.stdout:163208757276 2026-02-24T09:17:17.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.069+0000 7f5b32b4b640 1 -- 10.20.193.28:0/751524845 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f5af00055b0 con 0x7f5b2c114880 2026-02-24T09:17:17.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.069+0000 7f5b1effd640 1 -- 10.20.193.28:0/751524845 <== mon.1 v2:10.20.193.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f5b280d21b0 con 0x7f5b2c114880 2026-02-24T09:17:17.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.073+0000 7f5b32b4b640 1 -- 10.20.193.28:0/751524845 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5b000b5840 msgr2=0x7f5b000d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.073+0000 7f5b32b4b640 1 --2- 10.20.193.28:0/751524845 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5b000b5840 0x7f5b000d5cf0 secure :-1 s=READY pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b2c119400 tx=0x7f5b18009190 comp rx=0 tx=0).stop 2026-02-24T09:17:17.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.073+0000 7f5b32b4b640 1 -- 10.20.193.28:0/751524845 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5b2c114880 msgr2=0x7f5b2c113da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.073+0000 7f5b32b4b640 1 --2- 10.20.193.28:0/751524845 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5b2c114880 0x7f5b2c113da0 secure :-1 s=READY pgs=91 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b28039820 tx=0x7f5b280039b0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.074+0000 7f5b32b4b640 1 -- 10.20.193.28:0/751524845 shutdown_connections 2026-02-24T09:17:17.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.074+0000 7f5b32b4b640 1 --2- 10.20.193.28:0/751524845 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5b000b5840 0x7f5b000d5cf0 unknown :-1 s=CLOSED pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.074+0000 7f5b32b4b640 1 --2- 10.20.193.28:0/751524845 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5b2c119e80 0x7f5b2c10d540 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.074+0000 7f5b32b4b640 1 --2- 10.20.193.28:0/751524845 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5b2c115270 0x7f5b2c10d000 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.074+0000 7f5b32b4b640 1 --2- 10.20.193.28:0/751524845 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5b2c114880 0x7f5b2c113da0 unknown :-1 s=CLOSED pgs=91 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.074+0000 7f5b32b4b640 1 -- 10.20.193.28:0/751524845 >> 10.20.193.28:0/751524845 conn(0x7f5b2c057af0 msgr2=0x7f5b2c1178d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:17.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.074+0000 7f5b32b4b640 1 -- 10.20.193.28:0/751524845 shutdown_connections 2026-02-24T09:17:17.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.074+0000 7f5b32b4b640 1 -- 10.20.193.28:0/751524845 wait complete. 2026-02-24T09:17:17.095 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:17.134 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:16 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/1464022515' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-24T09:17:17.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.162+0000 7f1a054ea640 1 -- 10.20.193.28:0/2491871942 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1a0010d010 msgr2=0x7f1a0010d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.162+0000 7f1a054ea640 1 --2- 10.20.193.28:0/2491871942 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1a0010d010 0x7f1a0010d3e0 secure :-1 s=READY pgs=92 gs=1 cs=0 l=1 c_cookie=16553764403613231162 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19f4009950 tx=0x7f19f402f1b0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.162+0000 7f1a054ea640 1 -- 10.20.193.28:0/2491871942 shutdown_connections 2026-02-24T09:17:17.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.162+0000 7f1a054ea640 1 --2- 10.20.193.28:0/2491871942 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a00113200 0x7f1a00173bd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.162+0000 7f1a054ea640 1 --2- 10.20.193.28:0/2491871942 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f1a0010da00 0x7f1a00112a50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.162+0000 7f1a054ea640 1 --2- 10.20.193.28:0/2491871942 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1a0010d010 0x7f1a0010d3e0 unknown :-1 s=CLOSED pgs=92 gs=1 cs=0 l=1 c_cookie=16553764403613231162 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.162+0000 7f1a054ea640 1 -- 10.20.193.28:0/2491871942 >> 10.20.193.28:0/2491871942 conn(0x7f1a0005f830 msgr2=0x7f1a0010ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:17.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.162+0000 7f1a054ea640 1 -- 10.20.193.28:0/2491871942 shutdown_connections 2026-02-24T09:17:17.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.162+0000 7f1a054ea640 1 -- 10.20.193.28:0/2491871942 wait complete. 2026-02-24T09:17:17.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.163+0000 7f1a054ea640 1 Processor -- start 2026-02-24T09:17:17.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.163+0000 7f1a054ea640 1 -- start start 2026-02-24T09:17:17.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.163+0000 7f1a054ea640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1a0010d010 0x7f1a000623c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.163+0000 7f1a054ea640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a0010da00 0x7f1a00173ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.163+0000 7f1a054ea640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f1a00113200 0x7f1a00062aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.163+0000 7f1a054ea640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1a00060fa0 con 0x7f1a0010da00 2026-02-24T09:17:17.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.163+0000 7f1a054ea640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f1a00061110 con 0x7f1a00113200 2026-02-24T09:17:17.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.164+0000 7f1a054ea640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1a000612d0 con 0x7f1a0010d010 2026-02-24T09:17:17.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.164+0000 7f19feffd640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1a0010d010 0x7f1a000623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.164+0000 7f19feffd640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1a0010d010 0x7f1a000623c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:34814/0 (socket says 10.20.193.28:34814) 2026-02-24T09:17:17.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.164+0000 7f19feffd640 1 -- 10.20.193.28:0/2870878949 learned_addr learned my addr 10.20.193.28:0/2870878949 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:17.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.164+0000 7f19ff7fe640 1 --2- 10.20.193.28:0/2870878949 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f1a00113200 0x7f1a00062aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.164+0000 7f19fe7fc640 1 --2- 10.20.193.28:0/2870878949 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a0010da00 0x7f1a00173ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.164+0000 7f19feffd640 1 -- 10.20.193.28:0/2870878949 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f1a00113200 msgr2=0x7f1a00062aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.164+0000 7f19feffd640 1 --2- 10.20.193.28:0/2870878949 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f1a00113200 0x7f1a00062aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.164+0000 7f19feffd640 1 -- 10.20.193.28:0/2870878949 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a0010da00 msgr2=0x7f1a00173ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.164+0000 7f19feffd640 1 --2- 10.20.193.28:0/2870878949 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a0010da00 0x7f1a00173ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.164+0000 7f19feffd640 1 -- 10.20.193.28:0/2870878949 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f000a590 con 0x7f1a0010d010 2026-02-24T09:17:17.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.164+0000 7f19fe7fc640 1 --2- 10.20.193.28:0/2870878949 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a0010da00 0x7f1a00173ad0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:17:17.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.165+0000 7f19feffd640 1 --2- 10.20.193.28:0/2870878949 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1a0010d010 0x7f1a000623c0 secure :-1 s=READY pgs=93 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19f402f6c0 tx=0x7f19f40384e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:17.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.165+0000 7f19dffff640 1 -- 10.20.193.28:0/2870878949 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19f403d070 con 0x7f1a0010d010 2026-02-24T09:17:17.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.165+0000 7f1a054ea640 1 -- 10.20.193.28:0/2870878949 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19f4009570 con 0x7f1a0010d010 2026-02-24T09:17:17.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.165+0000 7f1a054ea640 1 -- 10.20.193.28:0/2870878949 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a00061880 con 0x7f1a0010d010 2026-02-24T09:17:17.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.165+0000 7f19dffff640 1 -- 10.20.193.28:0/2870878949 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f19f4041410 con 0x7f1a0010d010 2026-02-24T09:17:17.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.165+0000 7f19dffff640 1 -- 10.20.193.28:0/2870878949 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19f4040630 con 0x7f1a0010d010 2026-02-24T09:17:17.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.166+0000 7f1a054ea640 1 -- 10.20.193.28:0/2870878949 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a0010e2f0 con 0x7f1a0010d010 2026-02-24T09:17:17.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.167+0000 7f19dffff640 1 -- 10.20.193.28:0/2870878949 <== mon.1 v2:10.20.193.159:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f19f4041960 con 0x7f1a0010d010 2026-02-24T09:17:17.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.169+0000 7f19dffff640 1 --2- 10.20.193.28:0/2870878949 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f19d40b5840 0x7f19d40d5cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.169+0000 7f19dffff640 1 -- 10.20.193.28:0/2870878949 <== mon.1 v2:10.20.193.159:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f19f410b0e0 con 0x7f1a0010d010 2026-02-24T09:17:17.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.169+0000 7f19dffff640 1 -- 10.20.193.28:0/2870878949 <== mon.1 v2:10.20.193.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f19f410b560 con 0x7f1a0010d010 2026-02-24T09:17:17.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.170+0000 7f19fe7fc640 1 --2- 10.20.193.28:0/2870878949 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f19d40b5840 0x7f19d40d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.170+0000 7f19fe7fc640 1 --2- 10.20.193.28:0/2870878949 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f19d40b5840 0x7f19d40d5cf0 secure :-1 s=READY pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a0010b1c0 tx=0x7f19e8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:17.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.171+0000 7f87140ff640 1 -- 10.20.193.28:0/2982523016 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f870c125ec0 con 0x7f870c116fe0 2026-02-24T09:17:17.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.172+0000 7f870affd640 1 -- 10.20.193.28:0/2982523016 <== mon.2 v2:10.20.193.74:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f87040aa670 con 0x7f870c116fe0 2026-02-24T09:17:17.174 INFO:teuthology.orchestra.run.trial028.stdout:68719476772 2026-02-24T09:17:17.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.175+0000 7f87140ff640 1 -- 10.20.193.28:0/2982523016 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f86e80b58c0 msgr2=0x7f86e80d5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.175+0000 7f87140ff640 1 --2- 10.20.193.28:0/2982523016 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f86e80b58c0 0x7f86e80d5d70 secure :-1 s=READY pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86fc005b30 tx=0x7f86fc009310 comp rx=0 tx=0).stop 2026-02-24T09:17:17.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.175+0000 7f87140ff640 1 -- 10.20.193.28:0/2982523016 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f870c116fe0 msgr2=0x7f870c12a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.175+0000 7f87140ff640 1 --2- 10.20.193.28:0/2982523016 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f870c116fe0 0x7f870c12a670 secure :-1 s=READY pgs=91 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f870400f940 tx=0x7f870400fe10 comp rx=0 tx=0).stop 2026-02-24T09:17:17.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.175+0000 7f87140ff640 1 -- 10.20.193.28:0/2982523016 shutdown_connections 2026-02-24T09:17:17.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.175+0000 7f87140ff640 1 --2- 10.20.193.28:0/2982523016 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f86e80b58c0 0x7f86e80d5d70 unknown :-1 s=CLOSED pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.175+0000 7f87140ff640 1 --2- 10.20.193.28:0/2982523016 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f870c116fe0 0x7f870c12a670 unknown :-1 s=CLOSED pgs=91 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.175+0000 7f87140ff640 1 --2- 10.20.193.28:0/2982523016 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f870c115270 0x7f870c1252a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.175+0000 7f87140ff640 1 --2- 10.20.193.28:0/2982523016 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f870c114880 0x7f870c124d60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.175+0000 7f87140ff640 1 -- 10.20.193.28:0/2982523016 >> 10.20.193.28:0/2982523016 conn(0x7f870c057af0 msgr2=0x7f870c118000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:17.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.175+0000 7f87140ff640 1 -- 10.20.193.28:0/2982523016 shutdown_connections 2026-02-24T09:17:17.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.175+0000 7f87140ff640 1 -- 10.20.193.28:0/2982523016 wait complete. 2026-02-24T09:17:17.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.215+0000 7f505deac640 1 -- 10.20.193.28:0/3653827026 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f505810f6c0 msgr2=0x7f505810fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.215+0000 7f505deac640 1 --2- 10.20.193.28:0/3653827026 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f505810f6c0 0x7f505810fa90 secure :-1 s=READY pgs=294 gs=1 cs=0 l=1 c_cookie=9768807159958993987 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5048009950 tx=0x7f504802f190 comp rx=0 tx=0).stop 2026-02-24T09:17:17.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.215+0000 7f505deac640 1 -- 10.20.193.28:0/3653827026 shutdown_connections 2026-02-24T09:17:17.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.215+0000 7f505deac640 1 --2- 10.20.193.28:0/3653827026 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f50581158b0 0x7f5058176280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.215+0000 7f505deac640 1 --2- 10.20.193.28:0/3653827026 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f50581100b0 0x7f5058115100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.215+0000 7f505deac640 1 --2- 10.20.193.28:0/3653827026 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f505810f6c0 0x7f505810fa90 unknown :-1 s=CLOSED pgs=294 gs=1 cs=0 l=1 c_cookie=9768807159958993987 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.215+0000 7f505deac640 1 -- 10.20.193.28:0/3653827026 >> 10.20.193.28:0/3653827026 conn(0x7f50580ecfd0 msgr2=0x7f505810d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:17.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.216+0000 7f505deac640 1 -- 10.20.193.28:0/3653827026 shutdown_connections 2026-02-24T09:17:17.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.216+0000 7f505deac640 1 -- 10.20.193.28:0/3653827026 wait complete. 2026-02-24T09:17:17.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.218+0000 7f505deac640 1 Processor -- start 2026-02-24T09:17:17.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.218+0000 7f505deac640 1 -- start start 2026-02-24T09:17:17.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.218+0000 7f505deac640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f505810f6c0 0x7f505811e070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.218+0000 7f505deac640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f50581100b0 0x7f505811e5b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.218+0000 7f505deac640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f50581158b0 0x7f5058123980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.218+0000 7f505deac640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5058123fa0 con 0x7f505810f6c0 2026-02-24T09:17:17.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.218+0000 7f505deac640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f5058124110 con 0x7f50581100b0 2026-02-24T09:17:17.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.218+0000 7f505deac640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f50581242d0 con 0x7f50581158b0 2026-02-24T09:17:17.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.219+0000 7f5057fff640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f50581158b0 0x7f5058123980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.219+0000 7f50577fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f505810f6c0 0x7f505811e070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.219+0000 7f5057fff640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f50581158b0 0x7f5058123980 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:34846/0 (socket says 10.20.193.28:34846) 2026-02-24T09:17:17.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.219+0000 7f5057fff640 1 -- 10.20.193.28:0/340131746 learned_addr learned my addr 10.20.193.28:0/340131746 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:17.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.219+0000 7f5056ffd640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f50581100b0 0x7f505811e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.219+0000 7f5057fff640 1 -- 10.20.193.28:0/340131746 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f50581100b0 msgr2=0x7f505811e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.219+0000 7f5057fff640 1 --2- 10.20.193.28:0/340131746 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f50581100b0 0x7f505811e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.219+0000 7f5057fff640 1 -- 10.20.193.28:0/340131746 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f505810f6c0 msgr2=0x7f505811e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.219+0000 7f5057fff640 1 --2- 10.20.193.28:0/340131746 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f505810f6c0 0x7f505811e070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.219+0000 7f5057fff640 1 -- 10.20.193.28:0/340131746 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5048009570 con 0x7f50581158b0 2026-02-24T09:17:17.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.219+0000 7f5057fff640 1 --2- 10.20.193.28:0/340131746 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f50581158b0 0x7f5058123980 secure :-1 s=READY pgs=94 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f504c00f8d0 tx=0x7f504c00fda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:17.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.219+0000 7f5054ff9640 1 -- 10.20.193.28:0/340131746 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f504c00dce0 con 0x7f50581158b0 2026-02-24T09:17:17.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.219+0000 7f5054ff9640 1 -- 10.20.193.28:0/340131746 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f504c00de40 con 0x7f50581158b0 2026-02-24T09:17:17.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.219+0000 7f5054ff9640 1 -- 10.20.193.28:0/340131746 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f504c0116b0 con 0x7f50581158b0 2026-02-24T09:17:17.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.220+0000 7f505deac640 1 -- 10.20.193.28:0/340131746 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50581245b0 con 0x7f50581158b0 2026-02-24T09:17:17.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.220+0000 7f505deac640 1 -- 10.20.193.28:0/340131746 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5058164cb0 con 0x7f50581158b0 2026-02-24T09:17:17.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.225+0000 7f50327fc640 1 -- 10.20.193.28:0/340131746 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50581247d0 con 0x7f50581158b0 2026-02-24T09:17:17.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.227+0000 7f5054ff9640 1 -- 10.20.193.28:0/340131746 <== mon.1 v2:10.20.193.159:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f504c020060 con 0x7f50581158b0 2026-02-24T09:17:17.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.229+0000 7f5054ff9640 1 --2- 10.20.193.28:0/340131746 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f502c0b5840 0x7f502c0d5cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.229+0000 7f5054ff9640 1 -- 10.20.193.28:0/340131746 <== mon.1 v2:10.20.193.159:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f504c015070 con 0x7f50581158b0 2026-02-24T09:17:17.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.229+0000 7f5054ff9640 1 -- 10.20.193.28:0/340131746 <== mon.1 v2:10.20.193.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f504c0e81d0 con 0x7f50581158b0 2026-02-24T09:17:17.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.229+0000 7f50577fe640 1 --2- 10.20.193.28:0/340131746 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f502c0b5840 0x7f502c0d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.234+0000 7f50577fe640 1 --2- 10.20.193.28:0/340131746 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f502c0b5840 0x7f502c0d5cf0 secure :-1 s=READY pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50480023d0 tx=0x7f5048031040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:17.273 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018911 got 128849018910 for osd.3 2026-02-24T09:17:17.279 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:16 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/1464022515' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-24T09:17:17.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.300+0000 7f1a054ea640 1 -- 10.20.193.28:0/2870878949 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f1a00176de0 con 0x7f1a0010d010 2026-02-24T09:17:17.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.302+0000 7f19dffff640 1 -- 10.20.193.28:0/2870878949 <== mon.1 v2:10.20.193.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f19f40cda80 con 0x7f1a0010d010 2026-02-24T09:17:17.304 INFO:teuthology.orchestra.run.trial028.stdout:227633266710 2026-02-24T09:17:17.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.305+0000 7f1a054ea640 1 -- 10.20.193.28:0/2870878949 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f19d40b5840 msgr2=0x7f19d40d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.305+0000 7f1a054ea640 1 --2- 10.20.193.28:0/2870878949 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f19d40b5840 0x7f19d40d5cf0 secure :-1 s=READY pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a0010b1c0 tx=0x7f19e8005f90 comp rx=0 tx=0).stop 2026-02-24T09:17:17.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.305+0000 7f1a054ea640 1 -- 10.20.193.28:0/2870878949 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1a0010d010 msgr2=0x7f1a000623c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.305+0000 7f1a054ea640 1 --2- 10.20.193.28:0/2870878949 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1a0010d010 0x7f1a000623c0 secure :-1 s=READY pgs=93 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19f402f6c0 tx=0x7f19f40384e0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.305+0000 7f1a054ea640 1 -- 10.20.193.28:0/2870878949 shutdown_connections 2026-02-24T09:17:17.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.305+0000 7f1a054ea640 1 --2- 10.20.193.28:0/2870878949 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f19d40b5840 0x7f19d40d5cf0 unknown :-1 s=CLOSED pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.305+0000 7f1a054ea640 1 --2- 10.20.193.28:0/2870878949 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f1a00113200 0x7f1a00062aa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.305+0000 7f1a054ea640 1 --2- 10.20.193.28:0/2870878949 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a0010da00 0x7f1a00173ad0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.305+0000 7f1a054ea640 1 --2- 10.20.193.28:0/2870878949 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1a0010d010 0x7f1a000623c0 unknown :-1 s=CLOSED pgs=93 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.305+0000 7f1a054ea640 1 -- 10.20.193.28:0/2870878949 >> 10.20.193.28:0/2870878949 conn(0x7f1a0005f830 msgr2=0x7f1a0010f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:17.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.306+0000 7f1a054ea640 1 -- 10.20.193.28:0/2870878949 shutdown_connections 2026-02-24T09:17:17.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.306+0000 7f1a054ea640 1 -- 10.20.193.28:0/2870878949 wait complete. 2026-02-24T09:17:17.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.313+0000 7fb703fff640 1 -- 10.20.193.28:0/2212323811 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb70411b9a0 msgr2=0x7fb70411a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.313+0000 7fb703fff640 1 --2- 10.20.193.28:0/2212323811 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb70411b9a0 0x7fb70411a6d0 secure :-1 s=READY pgs=95 gs=2 cs=0 l=1 c_cookie=3570346351887937477 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6f4009950 tx=0x7fb6f402f190 comp rx=0 tx=0).stop 2026-02-24T09:17:17.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.313+0000 7fb703fff640 1 -- 10.20.193.28:0/2212323811 shutdown_connections 2026-02-24T09:17:17.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.313+0000 7fb703fff640 1 --2- 10.20.193.28:0/2212323811 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb704118690 0x7fb704118af0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.313+0000 7fb703fff640 1 --2- 10.20.193.28:0/2212323811 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb70411ac10 0x7fb70411b040 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.313+0000 7fb703fff640 1 --2- 10.20.193.28:0/2212323811 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb70411b9a0 0x7fb70411a6d0 unknown :-1 s=CLOSED pgs=95 gs=2 cs=0 l=1 c_cookie=3570346351887937477 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.313+0000 7fb703fff640 1 -- 10.20.193.28:0/2212323811 >> 10.20.193.28:0/2212323811 conn(0x7fb704057b30 msgr2=0x7fb704057f30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:17.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.313+0000 7fb703fff640 1 -- 10.20.193.28:0/2212323811 shutdown_connections 2026-02-24T09:17:17.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.313+0000 7fb703fff640 1 -- 10.20.193.28:0/2212323811 wait complete. 2026-02-24T09:17:17.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.315+0000 7fb703fff640 1 Processor -- start 2026-02-24T09:17:17.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.316+0000 7fb703fff640 1 -- start start 2026-02-24T09:17:17.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.316+0000 7fb703fff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb704118690 0x7fb7040ffea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.316+0000 7fb703fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb70411ac10 0x7fb7041003e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.316+0000 7fb703fff640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb70411b9a0 0x7fb7041057b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.316+0000 7fb703fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb704105dd0 con 0x7fb70411ac10 2026-02-24T09:17:17.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.316+0000 7fb703fff640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fb704105f40 con 0x7fb704118690 2026-02-24T09:17:17.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.316+0000 7fb703fff640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb704106100 con 0x7fb70411b9a0 2026-02-24T09:17:17.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.316+0000 7fb702ffd640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb704118690 0x7fb7040ffea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.317+0000 7fb702ffd640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb704118690 0x7fb7040ffea0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:43854/0 (socket says 10.20.193.28:43854) 2026-02-24T09:17:17.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.317+0000 7fb702ffd640 1 -- 10.20.193.28:0/3696166271 learned_addr learned my addr 10.20.193.28:0/3696166271 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:17.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.317+0000 7fb702ffd640 1 -- 10.20.193.28:0/3696166271 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb70411b9a0 msgr2=0x7fb7041057b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.317+0000 7fb702ffd640 1 --2- 10.20.193.28:0/3696166271 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb70411b9a0 0x7fb7041057b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.317+0000 7fb702ffd640 1 -- 10.20.193.28:0/3696166271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb70411ac10 msgr2=0x7fb7041003e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.318+0000 7fb7027fc640 1 --2- 10.20.193.28:0/3696166271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb70411ac10 0x7fb7041003e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.318+0000 7fb702ffd640 1 --2- 10.20.193.28:0/3696166271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb70411ac10 0x7fb7041003e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.318+0000 7fb702ffd640 1 -- 10.20.193.28:0/3696166271 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6f4009570 con 0x7fb704118690 2026-02-24T09:17:17.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.318+0000 7fb7027fc640 1 --2- 10.20.193.28:0/3696166271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb70411ac10 0x7fb7041003e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:17.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.318+0000 7fb702ffd640 1 --2- 10.20.193.28:0/3696166271 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb704118690 0x7fb7040ffea0 secure :-1 s=READY pgs=92 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6f402fc20 tx=0x7fb6f402fc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:17.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.318+0000 7fb708825640 1 -- 10.20.193.28:0/3696166271 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6f403d070 con 0x7fb704118690 2026-02-24T09:17:17.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.318+0000 7fb703fff640 1 -- 10.20.193.28:0/3696166271 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb704106380 con 0x7fb704118690 2026-02-24T09:17:17.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.318+0000 7fb708825640 1 -- 10.20.193.28:0/3696166271 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb6f4002c10 con 0x7fb704118690 2026-02-24T09:17:17.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.318+0000 7fb703fff640 1 -- 10.20.193.28:0/3696166271 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb704117ed0 con 0x7fb704118690 2026-02-24T09:17:17.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.319+0000 7fb708825640 1 -- 10.20.193.28:0/3696166271 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6f403d070 con 0x7fb704118690 2026-02-24T09:17:17.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.319+0000 7fb703fff640 1 -- 10.20.193.28:0/3696166271 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6c8005300 con 0x7fb704118690 2026-02-24T09:17:17.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.321+0000 7fb708825640 1 -- 10.20.193.28:0/3696166271 <== mon.2 v2:10.20.193.74:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7fb6f4041a00 con 0x7fb704118690 2026-02-24T09:17:17.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.324+0000 7fb708825640 1 --2- 10.20.193.28:0/3696166271 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb6d80b5810 0x7fb6d80d5cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.324+0000 7fb708825640 1 -- 10.20.193.28:0/3696166271 <== mon.2 v2:10.20.193.74:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7fb6f410af10 con 0x7fb704118690 2026-02-24T09:17:17.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.324+0000 7fb708825640 1 -- 10.20.193.28:0/3696166271 <== mon.2 v2:10.20.193.74:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fb6f410b400 con 0x7fb704118690 2026-02-24T09:17:17.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.324+0000 7fb7027fc640 1 --2- 10.20.193.28:0/3696166271 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb6d80b5810 0x7fb6d80d5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.325+0000 7fb7027fc640 1 --2- 10.20.193.28:0/3696166271 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb6d80b5810 0x7fb6d80d5cc0 secure :-1 s=READY pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb704106840 tx=0x7fb6f8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:17.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.332+0000 7fd83bcc0640 1 -- 10.20.193.28:0/2911838964 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd8341100b0 msgr2=0x7fd834115100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.332+0000 7fd83bcc0640 1 --2- 10.20.193.28:0/2911838964 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd8341100b0 0x7fd834115100 secure :-1 s=READY pgs=295 gs=1 cs=0 l=1 c_cookie=1664215483506406177 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd8240099a0 tx=0x7fd82402f1e0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.332+0000 7fd83bcc0640 1 -- 10.20.193.28:0/2911838964 shutdown_connections 2026-02-24T09:17:17.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.332+0000 7fd83bcc0640 1 --2- 10.20.193.28:0/2911838964 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fd8341158b0 0x7fd834176280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.332+0000 7fd83bcc0640 1 --2- 10.20.193.28:0/2911838964 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd8341100b0 0x7fd834115100 unknown :-1 s=CLOSED pgs=295 gs=1 cs=0 l=1 c_cookie=1664215483506406177 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.332+0000 7fd83bcc0640 1 --2- 10.20.193.28:0/2911838964 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fd83410f6c0 0x7fd83410fa90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.332+0000 7fd83bcc0640 1 -- 10.20.193.28:0/2911838964 >> 10.20.193.28:0/2911838964 conn(0x7fd8340ecfd0 msgr2=0x7fd83410d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:17.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.337+0000 7fd83bcc0640 1 -- 10.20.193.28:0/2911838964 shutdown_connections 2026-02-24T09:17:17.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.337+0000 7fd83bcc0640 1 -- 10.20.193.28:0/2911838964 wait complete. 2026-02-24T09:17:17.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.339+0000 7fd83bcc0640 1 Processor -- start 2026-02-24T09:17:17.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.339+0000 7fd83bcc0640 1 -- start start 2026-02-24T09:17:17.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.339+0000 7fd83bcc0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd83410f6c0 0x7fd8340f5a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.339+0000 7fd83bcc0640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fd8341100b0 0x7fd834176180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.339+0000 7fd83bcc0640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fd8341158b0 0x7fd8340f6190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.339+0000 7fd83bcc0640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd8340fb3a0 con 0x7fd83410f6c0 2026-02-24T09:17:17.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.339+0000 7fd83bcc0640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fd8340fb510 con 0x7fd8341100b0 2026-02-24T09:17:17.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.339+0000 7fd83bcc0640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd8340fb6d0 con 0x7fd8341158b0 2026-02-24T09:17:17.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.340+0000 7fd839a35640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd83410f6c0 0x7fd8340f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.340+0000 7fd839a35640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd83410f6c0 0x7fd8340f5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40060/0 (socket says 10.20.193.28:40060) 2026-02-24T09:17:17.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.340+0000 7fd839a35640 1 -- 10.20.193.28:0/1182942384 learned_addr learned my addr 10.20.193.28:0/1182942384 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:17.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.340+0000 7fd839a35640 1 -- 10.20.193.28:0/1182942384 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fd8341158b0 msgr2=0x7fd8340f6190 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:17:17.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.340+0000 7fd839a35640 1 --2- 10.20.193.28:0/1182942384 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fd8341158b0 0x7fd8340f6190 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.340+0000 7fd839a35640 1 -- 10.20.193.28:0/1182942384 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fd8341100b0 msgr2=0x7fd834176180 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:17:17.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.340+0000 7fd839a35640 1 --2- 10.20.193.28:0/1182942384 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fd8341100b0 0x7fd834176180 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.340+0000 7fd839a35640 1 -- 10.20.193.28:0/1182942384 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd824009570 con 0x7fd83410f6c0 2026-02-24T09:17:17.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.341+0000 7fd839a35640 1 --2- 10.20.193.28:0/1182942384 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd83410f6c0 0x7fd8340f5a90 secure :-1 s=READY pgs=297 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd82800d950 tx=0x7fd82800de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:17.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.341+0000 7fd822ffd640 1 -- 10.20.193.28:0/1182942384 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd828004540 con 0x7fd83410f6c0 2026-02-24T09:17:17.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.341+0000 7fd822ffd640 1 -- 10.20.193.28:0/1182942384 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd828009ce0 con 0x7fd83410f6c0 2026-02-24T09:17:17.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.341+0000 7fd822ffd640 1 -- 10.20.193.28:0/1182942384 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd8280106e0 con 0x7fd83410f6c0 2026-02-24T09:17:17.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.341+0000 7fd83bcc0640 1 -- 10.20.193.28:0/1182942384 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8340fb9b0 con 0x7fd83410f6c0 2026-02-24T09:17:17.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.341+0000 7fd83bcc0640 1 -- 10.20.193.28:0/1182942384 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8340fbe30 con 0x7fd83410f6c0 2026-02-24T09:17:17.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.341+0000 7f9496e6c640 1 -- 10.20.193.28:0/46203140 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f949010f670 msgr2=0x7f949010fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.341+0000 7f9496e6c640 1 --2- 10.20.193.28:0/46203140 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f949010f670 0x7f949010fa40 secure :-1 s=READY pgs=296 gs=2 cs=0 l=1 c_cookie=1647164662771097614 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94780099a0 tx=0x7f947802f220 comp rx=0 tx=0).stop 2026-02-24T09:17:17.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.342+0000 7f9496e6c640 1 -- 10.20.193.28:0/46203140 shutdown_connections 2026-02-24T09:17:17.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.342+0000 7f9496e6c640 1 --2- 10.20.193.28:0/46203140 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f9490115860 0x7f9490176230 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.342+0000 7f9496e6c640 1 --2- 10.20.193.28:0/46203140 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f9490110060 0x7f94901150b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.342+0000 7f9496e6c640 1 --2- 10.20.193.28:0/46203140 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f949010f670 0x7f949010fa40 unknown :-1 s=CLOSED pgs=296 gs=2 cs=0 l=1 c_cookie=1647164662771097614 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.342+0000 7f9496e6c640 1 -- 10.20.193.28:0/46203140 >> 10.20.193.28:0/46203140 conn(0x7f94900ecf40 msgr2=0x7f949010d350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:17.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.342+0000 7fd820ff9640 1 -- 10.20.193.28:0/1182942384 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8341109a0 con 0x7fd83410f6c0 2026-02-24T09:17:17.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.345+0000 7fd822ffd640 1 -- 10.20.193.28:0/1182942384 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7fd8280097c0 con 0x7fd83410f6c0 2026-02-24T09:17:17.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.347+0000 7fd822ffd640 1 --2- 10.20.193.28:0/1182942384 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fd8100b5830 0x7fd8100d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.347+0000 7fd822ffd640 1 -- 10.20.193.28:0/1182942384 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7fd8280e7050 con 0x7fd83410f6c0 2026-02-24T09:17:17.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.347+0000 7fd839234640 1 --2- 10.20.193.28:0/1182942384 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fd8100b5830 0x7fd8100d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.347+0000 7fd822ffd640 1 -- 10.20.193.28:0/1182942384 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fd8280e74d0 con 0x7fd83410f6c0 2026-02-24T09:17:17.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.348+0000 7f9496e6c640 1 -- 10.20.193.28:0/46203140 shutdown_connections 2026-02-24T09:17:17.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.348+0000 7f9496e6c640 1 -- 10.20.193.28:0/46203140 wait complete. 2026-02-24T09:17:17.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.349+0000 7fd839234640 1 --2- 10.20.193.28:0/1182942384 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fd8100b5830 0x7fd8100d5ce0 secure :-1 s=READY pgs=176 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd8240098f0 tx=0x7fd824002390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:17.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.353+0000 7f9496e6c640 1 Processor -- start 2026-02-24T09:17:17.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.353+0000 7f9496e6c640 1 -- start start 2026-02-24T09:17:17.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.354+0000 7f9496e6c640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f949010f670 0x7f949005a1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.354+0000 7f9496e6c640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f9490110060 0x7f9490176130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.354+0000 7f9496e6c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9490115860 0x7f949005a8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.355+0000 7f9496e6c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f94900ff730 con 0x7f9490115860 2026-02-24T09:17:17.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.355+0000 7f9496e6c640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f94900ff8a0 con 0x7f9490110060 2026-02-24T09:17:17.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.355+0000 7f9496e6c640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f94900ffa60 con 0x7f949010f670 2026-02-24T09:17:17.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.355+0000 7f9487fff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f9490110060 0x7f9490176130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.355+0000 7f94953e2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9490115860 0x7f949005a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.355+0000 7f9487fff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f9490110060 0x7f9490176130 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:43890/0 (socket says 10.20.193.28:43890) 2026-02-24T09:17:17.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.355+0000 7f9487fff640 1 -- 10.20.193.28:0/3668107407 learned_addr learned my addr 10.20.193.28:0/3668107407 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:17.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.356+0000 7f94953e2640 1 -- 10.20.193.28:0/3668107407 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f949010f670 msgr2=0x7f949005a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.356+0000 7f94953e2640 1 --2- 10.20.193.28:0/3668107407 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f949010f670 0x7f949005a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.356+0000 7f94953e2640 1 -- 10.20.193.28:0/3668107407 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f9490110060 msgr2=0x7f9490176130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.356+0000 7f94953e2640 1 --2- 10.20.193.28:0/3668107407 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f9490110060 0x7f9490176130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.356+0000 7f94953e2640 1 -- 10.20.193.28:0/3668107407 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9478009570 con 0x7f9490115860 2026-02-24T09:17:17.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.356+0000 7f94953e2640 1 --2- 10.20.193.28:0/3668107407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9490115860 0x7f949005a8c0 secure :-1 s=READY pgs=298 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f948c00c470 tx=0x7f948c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:17.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.357+0000 7f9485ffb640 1 -- 10.20.193.28:0/3668107407 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f948c0054a0 con 0x7f9490115860 2026-02-24T09:17:17.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.357+0000 7f9485ffb640 1 -- 10.20.193.28:0/3668107407 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f948c005600 con 0x7f9490115860 2026-02-24T09:17:17.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.357+0000 7f9496e6c640 1 -- 10.20.193.28:0/3668107407 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94900ffd40 con 0x7f9490115860 2026-02-24T09:17:17.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.357+0000 7f9485ffb640 1 -- 10.20.193.28:0/3668107407 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f948c011cf0 con 0x7f9490115860 2026-02-24T09:17:17.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.357+0000 7f9496e6c640 1 -- 10.20.193.28:0/3668107407 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94901001c0 con 0x7f9490115860 2026-02-24T09:17:17.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.358+0000 7f945f7fe640 1 -- 10.20.193.28:0/3668107407 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9458005300 con 0x7f9490115860 2026-02-24T09:17:17.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.359+0000 7f50327fc640 1 -- 10.20.193.28:0/340131746 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f505810fa90 con 0x7f50581158b0 2026-02-24T09:17:17.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.360+0000 7f5054ff9640 1 -- 10.20.193.28:0/340131746 <== mon.1 v2:10.20.193.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f504c0aa7a0 con 0x7f50581158b0 2026-02-24T09:17:17.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.360+0000 7f9485ffb640 1 -- 10.20.193.28:0/3668107407 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f948c003820 con 0x7f9490115860 2026-02-24T09:17:17.361 INFO:teuthology.orchestra.run.trial028.stdout:94489280545 2026-02-24T09:17:17.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.361+0000 7f9485ffb640 1 --2- 10.20.193.28:0/3668107407 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f946c0b58b0 0x7f946c0d5d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.362+0000 7f9485ffb640 1 -- 10.20.193.28:0/3668107407 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f948c0e7200 con 0x7f9490115860 2026-02-24T09:17:17.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.362+0000 7f9494be1640 1 --2- 10.20.193.28:0/3668107407 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f946c0b58b0 0x7f946c0d5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.363+0000 7f50327fc640 1 -- 10.20.193.28:0/340131746 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f502c0b5840 msgr2=0x7f502c0d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.363+0000 7f50327fc640 1 --2- 10.20.193.28:0/340131746 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f502c0b5840 0x7f502c0d5cf0 secure :-1 s=READY pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50480023d0 tx=0x7f5048031040 comp rx=0 tx=0).stop 2026-02-24T09:17:17.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.363+0000 7f9494be1640 1 --2- 10.20.193.28:0/3668107407 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f946c0b58b0 0x7f946c0d5d60 secure :-1 s=READY pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94780098f0 tx=0x7f9478005d90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:17.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.363+0000 7f50327fc640 1 -- 10.20.193.28:0/340131746 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f50581158b0 msgr2=0x7f5058123980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.363+0000 7f50327fc640 1 --2- 10.20.193.28:0/340131746 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f50581158b0 0x7f5058123980 secure :-1 s=READY pgs=94 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f504c00f8d0 tx=0x7f504c00fda0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.365+0000 7f9485ffb640 1 -- 10.20.193.28:0/3668107407 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f948c0a9ba0 con 0x7f9490115860 2026-02-24T09:17:17.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:16 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/1464022515' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-24T09:17:17.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.403+0000 7f50327fc640 1 -- 10.20.193.28:0/340131746 shutdown_connections 2026-02-24T09:17:17.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.403+0000 7f50327fc640 1 --2- 10.20.193.28:0/340131746 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f502c0b5840 0x7f502c0d5cf0 unknown :-1 s=CLOSED pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.403+0000 7f50327fc640 1 --2- 10.20.193.28:0/340131746 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f50581158b0 0x7f5058123980 unknown :-1 s=CLOSED pgs=94 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.403+0000 7f50327fc640 1 --2- 10.20.193.28:0/340131746 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f50581100b0 0x7f505811e5b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.403+0000 7f50327fc640 1 --2- 10.20.193.28:0/340131746 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f505810f6c0 0x7f505811e070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.403+0000 7f50327fc640 1 -- 10.20.193.28:0/340131746 >> 10.20.193.28:0/340131746 conn(0x7f50580ecfd0 msgr2=0x7f505810d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:17.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.403+0000 7f50327fc640 1 -- 10.20.193.28:0/340131746 shutdown_connections 2026-02-24T09:17:17.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.403+0000 7f50327fc640 1 -- 10.20.193.28:0/340131746 wait complete. 2026-02-24T09:17:17.407 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757277 got 163208757276 for osd.4 2026-02-24T09:17:17.419 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476773 got 68719476772 for osd.1 2026-02-24T09:17:17.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.451+0000 7fb703fff640 1 -- 10.20.193.28:0/3696166271 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fb6c8005880 con 0x7fb704118690 2026-02-24T09:17:17.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.451+0000 7fb708825640 1 -- 10.20.193.28:0/3696166271 <== mon.2 v2:10.20.193.74:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fb6f40cd8f0 con 0x7fb704118690 2026-02-24T09:17:17.457 INFO:teuthology.orchestra.run.trial028.stdout:373662154761 2026-02-24T09:17:17.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.457+0000 7fb703fff640 1 -- 10.20.193.28:0/3696166271 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb6d80b5810 msgr2=0x7fb6d80d5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.457+0000 7fb703fff640 1 --2- 10.20.193.28:0/3696166271 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb6d80b5810 0x7fb6d80d5cc0 secure :-1 s=READY pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb704106840 tx=0x7fb6f8005f90 comp rx=0 tx=0).stop 2026-02-24T09:17:17.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.457+0000 7fb703fff640 1 -- 10.20.193.28:0/3696166271 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb704118690 msgr2=0x7fb7040ffea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.457+0000 7fb703fff640 1 --2- 10.20.193.28:0/3696166271 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb704118690 0x7fb7040ffea0 secure :-1 s=READY pgs=92 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6f402fc20 tx=0x7fb6f402fc50 comp rx=0 tx=0).stop 2026-02-24T09:17:17.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.457+0000 7fb703fff640 1 -- 10.20.193.28:0/3696166271 shutdown_connections 2026-02-24T09:17:17.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.457+0000 7fb703fff640 1 --2- 10.20.193.28:0/3696166271 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb6d80b5810 0x7fb6d80d5cc0 unknown :-1 s=CLOSED pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.457+0000 7fb703fff640 1 --2- 10.20.193.28:0/3696166271 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb70411b9a0 0x7fb7041057b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.457+0000 7fb703fff640 1 --2- 10.20.193.28:0/3696166271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb70411ac10 0x7fb7041003e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.457+0000 7fb703fff640 1 --2- 10.20.193.28:0/3696166271 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb704118690 0x7fb7040ffea0 unknown :-1 s=CLOSED pgs=92 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.458+0000 7fb703fff640 1 -- 10.20.193.28:0/3696166271 >> 10.20.193.28:0/3696166271 conn(0x7fb704057b30 msgr2=0x7fb7040f5f20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:17.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.458+0000 7fb703fff640 1 -- 10.20.193.28:0/3696166271 shutdown_connections 2026-02-24T09:17:17.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.458+0000 7fb703fff640 1 -- 10.20.193.28:0/3696166271 wait complete. 2026-02-24T09:17:17.469 INFO:tasks.cephadm.ceph_manager.ceph:need seq 339302416396 got 339302416395 for osd.10 2026-02-24T09:17:17.477 INFO:tasks.cephadm.ceph_manager.ceph:need seq 227633266711 got 227633266710 for osd.6 2026-02-24T09:17:17.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.481+0000 7fd820ff9640 1 -- 10.20.193.28:0/1182942384 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fd8340f6c50 con 0x7fd83410f6c0 2026-02-24T09:17:17.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.482+0000 7fd822ffd640 1 -- 10.20.193.28:0/1182942384 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd8280a98e0 con 0x7fd83410f6c0 2026-02-24T09:17:17.484 INFO:teuthology.orchestra.run.trial028.stdout:283467841553 2026-02-24T09:17:17.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.484+0000 7fd820ff9640 1 -- 10.20.193.28:0/1182942384 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fd8100b5830 msgr2=0x7fd8100d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.484+0000 7fd820ff9640 1 --2- 10.20.193.28:0/1182942384 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fd8100b5830 0x7fd8100d5ce0 secure :-1 s=READY pgs=176 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd8240098f0 tx=0x7fd824002390 comp rx=0 tx=0).stop 2026-02-24T09:17:17.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.484+0000 7fd820ff9640 1 -- 10.20.193.28:0/1182942384 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd83410f6c0 msgr2=0x7fd8340f5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.484+0000 7fd820ff9640 1 --2- 10.20.193.28:0/1182942384 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd83410f6c0 0x7fd8340f5a90 secure :-1 s=READY pgs=297 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd82800d950 tx=0x7fd82800de20 comp rx=0 tx=0).stop 2026-02-24T09:17:17.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.485+0000 7fd820ff9640 1 -- 10.20.193.28:0/1182942384 shutdown_connections 2026-02-24T09:17:17.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.485+0000 7fd820ff9640 1 --2- 10.20.193.28:0/1182942384 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fd8100b5830 0x7fd8100d5ce0 unknown :-1 s=CLOSED pgs=176 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.485+0000 7fd820ff9640 1 --2- 10.20.193.28:0/1182942384 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fd8341158b0 0x7fd8340f6190 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.485+0000 7fd820ff9640 1 --2- 10.20.193.28:0/1182942384 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fd8341100b0 0x7fd834176180 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.485+0000 7fd820ff9640 1 --2- 10.20.193.28:0/1182942384 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd83410f6c0 0x7fd8340f5a90 unknown :-1 s=CLOSED pgs=297 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.485+0000 7fd820ff9640 1 -- 10.20.193.28:0/1182942384 >> 10.20.193.28:0/1182942384 conn(0x7fd8340ecfd0 msgr2=0x7fd834111ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:17.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.485+0000 7fd820ff9640 1 -- 10.20.193.28:0/1182942384 shutdown_connections 2026-02-24T09:17:17.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.485+0000 7fd820ff9640 1 -- 10.20.193.28:0/1182942384 wait complete. 2026-02-24T09:17:17.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.519+0000 7f945f7fe640 1 -- 10.20.193.28:0/3668107407 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f94580055b0 con 0x7f9490115860 2026-02-24T09:17:17.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.520+0000 7f9485ffb640 1 -- 10.20.193.28:0/3668107407 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f948c0acd50 con 0x7f9490115860 2026-02-24T09:17:17.522 INFO:teuthology.orchestra.run.trial028.stdout:249108103187 2026-02-24T09:17:17.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.524+0000 7f945f7fe640 1 -- 10.20.193.28:0/3668107407 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f946c0b58b0 msgr2=0x7f946c0d5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.524+0000 7f945f7fe640 1 --2- 10.20.193.28:0/3668107407 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f946c0b58b0 0x7f946c0d5d60 secure :-1 s=READY pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94780098f0 tx=0x7f9478005d90 comp rx=0 tx=0).stop 2026-02-24T09:17:17.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.524+0000 7f945f7fe640 1 -- 10.20.193.28:0/3668107407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9490115860 msgr2=0x7f949005a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.524+0000 7f945f7fe640 1 --2- 10.20.193.28:0/3668107407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9490115860 0x7f949005a8c0 secure :-1 s=READY pgs=298 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f948c00c470 tx=0x7f948c00c940 comp rx=0 tx=0).stop 2026-02-24T09:17:17.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.525+0000 7f945f7fe640 1 -- 10.20.193.28:0/3668107407 shutdown_connections 2026-02-24T09:17:17.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.525+0000 7f945f7fe640 1 --2- 10.20.193.28:0/3668107407 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f946c0b58b0 0x7f946c0d5d60 unknown :-1 s=CLOSED pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.525+0000 7f945f7fe640 1 --2- 10.20.193.28:0/3668107407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9490115860 0x7f949005a8c0 unknown :-1 s=CLOSED pgs=298 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.525+0000 7f945f7fe640 1 --2- 10.20.193.28:0/3668107407 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f9490110060 0x7f9490176130 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.525+0000 7f945f7fe640 1 --2- 10.20.193.28:0/3668107407 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f949010f670 0x7f949005a1c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.525+0000 7f945f7fe640 1 -- 10.20.193.28:0/3668107407 >> 10.20.193.28:0/3668107407 conn(0x7f94900ecf40 msgr2=0x7f9490113100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:17.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.525+0000 7f945f7fe640 1 -- 10.20.193.28:0/3668107407 shutdown_connections 2026-02-24T09:17:17.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.525+0000 7f945f7fe640 1 -- 10.20.193.28:0/3668107407 wait complete. 2026-02-24T09:17:17.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.533+0000 7f109e26a640 1 -- 10.20.193.28:0/2991761883 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1098119d10 msgr2=0x7f109817a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.533+0000 7f109e26a640 1 --2- 10.20.193.28:0/2991761883 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1098119d10 0x7f109817a6e0 secure :-1 s=READY pgs=299 gs=3 cs=0 l=1 c_cookie=11538427615778785510 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f108c00a970 tx=0x7f108c0301f0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.533+0000 7f109e26a640 1 -- 10.20.193.28:0/2991761883 shutdown_connections 2026-02-24T09:17:17.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.533+0000 7f109e26a640 1 --2- 10.20.193.28:0/2991761883 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1098119d10 0x7f109817a6e0 unknown :-1 s=CLOSED pgs=299 gs=3 cs=0 l=1 c_cookie=11538427615778785510 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.533+0000 7f109e26a640 1 --2- 10.20.193.28:0/2991761883 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1098114a10 0x7f1098119560 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.533+0000 7f109e26a640 1 --2- 10.20.193.28:0/2991761883 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f1098114020 0x7f10981143f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.533+0000 7f109e26a640 1 -- 10.20.193.28:0/2991761883 >> 10.20.193.28:0/2991761883 conn(0x7f1098064c40 msgr2=0x7f1098065040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:17.535 INFO:tasks.cephadm.ceph_manager.ceph:need seq 94489280546 got 94489280545 for osd.2 2026-02-24T09:17:17.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.534+0000 7f109e26a640 1 -- 10.20.193.28:0/2991761883 shutdown_connections 2026-02-24T09:17:17.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.534+0000 7f109e26a640 1 -- 10.20.193.28:0/2991761883 wait complete. 2026-02-24T09:17:17.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.535+0000 7f109e26a640 1 Processor -- start 2026-02-24T09:17:17.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.535+0000 7f109e26a640 1 -- start start 2026-02-24T09:17:17.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.535+0000 7f109e26a640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1098114020 0x7f1098105390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.535+0000 7f109e26a640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f1098114a10 0x7f109817a5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.535+0000 7f109e26a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1098119d10 0x7f1098105930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.535+0000 7f109e26a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f10981060c0 con 0x7f1098119d10 2026-02-24T09:17:17.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.535+0000 7f109e26a640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f109810a270 con 0x7f1098114a10 2026-02-24T09:17:17.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.535+0000 7f109e26a640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f109810a430 con 0x7f1098114020 2026-02-24T09:17:17.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.536+0000 7f1096ffd640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f1098114a10 0x7f109817a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.536+0000 7f1096ffd640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f1098114a10 0x7f109817a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:43908/0 (socket says 10.20.193.28:43908) 2026-02-24T09:17:17.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.536+0000 7f1096ffd640 1 -- 10.20.193.28:0/2198644570 learned_addr learned my addr 10.20.193.28:0/2198644570 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:17.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.536+0000 7f10977fe640 1 --2- 10.20.193.28:0/2198644570 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1098114020 0x7f1098105390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.536+0000 7f1097fff640 1 --2- 10.20.193.28:0/2198644570 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1098119d10 0x7f1098105930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.536+0000 7f1096ffd640 1 -- 10.20.193.28:0/2198644570 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1098114020 msgr2=0x7f1098105390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.538+0000 7f1096ffd640 1 --2- 10.20.193.28:0/2198644570 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1098114020 0x7f1098105390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.538+0000 7f1096ffd640 1 -- 10.20.193.28:0/2198644570 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1098119d10 msgr2=0x7f1098105930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.538+0000 7f1096ffd640 1 --2- 10.20.193.28:0/2198644570 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1098119d10 0x7f1098105930 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.538+0000 7f1096ffd640 1 -- 10.20.193.28:0/2198644570 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1084009570 con 0x7f1098114a10 2026-02-24T09:17:17.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.538+0000 7f1097fff640 1 --2- 10.20.193.28:0/2198644570 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1098119d10 0x7f1098105930 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:17:17.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.538+0000 7f10977fe640 1 --2- 10.20.193.28:0/2198644570 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1098114020 0x7f1098105390 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:17.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.539+0000 7f1096ffd640 1 --2- 10.20.193.28:0/2198644570 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f1098114a10 0x7f109817a5e0 secure :-1 s=READY pgs=93 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10880072a0 tx=0x7f108800ddf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:17.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.539+0000 7f1094ff9640 1 -- 10.20.193.28:0/2198644570 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1088004500 con 0x7f1098114a10 2026-02-24T09:17:17.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.539+0000 7f109e26a640 1 -- 10.20.193.28:0/2198644570 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f108c00a590 con 0x7f1098114a10 2026-02-24T09:17:17.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.539+0000 7f109e26a640 1 -- 10.20.193.28:0/2198644570 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f109810aa50 con 0x7f1098114a10 2026-02-24T09:17:17.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.539+0000 7f1094ff9640 1 -- 10.20.193.28:0/2198644570 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f108800bd00 con 0x7f1098114a10 2026-02-24T09:17:17.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.539+0000 7f1094ff9640 1 -- 10.20.193.28:0/2198644570 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f10880106e0 con 0x7f1098114a10 2026-02-24T09:17:17.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.540+0000 7f1072ffd640 1 -- 10.20.193.28:0/2198644570 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1098114e00 con 0x7f1098114a10 2026-02-24T09:17:17.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.546+0000 7f1094ff9640 1 -- 10.20.193.28:0/2198644570 <== mon.2 v2:10.20.193.74:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f108800b840 con 0x7f1098114a10 2026-02-24T09:17:17.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.546+0000 7f1094ff9640 1 --2- 10.20.193.28:0/2198644570 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f106c0b5910 0x7f106c0d5dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.546+0000 7f1094ff9640 1 -- 10.20.193.28:0/2198644570 <== mon.2 v2:10.20.193.74:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f10880e6bb0 con 0x7f1098114a10 2026-02-24T09:17:17.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.546+0000 7f10977fe640 1 --2- 10.20.193.28:0/2198644570 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f106c0b5910 0x7f106c0d5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.546+0000 7f1094ff9640 1 -- 10.20.193.28:0/2198644570 <== mon.2 v2:10.20.193.74:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f108811f930 con 0x7f1098114a10 2026-02-24T09:17:17.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.546+0000 7f10977fe640 1 --2- 10.20.193.28:0/2198644570 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f106c0b5910 0x7f106c0d5dc0 secure :-1 s=READY pgs=178 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1084005b30 tx=0x7f1084009310 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:17.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.581+0000 7fcdea542640 1 -- 10.20.193.28:0/3753407880 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcde410b570 msgr2=0x7fcde410b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.581+0000 7fcdea542640 1 --2- 10.20.193.28:0/3753407880 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcde410b570 0x7fcde410b940 secure :-1 s=READY pgs=300 gs=3 cs=0 l=1 c_cookie=12967165012375821869 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdd4007520 tx=0x7fcdd402fd90 comp rx=0 tx=0).stop 2026-02-24T09:17:17.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.582+0000 7fcdea542640 1 -- 10.20.193.28:0/3753407880 shutdown_connections 2026-02-24T09:17:17.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.582+0000 7fcdea542640 1 --2- 10.20.193.28:0/3753407880 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fcde4111760 0x7fcde4172130 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.582+0000 7fcdea542640 1 --2- 10.20.193.28:0/3753407880 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fcde410bf60 0x7fcde4110fb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.582+0000 7fcdea542640 1 --2- 10.20.193.28:0/3753407880 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcde410b570 0x7fcde410b940 unknown :-1 s=CLOSED pgs=300 gs=3 cs=0 l=1 c_cookie=12967165012375821869 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.582+0000 7fcdea542640 1 -- 10.20.193.28:0/3753407880 >> 10.20.193.28:0/3753407880 conn(0x7fcde40e8e40 msgr2=0x7fcde4109250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:17.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.582+0000 7fcdea542640 1 -- 10.20.193.28:0/3753407880 shutdown_connections 2026-02-24T09:17:17.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.582+0000 7fcdea542640 1 -- 10.20.193.28:0/3753407880 wait complete. 2026-02-24T09:17:17.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.583+0000 7fcdea542640 1 Processor -- start 2026-02-24T09:17:17.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.583+0000 7fcdea542640 1 -- start start 2026-02-24T09:17:17.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.583+0000 7fcdea542640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fcde410b570 0x7fcde4119530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.584+0000 7fcdea542640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fcde410bf60 0x7fcde4119a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.584+0000 7fcdea542640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcde4111760 0x7fcde411ee40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.584+0000 7fcdea542640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcde411f460 con 0x7fcde4111760 2026-02-24T09:17:17.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.584+0000 7fcdea542640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fcde411f5d0 con 0x7fcde410bf60 2026-02-24T09:17:17.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.584+0000 7fcdea542640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fcde411f790 con 0x7fcde410b570 2026-02-24T09:17:17.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.584+0000 7fcde9540640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fcde410b570 0x7fcde4119530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.584+0000 7fcde9540640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fcde410b570 0x7fcde4119530 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:34924/0 (socket says 10.20.193.28:34924) 2026-02-24T09:17:17.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.584+0000 7fcde9540640 1 -- 10.20.193.28:0/397538032 learned_addr learned my addr 10.20.193.28:0/397538032 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:17.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.584+0000 7fcde9d41640 1 --2- 10.20.193.28:0/397538032 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcde4111760 0x7fcde411ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.584+0000 7fcde9540640 1 -- 10.20.193.28:0/397538032 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fcde410bf60 msgr2=0x7fcde4119a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.584+0000 7fcde8d3f640 1 --2- 10.20.193.28:0/397538032 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fcde410bf60 0x7fcde4119a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.585+0000 7fcde9540640 1 --2- 10.20.193.28:0/397538032 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fcde410bf60 0x7fcde4119a70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.585+0000 7fcde9540640 1 -- 10.20.193.28:0/397538032 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcde4111760 msgr2=0x7fcde411ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.585+0000 7fcde9540640 1 --2- 10.20.193.28:0/397538032 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcde4111760 0x7fcde411ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.585+0000 7fcde9540640 1 -- 10.20.193.28:0/397538032 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd40071c0 con 0x7fcde410b570 2026-02-24T09:17:17.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.585+0000 7fcde9d41640 1 --2- 10.20.193.28:0/397538032 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcde4111760 0x7fcde411ee40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:17:17.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.585+0000 7fcde8d3f640 1 --2- 10.20.193.28:0/397538032 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fcde410bf60 0x7fcde4119a70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:17.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.586+0000 7fcde9540640 1 --2- 10.20.193.28:0/397538032 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fcde410b570 0x7fcde4119530 secure :-1 s=READY pgs=96 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdd4002390 tx=0x7fcdd4030910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:17.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.586+0000 7fcdd27fc640 1 -- 10.20.193.28:0/397538032 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcdd4004260 con 0x7fcde410b570 2026-02-24T09:17:17.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.586+0000 7fcdd27fc640 1 -- 10.20.193.28:0/397538032 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fcdd4002cd0 con 0x7fcde410b570 2026-02-24T09:17:17.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.586+0000 7fcdd27fc640 1 -- 10.20.193.28:0/397538032 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcdd400a830 con 0x7fcde410b570 2026-02-24T09:17:17.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.586+0000 7fcdea542640 1 -- 10.20.193.28:0/397538032 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcde411fa10 con 0x7fcde410b570 2026-02-24T09:17:17.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.586+0000 7fcdea542640 1 -- 10.20.193.28:0/397538032 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcde41761f0 con 0x7fcde410b570 2026-02-24T09:17:17.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.587+0000 7fcdea542640 1 -- 10.20.193.28:0/397538032 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcde410c850 con 0x7fcde410b570 2026-02-24T09:17:17.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f789c788640 1 -- 10.20.193.28:0/70311921 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f789411ac80 msgr2=0x7f789411b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f789c788640 1 --2- 10.20.193.28:0/70311921 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f789411ac80 0x7f789411b0b0 secure :-1 s=READY pgs=94 gs=1 cs=0 l=1 c_cookie=14761795492550330116 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7888009950 tx=0x7f788802f1b0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f789c788640 1 -- 10.20.193.28:0/70311921 shutdown_connections 2026-02-24T09:17:17.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f789c788640 1 --2- 10.20.193.28:0/70311921 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78941187a0 0x7f7894118c20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f789c788640 1 --2- 10.20.193.28:0/70311921 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f789411ac80 0x7f789411b0b0 unknown :-1 s=CLOSED pgs=94 gs=1 cs=0 l=1 c_cookie=14761795492550330116 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f789c788640 1 --2- 10.20.193.28:0/70311921 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f789411baa0 0x7f789411a740 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f789c788640 1 -- 10.20.193.28:0/70311921 >> 10.20.193.28:0/70311921 conn(0x7f7894057f50 msgr2=0x7f7894058350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:17.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f789c788640 1 -- 10.20.193.28:0/70311921 shutdown_connections 2026-02-24T09:17:17.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f789c788640 1 -- 10.20.193.28:0/70311921 wait complete. 2026-02-24T09:17:17.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f789c788640 1 Processor -- start 2026-02-24T09:17:17.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f789c788640 1 -- start start 2026-02-24T09:17:17.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f789c788640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78941187a0 0x7f78940fffa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f789c788640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f789411ac80 0x7f78941004e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f789c788640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f789411baa0 0x7f78941058b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f789c788640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7894105e40 con 0x7f78941187a0 2026-02-24T09:17:17.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f789c788640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f7894105fb0 con 0x7f789411ac80 2026-02-24T09:17:17.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f789c788640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7894106170 con 0x7f789411baa0 2026-02-24T09:17:17.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f789a4fd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78941187a0 0x7f78940fffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f789a4fd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78941187a0 0x7f78940fffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40122/0 (socket says 10.20.193.28:40122) 2026-02-24T09:17:17.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f789a4fd640 1 -- 10.20.193.28:0/4125120301 learned_addr learned my addr 10.20.193.28:0/4125120301 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:17.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f789acfe640 1 --2- 10.20.193.28:0/4125120301 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f789411baa0 0x7f78941058b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f789a4fd640 1 -- 10.20.193.28:0/4125120301 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f789411baa0 msgr2=0x7f78941058b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f7899cfc640 1 --2- 10.20.193.28:0/4125120301 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f789411ac80 0x7f78941004e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f789a4fd640 1 --2- 10.20.193.28:0/4125120301 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f789411baa0 0x7f78941058b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f789a4fd640 1 -- 10.20.193.28:0/4125120301 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f789411ac80 msgr2=0x7f78941004e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f789a4fd640 1 --2- 10.20.193.28:0/4125120301 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f789411ac80 0x7f78941004e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f789a4fd640 1 -- 10.20.193.28:0/4125120301 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7888009570 con 0x7f78941187a0 2026-02-24T09:17:17.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f7899cfc640 1 --2- 10.20.193.28:0/4125120301 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f789411ac80 0x7f78941004e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:17.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f789acfe640 1 --2- 10.20.193.28:0/4125120301 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f789411baa0 0x7f78941058b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:17.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7fcdd27fc640 1 -- 10.20.193.28:0/397538032 <== mon.1 v2:10.20.193.159:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7fcdd4002810 con 0x7fcde410b570 2026-02-24T09:17:17.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f789a4fd640 1 --2- 10.20.193.28:0/4125120301 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78941187a0 0x7f78940fffa0 secure :-1 s=READY pgs=301 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7884009fd0 tx=0x7f788400bbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:17.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f78837fe640 1 -- 10.20.193.28:0/4125120301 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7884004290 con 0x7f78941187a0 2026-02-24T09:17:17.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f78837fe640 1 -- 10.20.193.28:0/4125120301 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f78840043f0 con 0x7f78941187a0 2026-02-24T09:17:17.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f78837fe640 1 -- 10.20.193.28:0/4125120301 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f788400ccd0 con 0x7f78941187a0 2026-02-24T09:17:17.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f789c788640 1 -- 10.20.193.28:0/4125120301 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7894106450 con 0x7f78941187a0 2026-02-24T09:17:17.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7f789c788640 1 -- 10.20.193.28:0/4125120301 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7894106730 con 0x7f78941187a0 2026-02-24T09:17:17.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7fcdd27fc640 1 --2- 10.20.193.28:0/397538032 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fcdb40b5840 0x7fcdb40d5cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7fcdd27fc640 1 -- 10.20.193.28:0/397538032 <== mon.1 v2:10.20.193.159:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7fcdd4002e40 con 0x7fcde410b570 2026-02-24T09:17:17.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.589+0000 7fcde8d3f640 1 --2- 10.20.193.28:0/397538032 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fcdb40b5840 0x7fcdb40d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.595+0000 7fcdd27fc640 1 -- 10.20.193.28:0/397538032 <== mon.1 v2:10.20.193.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fcdd410b480 con 0x7fcde410b570 2026-02-24T09:17:17.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.595+0000 7fcde8d3f640 1 --2- 10.20.193.28:0/397538032 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fcdb40b5840 0x7fcdb40d5cf0 secure :-1 s=READY pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdd8005b30 tx=0x7fcdd8009310 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:17.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.598+0000 7f78817fa640 1 -- 10.20.193.28:0/4125120301 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f789405a3b0 con 0x7f78941187a0 2026-02-24T09:17:17.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.598+0000 7f78837fe640 1 -- 10.20.193.28:0/4125120301 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f7884002740 con 0x7f78941187a0 2026-02-24T09:17:17.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.598+0000 7f78837fe640 1 --2- 10.20.193.28:0/4125120301 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f78700b5910 0x7f78700d5dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.598+0000 7f78837fe640 1 -- 10.20.193.28:0/4125120301 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f78840e5f20 con 0x7f78941187a0 2026-02-24T09:17:17.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.598+0000 7f7899cfc640 1 --2- 10.20.193.28:0/4125120301 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f78700b5910 0x7f78700d5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.598+0000 7f7899cfc640 1 --2- 10.20.193.28:0/4125120301 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f78700b5910 0x7f78700d5dc0 secure :-1 s=READY pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78880098a0 tx=0x7f7888031040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:17.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.598+0000 7f78837fe640 1 -- 10.20.193.28:0/4125120301 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f78840a88c0 con 0x7f78941187a0 2026-02-24T09:17:17.662 INFO:tasks.cephadm.ceph_manager.ceph:need seq 373662154762 got 373662154761 for osd.11 2026-02-24T09:17:17.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.677+0000 7f1072ffd640 1 -- 10.20.193.28:0/2198644570 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f109810a5f0 con 0x7f1098114a10 2026-02-24T09:17:17.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.677+0000 7f1094ff9640 1 -- 10.20.193.28:0/2198644570 <== mon.2 v2:10.20.193.74:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f10880a9480 con 0x7f1098114a10 2026-02-24T09:17:17.681 INFO:teuthology.orchestra.run.trial028.stdout:42949672999 2026-02-24T09:17:17.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.681+0000 7f1072ffd640 1 -- 10.20.193.28:0/2198644570 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f106c0b5910 msgr2=0x7f106c0d5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.681+0000 7f1072ffd640 1 --2- 10.20.193.28:0/2198644570 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f106c0b5910 0x7f106c0d5dc0 secure :-1 s=READY pgs=178 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1084005b30 tx=0x7f1084009310 comp rx=0 tx=0).stop 2026-02-24T09:17:17.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.681+0000 7f1072ffd640 1 -- 10.20.193.28:0/2198644570 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f1098114a10 msgr2=0x7f109817a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.681+0000 7f1072ffd640 1 --2- 10.20.193.28:0/2198644570 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f1098114a10 0x7f109817a5e0 secure :-1 s=READY pgs=93 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10880072a0 tx=0x7f108800ddf0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.681+0000 7f1072ffd640 1 -- 10.20.193.28:0/2198644570 shutdown_connections 2026-02-24T09:17:17.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.681+0000 7f1072ffd640 1 --2- 10.20.193.28:0/2198644570 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f106c0b5910 0x7f106c0d5dc0 unknown :-1 s=CLOSED pgs=178 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.681+0000 7f1072ffd640 1 --2- 10.20.193.28:0/2198644570 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1098119d10 0x7f1098105930 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.681+0000 7f1072ffd640 1 --2- 10.20.193.28:0/2198644570 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f1098114a10 0x7f109817a5e0 unknown :-1 s=CLOSED pgs=93 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.681+0000 7f1072ffd640 1 --2- 10.20.193.28:0/2198644570 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f1098114020 0x7f1098105390 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.681+0000 7f1072ffd640 1 -- 10.20.193.28:0/2198644570 >> 10.20.193.28:0/2198644570 conn(0x7f1098064c40 msgr2=0x7f10981178b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:17.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.681+0000 7f1072ffd640 1 -- 10.20.193.28:0/2198644570 shutdown_connections 2026-02-24T09:17:17.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.682+0000 7f1072ffd640 1 -- 10.20.193.28:0/2198644570 wait complete. 2026-02-24T09:17:17.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.721+0000 7f78817fa640 1 -- 10.20.193.28:0/4125120301 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f7894101100 con 0x7f78941187a0 2026-02-24T09:17:17.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.722+0000 7f78837fe640 1 -- 10.20.193.28:0/4125120301 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f78840aba70 con 0x7f78941187a0 2026-02-24T09:17:17.724 INFO:teuthology.orchestra.run.trial028.stdout:317827579919 2026-02-24T09:17:17.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.725+0000 7fcdea542640 1 -- 10.20.193.28:0/397538032 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fcde411a690 con 0x7fcde410b570 2026-02-24T09:17:17.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.725+0000 7fcdd27fc640 1 -- 10.20.193.28:0/397538032 <== mon.1 v2:10.20.193.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fcdd40cdb60 con 0x7fcde410b570 2026-02-24T09:17:17.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.725+0000 7f78817fa640 1 -- 10.20.193.28:0/4125120301 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f78700b5910 msgr2=0x7f78700d5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.725+0000 7f78817fa640 1 --2- 10.20.193.28:0/4125120301 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f78700b5910 0x7f78700d5dc0 secure :-1 s=READY pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78880098a0 tx=0x7f7888031040 comp rx=0 tx=0).stop 2026-02-24T09:17:17.726 INFO:teuthology.orchestra.run.trial028.stdout:193273528345 2026-02-24T09:17:17.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.725+0000 7f78817fa640 1 -- 10.20.193.28:0/4125120301 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78941187a0 msgr2=0x7f78940fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.725+0000 7f78817fa640 1 --2- 10.20.193.28:0/4125120301 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78941187a0 0x7f78940fffa0 secure :-1 s=READY pgs=301 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7884009fd0 tx=0x7f788400bbf0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.725+0000 7f78817fa640 1 -- 10.20.193.28:0/4125120301 shutdown_connections 2026-02-24T09:17:17.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.725+0000 7f78817fa640 1 --2- 10.20.193.28:0/4125120301 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f78700b5910 0x7f78700d5dc0 unknown :-1 s=CLOSED pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.725+0000 7f78817fa640 1 --2- 10.20.193.28:0/4125120301 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f789411baa0 0x7f78941058b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.725+0000 7f78817fa640 1 --2- 10.20.193.28:0/4125120301 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f789411ac80 0x7f78941004e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.725+0000 7f78817fa640 1 --2- 10.20.193.28:0/4125120301 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78941187a0 0x7f78940fffa0 unknown :-1 s=CLOSED pgs=301 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.725+0000 7f78817fa640 1 -- 10.20.193.28:0/4125120301 >> 10.20.193.28:0/4125120301 conn(0x7f7894057f50 msgr2=0x7f78940f5f20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:17.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.725+0000 7f78817fa640 1 -- 10.20.193.28:0/4125120301 shutdown_connections 2026-02-24T09:17:17.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.725+0000 7f78817fa640 1 -- 10.20.193.28:0/4125120301 wait complete. 2026-02-24T09:17:17.728 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103189 got 249108103187 for osd.7 2026-02-24T09:17:17.729 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841554 got 283467841553 for osd.8 2026-02-24T09:17:17.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.728+0000 7fcdea542640 1 -- 10.20.193.28:0/397538032 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fcdb40b5840 msgr2=0x7fcdb40d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.728+0000 7fcdea542640 1 --2- 10.20.193.28:0/397538032 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fcdb40b5840 0x7fcdb40d5cf0 secure :-1 s=READY pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdd8005b30 tx=0x7fcdd8009310 comp rx=0 tx=0).stop 2026-02-24T09:17:17.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.728+0000 7fcdea542640 1 -- 10.20.193.28:0/397538032 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fcde410b570 msgr2=0x7fcde4119530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.728+0000 7fcdea542640 1 --2- 10.20.193.28:0/397538032 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fcde410b570 0x7fcde4119530 secure :-1 s=READY pgs=96 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdd4002390 tx=0x7fcdd4030910 comp rx=0 tx=0).stop 2026-02-24T09:17:17.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.728+0000 7fcdea542640 1 -- 10.20.193.28:0/397538032 shutdown_connections 2026-02-24T09:17:17.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.728+0000 7fcdea542640 1 --2- 10.20.193.28:0/397538032 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fcdb40b5840 0x7fcdb40d5cf0 unknown :-1 s=CLOSED pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.728+0000 7fcdea542640 1 --2- 10.20.193.28:0/397538032 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcde4111760 0x7fcde411ee40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.728+0000 7fcdea542640 1 --2- 10.20.193.28:0/397538032 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fcde410bf60 0x7fcde4119a70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.728+0000 7fcdea542640 1 --2- 10.20.193.28:0/397538032 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fcde410b570 0x7fcde4119530 unknown :-1 s=CLOSED pgs=96 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.728+0000 7fcdea542640 1 -- 10.20.193.28:0/397538032 >> 10.20.193.28:0/397538032 conn(0x7fcde40e8e40 msgr2=0x7fcde4109220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:17.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.729+0000 7fcdea542640 1 -- 10.20.193.28:0/397538032 shutdown_connections 2026-02-24T09:17:17.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:17.729+0000 7fcdea542640 1 -- 10.20.193.28:0/397538032 wait complete. 2026-02-24T09:17:17.834 INFO:tasks.cephadm.ceph_manager.ceph:need seq 42949673001 got 42949672999 for osd.0 2026-02-24T09:17:17.893 INFO:tasks.cephadm.ceph_manager.ceph:need seq 317827579920 got 317827579919 for osd.9 2026-02-24T09:17:17.896 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528346 got 193273528345 for osd.5 2026-02-24T09:17:18.274 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-24T09:17:18.279 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:17 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/3910235105' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-24T09:17:18.279 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:17 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/751524845' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-24T09:17:18.279 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:17 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/2982523016' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-24T09:17:18.279 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:17 trial159 ceph-mon[44242]: pgmap v189: 97 pgs: 97 active+clean; 637 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 9.3 KiB/s rd, 7.5 KiB/s wr, 16 op/s 2026-02-24T09:17:18.279 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:17 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/2870878949' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-24T09:17:18.279 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:17 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/340131746' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-24T09:17:18.279 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:17 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/3696166271' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-24T09:17:18.279 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:17 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/1182942384' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-24T09:17:18.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:17 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/3668107407' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-24T09:17:18.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:17 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/2198644570' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-24T09:17:18.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:17 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/4125120301' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-24T09:17:18.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:17 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/397538032' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-24T09:17:18.324 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:17 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/3910235105' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-24T09:17:18.324 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:17 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/751524845' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-24T09:17:18.324 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:17 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/2982523016' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-24T09:17:18.324 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:17 trial028 ceph-mon[40371]: pgmap v189: 97 pgs: 97 active+clean; 637 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 9.3 KiB/s rd, 7.5 KiB/s wr, 16 op/s 2026-02-24T09:17:18.324 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:17 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/2870878949' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-24T09:17:18.324 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:17 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/340131746' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-24T09:17:18.324 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:17 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/3696166271' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-24T09:17:18.324 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:17 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/1182942384' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-24T09:17:18.324 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:17 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/3668107407' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-24T09:17:18.324 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:17 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/2198644570' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-24T09:17:18.324 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:17 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/4125120301' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-24T09:17:18.324 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:17 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/397538032' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-24T09:17:18.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:17 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/3910235105' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-24T09:17:18.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:17 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/751524845' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-24T09:17:18.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:17 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/2982523016' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-24T09:17:18.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:17 trial074 ceph-mon[44412]: pgmap v189: 97 pgs: 97 active+clean; 637 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 9.3 KiB/s rd, 7.5 KiB/s wr, 16 op/s 2026-02-24T09:17:18.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:17 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/2870878949' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-24T09:17:18.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:17 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/340131746' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-24T09:17:18.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:17 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/3696166271' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-24T09:17:18.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:17 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/1182942384' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-24T09:17:18.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:17 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/3668107407' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-24T09:17:18.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:17 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/2198644570' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-24T09:17:18.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:17 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/4125120301' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-24T09:17:18.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:17 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/397538032' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-24T09:17:18.408 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-24T09:17:18.420 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-24T09:17:18.458 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:18.469 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd last-stat-seq osd.10 2026-02-24T09:17:18.478 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd last-stat-seq osd.6 2026-02-24T09:17:18.536 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-24T09:17:18.603 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:18.658 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:18.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.657+0000 7f8141948640 1 -- 10.20.193.28:0/3205825959 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f813c10c920 msgr2=0x7f813c110ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:18.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.657+0000 7f8141948640 1 --2- 10.20.193.28:0/3205825959 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f813c10c920 0x7f813c110ef0 secure :-1 s=READY pgs=97 gs=3 cs=0 l=1 c_cookie=6705390391197799847 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8124009890 tx=0x7f812402f0e0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.657+0000 7f8141948640 1 -- 10.20.193.28:0/3205825959 shutdown_connections 2026-02-24T09:17:18.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.657+0000 7f8141948640 1 --2- 10.20.193.28:0/3205825959 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f813c111510 0x7f813c1119b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.657+0000 7f8141948640 1 --2- 10.20.193.28:0/3205825959 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f813c10c920 0x7f813c110ef0 unknown :-1 s=CLOSED pgs=97 gs=3 cs=0 l=1 c_cookie=6705390391197799847 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.657+0000 7f8141948640 1 --2- 10.20.193.28:0/3205825959 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f813c10bf30 0x7f813c10c300 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.657+0000 7f8141948640 1 -- 10.20.193.28:0/3205825959 >> 10.20.193.28:0/3205825959 conn(0x7f813c0e9bc0 msgr2=0x7f813c109fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:18.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.657+0000 7f8141948640 1 -- 10.20.193.28:0/3205825959 shutdown_connections 2026-02-24T09:17:18.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.658+0000 7f8141948640 1 -- 10.20.193.28:0/3205825959 wait complete. 2026-02-24T09:17:18.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.658+0000 7f8141948640 1 Processor -- start 2026-02-24T09:17:18.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.659+0000 7f8141948640 1 -- start start 2026-02-24T09:17:18.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.659+0000 7f8141948640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f813c10bf30 0x7f813c122900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.659+0000 7f8141948640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f813c10c920 0x7f813c122e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.659+0000 7f8141948640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f813c111510 0x7f813c128210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.659+0000 7f8141948640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f813c128830 con 0x7f813c10bf30 2026-02-24T09:17:18.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.659+0000 7f8141948640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f813c1289a0 con 0x7f813c10c920 2026-02-24T09:17:18.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.659+0000 7f8141948640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f813c128b60 con 0x7f813c111510 2026-02-24T09:17:18.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.659+0000 7f8141147640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f813c111510 0x7f813c128210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.660+0000 7f8141147640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f813c111510 0x7f813c128210 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:34946/0 (socket says 10.20.193.28:34946) 2026-02-24T09:17:18.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.660+0000 7f8141147640 1 -- 10.20.193.28:0/777730800 learned_addr learned my addr 10.20.193.28:0/777730800 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:18.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.660+0000 7f8140946640 1 --2- 10.20.193.28:0/777730800 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f813c10bf30 0x7f813c122900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.660+0000 7f8133fff640 1 --2- 10.20.193.28:0/777730800 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f813c10c920 0x7f813c122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.660+0000 7f8141147640 1 -- 10.20.193.28:0/777730800 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f813c10c920 msgr2=0x7f813c122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:18.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.660+0000 7f8141147640 1 --2- 10.20.193.28:0/777730800 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f813c10c920 0x7f813c122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.660+0000 7f8141147640 1 -- 10.20.193.28:0/777730800 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f813c10bf30 msgr2=0x7f813c122900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:18.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.660+0000 7f8141147640 1 --2- 10.20.193.28:0/777730800 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f813c10bf30 0x7f813c122900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.660+0000 7f8141147640 1 -- 10.20.193.28:0/777730800 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81240094b0 con 0x7f813c111510 2026-02-24T09:17:18.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.661+0000 7f8140946640 1 --2- 10.20.193.28:0/777730800 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f813c10bf30 0x7f813c122900 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:17:18.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.661+0000 7f8141147640 1 --2- 10.20.193.28:0/777730800 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f813c111510 0x7f813c128210 secure :-1 s=READY pgs=98 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f813800c750 tx=0x7f813800cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:18.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.661+0000 7f8131ffb640 1 -- 10.20.193.28:0/777730800 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8138005500 con 0x7f813c111510 2026-02-24T09:17:18.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.661+0000 7f8131ffb640 1 -- 10.20.193.28:0/777730800 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8138003c40 con 0x7f813c111510 2026-02-24T09:17:18.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.661+0000 7f8131ffb640 1 -- 10.20.193.28:0/777730800 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f813800dd40 con 0x7f813c111510 2026-02-24T09:17:18.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.661+0000 7f8141948640 1 -- 10.20.193.28:0/777730800 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f813c128e40 con 0x7f813c111510 2026-02-24T09:17:18.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.661+0000 7f8141948640 1 -- 10.20.193.28:0/777730800 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f813c169540 con 0x7f813c111510 2026-02-24T09:17:18.666 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd last-stat-seq osd.11 2026-02-24T09:17:18.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.662+0000 7f8141948640 1 -- 10.20.193.28:0/777730800 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f813c129060 con 0x7f813c111510 2026-02-24T09:17:18.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.665+0000 7f8131ffb640 1 -- 10.20.193.28:0/777730800 <== mon.1 v2:10.20.193.159:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f8138003780 con 0x7f813c111510 2026-02-24T09:17:18.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.668+0000 7f8131ffb640 1 --2- 10.20.193.28:0/777730800 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f81180b5840 0x7f81180d5cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.668+0000 7f8131ffb640 1 -- 10.20.193.28:0/777730800 <== mon.1 v2:10.20.193.159:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f81380e6ec0 con 0x7f813c111510 2026-02-24T09:17:18.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.668+0000 7f8131ffb640 1 -- 10.20.193.28:0/777730800 <== mon.1 v2:10.20.193.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f81380e7340 con 0x7f813c111510 2026-02-24T09:17:18.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.668+0000 7f8140946640 1 --2- 10.20.193.28:0/777730800 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f81180b5840 0x7f81180d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.669+0000 7f8140946640 1 --2- 10.20.193.28:0/777730800 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f81180b5840 0x7f81180d5cf0 secure :-1 s=READY pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f812c004740 tx=0x7f812c009310 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:18.679 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:18.729 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-24T09:17:18.730 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd last-stat-seq osd.8 2026-02-24T09:17:18.736 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:18.781 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:18.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.794+0000 7f8141948640 1 -- 10.20.193.28:0/777730800 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f813c060420 con 0x7f813c111510 2026-02-24T09:17:18.799 INFO:teuthology.orchestra.run.trial028.stdout:128849018912 2026-02-24T09:17:18.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.795+0000 7f8131ffb640 1 -- 10.20.193.28:0/777730800 <== mon.1 v2:10.20.193.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f81380a98f0 con 0x7f813c111510 2026-02-24T09:17:18.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.799+0000 7f8141948640 1 -- 10.20.193.28:0/777730800 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f81180b5840 msgr2=0x7f81180d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:18.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.799+0000 7f8141948640 1 --2- 10.20.193.28:0/777730800 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f81180b5840 0x7f81180d5cf0 secure :-1 s=READY pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f812c004740 tx=0x7f812c009310 comp rx=0 tx=0).stop 2026-02-24T09:17:18.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.799+0000 7f8141948640 1 -- 10.20.193.28:0/777730800 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f813c111510 msgr2=0x7f813c128210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:18.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.799+0000 7f8141948640 1 --2- 10.20.193.28:0/777730800 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f813c111510 0x7f813c128210 secure :-1 s=READY pgs=98 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f813800c750 tx=0x7f813800cc20 comp rx=0 tx=0).stop 2026-02-24T09:17:18.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.800+0000 7f8141948640 1 -- 10.20.193.28:0/777730800 shutdown_connections 2026-02-24T09:17:18.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.800+0000 7f8141948640 1 --2- 10.20.193.28:0/777730800 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f81180b5840 0x7f81180d5cf0 unknown :-1 s=CLOSED pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.800+0000 7f8141948640 1 --2- 10.20.193.28:0/777730800 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f813c111510 0x7f813c128210 unknown :-1 s=CLOSED pgs=98 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.800+0000 7f8141948640 1 --2- 10.20.193.28:0/777730800 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f813c10c920 0x7f813c122e40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.800+0000 7f8141948640 1 --2- 10.20.193.28:0/777730800 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f813c10bf30 0x7f813c122900 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.800+0000 7f8141948640 1 -- 10.20.193.28:0/777730800 >> 10.20.193.28:0/777730800 conn(0x7f813c0e9bc0 msgr2=0x7f813c109fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:18.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.800+0000 7f8141948640 1 -- 10.20.193.28:0/777730800 shutdown_connections 2026-02-24T09:17:18.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.801+0000 7f8141948640 1 -- 10.20.193.28:0/777730800 wait complete. 2026-02-24T09:17:18.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.815+0000 7f6520dda640 1 -- 10.20.193.28:0/3558406924 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f651c060090 msgr2=0x7f651c0644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:18.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.815+0000 7f6520dda640 1 --2- 10.20.193.28:0/3558406924 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f651c060090 0x7f651c0644c0 secure :-1 s=READY pgs=302 gs=1 cs=0 l=1 c_cookie=11011907545668357761 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6504008950 tx=0x7f6504031670 comp rx=0 tx=0).stop 2026-02-24T09:17:18.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.817+0000 7f6520dda640 1 -- 10.20.193.28:0/3558406924 shutdown_connections 2026-02-24T09:17:18.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.817+0000 7f6520dda640 1 --2- 10.20.193.28:0/3558406924 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f651c064c20 0x7f651c065560 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.817+0000 7f6520dda640 1 --2- 10.20.193.28:0/3558406924 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f651c060090 0x7f651c0644c0 unknown :-1 s=CLOSED pgs=302 gs=1 cs=0 l=1 c_cookie=11011907545668357761 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.817+0000 7f6520dda640 1 --2- 10.20.193.28:0/3558406924 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f651c05f6a0 0x7f651c05fa70 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.817+0000 7f6520dda640 1 -- 10.20.193.28:0/3558406924 >> 10.20.193.28:0/3558406924 conn(0x7f651c057af0 msgr2=0x7f651c057ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:18.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.817+0000 7f6520dda640 1 -- 10.20.193.28:0/3558406924 shutdown_connections 2026-02-24T09:17:18.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.817+0000 7f6520dda640 1 -- 10.20.193.28:0/3558406924 wait complete. 2026-02-24T09:17:18.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.818+0000 7f6520dda640 1 Processor -- start 2026-02-24T09:17:18.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.818+0000 7f6520dda640 1 -- start start 2026-02-24T09:17:18.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.818+0000 7f6520dda640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f651c05f6a0 0x7f651c06cfe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.818+0000 7f6520dda640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f651c060090 0x7f651c069250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.818+0000 7f6520dda640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f651c064c20 0x7f651c069900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.818+0000 7f6520dda640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f651c06a090 con 0x7f651c05f6a0 2026-02-24T09:17:18.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.818+0000 7f6520dda640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f651c22c660 con 0x7f651c060090 2026-02-24T09:17:18.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.818+0000 7f6520dda640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f651c22c7d0 con 0x7f651c064c20 2026-02-24T09:17:18.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.819+0000 7f651affd640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f651c060090 0x7f651c069250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.819+0000 7f651affd640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f651c060090 0x7f651c069250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:43956/0 (socket says 10.20.193.28:43956) 2026-02-24T09:17:18.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.819+0000 7f651affd640 1 -- 10.20.193.28:0/1628746378 learned_addr learned my addr 10.20.193.28:0/1628746378 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:18.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.819+0000 7f651affd640 1 -- 10.20.193.28:0/1628746378 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f651c064c20 msgr2=0x7f651c069900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:18.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.819+0000 7f651affd640 1 --2- 10.20.193.28:0/1628746378 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f651c064c20 0x7f651c069900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.819+0000 7f651affd640 1 -- 10.20.193.28:0/1628746378 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f651c05f6a0 msgr2=0x7f651c06cfe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-24T09:17:18.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.819+0000 7f651affd640 1 --2- 10.20.193.28:0/1628746378 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f651c05f6a0 0x7f651c06cfe0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.819+0000 7f651affd640 1 -- 10.20.193.28:0/1628746378 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6504008570 con 0x7f651c060090 2026-02-24T09:17:18.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.819+0000 7f651affd640 1 --2- 10.20.193.28:0/1628746378 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f651c060090 0x7f651c069250 secure :-1 s=READY pgs=95 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f650400a9c0 tx=0x7f650400a9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:18.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.820+0000 7f6518ff9640 1 -- 10.20.193.28:0/1628746378 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f650403e070 con 0x7f651c060090 2026-02-24T09:17:18.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.820+0000 7f6520dda640 1 -- 10.20.193.28:0/1628746378 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f651c22ca50 con 0x7f651c060090 2026-02-24T09:17:18.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.820+0000 7f6520dda640 1 -- 10.20.193.28:0/1628746378 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f651c22ceb0 con 0x7f651c060090 2026-02-24T09:17:18.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.820+0000 7f6520dda640 1 -- 10.20.193.28:0/1628746378 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f651c05d010 con 0x7f651c060090 2026-02-24T09:17:18.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.822+0000 7f6518ff9640 1 -- 10.20.193.28:0/1628746378 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f650400a500 con 0x7f651c060090 2026-02-24T09:17:18.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.822+0000 7f6518ff9640 1 -- 10.20.193.28:0/1628746378 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6504042640 con 0x7f651c060090 2026-02-24T09:17:18.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.825+0000 7f6518ff9640 1 -- 10.20.193.28:0/1628746378 <== mon.2 v2:10.20.193.74:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f6504039430 con 0x7f651c060090 2026-02-24T09:17:18.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.827+0000 7f6518ff9640 1 --2- 10.20.193.28:0/1628746378 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f64f00b5740 0x7f64f00d5bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.827+0000 7f6518ff9640 1 -- 10.20.193.28:0/1628746378 <== mon.2 v2:10.20.193.74:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f650410beb0 con 0x7f651c060090 2026-02-24T09:17:18.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.827+0000 7f6518ff9640 1 -- 10.20.193.28:0/1628746378 <== mon.2 v2:10.20.193.74:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f650410c3a0 con 0x7f651c060090 2026-02-24T09:17:18.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.827+0000 7f651b7fe640 1 --2- 10.20.193.28:0/1628746378 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f64f00b5740 0x7f64f00d5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.830+0000 7f651b7fe640 1 --2- 10.20.193.28:0/1628746378 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f64f00b5740 0x7f64f00d5bf0 secure :-1 s=READY pgs=182 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f650c004760 tx=0x7f650c006c80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:18.835 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-24T09:17:18.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.891+0000 7faf45642640 1 -- 10.20.193.28:0/3141263720 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faf38038470 con 0x7faf4010f280 2026-02-24T09:17:18.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.892+0000 7faf488cf640 1 -- 10.20.193.28:0/3141263720 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf4010f280 msgr2=0x7faf4010f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:18.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.892+0000 7faf488cf640 1 --2- 10.20.193.28:0/3141263720 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf4010f280 0x7faf4010f650 secure :-1 s=READY pgs=303 gs=2 cs=0 l=1 c_cookie=11384108581111817118 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf380098e0 tx=0x7faf3802f160 comp rx=0 tx=0).stop 2026-02-24T09:17:18.894 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd last-stat-seq osd.9 2026-02-24T09:17:18.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.892+0000 7faf488cf640 1 -- 10.20.193.28:0/3141263720 shutdown_connections 2026-02-24T09:17:18.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.892+0000 7faf488cf640 1 --2- 10.20.193.28:0/3141263720 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7faf40115470 0x7faf40175e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.892+0000 7faf488cf640 1 --2- 10.20.193.28:0/3141263720 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7faf4010fc70 0x7faf40114cc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.892+0000 7faf488cf640 1 --2- 10.20.193.28:0/3141263720 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf4010f280 0x7faf4010f650 unknown :-1 s=CLOSED pgs=303 gs=2 cs=0 l=1 c_cookie=11384108581111817118 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.892+0000 7faf488cf640 1 -- 10.20.193.28:0/3141263720 >> 10.20.193.28:0/3141263720 conn(0x7faf4005f830 msgr2=0x7faf4010cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:18.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.893+0000 7faf488cf640 1 -- 10.20.193.28:0/3141263720 shutdown_connections 2026-02-24T09:17:18.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.893+0000 7faf488cf640 1 -- 10.20.193.28:0/3141263720 wait complete. 2026-02-24T09:17:18.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.894+0000 7faf488cf640 1 Processor -- start 2026-02-24T09:17:18.897 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd last-stat-seq osd.5 2026-02-24T09:17:18.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.894+0000 7faf488cf640 1 -- start start 2026-02-24T09:17:18.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.894+0000 7faf488cf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf4010f280 0x7faf401197c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.894+0000 7faf488cf640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7faf4010fc70 0x7faf40119d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.894+0000 7faf488cf640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7faf40115470 0x7faf4011f0d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.894+0000 7faf488cf640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7faf4011f6f0 con 0x7faf4010f280 2026-02-24T09:17:18.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.894+0000 7faf488cf640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7faf4011f860 con 0x7faf4010fc70 2026-02-24T09:17:18.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.894+0000 7faf488cf640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7faf4011fa20 con 0x7faf40115470 2026-02-24T09:17:18.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.895+0000 7faf46644640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf4010f280 0x7faf401197c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.897+0000 7faf46e45640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7faf40115470 0x7faf4011f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.897+0000 7faf46644640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf4010f280 0x7faf401197c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40174/0 (socket says 10.20.193.28:40174) 2026-02-24T09:17:18.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.897+0000 7faf46644640 1 -- 10.20.193.28:0/4211068098 learned_addr learned my addr 10.20.193.28:0/4211068098 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:18.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.897+0000 7faf45e43640 1 --2- 10.20.193.28:0/4211068098 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7faf4010fc70 0x7faf40119d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.897+0000 7faf46644640 1 -- 10.20.193.28:0/4211068098 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7faf40115470 msgr2=0x7faf4011f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:18.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.897+0000 7faf46644640 1 --2- 10.20.193.28:0/4211068098 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7faf40115470 0x7faf4011f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.897+0000 7faf46644640 1 -- 10.20.193.28:0/4211068098 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7faf4010fc70 msgr2=0x7faf40119d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:18.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.897+0000 7faf46644640 1 --2- 10.20.193.28:0/4211068098 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7faf4010fc70 0x7faf40119d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.897+0000 7faf46644640 1 -- 10.20.193.28:0/4211068098 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf380094b0 con 0x7faf4010f280 2026-02-24T09:17:18.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.897+0000 7faf46644640 1 --2- 10.20.193.28:0/4211068098 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf4010f280 0x7faf401197c0 secure :-1 s=READY pgs=304 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf380099e0 tx=0x7faf380028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:18.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.898+0000 7faf2b7fe640 1 -- 10.20.193.28:0/4211068098 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faf38002ac0 con 0x7faf4010f280 2026-02-24T09:17:18.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.898+0000 7faf488cf640 1 -- 10.20.193.28:0/4211068098 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf4011fca0 con 0x7faf4010f280 2026-02-24T09:17:18.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.898+0000 7faf488cf640 1 -- 10.20.193.28:0/4211068098 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf40171670 con 0x7faf4010f280 2026-02-24T09:17:18.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.898+0000 7faf2b7fe640 1 -- 10.20.193.28:0/4211068098 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7faf380043c0 con 0x7faf4010f280 2026-02-24T09:17:18.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.898+0000 7faf2b7fe640 1 -- 10.20.193.28:0/4211068098 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faf3804a840 con 0x7faf4010f280 2026-02-24T09:17:18.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.900+0000 7faf488cf640 1 -- 10.20.193.28:0/4211068098 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf40110560 con 0x7faf4010f280 2026-02-24T09:17:18.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.901+0000 7faf2b7fe640 1 -- 10.20.193.28:0/4211068098 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7faf3803f030 con 0x7faf4010f280 2026-02-24T09:17:18.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.903+0000 7faf2b7fe640 1 --2- 10.20.193.28:0/4211068098 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7faf140b5840 0x7faf140d5cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.904+0000 7faf2b7fe640 1 -- 10.20.193.28:0/4211068098 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7faf380d2020 con 0x7faf4010f280 2026-02-24T09:17:18.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.904+0000 7faf45e43640 1 --2- 10.20.193.28:0/4211068098 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7faf140b5840 0x7faf140d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.905+0000 7faf45e43640 1 --2- 10.20.193.28:0/4211068098 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7faf140b5840 0x7faf140d5cf0 secure :-1 s=READY pgs=183 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf2c005970 tx=0x7faf2c005900 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:18.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.906+0000 7faf2b7fe640 1 -- 10.20.193.28:0/4211068098 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7faf380cdc70 con 0x7faf4010f280 2026-02-24T09:17:18.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.909+0000 7fad07262640 1 -- 10.20.193.28:0/1967849869 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fad00115270 msgr2=0x7fad00116860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:18.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.909+0000 7fad07262640 1 --2- 10.20.193.28:0/1967849869 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fad00115270 0x7fad00116860 secure :-1 s=READY pgs=96 gs=3 cs=0 l=1 c_cookie=1137696124218628371 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7face8009890 tx=0x7face802f100 comp rx=0 tx=0).stop 2026-02-24T09:17:18.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.909+0000 7fad07262640 1 -- 10.20.193.28:0/1967849869 shutdown_connections 2026-02-24T09:17:18.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.909+0000 7fad07262640 1 --2- 10.20.193.28:0/1967849869 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad00116fe0 0x7fad0017ac20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.910+0000 7fad07262640 1 --2- 10.20.193.28:0/1967849869 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fad00115270 0x7fad00116860 unknown :-1 s=CLOSED pgs=96 gs=3 cs=0 l=1 c_cookie=1137696124218628371 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.910+0000 7fad07262640 1 --2- 10.20.193.28:0/1967849869 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fad00114880 0x7fad00114c50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.910+0000 7fad07262640 1 -- 10.20.193.28:0/1967849869 >> 10.20.193.28:0/1967849869 conn(0x7fad00057af0 msgr2=0x7fad00057ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:18.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.910+0000 7fad07262640 1 -- 10.20.193.28:0/1967849869 shutdown_connections 2026-02-24T09:17:18.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.910+0000 7fad07262640 1 -- 10.20.193.28:0/1967849869 wait complete. 2026-02-24T09:17:18.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.911+0000 7fad07262640 1 Processor -- start 2026-02-24T09:17:18.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.911+0000 7fad07262640 1 -- start start 2026-02-24T09:17:18.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.912+0000 7fad07262640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad00114880 0x7fad0018bc50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.912+0000 7fad07262640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fad00115270 0x7fad00185ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.912+0000 7fad07262640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fad00116fe0 0x7fad0017ab90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.912+0000 7fad07262640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fad001867b0 con 0x7fad00114880 2026-02-24T09:17:18.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.912+0000 7fad07262640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fad00186920 con 0x7fad00115270 2026-02-24T09:17:18.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.912+0000 7fad07262640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fad00186ae0 con 0x7fad00116fe0 2026-02-24T09:17:18.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.912+0000 7fad057d8640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fad00116fe0 0x7fad0017ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.912+0000 7fad057d8640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fad00116fe0 0x7fad0017ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:35020/0 (socket says 10.20.193.28:35020) 2026-02-24T09:17:18.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.912+0000 7fad057d8640 1 -- 10.20.193.28:0/3835380649 learned_addr learned my addr 10.20.193.28:0/3835380649 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:18.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.912+0000 7facf7fff640 1 --2- 10.20.193.28:0/3835380649 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fad00115270 0x7fad00185ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.913+0000 7fad04fd7640 1 --2- 10.20.193.28:0/3835380649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad00114880 0x7fad0018bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.913+0000 7fad057d8640 1 -- 10.20.193.28:0/3835380649 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fad00115270 msgr2=0x7fad00185ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:18.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.913+0000 7fad057d8640 1 --2- 10.20.193.28:0/3835380649 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fad00115270 0x7fad00185ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.913+0000 7fad057d8640 1 -- 10.20.193.28:0/3835380649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad00114880 msgr2=0x7fad0018bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:18.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.913+0000 7fad057d8640 1 --2- 10.20.193.28:0/3835380649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad00114880 0x7fad0018bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.913+0000 7fad057d8640 1 -- 10.20.193.28:0/3835380649 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face80094b0 con 0x7fad00116fe0 2026-02-24T09:17:18.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.913+0000 7fad04fd7640 1 --2- 10.20.193.28:0/3835380649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad00114880 0x7fad0018bc50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:18.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.915+0000 7fad057d8640 1 --2- 10.20.193.28:0/3835380649 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fad00116fe0 0x7fad0017ab90 secure :-1 s=READY pgs=99 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7facfc006fd0 tx=0x7facfc00dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:18.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.915+0000 7facf5ffb640 1 -- 10.20.193.28:0/3835380649 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7facfc008c90 con 0x7fad00116fe0 2026-02-24T09:17:18.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.917+0000 7fad07262640 1 -- 10.20.193.28:0/3835380649 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad002242c0 con 0x7fad00116fe0 2026-02-24T09:17:18.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.917+0000 7facf5ffb640 1 -- 10.20.193.28:0/3835380649 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7facfc008df0 con 0x7fad00116fe0 2026-02-24T09:17:18.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.917+0000 7facf5ffb640 1 -- 10.20.193.28:0/3835380649 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7facfc0106d0 con 0x7fad00116fe0 2026-02-24T09:17:18.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.917+0000 7fad07262640 1 -- 10.20.193.28:0/3835380649 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad002246a0 con 0x7fad00116fe0 2026-02-24T09:17:18.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.918+0000 7fad07262640 1 -- 10.20.193.28:0/3835380649 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad0005a940 con 0x7fad00116fe0 2026-02-24T09:17:18.941 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:18.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.944+0000 7facf5ffb640 1 -- 10.20.193.28:0/3835380649 <== mon.1 v2:10.20.193.159:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7facfc0050d0 con 0x7fad00116fe0 2026-02-24T09:17:18.953 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018911 got 128849018912 for osd.3 2026-02-24T09:17:18.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.951+0000 7facf5ffb640 1 --2- 10.20.193.28:0/3835380649 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7facd00b58c0 0x7facd00d5d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.954 DEBUG:teuthology.parallel:result is None 2026-02-24T09:17:18.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.951+0000 7facf5ffb640 1 -- 10.20.193.28:0/3835380649 <== mon.1 v2:10.20.193.159:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7facfc0e75f0 con 0x7fad00116fe0 2026-02-24T09:17:18.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.952+0000 7fad04fd7640 1 --2- 10.20.193.28:0/3835380649 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7facd00b58c0 0x7facd00d5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.954+0000 7facf5ffb640 1 -- 10.20.193.28:0/3835380649 <== mon.1 v2:10.20.193.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7facfc0e79f0 con 0x7fad00116fe0 2026-02-24T09:17:18.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.956+0000 7fad04fd7640 1 --2- 10.20.193.28:0/3835380649 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7facd00b58c0 0x7facd00d5d70 secure :-1 s=READY pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7facf0005b30 tx=0x7facf0009310 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:18.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.965+0000 7f6520dda640 1 -- 10.20.193.28:0/1628746378 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f651c05a500 con 0x7f651c060090 2026-02-24T09:17:18.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.965+0000 7f6518ff9640 1 -- 10.20.193.28:0/1628746378 <== mon.2 v2:10.20.193.74:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f65040ce780 con 0x7f651c060090 2026-02-24T09:17:18.971 INFO:teuthology.orchestra.run.trial028.stdout:163208757277 2026-02-24T09:17:18.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.970+0000 7f6520dda640 1 -- 10.20.193.28:0/1628746378 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f64f00b5740 msgr2=0x7f64f00d5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:18.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.970+0000 7f6520dda640 1 --2- 10.20.193.28:0/1628746378 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f64f00b5740 0x7f64f00d5bf0 secure :-1 s=READY pgs=182 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f650c004760 tx=0x7f650c006c80 comp rx=0 tx=0).stop 2026-02-24T09:17:18.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.970+0000 7f6520dda640 1 -- 10.20.193.28:0/1628746378 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f651c060090 msgr2=0x7f651c069250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:18.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.970+0000 7f6520dda640 1 --2- 10.20.193.28:0/1628746378 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f651c060090 0x7f651c069250 secure :-1 s=READY pgs=95 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f650400a9c0 tx=0x7f650400a9f0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.970+0000 7f6520dda640 1 -- 10.20.193.28:0/1628746378 shutdown_connections 2026-02-24T09:17:18.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.970+0000 7f6520dda640 1 --2- 10.20.193.28:0/1628746378 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f64f00b5740 0x7f64f00d5bf0 unknown :-1 s=CLOSED pgs=182 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.970+0000 7f6520dda640 1 --2- 10.20.193.28:0/1628746378 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f651c064c20 0x7f651c069900 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.970+0000 7f6520dda640 1 --2- 10.20.193.28:0/1628746378 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f651c060090 0x7f651c069250 unknown :-1 s=CLOSED pgs=95 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.970+0000 7f6520dda640 1 --2- 10.20.193.28:0/1628746378 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f651c05f6a0 0x7f651c06cfe0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.970+0000 7f6520dda640 1 -- 10.20.193.28:0/1628746378 >> 10.20.193.28:0/1628746378 conn(0x7f651c057af0 msgr2=0x7f651c061550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:18.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.971+0000 7f6520dda640 1 -- 10.20.193.28:0/1628746378 shutdown_connections 2026-02-24T09:17:18.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:18.971+0000 7f6520dda640 1 -- 10.20.193.28:0/1628746378 wait complete. 2026-02-24T09:17:19.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.005+0000 7fb0b53a0640 1 -- 10.20.193.28:0/1324182008 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb0b0114f60 msgr2=0x7fb0b0116860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.005+0000 7fb0b53a0640 1 --2- 10.20.193.28:0/1324182008 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb0b0114f60 0x7fb0b0116860 secure :-1 s=READY pgs=305 gs=1 cs=0 l=1 c_cookie=4737927781760007921 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb0980099a0 tx=0x7fb09802f220 comp rx=0 tx=0).stop 2026-02-24T09:17:19.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.005+0000 7fb0b53a0640 1 -- 10.20.193.28:0/1324182008 shutdown_connections 2026-02-24T09:17:19.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.005+0000 7fb0b53a0640 1 --2- 10.20.193.28:0/1324182008 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb0b0116da0 0x7fb0b0117220 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.005+0000 7fb0b53a0640 1 --2- 10.20.193.28:0/1324182008 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb0b0114f60 0x7fb0b0116860 unknown :-1 s=CLOSED pgs=305 gs=1 cs=0 l=1 c_cookie=4737927781760007921 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.005+0000 7fb0b53a0640 1 --2- 10.20.193.28:0/1324182008 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb0b0114650 0x7fb0b0114a20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.005+0000 7fb0b53a0640 1 -- 10.20.193.28:0/1324182008 >> 10.20.193.28:0/1324182008 conn(0x7fb0b0057af0 msgr2=0x7fb0b0057ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:19.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.006+0000 7fb0b53a0640 1 -- 10.20.193.28:0/1324182008 shutdown_connections 2026-02-24T09:17:19.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.006+0000 7fb0b53a0640 1 -- 10.20.193.28:0/1324182008 wait complete. 2026-02-24T09:17:19.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.014+0000 7fb0b53a0640 1 Processor -- start 2026-02-24T09:17:19.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.014+0000 7fb0b53a0640 1 -- start start 2026-02-24T09:17:19.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.015+0000 7fb0b53a0640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb0b0114650 0x7fb0b018a900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:19.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.015+0000 7fb0b53a0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb0b0114f60 0x7fb0b0185b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:19.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.015+0000 7fb0b53a0640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb0b0116da0 0x7fb0b0186290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:19.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.015+0000 7fb0aeffd640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb0b0114650 0x7fb0b018a900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:19.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.015+0000 7fb0aeffd640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb0b0114650 0x7fb0b018a900 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:35046/0 (socket says 10.20.193.28:35046) 2026-02-24T09:17:19.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.015+0000 7fb0aeffd640 1 -- 10.20.193.28:0/2622574809 learned_addr learned my addr 10.20.193.28:0/2622574809 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:19.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.015+0000 7fb0b53a0640 1 -- 10.20.193.28:0/2622574809 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b0186990 con 0x7fb0b0114f60 2026-02-24T09:17:19.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.015+0000 7fb0b53a0640 1 -- 10.20.193.28:0/2622574809 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b015ef90 con 0x7fb0b0116da0 2026-02-24T09:17:19.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.015+0000 7fb0b53a0640 1 -- 10.20.193.28:0/2622574809 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b015f150 con 0x7fb0b0114650 2026-02-24T09:17:19.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.015+0000 7fb0af7fe640 1 --2- 10.20.193.28:0/2622574809 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb0b0116da0 0x7fb0b0186290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:19.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.015+0000 7fb0ae7fc640 1 --2- 10.20.193.28:0/2622574809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb0b0114f60 0x7fb0b0185b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:19.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.015+0000 7fb0aeffd640 1 -- 10.20.193.28:0/2622574809 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb0b0116da0 msgr2=0x7fb0b0186290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.015+0000 7fb0aeffd640 1 --2- 10.20.193.28:0/2622574809 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb0b0116da0 0x7fb0b0186290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.015+0000 7fb0aeffd640 1 -- 10.20.193.28:0/2622574809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb0b0114f60 msgr2=0x7fb0b0185b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.015+0000 7fb0aeffd640 1 --2- 10.20.193.28:0/2622574809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb0b0114f60 0x7fb0b0185b60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.015+0000 7fb0aeffd640 1 -- 10.20.193.28:0/2622574809 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb098009570 con 0x7fb0b0114650 2026-02-24T09:17:19.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.016+0000 7fb0ae7fc640 1 --2- 10.20.193.28:0/2622574809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb0b0114f60 0x7fb0b0185b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:17:19.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.016+0000 7fb0aeffd640 1 --2- 10.20.193.28:0/2622574809 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb0b0114650 0x7fb0b018a900 secure :-1 s=READY pgs=100 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb0a000c9b0 tx=0x7fb0a000ce80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:19.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.016+0000 7fb08ffff640 1 -- 10.20.193.28:0/2622574809 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb0a0004560 con 0x7fb0b0114650 2026-02-24T09:17:19.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.016+0000 7fb08ffff640 1 -- 10.20.193.28:0/2622574809 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb0a0007d80 con 0x7fb0b0114650 2026-02-24T09:17:19.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.016+0000 7fb0b53a0640 1 -- 10.20.193.28:0/2622574809 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0b015f430 con 0x7fb0b0114650 2026-02-24T09:17:19.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.016+0000 7fb0b53a0640 1 -- 10.20.193.28:0/2622574809 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0b015f8b0 con 0x7fb0b0114650 2026-02-24T09:17:19.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.020+0000 7fb08ffff640 1 -- 10.20.193.28:0/2622574809 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb0a000f6d0 con 0x7fb0b0114650 2026-02-24T09:17:19.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.020+0000 7fb0b53a0640 1 -- 10.20.193.28:0/2622574809 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0b005a940 con 0x7fb0b0114650 2026-02-24T09:17:19.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.020+0000 7fb08ffff640 1 -- 10.20.193.28:0/2622574809 <== mon.1 v2:10.20.193.159:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7fb0a0020070 con 0x7fb0b0114650 2026-02-24T09:17:19.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.021+0000 7fb08ffff640 1 --2- 10.20.193.28:0/2622574809 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb0780b5880 0x7fb0780d5d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:19.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.021+0000 7fb08ffff640 1 -- 10.20.193.28:0/2622574809 <== mon.1 v2:10.20.193.159:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7fb0a00e7e00 con 0x7fb0b0114650 2026-02-24T09:17:19.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.022+0000 7fb0ae7fc640 1 --2- 10.20.193.28:0/2622574809 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb0780b5880 0x7fb0780d5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:19.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.022+0000 7fb08ffff640 1 -- 10.20.193.28:0/2622574809 <== mon.1 v2:10.20.193.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fb0a00aa690 con 0x7fb0b0114650 2026-02-24T09:17:19.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.023+0000 7fb0ae7fc640 1 --2- 10.20.193.28:0/2622574809 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb0780b5880 0x7fb0780d5d30 secure :-1 s=READY pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb0980023d0 tx=0x7fb098031040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:19.050 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:19.056 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:19.089 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:18 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/777730800' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-24T09:17:19.089 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:18 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/1628746378' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-24T09:17:19.098 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757277 got 163208757277 for osd.4 2026-02-24T09:17:19.099 DEBUG:teuthology.parallel:result is None 2026-02-24T09:17:19.113 INFO:teuthology.orchestra.run.trial028.stdout:339302416397 2026-02-24T09:17:19.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.110+0000 7fad07262640 1 -- 10.20.193.28:0/3835380649 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fad000008d0 con 0x7fad00116fe0 2026-02-24T09:17:19.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.111+0000 7facf5ffb640 1 -- 10.20.193.28:0/3835380649 <== mon.1 v2:10.20.193.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7facfc0a9e80 con 0x7fad00116fe0 2026-02-24T09:17:19.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.053+0000 7faf488cf640 1 -- 10.20.193.28:0/4211068098 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7faf4011a920 con 0x7faf4010f280 2026-02-24T09:17:19.116 INFO:teuthology.orchestra.run.trial028.stdout:68719476773 2026-02-24T09:17:19.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.114+0000 7faf2b7fe640 1 -- 10.20.193.28:0/4211068098 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faf380d0e20 con 0x7faf4010f280 2026-02-24T09:17:19.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.114+0000 7fad07262640 1 -- 10.20.193.28:0/3835380649 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7facd00b58c0 msgr2=0x7facd00d5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.114+0000 7fad07262640 1 --2- 10.20.193.28:0/3835380649 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7facd00b58c0 0x7facd00d5d70 secure :-1 s=READY pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7facf0005b30 tx=0x7facf0009310 comp rx=0 tx=0).stop 2026-02-24T09:17:19.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.114+0000 7fad07262640 1 -- 10.20.193.28:0/3835380649 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fad00116fe0 msgr2=0x7fad0017ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.114+0000 7fad07262640 1 --2- 10.20.193.28:0/3835380649 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fad00116fe0 0x7fad0017ab90 secure :-1 s=READY pgs=99 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7facfc006fd0 tx=0x7facfc00dde0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.116+0000 7faf297fa640 1 -- 10.20.193.28:0/4211068098 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7faf140b5840 msgr2=0x7faf140d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.116+0000 7faf297fa640 1 --2- 10.20.193.28:0/4211068098 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7faf140b5840 0x7faf140d5cf0 secure :-1 s=READY pgs=183 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf2c005970 tx=0x7faf2c005900 comp rx=0 tx=0).stop 2026-02-24T09:17:19.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.116+0000 7faf297fa640 1 -- 10.20.193.28:0/4211068098 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf4010f280 msgr2=0x7faf401197c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.116+0000 7faf297fa640 1 --2- 10.20.193.28:0/4211068098 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf4010f280 0x7faf401197c0 secure :-1 s=READY pgs=304 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf380099e0 tx=0x7faf380028d0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.117+0000 7fad07262640 1 -- 10.20.193.28:0/3835380649 shutdown_connections 2026-02-24T09:17:19.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.117+0000 7fad07262640 1 --2- 10.20.193.28:0/3835380649 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7facd00b58c0 0x7facd00d5d70 unknown :-1 s=CLOSED pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.117+0000 7fad07262640 1 --2- 10.20.193.28:0/3835380649 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fad00116fe0 0x7fad0017ab90 unknown :-1 s=CLOSED pgs=99 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.117+0000 7fad07262640 1 --2- 10.20.193.28:0/3835380649 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fad00115270 0x7fad00185ef0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.117+0000 7fad07262640 1 --2- 10.20.193.28:0/3835380649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad00114880 0x7fad0018bc50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.117+0000 7fad07262640 1 -- 10.20.193.28:0/3835380649 >> 10.20.193.28:0/3835380649 conn(0x7fad00057af0 msgr2=0x7fad00116040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:19.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.117+0000 7fad07262640 1 -- 10.20.193.28:0/3835380649 shutdown_connections 2026-02-24T09:17:19.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.118+0000 7fad07262640 1 -- 10.20.193.28:0/3835380649 wait complete. 2026-02-24T09:17:19.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.119+0000 7faf297fa640 1 -- 10.20.193.28:0/4211068098 shutdown_connections 2026-02-24T09:17:19.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.119+0000 7faf297fa640 1 --2- 10.20.193.28:0/4211068098 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7faf140b5840 0x7faf140d5cf0 unknown :-1 s=CLOSED pgs=183 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.119+0000 7faf297fa640 1 --2- 10.20.193.28:0/4211068098 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7faf40115470 0x7faf4011f0d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.119+0000 7faf297fa640 1 --2- 10.20.193.28:0/4211068098 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7faf4010fc70 0x7faf40119d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.119+0000 7faf297fa640 1 --2- 10.20.193.28:0/4211068098 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf4010f280 0x7faf401197c0 unknown :-1 s=CLOSED pgs=304 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.119+0000 7faf297fa640 1 -- 10.20.193.28:0/4211068098 >> 10.20.193.28:0/4211068098 conn(0x7faf4005f830 msgr2=0x7faf4010e020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:19.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.119+0000 7faf297fa640 1 -- 10.20.193.28:0/4211068098 shutdown_connections 2026-02-24T09:17:19.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.119+0000 7faf297fa640 1 -- 10.20.193.28:0/4211068098 wait complete. 2026-02-24T09:17:19.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.133+0000 7f73191e3640 1 -- 10.20.193.28:0/253419736 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7314119930 msgr2=0x7f731417a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.133+0000 7f73191e3640 1 --2- 10.20.193.28:0/253419736 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7314119930 0x7f731417a300 secure :-1 s=READY pgs=97 gs=1 cs=0 l=1 c_cookie=15646975540439503587 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72fc009950 tx=0x7f72fc02f1b0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.134+0000 7f73191e3640 1 -- 10.20.193.28:0/253419736 shutdown_connections 2026-02-24T09:17:19.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.134+0000 7f73191e3640 1 --2- 10.20.193.28:0/253419736 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7314119930 0x7f731417a300 unknown :-1 s=CLOSED pgs=97 gs=1 cs=0 l=1 c_cookie=15646975540439503587 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.134+0000 7f73191e3640 1 --2- 10.20.193.28:0/253419736 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7314114220 0x7f7314119180 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.134+0000 7f73191e3640 1 --2- 10.20.193.28:0/253419736 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7314113830 0x7f7314113c00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.134+0000 7f73191e3640 1 -- 10.20.193.28:0/253419736 >> 10.20.193.28:0/253419736 conn(0x7f7314060810 msgr2=0x7f7314064c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:19.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.134+0000 7f73191e3640 1 -- 10.20.193.28:0/253419736 shutdown_connections 2026-02-24T09:17:19.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.135+0000 7f73191e3640 1 -- 10.20.193.28:0/253419736 wait complete. 2026-02-24T09:17:19.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.136+0000 7f73191e3640 1 Processor -- start 2026-02-24T09:17:19.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.136+0000 7f73191e3640 1 -- start start 2026-02-24T09:17:19.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.137+0000 7f73191e3640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7314113830 0x7f73140fb4e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:19.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.137+0000 7f73191e3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7314114220 0x7f731417a200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:19.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.137+0000 7f73137fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7314114220 0x7f731417a200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:19.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.137+0000 7f73137fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7314114220 0x7f731417a200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40224/0 (socket says 10.20.193.28:40224) 2026-02-24T09:17:19.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.138+0000 7f73191e3640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7314119930 0x7f73140fbbe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:19.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.138+0000 7f73191e3640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7314100df0 con 0x7f7314114220 2026-02-24T09:17:19.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.138+0000 7f73191e3640 1 -- 10.20.193.28:0/3109537156 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f7314100f60 con 0x7f7314119930 2026-02-24T09:17:19.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.138+0000 7f73191e3640 1 -- 10.20.193.28:0/3109537156 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7314101120 con 0x7f7314113830 2026-02-24T09:17:19.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.138+0000 7f73137fe640 1 -- 10.20.193.28:0/3109537156 learned_addr learned my addr 10.20.193.28:0/3109537156 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:19.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.138+0000 7f7313fff640 1 --2- 10.20.193.28:0/3109537156 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7314113830 0x7f73140fb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:19.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.138+0000 7f73189e2640 1 --2- 10.20.193.28:0/3109537156 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7314119930 0x7f73140fbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:19.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.139+0000 7f73137fe640 1 -- 10.20.193.28:0/3109537156 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7314113830 msgr2=0x7f73140fb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.139+0000 7f73137fe640 1 --2- 10.20.193.28:0/3109537156 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7314113830 0x7f73140fb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.139+0000 7f73137fe640 1 -- 10.20.193.28:0/3109537156 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7314119930 msgr2=0x7f73140fbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.139+0000 7f73137fe640 1 --2- 10.20.193.28:0/3109537156 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7314119930 0x7f73140fbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.139+0000 7f73137fe640 1 -- 10.20.193.28:0/3109537156 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73080094b0 con 0x7f7314114220 2026-02-24T09:17:19.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.139+0000 7f7313fff640 1 --2- 10.20.193.28:0/3109537156 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7314113830 0x7f73140fb4e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:17:19.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.140+0000 7f73137fe640 1 --2- 10.20.193.28:0/3109537156 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7314114220 0x7f731417a200 secure :-1 s=READY pgs=306 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7308009fd0 tx=0x7f7308002bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:19.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.154+0000 7f73117fa640 1 -- 10.20.193.28:0/3109537156 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f730800ed60 con 0x7f7314114220 2026-02-24T09:17:19.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.154+0000 7f73117fa640 1 -- 10.20.193.28:0/3109537156 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7308002e20 con 0x7f7314114220 2026-02-24T09:17:19.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.154+0000 7f73117fa640 1 -- 10.20.193.28:0/3109537156 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f73080188b0 con 0x7f7314114220 2026-02-24T09:17:19.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.155+0000 7f73191e3640 1 -- 10.20.193.28:0/3109537156 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72fc009570 con 0x7f7314114220 2026-02-24T09:17:19.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.155+0000 7f73191e3640 1 -- 10.20.193.28:0/3109537156 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73141016f0 con 0x7f7314114220 2026-02-24T09:17:19.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.159+0000 7f73191e3640 1 -- 10.20.193.28:0/3109537156 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72d8005300 con 0x7f7314114220 2026-02-24T09:17:19.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.163+0000 7f73117fa640 1 -- 10.20.193.28:0/3109537156 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f7308016020 con 0x7f7314114220 2026-02-24T09:17:19.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.166+0000 7f73117fa640 1 --2- 10.20.193.28:0/3109537156 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f72ec0b58b0 0x7f72ec0d5d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:19.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.166+0000 7f73117fa640 1 -- 10.20.193.28:0/3109537156 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f73080e6dc0 con 0x7f7314114220 2026-02-24T09:17:19.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.166+0000 7f73117fa640 1 -- 10.20.193.28:0/3109537156 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f73080eb350 con 0x7f7314114220 2026-02-24T09:17:19.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.167+0000 7f7313fff640 1 --2- 10.20.193.28:0/3109537156 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f72ec0b58b0 0x7f72ec0d5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:19.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.171+0000 7fb0b53a0640 1 -- 10.20.193.28:0/2622574809 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fb0b0116890 con 0x7fb0b0114650 2026-02-24T09:17:19.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.167+0000 7f7313fff640 1 --2- 10.20.193.28:0/3109537156 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f72ec0b58b0 0x7f72ec0d5d60 secure :-1 s=READY pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7304005820 tx=0x7f730400a310 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:19.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.184+0000 7fb08ffff640 1 -- 10.20.193.28:0/2622574809 <== mon.1 v2:10.20.193.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb0a00ad840 con 0x7fb0b0114650 2026-02-24T09:17:19.191 INFO:teuthology.orchestra.run.trial028.stdout:227633266712 2026-02-24T09:17:19.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.189+0000 7fb0b53a0640 1 -- 10.20.193.28:0/2622574809 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb0780b5880 msgr2=0x7fb0780d5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.189+0000 7fb0b53a0640 1 --2- 10.20.193.28:0/2622574809 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb0780b5880 0x7fb0780d5d30 secure :-1 s=READY pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb0980023d0 tx=0x7fb098031040 comp rx=0 tx=0).stop 2026-02-24T09:17:19.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.189+0000 7fb0b53a0640 1 -- 10.20.193.28:0/2622574809 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb0b0114650 msgr2=0x7fb0b018a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.189+0000 7fb0b53a0640 1 --2- 10.20.193.28:0/2622574809 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb0b0114650 0x7fb0b018a900 secure :-1 s=READY pgs=100 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb0a000c9b0 tx=0x7fb0a000ce80 comp rx=0 tx=0).stop 2026-02-24T09:17:19.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.193+0000 7fb0b53a0640 1 -- 10.20.193.28:0/2622574809 shutdown_connections 2026-02-24T09:17:19.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.193+0000 7fb0b53a0640 1 --2- 10.20.193.28:0/2622574809 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb0780b5880 0x7fb0780d5d30 unknown :-1 s=CLOSED pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.193+0000 7fb0b53a0640 1 --2- 10.20.193.28:0/2622574809 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb0b0116da0 0x7fb0b0186290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.193+0000 7fb0b53a0640 1 --2- 10.20.193.28:0/2622574809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb0b0114f60 0x7fb0b0185b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.193+0000 7fb0b53a0640 1 --2- 10.20.193.28:0/2622574809 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb0b0114650 0x7fb0b018a900 unknown :-1 s=CLOSED pgs=100 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.193+0000 7fb0b53a0640 1 -- 10.20.193.28:0/2622574809 >> 10.20.193.28:0/2622574809 conn(0x7fb0b0057af0 msgr2=0x7fb0b00586a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:19.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.193+0000 7fb0b53a0640 1 -- 10.20.193.28:0/2622574809 shutdown_connections 2026-02-24T09:17:19.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.193+0000 7fb0b53a0640 1 -- 10.20.193.28:0/2622574809 wait complete. 2026-02-24T09:17:19.214 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:19.264 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:19.272 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:19.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:18 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/777730800' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-24T09:17:19.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:18 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/1628746378' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-24T09:17:19.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.295+0000 7f73191e3640 1 -- 10.20.193.28:0/3109537156 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f72d80055b0 con 0x7f7314114220 2026-02-24T09:17:19.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.297+0000 7f73117fa640 1 -- 10.20.193.28:0/3109537156 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f73080a9650 con 0x7f7314114220 2026-02-24T09:17:19.300 INFO:teuthology.orchestra.run.trial028.stdout:94489280546 2026-02-24T09:17:19.304 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476773 got 68719476773 for osd.1 2026-02-24T09:17:19.304 DEBUG:teuthology.parallel:result is None 2026-02-24T09:17:19.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.313+0000 7f73191e3640 1 -- 10.20.193.28:0/3109537156 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f72ec0b58b0 msgr2=0x7f72ec0d5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.313+0000 7f73191e3640 1 --2- 10.20.193.28:0/3109537156 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f72ec0b58b0 0x7f72ec0d5d60 secure :-1 s=READY pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7304005820 tx=0x7f730400a310 comp rx=0 tx=0).stop 2026-02-24T09:17:19.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.313+0000 7f73191e3640 1 -- 10.20.193.28:0/3109537156 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7314114220 msgr2=0x7f731417a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.313+0000 7f73191e3640 1 --2- 10.20.193.28:0/3109537156 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7314114220 0x7f731417a200 secure :-1 s=READY pgs=306 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7308009fd0 tx=0x7f7308002bc0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.315+0000 7f73191e3640 1 -- 10.20.193.28:0/3109537156 shutdown_connections 2026-02-24T09:17:19.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.315+0000 7f73191e3640 1 --2- 10.20.193.28:0/3109537156 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f72ec0b58b0 0x7f72ec0d5d60 unknown :-1 s=CLOSED pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.315+0000 7f73191e3640 1 --2- 10.20.193.28:0/3109537156 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7314119930 0x7f73140fbbe0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.315+0000 7f73191e3640 1 --2- 10.20.193.28:0/3109537156 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7314114220 0x7f731417a200 unknown :-1 s=CLOSED pgs=306 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.315+0000 7f73191e3640 1 --2- 10.20.193.28:0/3109537156 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7314113830 0x7f73140fb4e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.315+0000 7f73191e3640 1 -- 10.20.193.28:0/3109537156 >> 10.20.193.28:0/3109537156 conn(0x7f7314060810 msgr2=0x7f7314065930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:19.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.315+0000 7f73191e3640 1 -- 10.20.193.28:0/3109537156 shutdown_connections 2026-02-24T09:17:19.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.315+0000 7f73191e3640 1 -- 10.20.193.28:0/3109537156 wait complete. 2026-02-24T09:17:19.344 INFO:tasks.cephadm.ceph_manager.ceph:need seq 339302416396 got 339302416397 for osd.10 2026-02-24T09:17:19.344 DEBUG:teuthology.parallel:result is None 2026-02-24T09:17:19.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.351+0000 7f7656f0b640 1 -- 10.20.193.28:0/4190583204 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f765010fc40 msgr2=0x7f7650114c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.351+0000 7f7656f0b640 1 --2- 10.20.193.28:0/4190583204 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f765010fc40 0x7f7650114c90 secure :-1 s=READY pgs=98 gs=2 cs=0 l=1 c_cookie=6069920879948587696 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7644009950 tx=0x7f764402f190 comp rx=0 tx=0).stop 2026-02-24T09:17:19.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.352+0000 7f7656f0b640 1 -- 10.20.193.28:0/4190583204 shutdown_connections 2026-02-24T09:17:19.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.352+0000 7f7656f0b640 1 --2- 10.20.193.28:0/4190583204 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7650115440 0x7f7650175e10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.352+0000 7f7656f0b640 1 --2- 10.20.193.28:0/4190583204 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f765010fc40 0x7f7650114c90 unknown :-1 s=CLOSED pgs=98 gs=2 cs=0 l=1 c_cookie=6069920879948587696 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.352+0000 7f7656f0b640 1 --2- 10.20.193.28:0/4190583204 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f765010f250 0x7f765010f620 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.352+0000 7f7656f0b640 1 -- 10.20.193.28:0/4190583204 >> 10.20.193.28:0/4190583204 conn(0x7f76500ecb40 msgr2=0x7f765010cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:19.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.352+0000 7f7656f0b640 1 -- 10.20.193.28:0/4190583204 shutdown_connections 2026-02-24T09:17:19.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.352+0000 7f7656f0b640 1 -- 10.20.193.28:0/4190583204 wait complete. 2026-02-24T09:17:19.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.353+0000 7f7656f0b640 1 Processor -- start 2026-02-24T09:17:19.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.353+0000 7f7656f0b640 1 -- start start 2026-02-24T09:17:19.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.354+0000 7f7656f0b640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f765010f250 0x7f7650115e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:19.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.354+0000 7f7656f0b640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f765010fc40 0x7f76501163c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:19.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.354+0000 7f38dffff640 1 -- 10.20.193.28:0/1440991649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38d80b8bb0 msgr2=0x7f38d80b8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.354+0000 7f38dffff640 1 --2- 10.20.193.28:0/1440991649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38d80b8bb0 0x7f38d80b8f80 secure :-1 s=READY pgs=307 gs=3 cs=0 l=1 c_cookie=9671510938901596426 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38cc0099a0 tx=0x7f38cc02f1e0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.354+0000 7f38dffff640 1 -- 10.20.193.28:0/1440991649 shutdown_connections 2026-02-24T09:17:19.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.354+0000 7f38dffff640 1 --2- 10.20.193.28:0/1440991649 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f38d80bd380 0x7f38d8008e80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.354+0000 7f38dffff640 1 --2- 10.20.193.28:0/1440991649 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f38d80b95a0 0x7f38d80bcbf0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.354+0000 7f38dffff640 1 --2- 10.20.193.28:0/1440991649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38d80b8bb0 0x7f38d80b8f80 unknown :-1 s=CLOSED pgs=307 gs=3 cs=0 l=1 c_cookie=9671510938901596426 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.354+0000 7f38dffff640 1 -- 10.20.193.28:0/1440991649 >> 10.20.193.28:0/1440991649 conn(0x7f38d8094aa0 msgr2=0x7f38d80b4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:19.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.354+0000 7f7655f09640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f765010f250 0x7f7650115e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:19.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.354+0000 7f7655f09640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f765010f250 0x7f7650115e80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:35084/0 (socket says 10.20.193.28:35084) 2026-02-24T09:17:19.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.354+0000 7f7655f09640 1 -- 10.20.193.28:0/1028169789 learned_addr learned my addr 10.20.193.28:0/1028169789 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:19.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.354+0000 7f7655708640 1 --2- 10.20.193.28:0/1028169789 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f765010fc40 0x7f76501163c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:19.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.354+0000 7f7656f0b640 1 --2- 10.20.193.28:0/1028169789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7650115440 0x7f765015ad50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:19.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.355+0000 7f7656f0b640 1 -- 10.20.193.28:0/1028169789 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f765015b350 con 0x7f7650115440 2026-02-24T09:17:19.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.355+0000 7f7656f0b640 1 -- 10.20.193.28:0/1028169789 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f765015b4c0 con 0x7f765010fc40 2026-02-24T09:17:19.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.355+0000 7f7656f0b640 1 -- 10.20.193.28:0/1028169789 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f765015b680 con 0x7f765010f250 2026-02-24T09:17:19.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.355+0000 7f38dffff640 1 -- 10.20.193.28:0/1440991649 shutdown_connections 2026-02-24T09:17:19.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.355+0000 7f765670a640 1 --2- 10.20.193.28:0/1028169789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7650115440 0x7f765015ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:19.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.355+0000 7f765670a640 1 -- 10.20.193.28:0/1028169789 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f765010f250 msgr2=0x7f7650115e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.355+0000 7f765670a640 1 --2- 10.20.193.28:0/1028169789 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f765010f250 0x7f7650115e80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.355+0000 7f765670a640 1 -- 10.20.193.28:0/1028169789 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f765010fc40 msgr2=0x7f76501163c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.355+0000 7f765670a640 1 --2- 10.20.193.28:0/1028169789 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f765010fc40 0x7f76501163c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.355+0000 7f765670a640 1 -- 10.20.193.28:0/1028169789 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76400094b0 con 0x7f7650115440 2026-02-24T09:17:19.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.355+0000 7f765670a640 1 --2- 10.20.193.28:0/1028169789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7650115440 0x7f765015ad50 secure :-1 s=READY pgs=308 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f764c00f940 tx=0x7f764c00fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:19.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.355+0000 7f38dffff640 1 -- 10.20.193.28:0/1440991649 wait complete. 2026-02-24T09:17:19.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.356+0000 7f763effd640 1 -- 10.20.193.28:0/1028169789 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f764c00dce0 con 0x7f7650115440 2026-02-24T09:17:19.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.356+0000 7f763effd640 1 -- 10.20.193.28:0/1028169789 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f764c00de40 con 0x7f7650115440 2026-02-24T09:17:19.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.356+0000 7f763effd640 1 -- 10.20.193.28:0/1028169789 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f764c0116b0 con 0x7f7650115440 2026-02-24T09:17:19.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.356+0000 7f7656f0b640 1 -- 10.20.193.28:0/1028169789 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7644009570 con 0x7f7650115440 2026-02-24T09:17:19.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.356+0000 7f38dffff640 1 Processor -- start 2026-02-24T09:17:19.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.356+0000 7f38dffff640 1 -- start start 2026-02-24T09:17:19.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.356+0000 7f7656f0b640 1 -- 10.20.193.28:0/1028169789 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f765015bc50 con 0x7f7650115440 2026-02-24T09:17:19.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.357+0000 7f7656f0b640 1 -- 10.20.193.28:0/1028169789 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7650110530 con 0x7f7650115440 2026-02-24T09:17:19.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.357+0000 7f38dffff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f38d80b8bb0 0x7f38d80ad9d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:19.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.357+0000 7f38dffff640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f38d80b95a0 0x7f38d80adf10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:19.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.357+0000 7f38dffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38d80bd380 0x7f38d80b32e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:19.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.357+0000 7f38deffd640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f38d80b8bb0 0x7f38d80ad9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:19.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.357+0000 7f38dffff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f38d80b38b0 con 0x7f38d80bd380 2026-02-24T09:17:19.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.357+0000 7f38deffd640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f38d80b8bb0 0x7f38d80ad9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:44064/0 (socket says 10.20.193.28:44064) 2026-02-24T09:17:19.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.357+0000 7f38deffd640 1 -- 10.20.193.28:0/4152717925 learned_addr learned my addr 10.20.193.28:0/4152717925 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:19.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.357+0000 7f38de7fc640 1 --2- 10.20.193.28:0/4152717925 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f38d80b95a0 0x7f38d80adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:19.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.357+0000 7f38df7fe640 1 --2- 10.20.193.28:0/4152717925 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38d80bd380 0x7f38d80b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:19.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.357+0000 7f38dffff640 1 -- 10.20.193.28:0/4152717925 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f38d80b3a20 con 0x7f38d80b8bb0 2026-02-24T09:17:19.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.357+0000 7f38dffff640 1 -- 10.20.193.28:0/4152717925 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f38d80b3be0 con 0x7f38d80b95a0 2026-02-24T09:17:19.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.358+0000 7f38deffd640 1 -- 10.20.193.28:0/4152717925 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f38d80b95a0 msgr2=0x7f38d80adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.358+0000 7f38deffd640 1 --2- 10.20.193.28:0/4152717925 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f38d80b95a0 0x7f38d80adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.358+0000 7f38deffd640 1 -- 10.20.193.28:0/4152717925 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38d80bd380 msgr2=0x7f38d80b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.358+0000 7f38deffd640 1 --2- 10.20.193.28:0/4152717925 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38d80bd380 0x7f38d80b32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.358+0000 7f38deffd640 1 -- 10.20.193.28:0/4152717925 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38cc009570 con 0x7f38d80b8bb0 2026-02-24T09:17:19.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.358+0000 7f38df7fe640 1 --2- 10.20.193.28:0/4152717925 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38d80bd380 0x7f38d80b32e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:17:19.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.358+0000 7f38deffd640 1 --2- 10.20.193.28:0/4152717925 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f38d80b8bb0 0x7f38d80ad9d0 secure :-1 s=READY pgs=99 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38cc004270 tx=0x7f38cc0042a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:19.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.358+0000 7f38bbfff640 1 -- 10.20.193.28:0/4152717925 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f38cc02fe70 con 0x7f38d80b8bb0 2026-02-24T09:17:19.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.358+0000 7f38dffff640 1 -- 10.20.193.28:0/4152717925 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38d80b3e60 con 0x7f38d80b8bb0 2026-02-24T09:17:19.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.358+0000 7f38bbfff640 1 -- 10.20.193.28:0/4152717925 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f38cc038960 con 0x7f38d80b8bb0 2026-02-24T09:17:19.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.358+0000 7f38bbfff640 1 -- 10.20.193.28:0/4152717925 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f38cc02fe70 con 0x7f38d80b8bb0 2026-02-24T09:17:19.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.358+0000 7f38dffff640 1 -- 10.20.193.28:0/4152717925 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38d80b4450 con 0x7f38d80b8bb0 2026-02-24T09:17:19.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.359+0000 7f38dffff640 1 -- 10.20.193.28:0/4152717925 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38d80b8490 con 0x7f38d80b8bb0 2026-02-24T09:17:19.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.361+0000 7f38bbfff640 1 -- 10.20.193.28:0/4152717925 <== mon.2 v2:10.20.193.74:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f38cc03f070 con 0x7f38d80b8bb0 2026-02-24T09:17:19.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.362+0000 7f763effd640 1 -- 10.20.193.28:0/1028169789 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f764c006780 con 0x7f7650115440 2026-02-24T09:17:19.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.363+0000 7f38bbfff640 1 --2- 10.20.193.28:0/4152717925 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f38b40b5880 0x7f38b40d5d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:19.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.363+0000 7f38bbfff640 1 -- 10.20.193.28:0/4152717925 <== mon.2 v2:10.20.193.74:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f38cc10af40 con 0x7f38d80b8bb0 2026-02-24T09:17:19.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.364+0000 7f38bbfff640 1 -- 10.20.193.28:0/4152717925 <== mon.2 v2:10.20.193.74:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f38cc10b3c0 con 0x7f38d80b8bb0 2026-02-24T09:17:19.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.364+0000 7f38de7fc640 1 --2- 10.20.193.28:0/4152717925 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f38b40b5880 0x7f38b40d5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:19.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.364+0000 7f38de7fc640 1 --2- 10.20.193.28:0/4152717925 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f38b40b5880 0x7f38b40d5d30 secure :-1 s=READY pgs=187 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38d80b4370 tx=0x7f38d4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:19.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.364+0000 7f763effd640 1 --2- 10.20.193.28:0/1028169789 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f762c0b5910 0x7f762c0d5dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:19.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.364+0000 7f763effd640 1 -- 10.20.193.28:0/1028169789 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f764c015070 con 0x7f7650115440 2026-02-24T09:17:19.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.364+0000 7f7655f09640 1 --2- 10.20.193.28:0/1028169789 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f762c0b5910 0x7f762c0d5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:19.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.364+0000 7f763effd640 1 -- 10.20.193.28:0/1028169789 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f764c0e8360 con 0x7f7650115440 2026-02-24T09:17:19.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.365+0000 7f7655f09640 1 --2- 10.20.193.28:0/1028169789 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f762c0b5910 0x7f762c0d5dc0 secure :-1 s=READY pgs=188 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7640005c70 tx=0x7f7640005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:19.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:18 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/777730800' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-24T09:17:19.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:18 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/1628746378' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-24T09:17:19.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.390+0000 7f90fa58a640 1 -- 10.20.193.28:0/2555621017 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f90f410b1e0 msgr2=0x7f90f410bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.390+0000 7f90fa58a640 1 --2- 10.20.193.28:0/2555621017 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f90f410b1e0 0x7f90f410bcc0 secure :-1 s=READY pgs=100 gs=1 cs=0 l=1 c_cookie=10030710570659211942 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90e8009950 tx=0x7f90e802f1b0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.390+0000 7f90fa58a640 1 -- 10.20.193.28:0/2555621017 shutdown_connections 2026-02-24T09:17:19.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.391+0000 7f90fa58a640 1 --2- 10.20.193.28:0/2555621017 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90f4111450 0x7f90f41118d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.391+0000 7f90fa58a640 1 --2- 10.20.193.28:0/2555621017 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f90f410b640 0x7f90f410c200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.391+0000 7f90fa58a640 1 --2- 10.20.193.28:0/2555621017 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f90f410b1e0 0x7f90f410bcc0 unknown :-1 s=CLOSED pgs=100 gs=1 cs=0 l=1 c_cookie=10030710570659211942 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.391+0000 7f90fa58a640 1 -- 10.20.193.28:0/2555621017 >> 10.20.193.28:0/2555621017 conn(0x7f90f40e8e40 msgr2=0x7f90f4109250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:19.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.391+0000 7f90fa58a640 1 -- 10.20.193.28:0/2555621017 shutdown_connections 2026-02-24T09:17:19.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.391+0000 7f90fa58a640 1 -- 10.20.193.28:0/2555621017 wait complete. 2026-02-24T09:17:19.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.392+0000 7f90fa58a640 1 Processor -- start 2026-02-24T09:17:19.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.393+0000 7f90fa58a640 1 -- start start 2026-02-24T09:17:19.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.393+0000 7f90fa58a640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f90f410b1e0 0x7f90f40e9210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:19.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.394+0000 7f90fa58a640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f90f410b640 0x7f90f40e9750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:19.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.394+0000 7f90fa58a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90f4111450 0x7f90f40ee260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:19.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.394+0000 7f90f9d89640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90f4111450 0x7f90f40ee260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:19.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.394+0000 7f90f8d87640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f90f410b640 0x7f90f40e9750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:19.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.394+0000 7f90f8d87640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f90f410b640 0x7f90f40e9750 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:44088/0 (socket says 10.20.193.28:44088) 2026-02-24T09:17:19.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.394+0000 7f90f8d87640 1 -- 10.20.193.28:0/3108424276 learned_addr learned my addr 10.20.193.28:0/3108424276 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:19.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.395+0000 7f90f9588640 1 --2- 10.20.193.28:0/3108424276 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f90f410b1e0 0x7f90f40e9210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:19.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.395+0000 7f90fa58a640 1 -- 10.20.193.28:0/3108424276 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f90f40ea050 con 0x7f90f4111450 2026-02-24T09:17:19.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.395+0000 7f90fa58a640 1 -- 10.20.193.28:0/3108424276 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f90f40ee7a0 con 0x7f90f410b640 2026-02-24T09:17:19.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.395+0000 7f90fa58a640 1 -- 10.20.193.28:0/3108424276 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f90f40ee960 con 0x7f90f410b1e0 2026-02-24T09:17:19.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.396+0000 7f90f8d87640 1 -- 10.20.193.28:0/3108424276 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f90f410b1e0 msgr2=0x7f90f40e9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.396+0000 7f90f8d87640 1 --2- 10.20.193.28:0/3108424276 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f90f410b1e0 0x7f90f40e9210 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.396+0000 7f90f8d87640 1 -- 10.20.193.28:0/3108424276 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90f4111450 msgr2=0x7f90f40ee260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.396+0000 7f90f8d87640 1 --2- 10.20.193.28:0/3108424276 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90f4111450 0x7f90f40ee260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.396+0000 7f90f8d87640 1 -- 10.20.193.28:0/3108424276 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e8009570 con 0x7f90f410b640 2026-02-24T09:17:19.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.398+0000 7f90f9d89640 1 --2- 10.20.193.28:0/3108424276 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90f4111450 0x7f90f40ee260 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:19.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.398+0000 7f90f9588640 1 --2- 10.20.193.28:0/3108424276 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f90f410b1e0 0x7f90f40e9210 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:19.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.398+0000 7f90f8d87640 1 --2- 10.20.193.28:0/3108424276 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f90f410b640 0x7f90f40e9750 secure :-1 s=READY pgs=101 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90e400d950 tx=0x7f90e400de20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:19.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.399+0000 7f90e27fc640 1 -- 10.20.193.28:0/3108424276 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f90e4004540 con 0x7f90f410b640 2026-02-24T09:17:19.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.399+0000 7f90e27fc640 1 -- 10.20.193.28:0/3108424276 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f90e4009ce0 con 0x7f90f410b640 2026-02-24T09:17:19.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.399+0000 7f90e27fc640 1 -- 10.20.193.28:0/3108424276 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f90e40106e0 con 0x7f90f410b640 2026-02-24T09:17:19.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.399+0000 7f90fa58a640 1 -- 10.20.193.28:0/3108424276 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90f40eebe0 con 0x7f90f410b640 2026-02-24T09:17:19.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.399+0000 7f90fa58a640 1 -- 10.20.193.28:0/3108424276 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90f40ef060 con 0x7f90f410b640 2026-02-24T09:17:19.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.402+0000 7f90c3fff640 1 -- 10.20.193.28:0/3108424276 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90f410ccb0 con 0x7f90f410b640 2026-02-24T09:17:19.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.404+0000 7f90e27fc640 1 -- 10.20.193.28:0/3108424276 <== mon.2 v2:10.20.193.74:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f90e40097c0 con 0x7f90f410b640 2026-02-24T09:17:19.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.405+0000 7f90e27fc640 1 --2- 10.20.193.28:0/3108424276 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f90cc0b5840 0x7f90cc0d5cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:19.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.407+0000 7f90e27fc640 1 -- 10.20.193.28:0/3108424276 <== mon.2 v2:10.20.193.74:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f90e40e6fb0 con 0x7f90f410b640 2026-02-24T09:17:19.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.407+0000 7f90f9588640 1 --2- 10.20.193.28:0/3108424276 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f90cc0b5840 0x7f90cc0d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:19.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.407+0000 7f90f9588640 1 --2- 10.20.193.28:0/3108424276 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f90cc0b5840 0x7f90cc0d5cf0 secure :-1 s=READY pgs=189 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90e80098a0 tx=0x7f90e8031040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:19.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.407+0000 7f90e27fc640 1 -- 10.20.193.28:0/3108424276 <== mon.2 v2:10.20.193.74:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f90e40a9840 con 0x7f90f410b640 2026-02-24T09:17:19.431 INFO:tasks.cephadm.ceph_manager.ceph:need seq 227633266711 got 227633266712 for osd.6 2026-02-24T09:17:19.431 DEBUG:teuthology.parallel:result is None 2026-02-24T09:17:19.478 INFO:tasks.cephadm.ceph_manager.ceph:need seq 94489280546 got 94489280546 for osd.2 2026-02-24T09:17:19.478 DEBUG:teuthology.parallel:result is None 2026-02-24T09:17:19.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.495+0000 7f7656f0b640 1 -- 10.20.193.28:0/1028169789 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f765010f620 con 0x7f7650115440 2026-02-24T09:17:19.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.495+0000 7f763effd640 1 -- 10.20.193.28:0/1028169789 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f764c0aa900 con 0x7f7650115440 2026-02-24T09:17:19.497 INFO:teuthology.orchestra.run.trial028.stdout:373662154762 2026-02-24T09:17:19.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.497+0000 7f38dffff640 1 -- 10.20.193.28:0/4152717925 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f38d80aeb30 con 0x7f38d80b8bb0 2026-02-24T09:17:19.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.497+0000 7f38bbfff640 1 -- 10.20.193.28:0/4152717925 <== mon.2 v2:10.20.193.74:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f38cc0cd8e0 con 0x7f38d80b8bb0 2026-02-24T09:17:19.499 INFO:teuthology.orchestra.run.trial028.stdout:249108103189 2026-02-24T09:17:19.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.497+0000 7f7656f0b640 1 -- 10.20.193.28:0/1028169789 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f762c0b5910 msgr2=0x7f762c0d5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.497+0000 7f7656f0b640 1 --2- 10.20.193.28:0/1028169789 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f762c0b5910 0x7f762c0d5dc0 secure :-1 s=READY pgs=188 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7640005c70 tx=0x7f7640005f90 comp rx=0 tx=0).stop 2026-02-24T09:17:19.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.498+0000 7f7656f0b640 1 -- 10.20.193.28:0/1028169789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7650115440 msgr2=0x7f765015ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.498+0000 7f7656f0b640 1 --2- 10.20.193.28:0/1028169789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7650115440 0x7f765015ad50 secure :-1 s=READY pgs=308 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f764c00f940 tx=0x7f764c00fe10 comp rx=0 tx=0).stop 2026-02-24T09:17:19.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.498+0000 7f7656f0b640 1 -- 10.20.193.28:0/1028169789 shutdown_connections 2026-02-24T09:17:19.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.498+0000 7f7656f0b640 1 --2- 10.20.193.28:0/1028169789 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f762c0b5910 0x7f762c0d5dc0 unknown :-1 s=CLOSED pgs=188 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.498+0000 7f7656f0b640 1 --2- 10.20.193.28:0/1028169789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7650115440 0x7f765015ad50 unknown :-1 s=CLOSED pgs=308 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.498+0000 7f7656f0b640 1 --2- 10.20.193.28:0/1028169789 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f765010fc40 0x7f76501163c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.498+0000 7f7656f0b640 1 --2- 10.20.193.28:0/1028169789 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f765010f250 0x7f7650115e80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.498+0000 7f7656f0b640 1 -- 10.20.193.28:0/1028169789 >> 10.20.193.28:0/1028169789 conn(0x7f76500ecb40 msgr2=0x7f765010cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:19.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.499+0000 7f7656f0b640 1 -- 10.20.193.28:0/1028169789 shutdown_connections 2026-02-24T09:17:19.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.499+0000 7f7656f0b640 1 -- 10.20.193.28:0/1028169789 wait complete. 2026-02-24T09:17:19.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.501+0000 7f38dffff640 1 -- 10.20.193.28:0/4152717925 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f38b40b5880 msgr2=0x7f38b40d5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.501+0000 7f38dffff640 1 --2- 10.20.193.28:0/4152717925 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f38b40b5880 0x7f38b40d5d30 secure :-1 s=READY pgs=187 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38d80b4370 tx=0x7f38d4005f90 comp rx=0 tx=0).stop 2026-02-24T09:17:19.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.501+0000 7f38dffff640 1 -- 10.20.193.28:0/4152717925 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f38d80b8bb0 msgr2=0x7f38d80ad9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.501+0000 7f38dffff640 1 --2- 10.20.193.28:0/4152717925 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f38d80b8bb0 0x7f38d80ad9d0 secure :-1 s=READY pgs=99 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38cc004270 tx=0x7f38cc0042a0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.501+0000 7f38dffff640 1 -- 10.20.193.28:0/4152717925 shutdown_connections 2026-02-24T09:17:19.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.501+0000 7f38dffff640 1 --2- 10.20.193.28:0/4152717925 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f38b40b5880 0x7f38b40d5d30 unknown :-1 s=CLOSED pgs=187 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.501+0000 7f38dffff640 1 --2- 10.20.193.28:0/4152717925 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38d80bd380 0x7f38d80b32e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.501+0000 7f38dffff640 1 --2- 10.20.193.28:0/4152717925 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f38d80b95a0 0x7f38d80adf10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.501+0000 7f38dffff640 1 --2- 10.20.193.28:0/4152717925 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f38d80b8bb0 0x7f38d80ad9d0 unknown :-1 s=CLOSED pgs=99 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.501+0000 7f38dffff640 1 -- 10.20.193.28:0/4152717925 >> 10.20.193.28:0/4152717925 conn(0x7f38d8094aa0 msgr2=0x7f38d80b5660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:19.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.501+0000 7f38dffff640 1 -- 10.20.193.28:0/4152717925 shutdown_connections 2026-02-24T09:17:19.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.502+0000 7f38dffff640 1 -- 10.20.193.28:0/4152717925 wait complete. 2026-02-24T09:17:19.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.509+0000 7f3767264640 1 -- 10.20.193.28:0/776516416 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3760114a10 msgr2=0x7f37601191f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.509+0000 7f3767264640 1 --2- 10.20.193.28:0/776516416 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3760114a10 0x7f37601191f0 secure :-1 s=READY pgs=101 gs=2 cs=0 l=1 c_cookie=18131671324213147016 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3754009890 tx=0x7f375402f160 comp rx=0 tx=0).stop 2026-02-24T09:17:19.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.509+0000 7f3767264640 1 -- 10.20.193.28:0/776516416 shutdown_connections 2026-02-24T09:17:19.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.509+0000 7f3767264640 1 --2- 10.20.193.28:0/776516416 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f37601199a0 0x7f376017a370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.509+0000 7f3767264640 1 --2- 10.20.193.28:0/776516416 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3760114a10 0x7f37601191f0 unknown :-1 s=CLOSED pgs=101 gs=2 cs=0 l=1 c_cookie=18131671324213147016 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.509+0000 7f3767264640 1 --2- 10.20.193.28:0/776516416 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3760114020 0x7f37601143f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.509+0000 7f3767264640 1 -- 10.20.193.28:0/776516416 >> 10.20.193.28:0/776516416 conn(0x7f3760064810 msgr2=0x7f3760064c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:19.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.510+0000 7f3767264640 1 -- 10.20.193.28:0/776516416 shutdown_connections 2026-02-24T09:17:19.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.510+0000 7f3767264640 1 -- 10.20.193.28:0/776516416 wait complete. 2026-02-24T09:17:19.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.511+0000 7f3767264640 1 Processor -- start 2026-02-24T09:17:19.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.511+0000 7f3767264640 1 -- start start 2026-02-24T09:17:19.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.511+0000 7f3767264640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3760114020 0x7f376011a3e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:19.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.511+0000 7f3767264640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3760114a10 0x7f376011a920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:19.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.511+0000 7f3767264640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f37601199a0 0x7f376015f2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:19.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.511+0000 7f3767264640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f376015f7f0 con 0x7f37601199a0 2026-02-24T09:17:19.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.511+0000 7f3767264640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f3760067640 con 0x7f3760114020 2026-02-24T09:17:19.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.511+0000 7f3767264640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3760067800 con 0x7f3760114a10 2026-02-24T09:17:19.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.512+0000 7f3765a61640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3760114a10 0x7f376011a920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:19.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.512+0000 7f3765a61640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3760114a10 0x7f376011a920 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:35146/0 (socket says 10.20.193.28:35146) 2026-02-24T09:17:19.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.512+0000 7f3765a61640 1 -- 10.20.193.28:0/3032623162 learned_addr learned my addr 10.20.193.28:0/3032623162 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:19.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.512+0000 7f3766a63640 1 --2- 10.20.193.28:0/3032623162 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f37601199a0 0x7f376015f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:19.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.512+0000 7f3766a63640 1 -- 10.20.193.28:0/3032623162 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3760114a10 msgr2=0x7f376011a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.512+0000 7f3766a63640 1 --2- 10.20.193.28:0/3032623162 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3760114a10 0x7f376011a920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.512+0000 7f3766a63640 1 -- 10.20.193.28:0/3032623162 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3760114020 msgr2=0x7f376011a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.512+0000 7f3766a63640 1 --2- 10.20.193.28:0/3032623162 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3760114020 0x7f376011a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.512+0000 7f3766a63640 1 -- 10.20.193.28:0/3032623162 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3750009570 con 0x7f37601199a0 2026-02-24T09:17:19.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.513+0000 7f3766a63640 1 --2- 10.20.193.28:0/3032623162 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f37601199a0 0x7f376015f2b0 secure :-1 s=READY pgs=309 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f375c00e720 tx=0x7f375c00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:19.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.514+0000 7f37477fe640 1 -- 10.20.193.28:0/3032623162 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f375c005500 con 0x7f37601199a0 2026-02-24T09:17:19.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.514+0000 7f3767264640 1 -- 10.20.193.28:0/3032623162 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37540094b0 con 0x7f37601199a0 2026-02-24T09:17:19.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.514+0000 7f3767264640 1 -- 10.20.193.28:0/3032623162 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3760067e20 con 0x7f37601199a0 2026-02-24T09:17:19.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.514+0000 7f37477fe640 1 -- 10.20.193.28:0/3032623162 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f375c005660 con 0x7f37601199a0 2026-02-24T09:17:19.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.514+0000 7f37477fe640 1 -- 10.20.193.28:0/3032623162 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f375c011460 con 0x7f37601199a0 2026-02-24T09:17:19.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.515+0000 7f3767264640 1 -- 10.20.193.28:0/3032623162 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3728005300 con 0x7f37601199a0 2026-02-24T09:17:19.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.520+0000 7f37477fe640 1 -- 10.20.193.28:0/3032623162 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f375c00c7e0 con 0x7f37601199a0 2026-02-24T09:17:19.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.525+0000 7f37477fe640 1 --2- 10.20.193.28:0/3032623162 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f373c0b58b0 0x7f373c0d5d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:19.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.525+0000 7f37477fe640 1 -- 10.20.193.28:0/3032623162 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f375c0e7cd0 con 0x7f37601199a0 2026-02-24T09:17:19.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.525+0000 7f37477fe640 1 -- 10.20.193.28:0/3032623162 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f375c0ec260 con 0x7f37601199a0 2026-02-24T09:17:19.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.525+0000 7f3766262640 1 --2- 10.20.193.28:0/3032623162 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f373c0b58b0 0x7f373c0d5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:19.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.526+0000 7f3766262640 1 --2- 10.20.193.28:0/3032623162 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f373c0b58b0 0x7f373c0d5d60 secure :-1 s=READY pgs=190 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3750005b30 tx=0x7f37500040b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:19.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.532+0000 7f90c3fff640 1 -- 10.20.193.28:0/3108424276 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f90f405fc10 con 0x7f90f410b640 2026-02-24T09:17:19.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.532+0000 7f90e27fc640 1 -- 10.20.193.28:0/3108424276 <== mon.2 v2:10.20.193.74:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f90e40ac9f0 con 0x7f90f410b640 2026-02-24T09:17:19.540 INFO:teuthology.orchestra.run.trial028.stdout:283467841554 2026-02-24T09:17:19.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.539+0000 7f90c3fff640 1 -- 10.20.193.28:0/3108424276 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f90cc0b5840 msgr2=0x7f90cc0d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.539+0000 7f90c3fff640 1 --2- 10.20.193.28:0/3108424276 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f90cc0b5840 0x7f90cc0d5cf0 secure :-1 s=READY pgs=189 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90e80098a0 tx=0x7f90e8031040 comp rx=0 tx=0).stop 2026-02-24T09:17:19.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.539+0000 7f90c3fff640 1 -- 10.20.193.28:0/3108424276 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f90f410b640 msgr2=0x7f90f40e9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.539+0000 7f90c3fff640 1 --2- 10.20.193.28:0/3108424276 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f90f410b640 0x7f90f40e9750 secure :-1 s=READY pgs=101 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90e400d950 tx=0x7f90e400de20 comp rx=0 tx=0).stop 2026-02-24T09:17:19.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.543+0000 7f90c3fff640 1 -- 10.20.193.28:0/3108424276 shutdown_connections 2026-02-24T09:17:19.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.543+0000 7f90c3fff640 1 --2- 10.20.193.28:0/3108424276 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f90cc0b5840 0x7f90cc0d5cf0 unknown :-1 s=CLOSED pgs=189 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.543+0000 7f90c3fff640 1 --2- 10.20.193.28:0/3108424276 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90f4111450 0x7f90f40ee260 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.543+0000 7f90c3fff640 1 --2- 10.20.193.28:0/3108424276 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f90f410b640 0x7f90f40e9750 unknown :-1 s=CLOSED pgs=101 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.543+0000 7f90c3fff640 1 --2- 10.20.193.28:0/3108424276 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f90f410b1e0 0x7f90f40e9210 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.543+0000 7f90c3fff640 1 -- 10.20.193.28:0/3108424276 >> 10.20.193.28:0/3108424276 conn(0x7f90f40e8e40 msgr2=0x7f90f410f300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:19.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.544+0000 7f90c3fff640 1 -- 10.20.193.28:0/3108424276 shutdown_connections 2026-02-24T09:17:19.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.544+0000 7f90c3fff640 1 -- 10.20.193.28:0/3108424276 wait complete. 2026-02-24T09:17:19.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.571+0000 7f85907e4640 1 -- 10.20.193.28:0/116962405 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f858000f880 msgr2=0x7f85800c10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.571+0000 7f85907e4640 1 --2- 10.20.193.28:0/116962405 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f858000f880 0x7f85800c10b0 secure :-1 s=READY pgs=102 gs=1 cs=0 l=1 c_cookie=10887146303508211253 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f857c009890 tx=0x7f857c02f120 comp rx=0 tx=0).stop 2026-02-24T09:17:19.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.572+0000 7f85907e4640 1 -- 10.20.193.28:0/116962405 shutdown_connections 2026-02-24T09:17:19.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.572+0000 7f85907e4640 1 --2- 10.20.193.28:0/116962405 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85800c1860 0x7f8580122230 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.572+0000 7f85907e4640 1 --2- 10.20.193.28:0/116962405 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f858000f880 0x7f85800c10b0 unknown :-1 s=CLOSED pgs=102 gs=1 cs=0 l=1 c_cookie=10887146303508211253 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.572+0000 7f85907e4640 1 --2- 10.20.193.28:0/116962405 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f858000ee90 0x7f858000f260 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.572+0000 7f85907e4640 1 -- 10.20.193.28:0/116962405 >> 10.20.193.28:0/116962405 conn(0x7f858000c770 msgr2=0x7f858000cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:19.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.572+0000 7f85907e4640 1 -- 10.20.193.28:0/116962405 shutdown_connections 2026-02-24T09:17:19.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.572+0000 7f85907e4640 1 -- 10.20.193.28:0/116962405 wait complete. 2026-02-24T09:17:19.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.573+0000 7f85907e4640 1 Processor -- start 2026-02-24T09:17:19.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.573+0000 7f85907e4640 1 -- start start 2026-02-24T09:17:19.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.574+0000 7f85907e4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f858000ee90 0x7f8580018460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:19.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.574+0000 7f85907e4640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f858000f880 0x7f8580122130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:19.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.574+0000 7f85907e4640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f85800c1860 0x7f85800166f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:19.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.574+0000 7f85907e4640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8580016cf0 con 0x7f858000ee90 2026-02-24T09:17:19.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.574+0000 7f858e559640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f858000ee90 0x7f8580018460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:19.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.574+0000 7f85907e4640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f8580016e60 con 0x7f858000f880 2026-02-24T09:17:19.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.574+0000 7f85907e4640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8580017020 con 0x7f85800c1860 2026-02-24T09:17:19.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.574+0000 7f858e559640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f858000ee90 0x7f8580018460 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40308/0 (socket says 10.20.193.28:40308) 2026-02-24T09:17:19.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.574+0000 7f858e559640 1 -- 10.20.193.28:0/292608522 learned_addr learned my addr 10.20.193.28:0/292608522 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:19.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.574+0000 7f858dd58640 1 --2- 10.20.193.28:0/292608522 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f858000f880 0x7f8580122130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:19.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.574+0000 7f858e559640 1 -- 10.20.193.28:0/292608522 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f85800c1860 msgr2=0x7f85800166f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.574+0000 7f858e559640 1 --2- 10.20.193.28:0/292608522 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f85800c1860 0x7f85800166f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.574+0000 7f858e559640 1 -- 10.20.193.28:0/292608522 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f858000f880 msgr2=0x7f8580122130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.574+0000 7f858e559640 1 --2- 10.20.193.28:0/292608522 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f858000f880 0x7f8580122130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.574+0000 7f858e559640 1 -- 10.20.193.28:0/292608522 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8578009570 con 0x7f858000ee90 2026-02-24T09:17:19.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.574+0000 7f858e559640 1 --2- 10.20.193.28:0/292608522 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f858000ee90 0x7f8580018460 secure :-1 s=READY pgs=310 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8578005b30 tx=0x7f8578002c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:19.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.574+0000 7f856f7fe640 1 -- 10.20.193.28:0/292608522 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f857800ed60 con 0x7f858000ee90 2026-02-24T09:17:19.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.574+0000 7f856f7fe640 1 -- 10.20.193.28:0/292608522 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8578002e70 con 0x7f858000ee90 2026-02-24T09:17:19.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.574+0000 7f856f7fe640 1 -- 10.20.193.28:0/292608522 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f857800ed60 con 0x7f858000ee90 2026-02-24T09:17:19.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.574+0000 7f85907e4640 1 -- 10.20.193.28:0/292608522 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f858400a590 con 0x7f858000ee90 2026-02-24T09:17:19.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.574+0000 7f85907e4640 1 -- 10.20.193.28:0/292608522 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f857c0094b0 con 0x7f858000ee90 2026-02-24T09:17:19.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.579+0000 7f856f7fe640 1 -- 10.20.193.28:0/292608522 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f8578016070 con 0x7f858000ee90 2026-02-24T09:17:19.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.579+0000 7f85907e4640 1 -- 10.20.193.28:0/292608522 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8550005300 con 0x7f858000ee90 2026-02-24T09:17:19.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.579+0000 7f856f7fe640 1 --2- 10.20.193.28:0/292608522 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f85640b58a0 0x7f85640d5d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:19.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.583+0000 7f856f7fe640 1 -- 10.20.193.28:0/292608522 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f85780e6e10 con 0x7f858000ee90 2026-02-24T09:17:19.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.583+0000 7f858dd58640 1 --2- 10.20.193.28:0/292608522 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f85640b58a0 0x7f85640d5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:19.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.583+0000 7f856f7fe640 1 -- 10.20.193.28:0/292608522 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f85780a96a0 con 0x7f858000ee90 2026-02-24T09:17:19.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.583+0000 7f858dd58640 1 --2- 10.20.193.28:0/292608522 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f85640b58a0 0x7f85640d5d50 secure :-1 s=READY pgs=191 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85800181e0 tx=0x7f857c03a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:19.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.584+0000 7fc4e3577640 1 -- 10.20.193.28:0/2959013454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4e4114880 msgr2=0x7fc4e4114c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.584+0000 7fc4e3577640 1 --2- 10.20.193.28:0/2959013454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4e4114880 0x7fc4e4114c50 secure :-1 s=READY pgs=311 gs=1 cs=0 l=1 c_cookie=6785039284614043135 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4cc00aa80 tx=0x7fc4cc0302d0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.588+0000 7fc4e3577640 1 -- 10.20.193.28:0/2959013454 shutdown_connections 2026-02-24T09:17:19.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.588+0000 7fc4e3577640 1 --2- 10.20.193.28:0/2959013454 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc4e4116f70 0x7fc4e417abb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.588+0000 7fc4e3577640 1 --2- 10.20.193.28:0/2959013454 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc4e4115270 0x7fc4e41167f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.588+0000 7fc4e3577640 1 --2- 10.20.193.28:0/2959013454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4e4114880 0x7fc4e4114c50 unknown :-1 s=CLOSED pgs=311 gs=1 cs=0 l=1 c_cookie=6785039284614043135 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.588+0000 7fc4e3577640 1 -- 10.20.193.28:0/2959013454 >> 10.20.193.28:0/2959013454 conn(0x7fc4e4057af0 msgr2=0x7fc4e4057ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:19.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.588+0000 7fc4e3577640 1 -- 10.20.193.28:0/2959013454 shutdown_connections 2026-02-24T09:17:19.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.588+0000 7fc4e3577640 1 -- 10.20.193.28:0/2959013454 wait complete. 2026-02-24T09:17:19.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.588+0000 7fc4e3577640 1 Processor -- start 2026-02-24T09:17:19.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.591+0000 7fc4e3577640 1 -- start start 2026-02-24T09:17:19.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.591+0000 7fc4e3577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4e4114880 0x7fc4e418b9e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:19.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.591+0000 7fc4e2575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4e4114880 0x7fc4e418b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:19.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.591+0000 7fc4e3577640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc4e4115270 0x7fc4e417ab20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:19.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.591+0000 7fc4e3577640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc4e4116f70 0x7fc4e418c1a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:19.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.591+0000 7fc4e1d74640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc4e4115270 0x7fc4e417ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:19.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.591+0000 7fc4e3577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e4185dd0 con 0x7fc4e4114880 2026-02-24T09:17:19.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.591+0000 7fc4e2575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4e4114880 0x7fc4e418b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40328/0 (socket says 10.20.193.28:40328) 2026-02-24T09:17:19.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.591+0000 7fc4e2575640 1 -- 10.20.193.28:0/4294690005 learned_addr learned my addr 10.20.193.28:0/4294690005 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:19.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.591+0000 7fc4e2d76640 1 --2- 10.20.193.28:0/4294690005 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc4e4116f70 0x7fc4e418c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:19.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.591+0000 7fc4e3577640 1 -- 10.20.193.28:0/4294690005 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e4185f40 con 0x7fc4e4115270 2026-02-24T09:17:19.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.591+0000 7fc4e3577640 1 -- 10.20.193.28:0/4294690005 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e4186100 con 0x7fc4e4116f70 2026-02-24T09:17:19.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.591+0000 7fc4e2d76640 1 -- 10.20.193.28:0/4294690005 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc4e4115270 msgr2=0x7fc4e417ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.591+0000 7fc4e2d76640 1 --2- 10.20.193.28:0/4294690005 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc4e4115270 0x7fc4e417ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.591+0000 7fc4e2d76640 1 -- 10.20.193.28:0/4294690005 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4e4114880 msgr2=0x7fc4e418b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.591+0000 7fc4e2d76640 1 --2- 10.20.193.28:0/4294690005 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4e4114880 0x7fc4e418b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.591+0000 7fc4e2d76640 1 -- 10.20.193.28:0/4294690005 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4cc00a650 con 0x7fc4e4116f70 2026-02-24T09:17:19.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.591+0000 7fc4e2575640 1 --2- 10.20.193.28:0/4294690005 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4e4114880 0x7fc4e418b9e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:17:19.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.596+0000 7fc4e2d76640 1 --2- 10.20.193.28:0/4294690005 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc4e4116f70 0x7fc4e418c1a0 secure :-1 s=READY pgs=103 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4dc00d720 tx=0x7fc4dc00dbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:19.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.596+0000 7fc4db7fe640 1 -- 10.20.193.28:0/4294690005 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc4dc0042f0 con 0x7fc4e4116f70 2026-02-24T09:17:19.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.596+0000 7fc4db7fe640 1 -- 10.20.193.28:0/4294690005 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc4dc004450 con 0x7fc4e4116f70 2026-02-24T09:17:19.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.596+0000 7fc4db7fe640 1 -- 10.20.193.28:0/4294690005 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc4dc005020 con 0x7fc4e4116f70 2026-02-24T09:17:19.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.596+0000 7fc4e3577640 1 -- 10.20.193.28:0/4294690005 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4e41863e0 con 0x7fc4e4116f70 2026-02-24T09:17:19.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.596+0000 7fc4e3577640 1 -- 10.20.193.28:0/4294690005 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4e4186860 con 0x7fc4e4116f70 2026-02-24T09:17:19.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.596+0000 7fc4e3577640 1 -- 10.20.193.28:0/4294690005 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4e405d010 con 0x7fc4e4116f70 2026-02-24T09:17:19.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.598+0000 7fc4db7fe640 1 -- 10.20.193.28:0/4294690005 <== mon.1 v2:10.20.193.159:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7fc4dc048a00 con 0x7fc4e4116f70 2026-02-24T09:17:19.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.606+0000 7fc4db7fe640 1 --2- 10.20.193.28:0/4294690005 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc4b40b5840 0x7fc4b40d5cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:19.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.606+0000 7fc4db7fe640 1 -- 10.20.193.28:0/4294690005 <== mon.1 v2:10.20.193.159:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7fc4dc0e6a50 con 0x7fc4e4116f70 2026-02-24T09:17:19.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.606+0000 7fc4db7fe640 1 -- 10.20.193.28:0/4294690005 <== mon.1 v2:10.20.193.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fc4dc11f930 con 0x7fc4e4116f70 2026-02-24T09:17:19.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.606+0000 7fc4e2575640 1 --2- 10.20.193.28:0/4294690005 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc4b40b5840 0x7fc4b40d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:19.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.606+0000 7fc4e2575640 1 --2- 10.20.193.28:0/4294690005 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc4b40b5840 0x7fc4b40d5cf0 secure :-1 s=READY pgs=192 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4cc00a230 tx=0x7fc4cc03b040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:19.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.662+0000 7f3767264640 1 -- 10.20.193.28:0/3032623162 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f37280055b0 con 0x7f37601199a0 2026-02-24T09:17:19.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.662+0000 7f37477fe640 1 -- 10.20.193.28:0/3032623162 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f375c0aa560 con 0x7f37601199a0 2026-02-24T09:17:19.664 INFO:teuthology.orchestra.run.trial028.stdout:317827579920 2026-02-24T09:17:19.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.665+0000 7f3767264640 1 -- 10.20.193.28:0/3032623162 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f373c0b58b0 msgr2=0x7f373c0d5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.665+0000 7f3767264640 1 --2- 10.20.193.28:0/3032623162 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f373c0b58b0 0x7f373c0d5d60 secure :-1 s=READY pgs=190 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3750005b30 tx=0x7f37500040b0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.665+0000 7f3767264640 1 -- 10.20.193.28:0/3032623162 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f37601199a0 msgr2=0x7f376015f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.665+0000 7f3767264640 1 --2- 10.20.193.28:0/3032623162 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f37601199a0 0x7f376015f2b0 secure :-1 s=READY pgs=309 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f375c00e720 tx=0x7f375c00ebf0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.666+0000 7f3767264640 1 -- 10.20.193.28:0/3032623162 shutdown_connections 2026-02-24T09:17:19.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.666+0000 7f3767264640 1 --2- 10.20.193.28:0/3032623162 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f373c0b58b0 0x7f373c0d5d60 unknown :-1 s=CLOSED pgs=190 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.666+0000 7f3767264640 1 --2- 10.20.193.28:0/3032623162 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f37601199a0 0x7f376015f2b0 unknown :-1 s=CLOSED pgs=309 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.666+0000 7f3767264640 1 --2- 10.20.193.28:0/3032623162 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3760114a10 0x7f376011a920 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.666+0000 7f3767264640 1 --2- 10.20.193.28:0/3032623162 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3760114020 0x7f376011a3e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.666+0000 7f3767264640 1 -- 10.20.193.28:0/3032623162 >> 10.20.193.28:0/3032623162 conn(0x7f3760064810 msgr2=0x7f3760065420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:19.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.668+0000 7f3767264640 1 -- 10.20.193.28:0/3032623162 shutdown_connections 2026-02-24T09:17:19.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.668+0000 7f3767264640 1 -- 10.20.193.28:0/3032623162 wait complete. 2026-02-24T09:17:19.696 INFO:tasks.cephadm.ceph_manager.ceph:need seq 373662154762 got 373662154762 for osd.11 2026-02-24T09:17:19.696 DEBUG:teuthology.parallel:result is None 2026-02-24T09:17:19.704 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841554 got 283467841554 for osd.8 2026-02-24T09:17:19.705 DEBUG:teuthology.parallel:result is None 2026-02-24T09:17:19.706 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103189 got 249108103189 for osd.7 2026-02-24T09:17:19.706 DEBUG:teuthology.parallel:result is None 2026-02-24T09:17:19.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.710+0000 7f85907e4640 1 -- 10.20.193.28:0/292608522 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f85500055b0 con 0x7f858000ee90 2026-02-24T09:17:19.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.711+0000 7f856f7fe640 1 -- 10.20.193.28:0/292608522 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f85780ac850 con 0x7f858000ee90 2026-02-24T09:17:19.713 INFO:teuthology.orchestra.run.trial028.stdout:193273528346 2026-02-24T09:17:19.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.713+0000 7f85907e4640 1 -- 10.20.193.28:0/292608522 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f85640b58a0 msgr2=0x7f85640d5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.713+0000 7f85907e4640 1 --2- 10.20.193.28:0/292608522 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f85640b58a0 0x7f85640d5d50 secure :-1 s=READY pgs=191 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85800181e0 tx=0x7f857c03a040 comp rx=0 tx=0).stop 2026-02-24T09:17:19.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.713+0000 7f85907e4640 1 -- 10.20.193.28:0/292608522 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f858000ee90 msgr2=0x7f8580018460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.713+0000 7f85907e4640 1 --2- 10.20.193.28:0/292608522 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f858000ee90 0x7f8580018460 secure :-1 s=READY pgs=310 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8578005b30 tx=0x7f8578002c10 comp rx=0 tx=0).stop 2026-02-24T09:17:19.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.714+0000 7f85907e4640 1 -- 10.20.193.28:0/292608522 shutdown_connections 2026-02-24T09:17:19.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.714+0000 7f85907e4640 1 --2- 10.20.193.28:0/292608522 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f85640b58a0 0x7f85640d5d50 unknown :-1 s=CLOSED pgs=191 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.714+0000 7f85907e4640 1 --2- 10.20.193.28:0/292608522 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f85800c1860 0x7f85800166f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.714+0000 7f85907e4640 1 --2- 10.20.193.28:0/292608522 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f858000f880 0x7f8580122130 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.714+0000 7f85907e4640 1 --2- 10.20.193.28:0/292608522 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f858000ee90 0x7f8580018460 unknown :-1 s=CLOSED pgs=310 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.714+0000 7f85907e4640 1 -- 10.20.193.28:0/292608522 >> 10.20.193.28:0/292608522 conn(0x7f858000c770 msgr2=0x7f85800bde70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:19.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.714+0000 7f85907e4640 1 -- 10.20.193.28:0/292608522 shutdown_connections 2026-02-24T09:17:19.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.714+0000 7f85907e4640 1 -- 10.20.193.28:0/292608522 wait complete. 2026-02-24T09:17:19.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.732+0000 7fc4e3577640 1 -- 10.20.193.28:0/4294690005 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc4e4186f30 con 0x7fc4e4116f70 2026-02-24T09:17:19.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.732+0000 7fc4db7fe640 1 -- 10.20.193.28:0/4294690005 <== mon.1 v2:10.20.193.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc4dc0a92e0 con 0x7fc4e4116f70 2026-02-24T09:17:19.735 INFO:teuthology.orchestra.run.trial028.stdout:42949673001 2026-02-24T09:17:19.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.735+0000 7fc4e3577640 1 -- 10.20.193.28:0/4294690005 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc4b40b5840 msgr2=0x7fc4b40d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.735+0000 7fc4e3577640 1 --2- 10.20.193.28:0/4294690005 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc4b40b5840 0x7fc4b40d5cf0 secure :-1 s=READY pgs=192 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4cc00a230 tx=0x7fc4cc03b040 comp rx=0 tx=0).stop 2026-02-24T09:17:19.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.735+0000 7fc4e3577640 1 -- 10.20.193.28:0/4294690005 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc4e4116f70 msgr2=0x7fc4e418c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:19.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.735+0000 7fc4e3577640 1 --2- 10.20.193.28:0/4294690005 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc4e4116f70 0x7fc4e418c1a0 secure :-1 s=READY pgs=103 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4dc00d720 tx=0x7fc4dc00dbf0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.735+0000 7fc4e3577640 1 -- 10.20.193.28:0/4294690005 shutdown_connections 2026-02-24T09:17:19.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.735+0000 7fc4e3577640 1 --2- 10.20.193.28:0/4294690005 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc4b40b5840 0x7fc4b40d5cf0 unknown :-1 s=CLOSED pgs=192 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.735+0000 7fc4e3577640 1 --2- 10.20.193.28:0/4294690005 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc4e4116f70 0x7fc4e418c1a0 unknown :-1 s=CLOSED pgs=103 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.735+0000 7fc4e3577640 1 --2- 10.20.193.28:0/4294690005 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc4e4115270 0x7fc4e417ab20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.735+0000 7fc4e3577640 1 --2- 10.20.193.28:0/4294690005 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4e4114880 0x7fc4e418b9e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:19.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.735+0000 7fc4e3577640 1 -- 10.20.193.28:0/4294690005 >> 10.20.193.28:0/4294690005 conn(0x7fc4e4057af0 msgr2=0x7fc4e4058ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:19.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.735+0000 7fc4e3577640 1 -- 10.20.193.28:0/4294690005 shutdown_connections 2026-02-24T09:17:19.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:19.735+0000 7fc4e3577640 1 -- 10.20.193.28:0/4294690005 wait complete. 2026-02-24T09:17:19.858 INFO:tasks.cephadm.ceph_manager.ceph:need seq 317827579920 got 317827579920 for osd.9 2026-02-24T09:17:19.859 DEBUG:teuthology.parallel:result is None 2026-02-24T09:17:19.865 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528346 got 193273528346 for osd.5 2026-02-24T09:17:19.866 DEBUG:teuthology.parallel:result is None 2026-02-24T09:17:19.914 INFO:tasks.cephadm.ceph_manager.ceph:need seq 42949673001 got 42949673001 for osd.0 2026-02-24T09:17:19.914 DEBUG:teuthology.parallel:result is None 2026-02-24T09:17:19.914 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-24T09:17:19.915 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T09:17:20.096 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:20.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:19 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/4211068098' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-24T09:17:20.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:19 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/3835380649' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-24T09:17:20.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:19 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/2622574809' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-24T09:17:20.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:19 trial028 ceph-mon[40371]: pgmap v190: 97 pgs: 97 active+clean; 637 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 8.8 KiB/s rd, 7.2 KiB/s wr, 13 op/s 2026-02-24T09:17:20.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:19 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/3109537156' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-24T09:17:20.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:19 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/1028169789' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-24T09:17:20.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:19 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/4152717925' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-24T09:17:20.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:19 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/3108424276' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-24T09:17:20.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:19 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/3032623162' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-24T09:17:20.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:19 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/292608522' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-24T09:17:20.112 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:19 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/4294690005' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-24T09:17:20.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.263+0000 7f9f53577640 1 -- 10.20.193.28:0/1599820212 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f541157f0 msgr2=0x7f9f541761c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:20.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.263+0000 7f9f53577640 1 --2- 10.20.193.28:0/1599820212 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f541157f0 0x7f9f541761c0 secure :-1 s=READY pgs=312 gs=1 cs=0 l=1 c_cookie=4793305038787325806 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f4400aa30 tx=0x7f9f44030270 comp rx=0 tx=0).stop 2026-02-24T09:17:20.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.263+0000 7f9f53577640 1 -- 10.20.193.28:0/1599820212 shutdown_connections 2026-02-24T09:17:20.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.263+0000 7f9f53577640 1 --2- 10.20.193.28:0/1599820212 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f541157f0 0x7f9f541761c0 unknown :-1 s=CLOSED pgs=312 gs=1 cs=0 l=1 c_cookie=4793305038787325806 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:20.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.263+0000 7f9f53577640 1 --2- 10.20.193.28:0/1599820212 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f9f5410fff0 0x7f9f54115040 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:20.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.263+0000 7f9f53577640 1 --2- 10.20.193.28:0/1599820212 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f9f5410f600 0x7f9f5410f9d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:20.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.263+0000 7f9f53577640 1 -- 10.20.193.28:0/1599820212 >> 10.20.193.28:0/1599820212 conn(0x7f9f540ecef0 msgr2=0x7f9f5410d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:20.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.263+0000 7f9f53577640 1 -- 10.20.193.28:0/1599820212 shutdown_connections 2026-02-24T09:17:20.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.263+0000 7f9f53577640 1 -- 10.20.193.28:0/1599820212 wait complete. 2026-02-24T09:17:20.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.264+0000 7f9f53577640 1 Processor -- start 2026-02-24T09:17:20.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.264+0000 7f9f53577640 1 -- start start 2026-02-24T09:17:20.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.264+0000 7f9f53577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f5410f600 0x7f9f5411df30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:20.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.264+0000 7f9f53577640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f9f5410fff0 0x7f9f5411e470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:20.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.264+0000 7f9f53577640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f9f541157f0 0x7f9f54123840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:20.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.264+0000 7f9f53577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9f54123e60 con 0x7f9f5410f600 2026-02-24T09:17:20.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.264+0000 7f9f53577640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f9f54123fd0 con 0x7f9f5410fff0 2026-02-24T09:17:20.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.264+0000 7f9f53577640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9f54124190 con 0x7f9f541157f0 2026-02-24T09:17:20.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.265+0000 7f9f52575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f5410f600 0x7f9f5411df30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:20.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.265+0000 7f9f52575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f5410f600 0x7f9f5411df30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40346/0 (socket says 10.20.193.28:40346) 2026-02-24T09:17:20.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.265+0000 7f9f52575640 1 -- 10.20.193.28:0/3235801454 learned_addr learned my addr 10.20.193.28:0/3235801454 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:20.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.265+0000 7f9f51d74640 1 --2- 10.20.193.28:0/3235801454 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f9f5410fff0 0x7f9f5411e470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:20.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.265+0000 7f9f52d76640 1 --2- 10.20.193.28:0/3235801454 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f9f541157f0 0x7f9f54123840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:20.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.265+0000 7f9f51d74640 1 -- 10.20.193.28:0/3235801454 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f9f541157f0 msgr2=0x7f9f54123840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:20.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.265+0000 7f9f51d74640 1 --2- 10.20.193.28:0/3235801454 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f9f541157f0 0x7f9f54123840 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:20.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.265+0000 7f9f51d74640 1 -- 10.20.193.28:0/3235801454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f5410f600 msgr2=0x7f9f5411df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:20.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.265+0000 7f9f51d74640 1 --2- 10.20.193.28:0/3235801454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f5410f600 0x7f9f5411df30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:20.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.265+0000 7f9f51d74640 1 -- 10.20.193.28:0/3235801454 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f4400a650 con 0x7f9f5410fff0 2026-02-24T09:17:20.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.265+0000 7f9f52575640 1 --2- 10.20.193.28:0/3235801454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f5410f600 0x7f9f5411df30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:17:20.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.265+0000 7f9f51d74640 1 --2- 10.20.193.28:0/3235801454 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f9f5410fff0 0x7f9f5411e470 secure :-1 s=READY pgs=102 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f3c00e9c0 tx=0x7f9f3c00ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:20.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.265+0000 7f9f3b7fe640 1 -- 10.20.193.28:0/3235801454 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f3c00ccb0 con 0x7f9f5410fff0 2026-02-24T09:17:20.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.265+0000 7f9f53577640 1 -- 10.20.193.28:0/3235801454 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f54124470 con 0x7f9f5410fff0 2026-02-24T09:17:20.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.265+0000 7f9f53577640 1 -- 10.20.193.28:0/3235801454 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f54164b70 con 0x7f9f5410fff0 2026-02-24T09:17:20.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.265+0000 7f9f3b7fe640 1 -- 10.20.193.28:0/3235801454 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f9f3c00ce10 con 0x7f9f5410fff0 2026-02-24T09:17:20.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.265+0000 7f9f3b7fe640 1 -- 10.20.193.28:0/3235801454 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f3c010430 con 0x7f9f5410fff0 2026-02-24T09:17:20.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.266+0000 7f9f53577640 1 -- 10.20.193.28:0/3235801454 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f541108e0 con 0x7f9f5410fff0 2026-02-24T09:17:20.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.269+0000 7f9f3b7fe640 1 -- 10.20.193.28:0/3235801454 <== mon.2 v2:10.20.193.74:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f9f3c01f060 con 0x7f9f5410fff0 2026-02-24T09:17:20.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.271+0000 7f9f3b7fe640 1 --2- 10.20.193.28:0/3235801454 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f9f2c0b5840 0x7f9f2c0d5cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:20.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.271+0000 7f9f3b7fe640 1 -- 10.20.193.28:0/3235801454 <== mon.2 v2:10.20.193.74:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f9f3c014070 con 0x7f9f5410fff0 2026-02-24T09:17:20.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.271+0000 7f9f52575640 1 --2- 10.20.193.28:0/3235801454 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f9f2c0b5840 0x7f9f2c0d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:20.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.271+0000 7f9f3b7fe640 1 -- 10.20.193.28:0/3235801454 <== mon.2 v2:10.20.193.74:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f9f3c11f930 con 0x7f9f5410fff0 2026-02-24T09:17:20.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.271+0000 7f9f52575640 1 --2- 10.20.193.28:0/3235801454 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f9f2c0b5840 0x7f9f2c0d5cf0 secure :-1 s=READY pgs=193 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f480095b0 tx=0x7f9f48005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:20.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:19 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/4211068098' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-24T09:17:20.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:19 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/3835380649' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-24T09:17:20.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:19 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/2622574809' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-24T09:17:20.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:19 trial159 ceph-mon[44242]: pgmap v190: 97 pgs: 97 active+clean; 637 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 8.8 KiB/s rd, 7.2 KiB/s wr, 13 op/s 2026-02-24T09:17:20.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:19 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/3109537156' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-24T09:17:20.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:19 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/1028169789' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-24T09:17:20.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:19 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/4152717925' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-24T09:17:20.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:19 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/3108424276' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-24T09:17:20.281 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:19 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/3032623162' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-24T09:17:20.281 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:19 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/292608522' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-24T09:17:20.281 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:19 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/4294690005' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-24T09:17:20.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:19 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/4211068098' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-24T09:17:20.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:19 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/3835380649' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-24T09:17:20.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:19 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/2622574809' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-24T09:17:20.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:19 trial074 ceph-mon[44412]: pgmap v190: 97 pgs: 97 active+clean; 637 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 8.8 KiB/s rd, 7.2 KiB/s wr, 13 op/s 2026-02-24T09:17:20.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:19 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/3109537156' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-24T09:17:20.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:19 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/1028169789' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-24T09:17:20.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:19 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/4152717925' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-24T09:17:20.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:19 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/3108424276' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-24T09:17:20.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:19 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/3032623162' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-24T09:17:20.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:19 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/292608522' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-24T09:17:20.375 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:19 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/4294690005' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-24T09:17:20.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.384+0000 7f9f53577640 1 -- 10.20.193.28:0/3235801454 --> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9f5411f090 con 0x7f9f2c0b5840 2026-02-24T09:17:20.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.387+0000 7f9f3b7fe640 1 -- 10.20.193.28:0/3235801454 <== mgr.14223 v2:10.20.193.28:6800/906910473 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258978 (secure 0 0 0) 0x7f9f5411f090 con 0x7f9f2c0b5840 2026-02-24T09:17:20.390 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:17:20.391 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-24T09:17:20.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.390+0000 7f9f53577640 1 -- 10.20.193.28:0/3235801454 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f9f2c0b5840 msgr2=0x7f9f2c0d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:20.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.390+0000 7f9f53577640 1 --2- 10.20.193.28:0/3235801454 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f9f2c0b5840 0x7f9f2c0d5cf0 secure :-1 s=READY pgs=193 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f480095b0 tx=0x7f9f48005f90 comp rx=0 tx=0).stop 2026-02-24T09:17:20.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.390+0000 7f9f53577640 1 -- 10.20.193.28:0/3235801454 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f9f5410fff0 msgr2=0x7f9f5411e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:20.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.390+0000 7f9f53577640 1 --2- 10.20.193.28:0/3235801454 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f9f5410fff0 0x7f9f5411e470 secure :-1 s=READY pgs=102 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f3c00e9c0 tx=0x7f9f3c00ee90 comp rx=0 tx=0).stop 2026-02-24T09:17:20.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.390+0000 7f9f53577640 1 -- 10.20.193.28:0/3235801454 shutdown_connections 2026-02-24T09:17:20.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.390+0000 7f9f53577640 1 --2- 10.20.193.28:0/3235801454 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f9f2c0b5840 0x7f9f2c0d5cf0 unknown :-1 s=CLOSED pgs=193 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:20.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.390+0000 7f9f53577640 1 --2- 10.20.193.28:0/3235801454 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f9f541157f0 0x7f9f54123840 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:20.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.390+0000 7f9f53577640 1 --2- 10.20.193.28:0/3235801454 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f9f5410fff0 0x7f9f5411e470 unknown :-1 s=CLOSED pgs=102 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:20.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.390+0000 7f9f53577640 1 --2- 10.20.193.28:0/3235801454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f5410f600 0x7f9f5411df30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:20.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.390+0000 7f9f53577640 1 -- 10.20.193.28:0/3235801454 >> 10.20.193.28:0/3235801454 conn(0x7f9f540ecef0 msgr2=0x7f9f5410d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:20.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.390+0000 7f9f53577640 1 -- 10.20.193.28:0/3235801454 shutdown_connections 2026-02-24T09:17:20.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.390+0000 7f9f53577640 1 -- 10.20.193.28:0/3235801454 wait complete. 2026-02-24T09:17:20.487 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2026-02-24T09:17:19.274495+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":652135,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":208,"num_read_kb":211,"num_write":347,"num_write_kb":3826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":288,"ondisk_log_size":288,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":338772,"kb_used_data":12132,"kb_used_omap":440,"kb_used_meta":325959,"kb_avail":8807699628,"statfs":{"total":9019431321600,"available":9019084419072,"internally_reserved":0,"allocated":12423168,"data_stored":7860849,"data_compressed":113508,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":451011,"internal_metadata":333782589},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":59067,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":87,"num_read_kb":106,"num_write":80,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002528"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376724+0000","last_change":"2026-02-24T09:17:00.245387+0000","last_active":"2026-02-24T09:17:01.376724+0000","last_peered":"2026-02-24T09:17:01.376724+0000","last_clean":"2026-02-24T09:17:01.376724+0000","last_became_active":"2026-02-24T09:17:00.244938+0000","last_became_peered":"2026-02-24T09:17:00.244938+0000","last_unstale":"2026-02-24T09:17:01.376724+0000","last_undegraded":"2026-02-24T09:17:01.376724+0000","last_fullsized":"2026-02-24T09:17:01.376724+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:35:29.390820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376072+0000","last_change":"2026-02-24T09:17:00.236200+0000","last_active":"2026-02-24T09:17:01.376072+0000","last_peered":"2026-02-24T09:17:01.376072+0000","last_clean":"2026-02-24T09:17:01.376072+0000","last_became_active":"2026-02-24T09:17:00.236029+0000","last_became_peered":"2026-02-24T09:17:00.236029+0000","last_unstale":"2026-02-24T09:17:01.376072+0000","last_undegraded":"2026-02-24T09:17:01.376072+0000","last_fullsized":"2026-02-24T09:17:01.376072+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:06:22.417660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376003+0000","last_change":"2026-02-24T09:17:00.241494+0000","last_active":"2026-02-24T09:17:01.376003+0000","last_peered":"2026-02-24T09:17:01.376003+0000","last_clean":"2026-02-24T09:17:01.376003+0000","last_became_active":"2026-02-24T09:17:00.241220+0000","last_became_peered":"2026-02-24T09:17:00.241220+0000","last_unstale":"2026-02-24T09:17:01.376003+0000","last_undegraded":"2026-02-24T09:17:01.376003+0000","last_fullsized":"2026-02-24T09:17:01.376003+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:34:35.363256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375459+0000","last_change":"2026-02-24T09:17:00.245544+0000","last_active":"2026-02-24T09:17:01.375459+0000","last_peered":"2026-02-24T09:17:01.375459+0000","last_clean":"2026-02-24T09:17:01.375459+0000","last_became_active":"2026-02-24T09:17:00.245316+0000","last_became_peered":"2026-02-24T09:17:00.245316+0000","last_unstale":"2026-02-24T09:17:01.375459+0000","last_undegraded":"2026-02-24T09:17:01.375459+0000","last_fullsized":"2026-02-24T09:17:01.375459+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:44:07.848623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376966+0000","last_change":"2026-02-24T09:17:00.242163+0000","last_active":"2026-02-24T09:17:01.376966+0000","last_peered":"2026-02-24T09:17:01.376966+0000","last_clean":"2026-02-24T09:17:01.376966+0000","last_became_active":"2026-02-24T09:17:00.240475+0000","last_became_peered":"2026-02-24T09:17:00.240475+0000","last_unstale":"2026-02-24T09:17:01.376966+0000","last_undegraded":"2026-02-24T09:17:01.376966+0000","last_fullsized":"2026-02-24T09:17:01.376966+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:08:01.801955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231522+0000","last_change":"2026-02-24T09:17:00.239730+0000","last_active":"2026-02-24T09:17:01.231522+0000","last_peered":"2026-02-24T09:17:01.231522+0000","last_clean":"2026-02-24T09:17:01.231522+0000","last_became_active":"2026-02-24T09:17:00.239571+0000","last_became_peered":"2026-02-24T09:17:00.239571+0000","last_unstale":"2026-02-24T09:17:01.231522+0000","last_undegraded":"2026-02-24T09:17:01.231522+0000","last_fullsized":"2026-02-24T09:17:01.231522+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:44:51.158834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.609629+0000","last_change":"2026-02-24T09:17:00.246826+0000","last_active":"2026-02-24T09:17:01.609629+0000","last_peered":"2026-02-24T09:17:01.609629+0000","last_clean":"2026-02-24T09:17:01.609629+0000","last_became_active":"2026-02-24T09:17:00.246078+0000","last_became_peered":"2026-02-24T09:17:00.246078+0000","last_unstale":"2026-02-24T09:17:01.609629+0000","last_undegraded":"2026-02-24T09:17:01.609629+0000","last_fullsized":"2026-02-24T09:17:01.609629+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:01:08.591060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231860+0000","last_change":"2026-02-24T09:17:00.242859+0000","last_active":"2026-02-24T09:17:01.231860+0000","last_peered":"2026-02-24T09:17:01.231860+0000","last_clean":"2026-02-24T09:17:01.231860+0000","last_became_active":"2026-02-24T09:17:00.242754+0000","last_became_peered":"2026-02-24T09:17:00.242754+0000","last_unstale":"2026-02-24T09:17:01.231860+0000","last_undegraded":"2026-02-24T09:17:01.231860+0000","last_fullsized":"2026-02-24T09:17:01.231860+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:12:54.422166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376465+0000","last_change":"2026-02-24T09:17:00.243145+0000","last_active":"2026-02-24T09:17:01.376465+0000","last_peered":"2026-02-24T09:17:01.376465+0000","last_clean":"2026-02-24T09:17:01.376465+0000","last_became_active":"2026-02-24T09:17:00.242545+0000","last_became_peered":"2026-02-24T09:17:00.242545+0000","last_unstale":"2026-02-24T09:17:01.376465+0000","last_undegraded":"2026-02-24T09:17:01.376465+0000","last_fullsized":"2026-02-24T09:17:01.376465+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:57:48.262867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232059+0000","last_change":"2026-02-24T09:17:00.238410+0000","last_active":"2026-02-24T09:17:01.232059+0000","last_peered":"2026-02-24T09:17:01.232059+0000","last_clean":"2026-02-24T09:17:01.232059+0000","last_became_active":"2026-02-24T09:17:00.238208+0000","last_became_peered":"2026-02-24T09:17:00.238208+0000","last_unstale":"2026-02-24T09:17:01.232059+0000","last_undegraded":"2026-02-24T09:17:01.232059+0000","last_fullsized":"2026-02-24T09:17:01.232059+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:24:40.244153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.609971+0000","last_change":"2026-02-24T09:17:00.240756+0000","last_active":"2026-02-24T09:17:01.609971+0000","last_peered":"2026-02-24T09:17:01.609971+0000","last_clean":"2026-02-24T09:17:01.609971+0000","last_became_active":"2026-02-24T09:17:00.240549+0000","last_became_peered":"2026-02-24T09:17:00.240549+0000","last_unstale":"2026-02-24T09:17:01.609971+0000","last_undegraded":"2026-02-24T09:17:01.609971+0000","last_fullsized":"2026-02-24T09:17:01.609971+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:22:59.840951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375576+0000","last_change":"2026-02-24T09:17:00.244972+0000","last_active":"2026-02-24T09:17:01.375576+0000","last_peered":"2026-02-24T09:17:01.375576+0000","last_clean":"2026-02-24T09:17:01.375576+0000","last_became_active":"2026-02-24T09:17:00.244802+0000","last_became_peered":"2026-02-24T09:17:00.244802+0000","last_unstale":"2026-02-24T09:17:01.375576+0000","last_undegraded":"2026-02-24T09:17:01.375576+0000","last_fullsized":"2026-02-24T09:17:01.375576+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:23:42.961356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232520+0000","last_change":"2026-02-24T09:17:00.242225+0000","last_active":"2026-02-24T09:17:01.232520+0000","last_peered":"2026-02-24T09:17:01.232520+0000","last_clean":"2026-02-24T09:17:01.232520+0000","last_became_active":"2026-02-24T09:17:00.242034+0000","last_became_peered":"2026-02-24T09:17:00.242034+0000","last_unstale":"2026-02-24T09:17:01.232520+0000","last_undegraded":"2026-02-24T09:17:01.232520+0000","last_fullsized":"2026-02-24T09:17:01.232520+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:48:52.291960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375757+0000","last_change":"2026-02-24T09:17:00.236623+0000","last_active":"2026-02-24T09:17:01.375757+0000","last_peered":"2026-02-24T09:17:01.375757+0000","last_clean":"2026-02-24T09:17:01.375757+0000","last_became_active":"2026-02-24T09:17:00.236483+0000","last_became_peered":"2026-02-24T09:17:00.236483+0000","last_unstale":"2026-02-24T09:17:01.375757+0000","last_undegraded":"2026-02-24T09:17:01.375757+0000","last_fullsized":"2026-02-24T09:17:01.375757+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:39:38.003280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375602+0000","last_change":"2026-02-24T09:17:00.244527+0000","last_active":"2026-02-24T09:17:01.375602+0000","last_peered":"2026-02-24T09:17:01.375602+0000","last_clean":"2026-02-24T09:17:01.375602+0000","last_became_active":"2026-02-24T09:17:00.244187+0000","last_became_peered":"2026-02-24T09:17:00.244187+0000","last_unstale":"2026-02-24T09:17:01.375602+0000","last_undegraded":"2026-02-24T09:17:01.375602+0000","last_fullsized":"2026-02-24T09:17:01.375602+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:47:15.468911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375307+0000","last_change":"2026-02-24T09:17:00.243775+0000","last_active":"2026-02-24T09:17:01.375307+0000","last_peered":"2026-02-24T09:17:01.375307+0000","last_clean":"2026-02-24T09:17:01.375307+0000","last_became_active":"2026-02-24T09:17:00.243686+0000","last_became_peered":"2026-02-24T09:17:00.243686+0000","last_unstale":"2026-02-24T09:17:01.375307+0000","last_undegraded":"2026-02-24T09:17:01.375307+0000","last_fullsized":"2026-02-24T09:17:01.375307+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:54:25.237747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376808+0000","last_change":"2026-02-24T09:17:00.245658+0000","last_active":"2026-02-24T09:17:01.376808+0000","last_peered":"2026-02-24T09:17:01.376808+0000","last_clean":"2026-02-24T09:17:01.376808+0000","last_became_active":"2026-02-24T09:17:00.245551+0000","last_became_peered":"2026-02-24T09:17:00.245551+0000","last_unstale":"2026-02-24T09:17:01.376808+0000","last_undegraded":"2026-02-24T09:17:01.376808+0000","last_fullsized":"2026-02-24T09:17:01.376808+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:06:32.658730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376015+0000","last_change":"2026-02-24T09:17:00.241047+0000","last_active":"2026-02-24T09:17:01.376015+0000","last_peered":"2026-02-24T09:17:01.376015+0000","last_clean":"2026-02-24T09:17:01.376015+0000","last_became_active":"2026-02-24T09:17:00.240844+0000","last_became_peered":"2026-02-24T09:17:00.240844+0000","last_unstale":"2026-02-24T09:17:01.376015+0000","last_undegraded":"2026-02-24T09:17:01.376015+0000","last_fullsized":"2026-02-24T09:17:01.376015+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:50:07.221768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.233566+0000","last_change":"2026-02-24T09:17:00.240922+0000","last_active":"2026-02-24T09:17:01.233566+0000","last_peered":"2026-02-24T09:17:01.233566+0000","last_clean":"2026-02-24T09:17:01.233566+0000","last_became_active":"2026-02-24T09:17:00.240548+0000","last_became_peered":"2026-02-24T09:17:00.240548+0000","last_unstale":"2026-02-24T09:17:01.233566+0000","last_undegraded":"2026-02-24T09:17:01.233566+0000","last_fullsized":"2026-02-24T09:17:01.233566+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:30:44.534419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376664+0000","last_change":"2026-02-24T09:17:00.247308+0000","last_active":"2026-02-24T09:17:01.376664+0000","last_peered":"2026-02-24T09:17:01.376664+0000","last_clean":"2026-02-24T09:17:01.376664+0000","last_became_active":"2026-02-24T09:17:00.247135+0000","last_became_peered":"2026-02-24T09:17:00.247135+0000","last_unstale":"2026-02-24T09:17:01.376664+0000","last_undegraded":"2026-02-24T09:17:01.376664+0000","last_fullsized":"2026-02-24T09:17:01.376664+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:05:05.273336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232010+0000","last_change":"2026-02-24T09:17:00.242127+0000","last_active":"2026-02-24T09:17:01.232010+0000","last_peered":"2026-02-24T09:17:01.232010+0000","last_clean":"2026-02-24T09:17:01.232010+0000","last_became_active":"2026-02-24T09:17:00.241873+0000","last_became_peered":"2026-02-24T09:17:00.241873+0000","last_unstale":"2026-02-24T09:17:01.232010+0000","last_undegraded":"2026-02-24T09:17:01.232010+0000","last_fullsized":"2026-02-24T09:17:01.232010+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:36:44.961821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376289+0000","last_change":"2026-02-24T09:17:00.242993+0000","last_active":"2026-02-24T09:17:01.376289+0000","last_peered":"2026-02-24T09:17:01.376289+0000","last_clean":"2026-02-24T09:17:01.376289+0000","last_became_active":"2026-02-24T09:17:00.242422+0000","last_became_peered":"2026-02-24T09:17:00.242422+0000","last_unstale":"2026-02-24T09:17:01.376289+0000","last_undegraded":"2026-02-24T09:17:01.376289+0000","last_fullsized":"2026-02-24T09:17:01.376289+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:26:02.228158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231856+0000","last_change":"2026-02-24T09:17:00.238357+0000","last_active":"2026-02-24T09:17:01.231856+0000","last_peered":"2026-02-24T09:17:01.231856+0000","last_clean":"2026-02-24T09:17:01.231856+0000","last_became_active":"2026-02-24T09:17:00.236985+0000","last_became_peered":"2026-02-24T09:17:00.236985+0000","last_unstale":"2026-02-24T09:17:01.231856+0000","last_undegraded":"2026-02-24T09:17:01.231856+0000","last_fullsized":"2026-02-24T09:17:01.231856+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:21:51.769646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.377634+0000","last_change":"2026-02-24T09:17:00.242262+0000","last_active":"2026-02-24T09:17:01.377634+0000","last_peered":"2026-02-24T09:17:01.377634+0000","last_clean":"2026-02-24T09:17:01.377634+0000","last_became_active":"2026-02-24T09:17:00.240949+0000","last_became_peered":"2026-02-24T09:17:00.240949+0000","last_unstale":"2026-02-24T09:17:01.377634+0000","last_undegraded":"2026-02-24T09:17:01.377634+0000","last_fullsized":"2026-02-24T09:17:01.377634+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:58:56.715059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232175+0000","last_change":"2026-02-24T09:17:00.245461+0000","last_active":"2026-02-24T09:17:01.232175+0000","last_peered":"2026-02-24T09:17:01.232175+0000","last_clean":"2026-02-24T09:17:01.232175+0000","last_became_active":"2026-02-24T09:17:00.245379+0000","last_became_peered":"2026-02-24T09:17:00.245379+0000","last_unstale":"2026-02-24T09:17:01.232175+0000","last_undegraded":"2026-02-24T09:17:01.232175+0000","last_fullsized":"2026-02-24T09:17:01.232175+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:15:17.150043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.233635+0000","last_change":"2026-02-24T09:17:00.241481+0000","last_active":"2026-02-24T09:17:01.233635+0000","last_peered":"2026-02-24T09:17:01.233635+0000","last_clean":"2026-02-24T09:17:01.233635+0000","last_became_active":"2026-02-24T09:17:00.241338+0000","last_became_peered":"2026-02-24T09:17:00.241338+0000","last_unstale":"2026-02-24T09:17:01.233635+0000","last_undegraded":"2026-02-24T09:17:01.233635+0000","last_fullsized":"2026-02-24T09:17:01.233635+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:15:11.802265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376636+0000","last_change":"2026-02-24T09:17:00.244368+0000","last_active":"2026-02-24T09:17:01.376636+0000","last_peered":"2026-02-24T09:17:01.376636+0000","last_clean":"2026-02-24T09:17:01.376636+0000","last_became_active":"2026-02-24T09:17:00.244266+0000","last_became_peered":"2026-02-24T09:17:00.244266+0000","last_unstale":"2026-02-24T09:17:01.376636+0000","last_undegraded":"2026-02-24T09:17:01.376636+0000","last_fullsized":"2026-02-24T09:17:01.376636+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:53:30.615320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232157+0000","last_change":"2026-02-24T09:17:00.246040+0000","last_active":"2026-02-24T09:17:01.232157+0000","last_peered":"2026-02-24T09:17:01.232157+0000","last_clean":"2026-02-24T09:17:01.232157+0000","last_became_active":"2026-02-24T09:17:00.245960+0000","last_became_peered":"2026-02-24T09:17:00.245960+0000","last_unstale":"2026-02-24T09:17:01.232157+0000","last_undegraded":"2026-02-24T09:17:01.232157+0000","last_fullsized":"2026-02-24T09:17:01.232157+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:40:44.935311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375704+0000","last_change":"2026-02-24T09:17:00.237870+0000","last_active":"2026-02-24T09:17:01.375704+0000","last_peered":"2026-02-24T09:17:01.375704+0000","last_clean":"2026-02-24T09:17:01.375704+0000","last_became_active":"2026-02-24T09:17:00.237745+0000","last_became_peered":"2026-02-24T09:17:00.237745+0000","last_unstale":"2026-02-24T09:17:01.375704+0000","last_undegraded":"2026-02-24T09:17:01.375704+0000","last_fullsized":"2026-02-24T09:17:01.375704+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:46:16.173715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.233458+0000","last_change":"2026-02-24T09:17:00.242559+0000","last_active":"2026-02-24T09:17:01.233458+0000","last_peered":"2026-02-24T09:17:01.233458+0000","last_clean":"2026-02-24T09:17:01.233458+0000","last_became_active":"2026-02-24T09:17:00.242457+0000","last_became_peered":"2026-02-24T09:17:00.242457+0000","last_unstale":"2026-02-24T09:17:01.233458+0000","last_undegraded":"2026-02-24T09:17:01.233458+0000","last_fullsized":"2026-02-24T09:17:01.233458+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:20:59.258363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.233170+0000","last_change":"2026-02-24T09:17:00.245177+0000","last_active":"2026-02-24T09:17:01.233170+0000","last_peered":"2026-02-24T09:17:01.233170+0000","last_clean":"2026-02-24T09:17:01.233170+0000","last_became_active":"2026-02-24T09:17:00.245074+0000","last_became_peered":"2026-02-24T09:17:00.245074+0000","last_unstale":"2026-02-24T09:17:01.233170+0000","last_undegraded":"2026-02-24T09:17:01.233170+0000","last_fullsized":"2026-02-24T09:17:01.233170+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:10:45.134678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376730+0000","last_change":"2026-02-24T09:17:00.242875+0000","last_active":"2026-02-24T09:17:01.376730+0000","last_peered":"2026-02-24T09:17:01.376730+0000","last_clean":"2026-02-24T09:17:01.376730+0000","last_became_active":"2026-02-24T09:17:00.242769+0000","last_became_peered":"2026-02-24T09:17:00.242769+0000","last_unstale":"2026-02-24T09:17:01.376730+0000","last_undegraded":"2026-02-24T09:17:01.376730+0000","last_fullsized":"2026-02-24T09:17:01.376730+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:38:25.732620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376955+0000","last_change":"2026-02-24T09:17:00.244244+0000","last_active":"2026-02-24T09:17:01.376955+0000","last_peered":"2026-02-24T09:17:01.376955+0000","last_clean":"2026-02-24T09:17:01.376955+0000","last_became_active":"2026-02-24T09:17:00.244160+0000","last_became_peered":"2026-02-24T09:17:00.244160+0000","last_unstale":"2026-02-24T09:17:01.376955+0000","last_undegraded":"2026-02-24T09:17:01.376955+0000","last_fullsized":"2026-02-24T09:17:01.376955+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:04:37.036726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"92'6","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:15.580931+0000","last_change":"2026-02-24T09:16:59.240672+0000","last_active":"2026-02-24T09:17:15.580931+0000","last_peered":"2026-02-24T09:17:15.580931+0000","last_clean":"2026-02-24T09:17:15.580931+0000","last_became_active":"2026-02-24T09:16:59.240414+0000","last_became_peered":"2026-02-24T09:16:59.240414+0000","last_unstale":"2026-02-24T09:17:15.580931+0000","last_undegraded":"2026-02-24T09:17:15.580931+0000","last_fullsized":"2026-02-24T09:17:15.580931+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:41:36.122890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1032,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.377837+0000","last_change":"2026-02-24T09:17:00.243064+0000","last_active":"2026-02-24T09:17:01.377837+0000","last_peered":"2026-02-24T09:17:01.377837+0000","last_clean":"2026-02-24T09:17:01.377837+0000","last_became_active":"2026-02-24T09:17:00.242916+0000","last_became_peered":"2026-02-24T09:17:00.242916+0000","last_unstale":"2026-02-24T09:17:01.377837+0000","last_undegraded":"2026-02-24T09:17:01.377837+0000","last_fullsized":"2026-02-24T09:17:01.377837+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:54:10.866892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"92'3","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.255220+0000","last_change":"2026-02-24T09:16:59.240197+0000","last_active":"2026-02-24T09:17:05.255220+0000","last_peered":"2026-02-24T09:17:05.255220+0000","last_clean":"2026-02-24T09:17:05.255220+0000","last_became_active":"2026-02-24T09:16:59.240036+0000","last_became_peered":"2026-02-24T09:16:59.240036+0000","last_unstale":"2026-02-24T09:17:05.255220+0000","last_undegraded":"2026-02-24T09:17:05.255220+0000","last_fullsized":"2026-02-24T09:17:05.255220+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:10:20.710884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"92'2","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.256064+0000","last_change":"2026-02-24T09:16:59.235467+0000","last_active":"2026-02-24T09:17:05.256064+0000","last_peered":"2026-02-24T09:17:05.256064+0000","last_clean":"2026-02-24T09:17:05.256064+0000","last_became_active":"2026-02-24T09:16:59.235262+0000","last_became_peered":"2026-02-24T09:16:59.235262+0000","last_unstale":"2026-02-24T09:17:05.256064+0000","last_undegraded":"2026-02-24T09:17:05.256064+0000","last_fullsized":"2026-02-24T09:17:05.256064+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:15:01.906008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231788+0000","last_change":"2026-02-24T09:17:00.237830+0000","last_active":"2026-02-24T09:17:01.231788+0000","last_peered":"2026-02-24T09:17:01.231788+0000","last_clean":"2026-02-24T09:17:01.231788+0000","last_became_active":"2026-02-24T09:17:00.237730+0000","last_became_peered":"2026-02-24T09:17:00.237730+0000","last_unstale":"2026-02-24T09:17:01.231788+0000","last_undegraded":"2026-02-24T09:17:01.231788+0000","last_fullsized":"2026-02-24T09:17:01.231788+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:49:14.120510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"92'1","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:02.469482+0000","last_change":"2026-02-24T09:16:59.238783+0000","last_active":"2026-02-24T09:17:02.469482+0000","last_peered":"2026-02-24T09:17:02.469482+0000","last_clean":"2026-02-24T09:17:02.469482+0000","last_became_active":"2026-02-24T09:16:59.238700+0000","last_became_peered":"2026-02-24T09:16:59.238700+0000","last_unstale":"2026-02-24T09:17:02.469482+0000","last_undegraded":"2026-02-24T09:17:02.469482+0000","last_fullsized":"2026-02-24T09:17:02.469482+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:07:28.426507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375760+0000","last_change":"2026-02-24T09:17:00.240566+0000","last_active":"2026-02-24T09:17:01.375760+0000","last_peered":"2026-02-24T09:17:01.375760+0000","last_clean":"2026-02-24T09:17:01.375760+0000","last_became_active":"2026-02-24T09:17:00.239787+0000","last_became_peered":"2026-02-24T09:17:00.239787+0000","last_unstale":"2026-02-24T09:17:01.375760+0000","last_undegraded":"2026-02-24T09:17:01.375760+0000","last_fullsized":"2026-02-24T09:17:01.375760+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:37:55.629531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"92'3","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:14.578601+0000","last_change":"2026-02-24T09:16:59.239817+0000","last_active":"2026-02-24T09:17:14.578601+0000","last_peered":"2026-02-24T09:17:14.578601+0000","last_clean":"2026-02-24T09:17:14.578601+0000","last_became_active":"2026-02-24T09:16:59.239753+0000","last_became_peered":"2026-02-24T09:16:59.239753+0000","last_unstale":"2026-02-24T09:17:14.578601+0000","last_undegraded":"2026-02-24T09:17:14.578601+0000","last_fullsized":"2026-02-24T09:17:14.578601+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:25:15.726537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376407+0000","last_change":"2026-02-24T09:17:00.242220+0000","last_active":"2026-02-24T09:17:01.376407+0000","last_peered":"2026-02-24T09:17:01.376407+0000","last_clean":"2026-02-24T09:17:01.376407+0000","last_became_active":"2026-02-24T09:17:00.241795+0000","last_became_peered":"2026-02-24T09:17:00.241795+0000","last_unstale":"2026-02-24T09:17:01.376407+0000","last_undegraded":"2026-02-24T09:17:01.376407+0000","last_fullsized":"2026-02-24T09:17:01.376407+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:16:26.952516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"92'2","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:04.250229+0000","last_change":"2026-02-24T09:16:59.237294+0000","last_active":"2026-02-24T09:17:04.250229+0000","last_peered":"2026-02-24T09:17:04.250229+0000","last_clean":"2026-02-24T09:17:04.250229+0000","last_became_active":"2026-02-24T09:16:59.237192+0000","last_became_peered":"2026-02-24T09:16:59.237192+0000","last_unstale":"2026-02-24T09:17:04.250229+0000","last_undegraded":"2026-02-24T09:17:04.250229+0000","last_fullsized":"2026-02-24T09:17:04.250229+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:28:54.216539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375947+0000","last_change":"2026-02-24T09:17:00.244365+0000","last_active":"2026-02-24T09:17:01.375947+0000","last_peered":"2026-02-24T09:17:01.375947+0000","last_clean":"2026-02-24T09:17:01.375947+0000","last_became_active":"2026-02-24T09:17:00.244262+0000","last_became_peered":"2026-02-24T09:17:00.244262+0000","last_unstale":"2026-02-24T09:17:01.375947+0000","last_undegraded":"2026-02-24T09:17:01.375947+0000","last_fullsized":"2026-02-24T09:17:01.375947+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:46:44.145479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"92'4","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:04.250710+0000","last_change":"2026-02-24T09:16:59.240964+0000","last_active":"2026-02-24T09:17:04.250710+0000","last_peered":"2026-02-24T09:17:04.250710+0000","last_clean":"2026-02-24T09:17:04.250710+0000","last_became_active":"2026-02-24T09:16:59.240812+0000","last_became_peered":"2026-02-24T09:16:59.240812+0000","last_unstale":"2026-02-24T09:17:04.250710+0000","last_undegraded":"2026-02-24T09:17:04.250710+0000","last_fullsized":"2026-02-24T09:17:04.250710+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:07:51.752070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376252+0000","last_change":"2026-02-24T09:17:00.245692+0000","last_active":"2026-02-24T09:17:01.376252+0000","last_peered":"2026-02-24T09:17:01.376252+0000","last_clean":"2026-02-24T09:17:01.376252+0000","last_became_active":"2026-02-24T09:17:00.245616+0000","last_became_peered":"2026-02-24T09:17:00.245616+0000","last_unstale":"2026-02-24T09:17:01.376252+0000","last_undegraded":"2026-02-24T09:17:01.376252+0000","last_fullsized":"2026-02-24T09:17:01.376252+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:03:42.649936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"92'25","reported_seq":69,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:15.583090+0000","last_change":"2026-02-24T09:16:59.243723+0000","last_active":"2026-02-24T09:17:15.583090+0000","last_peered":"2026-02-24T09:17:15.583090+0000","last_clean":"2026-02-24T09:17:15.583090+0000","last_became_active":"2026-02-24T09:16:59.243606+0000","last_became_peered":"2026-02-24T09:16:59.243606+0000","last_unstale":"2026-02-24T09:17:15.583090+0000","last_undegraded":"2026-02-24T09:17:15.583090+0000","last_fullsized":"2026-02-24T09:17:15.583090+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:35:14.333104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57073,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":69,"num_write":26,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.377374+0000","last_change":"2026-02-24T09:17:00.237314+0000","last_active":"2026-02-24T09:17:01.377374+0000","last_peered":"2026-02-24T09:17:01.377374+0000","last_clean":"2026-02-24T09:17:01.377374+0000","last_became_active":"2026-02-24T09:17:00.237210+0000","last_became_peered":"2026-02-24T09:17:00.237210+0000","last_unstale":"2026-02-24T09:17:01.377374+0000","last_undegraded":"2026-02-24T09:17:01.377374+0000","last_fullsized":"2026-02-24T09:17:01.377374+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:03:03.936414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"92'6","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.257112+0000","last_change":"2026-02-24T09:16:59.242567+0000","last_active":"2026-02-24T09:17:05.257112+0000","last_peered":"2026-02-24T09:17:05.257112+0000","last_clean":"2026-02-24T09:17:05.257112+0000","last_became_active":"2026-02-24T09:16:59.242420+0000","last_became_peered":"2026-02-24T09:16:59.242420+0000","last_unstale":"2026-02-24T09:17:05.257112+0000","last_undegraded":"2026-02-24T09:17:05.257112+0000","last_fullsized":"2026-02-24T09:17:05.257112+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:58:16.881321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231844+0000","last_change":"2026-02-24T09:17:00.239405+0000","last_active":"2026-02-24T09:17:01.231844+0000","last_peered":"2026-02-24T09:17:01.231844+0000","last_clean":"2026-02-24T09:17:01.231844+0000","last_became_active":"2026-02-24T09:17:00.239281+0000","last_became_peered":"2026-02-24T09:17:00.239281+0000","last_unstale":"2026-02-24T09:17:01.231844+0000","last_undegraded":"2026-02-24T09:17:01.231844+0000","last_fullsized":"2026-02-24T09:17:01.231844+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:19:48.176289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"92'3","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:04.250578+0000","last_change":"2026-02-24T09:16:59.242394+0000","last_active":"2026-02-24T09:17:04.250578+0000","last_peered":"2026-02-24T09:17:04.250578+0000","last_clean":"2026-02-24T09:17:04.250578+0000","last_became_active":"2026-02-24T09:16:59.242199+0000","last_became_peered":"2026-02-24T09:16:59.242199+0000","last_unstale":"2026-02-24T09:17:04.250578+0000","last_undegraded":"2026-02-24T09:17:04.250578+0000","last_fullsized":"2026-02-24T09:17:04.250578+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:04:12.763715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.610151+0000","last_change":"2026-02-24T09:17:00.237820+0000","last_active":"2026-02-24T09:17:01.610151+0000","last_peered":"2026-02-24T09:17:01.610151+0000","last_clean":"2026-02-24T09:17:01.610151+0000","last_became_active":"2026-02-24T09:17:00.237711+0000","last_became_peered":"2026-02-24T09:17:00.237711+0000","last_unstale":"2026-02-24T09:17:01.610151+0000","last_undegraded":"2026-02-24T09:17:01.610151+0000","last_fullsized":"2026-02-24T09:17:01.610151+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:27:44.269231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"92'4","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:14.581922+0000","last_change":"2026-02-24T09:16:59.239787+0000","last_active":"2026-02-24T09:17:14.581922+0000","last_peered":"2026-02-24T09:17:14.581922+0000","last_clean":"2026-02-24T09:17:14.581922+0000","last_became_active":"2026-02-24T09:16:59.239066+0000","last_became_peered":"2026-02-24T09:16:59.239066+0000","last_unstale":"2026-02-24T09:17:14.581922+0000","last_undegraded":"2026-02-24T09:17:14.581922+0000","last_fullsized":"2026-02-24T09:17:14.581922+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:10:34.992034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.609694+0000","last_change":"2026-02-24T09:17:00.246515+0000","last_active":"2026-02-24T09:17:01.609694+0000","last_peered":"2026-02-24T09:17:01.609694+0000","last_clean":"2026-02-24T09:17:01.609694+0000","last_became_active":"2026-02-24T09:17:00.246222+0000","last_became_peered":"2026-02-24T09:17:00.246222+0000","last_unstale":"2026-02-24T09:17:01.609694+0000","last_undegraded":"2026-02-24T09:17:01.609694+0000","last_fullsized":"2026-02-24T09:17:01.609694+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:28:05.377985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"92'15","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.257255+0000","last_change":"2026-02-24T09:16:59.239752+0000","last_active":"2026-02-24T09:17:05.257255+0000","last_peered":"2026-02-24T09:17:05.257255+0000","last_clean":"2026-02-24T09:17:05.257255+0000","last_became_active":"2026-02-24T09:16:59.239609+0000","last_became_peered":"2026-02-24T09:16:59.239609+0000","last_unstale":"2026-02-24T09:17:05.257255+0000","last_undegraded":"2026-02-24T09:17:05.257255+0000","last_fullsized":"2026-02-24T09:17:05.257255+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:30:54.943423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.378159+0000","last_change":"2026-02-24T09:17:00.246053+0000","last_active":"2026-02-24T09:17:01.378159+0000","last_peered":"2026-02-24T09:17:01.378159+0000","last_clean":"2026-02-24T09:17:01.378159+0000","last_became_active":"2026-02-24T09:17:00.245905+0000","last_became_peered":"2026-02-24T09:17:00.245905+0000","last_unstale":"2026-02-24T09:17:01.378159+0000","last_undegraded":"2026-02-24T09:17:01.378159+0000","last_fullsized":"2026-02-24T09:17:01.378159+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:36:56.843524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"92'2","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.570884+0000","last_change":"2026-02-24T09:16:59.241232+0000","last_active":"2026-02-24T09:17:05.570884+0000","last_peered":"2026-02-24T09:17:05.570884+0000","last_clean":"2026-02-24T09:17:05.570884+0000","last_became_active":"2026-02-24T09:16:59.240754+0000","last_became_peered":"2026-02-24T09:16:59.240754+0000","last_unstale":"2026-02-24T09:17:05.570884+0000","last_undegraded":"2026-02-24T09:17:05.570884+0000","last_fullsized":"2026-02-24T09:17:05.570884+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:57:01.258617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376875+0000","last_change":"2026-02-24T09:17:00.246591+0000","last_active":"2026-02-24T09:17:01.376875+0000","last_peered":"2026-02-24T09:17:01.376875+0000","last_clean":"2026-02-24T09:17:01.376875+0000","last_became_active":"2026-02-24T09:17:00.246487+0000","last_became_peered":"2026-02-24T09:17:00.246487+0000","last_unstale":"2026-02-24T09:17:01.376875+0000","last_undegraded":"2026-02-24T09:17:01.376875+0000","last_fullsized":"2026-02-24T09:17:01.376875+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:58:37.854234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"91'2","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232200+0000","last_change":"2026-02-24T09:16:59.239102+0000","last_active":"2026-02-24T09:17:01.232200+0000","last_peered":"2026-02-24T09:17:01.232200+0000","last_clean":"2026-02-24T09:17:01.232200+0000","last_became_active":"2026-02-24T09:16:59.238978+0000","last_became_peered":"2026-02-24T09:16:59.238978+0000","last_unstale":"2026-02-24T09:17:01.232200+0000","last_undegraded":"2026-02-24T09:17:01.232200+0000","last_fullsized":"2026-02-24T09:17:01.232200+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:57:02.192151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.610201+0000","last_change":"2026-02-24T09:17:00.238578+0000","last_active":"2026-02-24T09:17:01.610201+0000","last_peered":"2026-02-24T09:17:01.610201+0000","last_clean":"2026-02-24T09:17:01.610201+0000","last_became_active":"2026-02-24T09:17:00.238465+0000","last_became_peered":"2026-02-24T09:17:00.238465+0000","last_unstale":"2026-02-24T09:17:01.610201+0000","last_undegraded":"2026-02-24T09:17:01.610201+0000","last_fullsized":"2026-02-24T09:17:01.610201+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:44:35.349567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"91'1","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:02.469552+0000","last_change":"2026-02-24T09:16:59.242643+0000","last_active":"2026-02-24T09:17:02.469552+0000","last_peered":"2026-02-24T09:17:02.469552+0000","last_clean":"2026-02-24T09:17:02.469552+0000","last_became_active":"2026-02-24T09:16:59.242376+0000","last_became_peered":"2026-02-24T09:16:59.242376+0000","last_unstale":"2026-02-24T09:17:02.469552+0000","last_undegraded":"2026-02-24T09:17:02.469552+0000","last_fullsized":"2026-02-24T09:17:02.469552+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:27:11.004972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"92'1","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.609794+0000","last_change":"2026-02-24T09:17:00.246332+0000","last_active":"2026-02-24T09:17:01.609794+0000","last_peered":"2026-02-24T09:17:01.609794+0000","last_clean":"2026-02-24T09:17:01.609794+0000","last_became_active":"2026-02-24T09:17:00.246194+0000","last_became_peered":"2026-02-24T09:17:00.246194+0000","last_unstale":"2026-02-24T09:17:01.609794+0000","last_undegraded":"2026-02-24T09:17:01.609794+0000","last_fullsized":"2026-02-24T09:17:01.609794+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:58:11.173666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"92'3","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.257225+0000","last_change":"2026-02-24T09:16:59.243374+0000","last_active":"2026-02-24T09:17:05.257225+0000","last_peered":"2026-02-24T09:17:05.257225+0000","last_clean":"2026-02-24T09:17:05.257225+0000","last_became_active":"2026-02-24T09:16:59.241003+0000","last_became_peered":"2026-02-24T09:16:59.241003+0000","last_unstale":"2026-02-24T09:17:05.257225+0000","last_undegraded":"2026-02-24T09:17:05.257225+0000","last_fullsized":"2026-02-24T09:17:05.257225+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:26:57.571616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.610188+0000","last_change":"2026-02-24T09:17:00.240655+0000","last_active":"2026-02-24T09:17:01.610188+0000","last_peered":"2026-02-24T09:17:01.610188+0000","last_clean":"2026-02-24T09:17:01.610188+0000","last_became_active":"2026-02-24T09:17:00.240419+0000","last_became_peered":"2026-02-24T09:17:00.240419+0000","last_unstale":"2026-02-24T09:17:01.610188+0000","last_undegraded":"2026-02-24T09:17:01.610188+0000","last_fullsized":"2026-02-24T09:17:01.610188+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:18:34.651497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"25'152","reported_seq":371,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.609797+0000","last_change":"2026-02-24T09:16:23.569634+0000","last_active":"2026-02-24T09:17:01.609797+0000","last_peered":"2026-02-24T09:17:01.609797+0000","last_clean":"2026-02-24T09:17:01.609797+0000","last_became_active":"2026-02-24T09:16:23.569284+0000","last_became_peered":"2026-02-24T09:16:23.569284+0000","last_unstale":"2026-02-24T09:17:01.609797+0000","last_undegraded":"2026-02-24T09:17:01.609797+0000","last_fullsized":"2026-02-24T09:17:01.609797+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:14:34.386267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:14:34.386267+0000","last_clean_scrub_stamp":"2026-02-24T09:14:34.386267+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:03:26.216331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"92'3","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.568942+0000","last_change":"2026-02-24T09:16:59.239216+0000","last_active":"2026-02-24T09:17:05.568942+0000","last_peered":"2026-02-24T09:17:05.568942+0000","last_clean":"2026-02-24T09:17:05.568942+0000","last_became_active":"2026-02-24T09:16:59.239009+0000","last_became_peered":"2026-02-24T09:16:59.239009+0000","last_unstale":"2026-02-24T09:17:05.568942+0000","last_undegraded":"2026-02-24T09:17:05.568942+0000","last_fullsized":"2026-02-24T09:17:05.568942+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:51:32.186590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231677+0000","last_change":"2026-02-24T09:17:00.242943+0000","last_active":"2026-02-24T09:17:01.231677+0000","last_peered":"2026-02-24T09:17:01.231677+0000","last_clean":"2026-02-24T09:17:01.231677+0000","last_became_active":"2026-02-24T09:17:00.242841+0000","last_became_peered":"2026-02-24T09:17:00.242841+0000","last_unstale":"2026-02-24T09:17:01.231677+0000","last_undegraded":"2026-02-24T09:17:01.231677+0000","last_fullsized":"2026-02-24T09:17:01.231677+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:27:23.973327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"92'3","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.254697+0000","last_change":"2026-02-24T09:16:59.239635+0000","last_active":"2026-02-24T09:17:05.254697+0000","last_peered":"2026-02-24T09:17:05.254697+0000","last_clean":"2026-02-24T09:17:05.254697+0000","last_became_active":"2026-02-24T09:16:59.239565+0000","last_became_peered":"2026-02-24T09:16:59.239565+0000","last_unstale":"2026-02-24T09:17:05.254697+0000","last_undegraded":"2026-02-24T09:17:05.254697+0000","last_fullsized":"2026-02-24T09:17:05.254697+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:33:03.541374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231556+0000","last_change":"2026-02-24T09:17:00.244300+0000","last_active":"2026-02-24T09:17:01.231556+0000","last_peered":"2026-02-24T09:17:01.231556+0000","last_clean":"2026-02-24T09:17:01.231556+0000","last_became_active":"2026-02-24T09:17:00.244133+0000","last_became_peered":"2026-02-24T09:17:00.244133+0000","last_unstale":"2026-02-24T09:17:01.231556+0000","last_undegraded":"2026-02-24T09:17:01.231556+0000","last_fullsized":"2026-02-24T09:17:01.231556+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:42:14.299522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"92'4","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:15.582901+0000","last_change":"2026-02-24T09:16:59.242539+0000","last_active":"2026-02-24T09:17:15.582901+0000","last_peered":"2026-02-24T09:17:15.582901+0000","last_clean":"2026-02-24T09:17:15.582901+0000","last_became_active":"2026-02-24T09:16:59.242210+0000","last_became_peered":"2026-02-24T09:16:59.242210+0000","last_unstale":"2026-02-24T09:17:15.582901+0000","last_undegraded":"2026-02-24T09:17:15.582901+0000","last_fullsized":"2026-02-24T09:17:15.582901+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:47:26.799485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.377784+0000","last_change":"2026-02-24T09:17:00.246745+0000","last_active":"2026-02-24T09:17:01.377784+0000","last_peered":"2026-02-24T09:17:01.377784+0000","last_clean":"2026-02-24T09:17:01.377784+0000","last_became_active":"2026-02-24T09:17:00.246652+0000","last_became_peered":"2026-02-24T09:17:00.246652+0000","last_unstale":"2026-02-24T09:17:01.377784+0000","last_undegraded":"2026-02-24T09:17:01.377784+0000","last_fullsized":"2026-02-24T09:17:01.377784+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:16:56.265530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"92'1","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.610257+0000","last_change":"2026-02-24T09:16:59.235982+0000","last_active":"2026-02-24T09:17:01.610257+0000","last_peered":"2026-02-24T09:17:01.610257+0000","last_clean":"2026-02-24T09:17:01.610257+0000","last_became_active":"2026-02-24T09:16:59.235893+0000","last_became_peered":"2026-02-24T09:16:59.235893+0000","last_unstale":"2026-02-24T09:17:01.610257+0000","last_undegraded":"2026-02-24T09:17:01.610257+0000","last_fullsized":"2026-02-24T09:17:01.610257+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:02:50.906502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231934+0000","last_change":"2026-02-24T09:17:00.237347+0000","last_active":"2026-02-24T09:17:01.231934+0000","last_peered":"2026-02-24T09:17:01.231934+0000","last_clean":"2026-02-24T09:17:01.231934+0000","last_became_active":"2026-02-24T09:17:00.237254+0000","last_became_peered":"2026-02-24T09:17:00.237254+0000","last_unstale":"2026-02-24T09:17:01.231934+0000","last_undegraded":"2026-02-24T09:17:01.231934+0000","last_fullsized":"2026-02-24T09:17:01.231934+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:26:24.955214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375984+0000","last_change":"2026-02-24T09:16:59.244271+0000","last_active":"2026-02-24T09:17:01.375984+0000","last_peered":"2026-02-24T09:17:01.375984+0000","last_clean":"2026-02-24T09:17:01.375984+0000","last_became_active":"2026-02-24T09:16:59.243995+0000","last_became_peered":"2026-02-24T09:16:59.243995+0000","last_unstale":"2026-02-24T09:17:01.375984+0000","last_undegraded":"2026-02-24T09:17:01.375984+0000","last_fullsized":"2026-02-24T09:17:01.375984+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:23:30.140261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"92'1","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231998+0000","last_change":"2026-02-24T09:17:00.238722+0000","last_active":"2026-02-24T09:17:01.231998+0000","last_peered":"2026-02-24T09:17:01.231998+0000","last_clean":"2026-02-24T09:17:01.231998+0000","last_became_active":"2026-02-24T09:17:00.238067+0000","last_became_peered":"2026-02-24T09:17:00.238067+0000","last_unstale":"2026-02-24T09:17:01.231998+0000","last_undegraded":"2026-02-24T09:17:01.231998+0000","last_fullsized":"2026-02-24T09:17:01.231998+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:15:12.608200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"92'1","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:04.250009+0000","last_change":"2026-02-24T09:16:59.240637+0000","last_active":"2026-02-24T09:17:04.250009+0000","last_peered":"2026-02-24T09:17:04.250009+0000","last_clean":"2026-02-24T09:17:04.250009+0000","last_became_active":"2026-02-24T09:16:59.240525+0000","last_became_peered":"2026-02-24T09:16:59.240525+0000","last_unstale":"2026-02-24T09:17:04.250009+0000","last_undegraded":"2026-02-24T09:17:04.250009+0000","last_fullsized":"2026-02-24T09:17:04.250009+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:19:39.812071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232103+0000","last_change":"2026-02-24T09:17:00.242384+0000","last_active":"2026-02-24T09:17:01.232103+0000","last_peered":"2026-02-24T09:17:01.232103+0000","last_clean":"2026-02-24T09:17:01.232103+0000","last_became_active":"2026-02-24T09:17:00.242252+0000","last_became_peered":"2026-02-24T09:17:00.242252+0000","last_unstale":"2026-02-24T09:17:01.232103+0000","last_undegraded":"2026-02-24T09:17:01.232103+0000","last_fullsized":"2026-02-24T09:17:01.232103+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:55:25.276787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"92'9","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:14.482300+0000","last_change":"2026-02-24T09:16:59.242386+0000","last_active":"2026-02-24T09:17:14.482300+0000","last_peered":"2026-02-24T09:17:14.482300+0000","last_clean":"2026-02-24T09:17:14.482300+0000","last_became_active":"2026-02-24T09:16:59.240737+0000","last_became_peered":"2026-02-24T09:16:59.240737+0000","last_unstale":"2026-02-24T09:17:14.482300+0000","last_undegraded":"2026-02-24T09:17:14.482300+0000","last_fullsized":"2026-02-24T09:17:14.482300+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:35:28.471311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232263+0000","last_change":"2026-02-24T09:17:00.239525+0000","last_active":"2026-02-24T09:17:01.232263+0000","last_peered":"2026-02-24T09:17:01.232263+0000","last_clean":"2026-02-24T09:17:01.232263+0000","last_became_active":"2026-02-24T09:17:00.239161+0000","last_became_peered":"2026-02-24T09:17:00.239161+0000","last_unstale":"2026-02-24T09:17:01.232263+0000","last_undegraded":"2026-02-24T09:17:01.232263+0000","last_fullsized":"2026-02-24T09:17:01.232263+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:35:14.881330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"92'4","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:04.248734+0000","last_change":"2026-02-24T09:16:59.233525+0000","last_active":"2026-02-24T09:17:04.248734+0000","last_peered":"2026-02-24T09:17:04.248734+0000","last_clean":"2026-02-24T09:17:04.248734+0000","last_became_active":"2026-02-24T09:16:59.233370+0000","last_became_peered":"2026-02-24T09:16:59.233370+0000","last_unstale":"2026-02-24T09:17:04.248734+0000","last_undegraded":"2026-02-24T09:17:04.248734+0000","last_fullsized":"2026-02-24T09:17:04.248734+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:49:37.491011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376128+0000","last_change":"2026-02-24T09:17:00.241506+0000","last_active":"2026-02-24T09:17:01.376128+0000","last_peered":"2026-02-24T09:17:01.376128+0000","last_clean":"2026-02-24T09:17:01.376128+0000","last_became_active":"2026-02-24T09:17:00.241385+0000","last_became_peered":"2026-02-24T09:17:00.241385+0000","last_unstale":"2026-02-24T09:17:01.376128+0000","last_undegraded":"2026-02-24T09:17:01.376128+0000","last_fullsized":"2026-02-24T09:17:01.376128+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:17:11.846529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"92'2","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:04.249681+0000","last_change":"2026-02-24T09:16:59.238575+0000","last_active":"2026-02-24T09:17:04.249681+0000","last_peered":"2026-02-24T09:17:04.249681+0000","last_clean":"2026-02-24T09:17:04.249681+0000","last_became_active":"2026-02-24T09:16:59.238286+0000","last_became_peered":"2026-02-24T09:16:59.238286+0000","last_unstale":"2026-02-24T09:17:04.249681+0000","last_undegraded":"2026-02-24T09:17:04.249681+0000","last_fullsized":"2026-02-24T09:17:04.249681+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:18:59.982647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376961+0000","last_change":"2026-02-24T09:17:00.238159+0000","last_active":"2026-02-24T09:17:01.376961+0000","last_peered":"2026-02-24T09:17:01.376961+0000","last_clean":"2026-02-24T09:17:01.376961+0000","last_became_active":"2026-02-24T09:17:00.238069+0000","last_became_peered":"2026-02-24T09:17:00.238069+0000","last_unstale":"2026-02-24T09:17:01.376961+0000","last_undegraded":"2026-02-24T09:17:01.376961+0000","last_fullsized":"2026-02-24T09:17:01.376961+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:45:21.584921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"92'3","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:04.250654+0000","last_change":"2026-02-24T09:16:59.241444+0000","last_active":"2026-02-24T09:17:04.250654+0000","last_peered":"2026-02-24T09:17:04.250654+0000","last_clean":"2026-02-24T09:17:04.250654+0000","last_became_active":"2026-02-24T09:16:59.241253+0000","last_became_peered":"2026-02-24T09:16:59.241253+0000","last_unstale":"2026-02-24T09:17:04.250654+0000","last_undegraded":"2026-02-24T09:17:04.250654+0000","last_fullsized":"2026-02-24T09:17:04.250654+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:07:34.833768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376780+0000","last_change":"2026-02-24T09:17:00.245603+0000","last_active":"2026-02-24T09:17:01.376780+0000","last_peered":"2026-02-24T09:17:01.376780+0000","last_clean":"2026-02-24T09:17:01.376780+0000","last_became_active":"2026-02-24T09:17:00.245409+0000","last_became_peered":"2026-02-24T09:17:00.245409+0000","last_unstale":"2026-02-24T09:17:01.376780+0000","last_undegraded":"2026-02-24T09:17:01.376780+0000","last_fullsized":"2026-02-24T09:17:01.376780+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:24:31.732634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"92'1","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:02.676977+0000","last_change":"2026-02-24T09:16:59.242808+0000","last_active":"2026-02-24T09:17:02.676977+0000","last_peered":"2026-02-24T09:17:02.676977+0000","last_clean":"2026-02-24T09:17:02.676977+0000","last_became_active":"2026-02-24T09:16:59.242717+0000","last_became_peered":"2026-02-24T09:16:59.242717+0000","last_unstale":"2026-02-24T09:17:02.676977+0000","last_undegraded":"2026-02-24T09:17:02.676977+0000","last_fullsized":"2026-02-24T09:17:02.676977+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:55:54.008569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231613+0000","last_change":"2026-02-24T09:17:00.239253+0000","last_active":"2026-02-24T09:17:01.231613+0000","last_peered":"2026-02-24T09:17:01.231613+0000","last_clean":"2026-02-24T09:17:01.231613+0000","last_became_active":"2026-02-24T09:17:00.238983+0000","last_became_peered":"2026-02-24T09:17:00.238983+0000","last_unstale":"2026-02-24T09:17:01.231613+0000","last_undegraded":"2026-02-24T09:17:01.231613+0000","last_fullsized":"2026-02-24T09:17:01.231613+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:15:35.939863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"92'4","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:04.250062+0000","last_change":"2026-02-24T09:16:59.238537+0000","last_active":"2026-02-24T09:17:04.250062+0000","last_peered":"2026-02-24T09:17:04.250062+0000","last_clean":"2026-02-24T09:17:04.250062+0000","last_became_active":"2026-02-24T09:16:59.238413+0000","last_became_peered":"2026-02-24T09:16:59.238413+0000","last_unstale":"2026-02-24T09:17:04.250062+0000","last_undegraded":"2026-02-24T09:17:04.250062+0000","last_fullsized":"2026-02-24T09:17:04.250062+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:18:35.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.609986+0000","last_change":"2026-02-24T09:17:00.241138+0000","last_active":"2026-02-24T09:17:01.609986+0000","last_peered":"2026-02-24T09:17:01.609986+0000","last_clean":"2026-02-24T09:17:01.609986+0000","last_became_active":"2026-02-24T09:17:00.240131+0000","last_became_peered":"2026-02-24T09:17:00.240131+0000","last_unstale":"2026-02-24T09:17:01.609986+0000","last_undegraded":"2026-02-24T09:17:01.609986+0000","last_fullsized":"2026-02-24T09:17:01.609986+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:30:04.572939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.378006+0000","last_change":"2026-02-24T09:17:00.247807+0000","last_active":"2026-02-24T09:17:01.378006+0000","last_peered":"2026-02-24T09:17:01.378006+0000","last_clean":"2026-02-24T09:17:01.378006+0000","last_became_active":"2026-02-24T09:17:00.247294+0000","last_became_peered":"2026-02-24T09:17:00.247294+0000","last_unstale":"2026-02-24T09:17:01.378006+0000","last_undegraded":"2026-02-24T09:17:01.378006+0000","last_fullsized":"2026-02-24T09:17:01.378006+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:40:19.082811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"91'2","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.377087+0000","last_change":"2026-02-24T09:16:59.241010+0000","last_active":"2026-02-24T09:17:01.377087+0000","last_peered":"2026-02-24T09:17:01.377087+0000","last_clean":"2026-02-24T09:17:01.377087+0000","last_became_active":"2026-02-24T09:16:59.240857+0000","last_became_peered":"2026-02-24T09:16:59.240857+0000","last_unstale":"2026-02-24T09:17:01.377087+0000","last_undegraded":"2026-02-24T09:17:01.377087+0000","last_fullsized":"2026-02-24T09:17:01.377087+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:00:21.995413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376275+0000","last_change":"2026-02-24T09:17:00.239878+0000","last_active":"2026-02-24T09:17:01.376275+0000","last_peered":"2026-02-24T09:17:01.376275+0000","last_clean":"2026-02-24T09:17:01.376275+0000","last_became_active":"2026-02-24T09:17:00.239782+0000","last_became_peered":"2026-02-24T09:17:00.239782+0000","last_unstale":"2026-02-24T09:17:01.376275+0000","last_undegraded":"2026-02-24T09:17:01.376275+0000","last_fullsized":"2026-02-24T09:17:01.376275+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:20:28.594190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"92'4","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.255383+0000","last_change":"2026-02-24T09:16:59.238466+0000","last_active":"2026-02-24T09:17:05.255383+0000","last_peered":"2026-02-24T09:17:05.255383+0000","last_clean":"2026-02-24T09:17:05.255383+0000","last_became_active":"2026-02-24T09:16:59.238371+0000","last_became_peered":"2026-02-24T09:16:59.238371+0000","last_unstale":"2026-02-24T09:17:05.255383+0000","last_undegraded":"2026-02-24T09:17:05.255383+0000","last_fullsized":"2026-02-24T09:17:05.255383+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:25:57.207215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375857+0000","last_change":"2026-02-24T09:17:00.242538+0000","last_active":"2026-02-24T09:17:01.375857+0000","last_peered":"2026-02-24T09:17:01.375857+0000","last_clean":"2026-02-24T09:17:01.375857+0000","last_became_active":"2026-02-24T09:17:00.241119+0000","last_became_peered":"2026-02-24T09:17:00.241119+0000","last_unstale":"2026-02-24T09:17:01.375857+0000","last_undegraded":"2026-02-24T09:17:01.375857+0000","last_fullsized":"2026-02-24T09:17:01.375857+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:03:23.360618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"92'2","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.545231+0000","last_change":"2026-02-24T09:16:59.243406+0000","last_active":"2026-02-24T09:17:01.545231+0000","last_peered":"2026-02-24T09:17:01.545231+0000","last_clean":"2026-02-24T09:17:01.545231+0000","last_became_active":"2026-02-24T09:16:59.243275+0000","last_became_peered":"2026-02-24T09:16:59.243275+0000","last_unstale":"2026-02-24T09:17:01.545231+0000","last_undegraded":"2026-02-24T09:17:01.545231+0000","last_fullsized":"2026-02-24T09:17:01.545231+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:11:58.812932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232102+0000","last_change":"2026-02-24T09:17:00.242628+0000","last_active":"2026-02-24T09:17:01.232102+0000","last_peered":"2026-02-24T09:17:01.232102+0000","last_clean":"2026-02-24T09:17:01.232102+0000","last_became_active":"2026-02-24T09:17:00.242482+0000","last_became_peered":"2026-02-24T09:17:00.242482+0000","last_unstale":"2026-02-24T09:17:01.232102+0000","last_undegraded":"2026-02-24T09:17:01.232102+0000","last_fullsized":"2026-02-24T09:17:01.232102+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:28:11.567636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"92'9","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.255500+0000","last_change":"2026-02-24T09:16:59.238503+0000","last_active":"2026-02-24T09:17:05.255500+0000","last_peered":"2026-02-24T09:17:05.255500+0000","last_clean":"2026-02-24T09:17:05.255500+0000","last_became_active":"2026-02-24T09:16:59.238321+0000","last_became_peered":"2026-02-24T09:16:59.238321+0000","last_unstale":"2026-02-24T09:17:05.255500+0000","last_undegraded":"2026-02-24T09:17:05.255500+0000","last_fullsized":"2026-02-24T09:17:05.255500+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:25:06.302717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":61533,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":94,"num_read_kb":112,"num_write":156,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":184599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":130390,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":261676,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":87,"seq":373662154763,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28188,"kb_used_data":968,"kb_used_omap":10,"kb_used_meta":27189,"kb_avail":733975012,"statfs":{"total":751619276800,"available":751590412288,"internally_reserved":0,"allocated":991232,"data_stored":492629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10767,"internal_metadata":27842033},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":79,"seq":339302416397,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28332,"kb_used_data":1112,"kb_used_omap":28,"kb_used_meta":27171,"kb_avail":733974868,"statfs":{"total":751619276800,"available":751590264832,"internally_reserved":0,"allocated":1138688,"data_stored":1141593,"data_compressed":37836,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":28890,"internal_metadata":27823910},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":74,"seq":317827579921,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28204,"kb_used_data":984,"kb_used_omap":26,"kb_used_meta":27173,"kb_avail":733974996,"statfs":{"total":751619276800,"available":751590395904,"internally_reserved":0,"allocated":1007616,"data_stored":492865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27137,"internal_metadata":27825663},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":66,"seq":283467841555,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28204,"kb_used_data":984,"kb_used_omap":16,"kb_used_meta":27183,"kb_avail":733974996,"statfs":{"total":751619276800,"available":751590395904,"internally_reserved":0,"allocated":1007616,"data_stored":492785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16555,"internal_metadata":27836245},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":58,"seq":249108103189,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28252,"kb_used_data":1032,"kb_used_omap":35,"kb_used_meta":27164,"kb_avail":733974948,"statfs":{"total":751619276800,"available":751590346752,"internally_reserved":0,"allocated":1056768,"data_stored":1085144,"data_compressed":37836,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":36450,"internal_metadata":27816350},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":53,"seq":227633266712,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28192,"kb_used_data":972,"kb_used_omap":32,"kb_used_meta":27167,"kb_avail":733975008,"statfs":{"total":751619276800,"available":751590408192,"internally_reserved":0,"allocated":995328,"data_stored":492244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33261,"internal_metadata":27819539},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":45,"seq":193273528347,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28264,"kb_used_data":1044,"kb_used_omap":36,"kb_used_meta":27163,"kb_avail":733974936,"statfs":{"total":751619276800,"available":751590334464,"internally_reserved":0,"allocated":1069056,"data_stored":1084418,"data_compressed":37836,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":37621,"internal_metadata":27815179},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":38,"seq":163208757277,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28196,"kb_used_data":976,"kb_used_omap":44,"kb_used_meta":27155,"kb_avail":733975004,"statfs":{"total":751619276800,"available":751590404096,"internally_reserved":0,"allocated":999424,"data_stored":493091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45564,"internal_metadata":27807236},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":30,"seq":128849018912,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28208,"kb_used_data":988,"kb_used_omap":54,"kb_used_meta":27145,"kb_avail":733974992,"statfs":{"total":751619276800,"available":751590391808,"internally_reserved":0,"allocated":1011712,"data_stored":492555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":55833,"internal_metadata":27796967},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280547,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28272,"kb_used_data":1052,"kb_used_omap":65,"kb_used_meta":27134,"kb_avail":733974928,"statfs":{"total":751619276800,"available":751590326272,"internally_reserved":0,"allocated":1077248,"data_stored":550880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":66689,"internal_metadata":27786111},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476774,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28248,"kb_used_data":1028,"kb_used_omap":54,"kb_used_meta":27145,"kb_avail":733974952,"statfs":{"total":751619276800,"available":751590350848,"internally_reserved":0,"allocated":1052672,"data_stored":549110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":55708,"internal_metadata":27797092},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673001,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28212,"kb_used_data":992,"kb_used_omap":35,"kb_used_meta":27164,"kb_avail":733974988,"statfs":{"total":751619276800,"available":751590387712,"internally_reserved":0,"allocated":1015808,"data_stored":493535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36536,"internal_metadata":27816264},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37836,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37836,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37836,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37836,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37836,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1431,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":57073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1713,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":58843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12982,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14142,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12139,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3482,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4590,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33104,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5258,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17306,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":59071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22881,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1362,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T09:17:20.495 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T09:17:20.679 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:20.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.871+0000 7ffbb1eea640 1 -- 10.20.193.28:0/641460377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffbac113500 msgr2=0x7ffbac173ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:20.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.871+0000 7ffbb1eea640 1 --2- 10.20.193.28:0/641460377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffbac113500 0x7ffbac173ed0 secure :-1 s=READY pgs=313 gs=1 cs=0 l=1 c_cookie=15649981880011354478 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffba800aa30 tx=0x7ffba8030270 comp rx=0 tx=0).stop 2026-02-24T09:17:20.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.871+0000 7ffbb1eea640 1 -- 10.20.193.28:0/641460377 shutdown_connections 2026-02-24T09:17:20.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.871+0000 7ffbb1eea640 1 --2- 10.20.193.28:0/641460377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffbac113500 0x7ffbac173ed0 unknown :-1 s=CLOSED pgs=313 gs=1 cs=0 l=1 c_cookie=15649981880011354478 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:20.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.871+0000 7ffbb1eea640 1 --2- 10.20.193.28:0/641460377 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ffbac10c1a0 0x7ffbac112d50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:20.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.871+0000 7ffbb1eea640 1 --2- 10.20.193.28:0/641460377 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ffbac10b7b0 0x7ffbac10bb80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:20.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.871+0000 7ffbb1eea640 1 -- 10.20.193.28:0/641460377 >> 10.20.193.28:0/641460377 conn(0x7ffbac0e9260 msgr2=0x7ffbac109670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:20.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.871+0000 7ffbb1eea640 1 -- 10.20.193.28:0/641460377 shutdown_connections 2026-02-24T09:17:20.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.871+0000 7ffbb1eea640 1 -- 10.20.193.28:0/641460377 wait complete. 2026-02-24T09:17:20.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.871+0000 7ffbb1eea640 1 Processor -- start 2026-02-24T09:17:20.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.871+0000 7ffbb1eea640 1 -- start start 2026-02-24T09:17:20.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.872+0000 7ffbb1eea640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ffbac10b7b0 0x7ffbac0f3ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:20.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.872+0000 7ffbb1eea640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffbac10c1a0 0x7ffbac173dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:20.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.872+0000 7ffbb1eea640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ffbac113500 0x7ffbac0f45e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:20.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.872+0000 7ffbb1eea640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ffbac0f97a0 con 0x7ffbac10c1a0 2026-02-24T09:17:20.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.872+0000 7ffbb1eea640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7ffbac0f9910 con 0x7ffbac113500 2026-02-24T09:17:20.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.872+0000 7ffbb1eea640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7ffbac0f9ad0 con 0x7ffbac10b7b0 2026-02-24T09:17:20.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.872+0000 7ffba3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffbac10c1a0 0x7ffbac173dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:20.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.872+0000 7ffba3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffbac10c1a0 0x7ffbac173dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40368/0 (socket says 10.20.193.28:40368) 2026-02-24T09:17:20.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.872+0000 7ffba3fff640 1 -- 10.20.193.28:0/606404843 learned_addr learned my addr 10.20.193.28:0/606404843 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:20.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.872+0000 7ffbb16e9640 1 --2- 10.20.193.28:0/606404843 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ffbac113500 0x7ffbac0f45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:20.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.872+0000 7ffba3fff640 1 -- 10.20.193.28:0/606404843 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ffbac10b7b0 msgr2=0x7ffbac0f3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:20.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.872+0000 7ffba3fff640 1 --2- 10.20.193.28:0/606404843 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ffbac10b7b0 0x7ffbac0f3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:20.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.872+0000 7ffba3fff640 1 -- 10.20.193.28:0/606404843 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ffbac113500 msgr2=0x7ffbac0f45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:20.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.872+0000 7ffba3fff640 1 --2- 10.20.193.28:0/606404843 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ffbac113500 0x7ffbac0f45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:20.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.872+0000 7ffba3fff640 1 -- 10.20.193.28:0/606404843 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba800a650 con 0x7ffbac10c1a0 2026-02-24T09:17:20.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.872+0000 7ffba3fff640 1 --2- 10.20.193.28:0/606404843 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffbac10c1a0 0x7ffbac173dd0 secure :-1 s=READY pgs=314 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb94009480 tx=0x7ffb9400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:20.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.873+0000 7ffba1ffb640 1 -- 10.20.193.28:0/606404843 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffb9400cd40 con 0x7ffbac10c1a0 2026-02-24T09:17:20.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.873+0000 7ffba1ffb640 1 -- 10.20.193.28:0/606404843 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ffb94004d10 con 0x7ffbac10c1a0 2026-02-24T09:17:20.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.873+0000 7ffba1ffb640 1 -- 10.20.193.28:0/606404843 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffb940106b0 con 0x7ffbac10c1a0 2026-02-24T09:17:20.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.873+0000 7ffbb1eea640 1 -- 10.20.193.28:0/606404843 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbac0f9db0 con 0x7ffbac10c1a0 2026-02-24T09:17:20.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.873+0000 7ffbb1eea640 1 -- 10.20.193.28:0/606404843 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbac0fa2d0 con 0x7ffbac10c1a0 2026-02-24T09:17:20.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.873+0000 7ffbb1eea640 1 -- 10.20.193.28:0/606404843 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbac05f9b0 con 0x7ffbac10c1a0 2026-02-24T09:17:20.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.876+0000 7ffba1ffb640 1 -- 10.20.193.28:0/606404843 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7ffb94004770 con 0x7ffbac10c1a0 2026-02-24T09:17:20.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.878+0000 7ffba1ffb640 1 --2- 10.20.193.28:0/606404843 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ffb880b5830 0x7ffb880d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:20.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.878+0000 7ffba1ffb640 1 -- 10.20.193.28:0/606404843 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7ffb94014070 con 0x7ffbac10c1a0 2026-02-24T09:17:20.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.878+0000 7ffbb0ee8640 1 --2- 10.20.193.28:0/606404843 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ffb880b5830 0x7ffb880d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:20.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.878+0000 7ffba1ffb640 1 -- 10.20.193.28:0/606404843 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7ffb940e76d0 con 0x7ffbac10c1a0 2026-02-24T09:17:20.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.878+0000 7ffbb0ee8640 1 --2- 10.20.193.28:0/606404843 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ffb880b5830 0x7ffb880d5ce0 secure :-1 s=READY pgs=194 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb9c004740 tx=0x7ffb9c009690 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:20.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.993+0000 7ffbb1eea640 1 -- 10.20.193.28:0/606404843 --> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffbac0f4ff0 con 0x7ffb880b5830 2026-02-24T09:17:20.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.996+0000 7ffba1ffb640 1 -- 10.20.193.28:0/606404843 <== mgr.14223 v2:10.20.193.28:6800/906910473 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258978 (secure 0 0 0) 0x7ffbac0f4ff0 con 0x7ffb880b5830 2026-02-24T09:17:20.998 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:17:20.998 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-24T09:17:20.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.999+0000 7ffbb1eea640 1 -- 10.20.193.28:0/606404843 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ffb880b5830 msgr2=0x7ffb880d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:20.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.999+0000 7ffbb1eea640 1 --2- 10.20.193.28:0/606404843 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ffb880b5830 0x7ffb880d5ce0 secure :-1 s=READY pgs=194 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb9c004740 tx=0x7ffb9c009690 comp rx=0 tx=0).stop 2026-02-24T09:17:20.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.999+0000 7ffbb1eea640 1 -- 10.20.193.28:0/606404843 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffbac10c1a0 msgr2=0x7ffbac173dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:20.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.999+0000 7ffbb1eea640 1 --2- 10.20.193.28:0/606404843 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffbac10c1a0 0x7ffbac173dd0 secure :-1 s=READY pgs=314 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb94009480 tx=0x7ffb9400ee60 comp rx=0 tx=0).stop 2026-02-24T09:17:20.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.999+0000 7ffbb1eea640 1 -- 10.20.193.28:0/606404843 shutdown_connections 2026-02-24T09:17:20.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.999+0000 7ffbb1eea640 1 --2- 10.20.193.28:0/606404843 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ffb880b5830 0x7ffb880d5ce0 unknown :-1 s=CLOSED pgs=194 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:20.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.999+0000 7ffbb1eea640 1 --2- 10.20.193.28:0/606404843 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ffbac113500 0x7ffbac0f45e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:21.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.999+0000 7ffbb1eea640 1 --2- 10.20.193.28:0/606404843 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffbac10c1a0 0x7ffbac173dd0 unknown :-1 s=CLOSED pgs=314 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:21.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.999+0000 7ffbb1eea640 1 --2- 10.20.193.28:0/606404843 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ffbac10b7b0 0x7ffbac0f3ee0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:21.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.999+0000 7ffbb1eea640 1 -- 10.20.193.28:0/606404843 >> 10.20.193.28:0/606404843 conn(0x7ffbac0e9260 msgr2=0x7ffbac111490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:21.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.999+0000 7ffbb1eea640 1 -- 10.20.193.28:0/606404843 shutdown_connections 2026-02-24T09:17:21.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:20.999+0000 7ffbb1eea640 1 -- 10.20.193.28:0/606404843 wait complete. 2026-02-24T09:17:21.098 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2026-02-24T09:17:19.274495+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":652135,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":208,"num_read_kb":211,"num_write":347,"num_write_kb":3826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":288,"ondisk_log_size":288,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":338772,"kb_used_data":12132,"kb_used_omap":440,"kb_used_meta":325959,"kb_avail":8807699628,"statfs":{"total":9019431321600,"available":9019084419072,"internally_reserved":0,"allocated":12423168,"data_stored":7860849,"data_compressed":113508,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":451011,"internal_metadata":333782589},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":59067,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":87,"num_read_kb":106,"num_write":80,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002528"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376724+0000","last_change":"2026-02-24T09:17:00.245387+0000","last_active":"2026-02-24T09:17:01.376724+0000","last_peered":"2026-02-24T09:17:01.376724+0000","last_clean":"2026-02-24T09:17:01.376724+0000","last_became_active":"2026-02-24T09:17:00.244938+0000","last_became_peered":"2026-02-24T09:17:00.244938+0000","last_unstale":"2026-02-24T09:17:01.376724+0000","last_undegraded":"2026-02-24T09:17:01.376724+0000","last_fullsized":"2026-02-24T09:17:01.376724+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:35:29.390820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376072+0000","last_change":"2026-02-24T09:17:00.236200+0000","last_active":"2026-02-24T09:17:01.376072+0000","last_peered":"2026-02-24T09:17:01.376072+0000","last_clean":"2026-02-24T09:17:01.376072+0000","last_became_active":"2026-02-24T09:17:00.236029+0000","last_became_peered":"2026-02-24T09:17:00.236029+0000","last_unstale":"2026-02-24T09:17:01.376072+0000","last_undegraded":"2026-02-24T09:17:01.376072+0000","last_fullsized":"2026-02-24T09:17:01.376072+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:06:22.417660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376003+0000","last_change":"2026-02-24T09:17:00.241494+0000","last_active":"2026-02-24T09:17:01.376003+0000","last_peered":"2026-02-24T09:17:01.376003+0000","last_clean":"2026-02-24T09:17:01.376003+0000","last_became_active":"2026-02-24T09:17:00.241220+0000","last_became_peered":"2026-02-24T09:17:00.241220+0000","last_unstale":"2026-02-24T09:17:01.376003+0000","last_undegraded":"2026-02-24T09:17:01.376003+0000","last_fullsized":"2026-02-24T09:17:01.376003+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:34:35.363256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375459+0000","last_change":"2026-02-24T09:17:00.245544+0000","last_active":"2026-02-24T09:17:01.375459+0000","last_peered":"2026-02-24T09:17:01.375459+0000","last_clean":"2026-02-24T09:17:01.375459+0000","last_became_active":"2026-02-24T09:17:00.245316+0000","last_became_peered":"2026-02-24T09:17:00.245316+0000","last_unstale":"2026-02-24T09:17:01.375459+0000","last_undegraded":"2026-02-24T09:17:01.375459+0000","last_fullsized":"2026-02-24T09:17:01.375459+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:44:07.848623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376966+0000","last_change":"2026-02-24T09:17:00.242163+0000","last_active":"2026-02-24T09:17:01.376966+0000","last_peered":"2026-02-24T09:17:01.376966+0000","last_clean":"2026-02-24T09:17:01.376966+0000","last_became_active":"2026-02-24T09:17:00.240475+0000","last_became_peered":"2026-02-24T09:17:00.240475+0000","last_unstale":"2026-02-24T09:17:01.376966+0000","last_undegraded":"2026-02-24T09:17:01.376966+0000","last_fullsized":"2026-02-24T09:17:01.376966+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:08:01.801955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231522+0000","last_change":"2026-02-24T09:17:00.239730+0000","last_active":"2026-02-24T09:17:01.231522+0000","last_peered":"2026-02-24T09:17:01.231522+0000","last_clean":"2026-02-24T09:17:01.231522+0000","last_became_active":"2026-02-24T09:17:00.239571+0000","last_became_peered":"2026-02-24T09:17:00.239571+0000","last_unstale":"2026-02-24T09:17:01.231522+0000","last_undegraded":"2026-02-24T09:17:01.231522+0000","last_fullsized":"2026-02-24T09:17:01.231522+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:44:51.158834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.609629+0000","last_change":"2026-02-24T09:17:00.246826+0000","last_active":"2026-02-24T09:17:01.609629+0000","last_peered":"2026-02-24T09:17:01.609629+0000","last_clean":"2026-02-24T09:17:01.609629+0000","last_became_active":"2026-02-24T09:17:00.246078+0000","last_became_peered":"2026-02-24T09:17:00.246078+0000","last_unstale":"2026-02-24T09:17:01.609629+0000","last_undegraded":"2026-02-24T09:17:01.609629+0000","last_fullsized":"2026-02-24T09:17:01.609629+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:01:08.591060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231860+0000","last_change":"2026-02-24T09:17:00.242859+0000","last_active":"2026-02-24T09:17:01.231860+0000","last_peered":"2026-02-24T09:17:01.231860+0000","last_clean":"2026-02-24T09:17:01.231860+0000","last_became_active":"2026-02-24T09:17:00.242754+0000","last_became_peered":"2026-02-24T09:17:00.242754+0000","last_unstale":"2026-02-24T09:17:01.231860+0000","last_undegraded":"2026-02-24T09:17:01.231860+0000","last_fullsized":"2026-02-24T09:17:01.231860+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:12:54.422166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376465+0000","last_change":"2026-02-24T09:17:00.243145+0000","last_active":"2026-02-24T09:17:01.376465+0000","last_peered":"2026-02-24T09:17:01.376465+0000","last_clean":"2026-02-24T09:17:01.376465+0000","last_became_active":"2026-02-24T09:17:00.242545+0000","last_became_peered":"2026-02-24T09:17:00.242545+0000","last_unstale":"2026-02-24T09:17:01.376465+0000","last_undegraded":"2026-02-24T09:17:01.376465+0000","last_fullsized":"2026-02-24T09:17:01.376465+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:57:48.262867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232059+0000","last_change":"2026-02-24T09:17:00.238410+0000","last_active":"2026-02-24T09:17:01.232059+0000","last_peered":"2026-02-24T09:17:01.232059+0000","last_clean":"2026-02-24T09:17:01.232059+0000","last_became_active":"2026-02-24T09:17:00.238208+0000","last_became_peered":"2026-02-24T09:17:00.238208+0000","last_unstale":"2026-02-24T09:17:01.232059+0000","last_undegraded":"2026-02-24T09:17:01.232059+0000","last_fullsized":"2026-02-24T09:17:01.232059+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:24:40.244153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.609971+0000","last_change":"2026-02-24T09:17:00.240756+0000","last_active":"2026-02-24T09:17:01.609971+0000","last_peered":"2026-02-24T09:17:01.609971+0000","last_clean":"2026-02-24T09:17:01.609971+0000","last_became_active":"2026-02-24T09:17:00.240549+0000","last_became_peered":"2026-02-24T09:17:00.240549+0000","last_unstale":"2026-02-24T09:17:01.609971+0000","last_undegraded":"2026-02-24T09:17:01.609971+0000","last_fullsized":"2026-02-24T09:17:01.609971+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:22:59.840951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375576+0000","last_change":"2026-02-24T09:17:00.244972+0000","last_active":"2026-02-24T09:17:01.375576+0000","last_peered":"2026-02-24T09:17:01.375576+0000","last_clean":"2026-02-24T09:17:01.375576+0000","last_became_active":"2026-02-24T09:17:00.244802+0000","last_became_peered":"2026-02-24T09:17:00.244802+0000","last_unstale":"2026-02-24T09:17:01.375576+0000","last_undegraded":"2026-02-24T09:17:01.375576+0000","last_fullsized":"2026-02-24T09:17:01.375576+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:23:42.961356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232520+0000","last_change":"2026-02-24T09:17:00.242225+0000","last_active":"2026-02-24T09:17:01.232520+0000","last_peered":"2026-02-24T09:17:01.232520+0000","last_clean":"2026-02-24T09:17:01.232520+0000","last_became_active":"2026-02-24T09:17:00.242034+0000","last_became_peered":"2026-02-24T09:17:00.242034+0000","last_unstale":"2026-02-24T09:17:01.232520+0000","last_undegraded":"2026-02-24T09:17:01.232520+0000","last_fullsized":"2026-02-24T09:17:01.232520+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:48:52.291960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375757+0000","last_change":"2026-02-24T09:17:00.236623+0000","last_active":"2026-02-24T09:17:01.375757+0000","last_peered":"2026-02-24T09:17:01.375757+0000","last_clean":"2026-02-24T09:17:01.375757+0000","last_became_active":"2026-02-24T09:17:00.236483+0000","last_became_peered":"2026-02-24T09:17:00.236483+0000","last_unstale":"2026-02-24T09:17:01.375757+0000","last_undegraded":"2026-02-24T09:17:01.375757+0000","last_fullsized":"2026-02-24T09:17:01.375757+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:39:38.003280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375602+0000","last_change":"2026-02-24T09:17:00.244527+0000","last_active":"2026-02-24T09:17:01.375602+0000","last_peered":"2026-02-24T09:17:01.375602+0000","last_clean":"2026-02-24T09:17:01.375602+0000","last_became_active":"2026-02-24T09:17:00.244187+0000","last_became_peered":"2026-02-24T09:17:00.244187+0000","last_unstale":"2026-02-24T09:17:01.375602+0000","last_undegraded":"2026-02-24T09:17:01.375602+0000","last_fullsized":"2026-02-24T09:17:01.375602+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:47:15.468911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375307+0000","last_change":"2026-02-24T09:17:00.243775+0000","last_active":"2026-02-24T09:17:01.375307+0000","last_peered":"2026-02-24T09:17:01.375307+0000","last_clean":"2026-02-24T09:17:01.375307+0000","last_became_active":"2026-02-24T09:17:00.243686+0000","last_became_peered":"2026-02-24T09:17:00.243686+0000","last_unstale":"2026-02-24T09:17:01.375307+0000","last_undegraded":"2026-02-24T09:17:01.375307+0000","last_fullsized":"2026-02-24T09:17:01.375307+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:54:25.237747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376808+0000","last_change":"2026-02-24T09:17:00.245658+0000","last_active":"2026-02-24T09:17:01.376808+0000","last_peered":"2026-02-24T09:17:01.376808+0000","last_clean":"2026-02-24T09:17:01.376808+0000","last_became_active":"2026-02-24T09:17:00.245551+0000","last_became_peered":"2026-02-24T09:17:00.245551+0000","last_unstale":"2026-02-24T09:17:01.376808+0000","last_undegraded":"2026-02-24T09:17:01.376808+0000","last_fullsized":"2026-02-24T09:17:01.376808+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:06:32.658730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376015+0000","last_change":"2026-02-24T09:17:00.241047+0000","last_active":"2026-02-24T09:17:01.376015+0000","last_peered":"2026-02-24T09:17:01.376015+0000","last_clean":"2026-02-24T09:17:01.376015+0000","last_became_active":"2026-02-24T09:17:00.240844+0000","last_became_peered":"2026-02-24T09:17:00.240844+0000","last_unstale":"2026-02-24T09:17:01.376015+0000","last_undegraded":"2026-02-24T09:17:01.376015+0000","last_fullsized":"2026-02-24T09:17:01.376015+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:50:07.221768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.233566+0000","last_change":"2026-02-24T09:17:00.240922+0000","last_active":"2026-02-24T09:17:01.233566+0000","last_peered":"2026-02-24T09:17:01.233566+0000","last_clean":"2026-02-24T09:17:01.233566+0000","last_became_active":"2026-02-24T09:17:00.240548+0000","last_became_peered":"2026-02-24T09:17:00.240548+0000","last_unstale":"2026-02-24T09:17:01.233566+0000","last_undegraded":"2026-02-24T09:17:01.233566+0000","last_fullsized":"2026-02-24T09:17:01.233566+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:30:44.534419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376664+0000","last_change":"2026-02-24T09:17:00.247308+0000","last_active":"2026-02-24T09:17:01.376664+0000","last_peered":"2026-02-24T09:17:01.376664+0000","last_clean":"2026-02-24T09:17:01.376664+0000","last_became_active":"2026-02-24T09:17:00.247135+0000","last_became_peered":"2026-02-24T09:17:00.247135+0000","last_unstale":"2026-02-24T09:17:01.376664+0000","last_undegraded":"2026-02-24T09:17:01.376664+0000","last_fullsized":"2026-02-24T09:17:01.376664+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:05:05.273336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232010+0000","last_change":"2026-02-24T09:17:00.242127+0000","last_active":"2026-02-24T09:17:01.232010+0000","last_peered":"2026-02-24T09:17:01.232010+0000","last_clean":"2026-02-24T09:17:01.232010+0000","last_became_active":"2026-02-24T09:17:00.241873+0000","last_became_peered":"2026-02-24T09:17:00.241873+0000","last_unstale":"2026-02-24T09:17:01.232010+0000","last_undegraded":"2026-02-24T09:17:01.232010+0000","last_fullsized":"2026-02-24T09:17:01.232010+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:36:44.961821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376289+0000","last_change":"2026-02-24T09:17:00.242993+0000","last_active":"2026-02-24T09:17:01.376289+0000","last_peered":"2026-02-24T09:17:01.376289+0000","last_clean":"2026-02-24T09:17:01.376289+0000","last_became_active":"2026-02-24T09:17:00.242422+0000","last_became_peered":"2026-02-24T09:17:00.242422+0000","last_unstale":"2026-02-24T09:17:01.376289+0000","last_undegraded":"2026-02-24T09:17:01.376289+0000","last_fullsized":"2026-02-24T09:17:01.376289+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:26:02.228158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231856+0000","last_change":"2026-02-24T09:17:00.238357+0000","last_active":"2026-02-24T09:17:01.231856+0000","last_peered":"2026-02-24T09:17:01.231856+0000","last_clean":"2026-02-24T09:17:01.231856+0000","last_became_active":"2026-02-24T09:17:00.236985+0000","last_became_peered":"2026-02-24T09:17:00.236985+0000","last_unstale":"2026-02-24T09:17:01.231856+0000","last_undegraded":"2026-02-24T09:17:01.231856+0000","last_fullsized":"2026-02-24T09:17:01.231856+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:21:51.769646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.377634+0000","last_change":"2026-02-24T09:17:00.242262+0000","last_active":"2026-02-24T09:17:01.377634+0000","last_peered":"2026-02-24T09:17:01.377634+0000","last_clean":"2026-02-24T09:17:01.377634+0000","last_became_active":"2026-02-24T09:17:00.240949+0000","last_became_peered":"2026-02-24T09:17:00.240949+0000","last_unstale":"2026-02-24T09:17:01.377634+0000","last_undegraded":"2026-02-24T09:17:01.377634+0000","last_fullsized":"2026-02-24T09:17:01.377634+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:58:56.715059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232175+0000","last_change":"2026-02-24T09:17:00.245461+0000","last_active":"2026-02-24T09:17:01.232175+0000","last_peered":"2026-02-24T09:17:01.232175+0000","last_clean":"2026-02-24T09:17:01.232175+0000","last_became_active":"2026-02-24T09:17:00.245379+0000","last_became_peered":"2026-02-24T09:17:00.245379+0000","last_unstale":"2026-02-24T09:17:01.232175+0000","last_undegraded":"2026-02-24T09:17:01.232175+0000","last_fullsized":"2026-02-24T09:17:01.232175+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:15:17.150043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.233635+0000","last_change":"2026-02-24T09:17:00.241481+0000","last_active":"2026-02-24T09:17:01.233635+0000","last_peered":"2026-02-24T09:17:01.233635+0000","last_clean":"2026-02-24T09:17:01.233635+0000","last_became_active":"2026-02-24T09:17:00.241338+0000","last_became_peered":"2026-02-24T09:17:00.241338+0000","last_unstale":"2026-02-24T09:17:01.233635+0000","last_undegraded":"2026-02-24T09:17:01.233635+0000","last_fullsized":"2026-02-24T09:17:01.233635+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:15:11.802265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376636+0000","last_change":"2026-02-24T09:17:00.244368+0000","last_active":"2026-02-24T09:17:01.376636+0000","last_peered":"2026-02-24T09:17:01.376636+0000","last_clean":"2026-02-24T09:17:01.376636+0000","last_became_active":"2026-02-24T09:17:00.244266+0000","last_became_peered":"2026-02-24T09:17:00.244266+0000","last_unstale":"2026-02-24T09:17:01.376636+0000","last_undegraded":"2026-02-24T09:17:01.376636+0000","last_fullsized":"2026-02-24T09:17:01.376636+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:53:30.615320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232157+0000","last_change":"2026-02-24T09:17:00.246040+0000","last_active":"2026-02-24T09:17:01.232157+0000","last_peered":"2026-02-24T09:17:01.232157+0000","last_clean":"2026-02-24T09:17:01.232157+0000","last_became_active":"2026-02-24T09:17:00.245960+0000","last_became_peered":"2026-02-24T09:17:00.245960+0000","last_unstale":"2026-02-24T09:17:01.232157+0000","last_undegraded":"2026-02-24T09:17:01.232157+0000","last_fullsized":"2026-02-24T09:17:01.232157+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:40:44.935311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375704+0000","last_change":"2026-02-24T09:17:00.237870+0000","last_active":"2026-02-24T09:17:01.375704+0000","last_peered":"2026-02-24T09:17:01.375704+0000","last_clean":"2026-02-24T09:17:01.375704+0000","last_became_active":"2026-02-24T09:17:00.237745+0000","last_became_peered":"2026-02-24T09:17:00.237745+0000","last_unstale":"2026-02-24T09:17:01.375704+0000","last_undegraded":"2026-02-24T09:17:01.375704+0000","last_fullsized":"2026-02-24T09:17:01.375704+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:46:16.173715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.233458+0000","last_change":"2026-02-24T09:17:00.242559+0000","last_active":"2026-02-24T09:17:01.233458+0000","last_peered":"2026-02-24T09:17:01.233458+0000","last_clean":"2026-02-24T09:17:01.233458+0000","last_became_active":"2026-02-24T09:17:00.242457+0000","last_became_peered":"2026-02-24T09:17:00.242457+0000","last_unstale":"2026-02-24T09:17:01.233458+0000","last_undegraded":"2026-02-24T09:17:01.233458+0000","last_fullsized":"2026-02-24T09:17:01.233458+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:20:59.258363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.233170+0000","last_change":"2026-02-24T09:17:00.245177+0000","last_active":"2026-02-24T09:17:01.233170+0000","last_peered":"2026-02-24T09:17:01.233170+0000","last_clean":"2026-02-24T09:17:01.233170+0000","last_became_active":"2026-02-24T09:17:00.245074+0000","last_became_peered":"2026-02-24T09:17:00.245074+0000","last_unstale":"2026-02-24T09:17:01.233170+0000","last_undegraded":"2026-02-24T09:17:01.233170+0000","last_fullsized":"2026-02-24T09:17:01.233170+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:10:45.134678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376730+0000","last_change":"2026-02-24T09:17:00.242875+0000","last_active":"2026-02-24T09:17:01.376730+0000","last_peered":"2026-02-24T09:17:01.376730+0000","last_clean":"2026-02-24T09:17:01.376730+0000","last_became_active":"2026-02-24T09:17:00.242769+0000","last_became_peered":"2026-02-24T09:17:00.242769+0000","last_unstale":"2026-02-24T09:17:01.376730+0000","last_undegraded":"2026-02-24T09:17:01.376730+0000","last_fullsized":"2026-02-24T09:17:01.376730+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:38:25.732620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376955+0000","last_change":"2026-02-24T09:17:00.244244+0000","last_active":"2026-02-24T09:17:01.376955+0000","last_peered":"2026-02-24T09:17:01.376955+0000","last_clean":"2026-02-24T09:17:01.376955+0000","last_became_active":"2026-02-24T09:17:00.244160+0000","last_became_peered":"2026-02-24T09:17:00.244160+0000","last_unstale":"2026-02-24T09:17:01.376955+0000","last_undegraded":"2026-02-24T09:17:01.376955+0000","last_fullsized":"2026-02-24T09:17:01.376955+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:04:37.036726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"92'6","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:15.580931+0000","last_change":"2026-02-24T09:16:59.240672+0000","last_active":"2026-02-24T09:17:15.580931+0000","last_peered":"2026-02-24T09:17:15.580931+0000","last_clean":"2026-02-24T09:17:15.580931+0000","last_became_active":"2026-02-24T09:16:59.240414+0000","last_became_peered":"2026-02-24T09:16:59.240414+0000","last_unstale":"2026-02-24T09:17:15.580931+0000","last_undegraded":"2026-02-24T09:17:15.580931+0000","last_fullsized":"2026-02-24T09:17:15.580931+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:41:36.122890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1032,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.377837+0000","last_change":"2026-02-24T09:17:00.243064+0000","last_active":"2026-02-24T09:17:01.377837+0000","last_peered":"2026-02-24T09:17:01.377837+0000","last_clean":"2026-02-24T09:17:01.377837+0000","last_became_active":"2026-02-24T09:17:00.242916+0000","last_became_peered":"2026-02-24T09:17:00.242916+0000","last_unstale":"2026-02-24T09:17:01.377837+0000","last_undegraded":"2026-02-24T09:17:01.377837+0000","last_fullsized":"2026-02-24T09:17:01.377837+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:54:10.866892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"92'3","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.255220+0000","last_change":"2026-02-24T09:16:59.240197+0000","last_active":"2026-02-24T09:17:05.255220+0000","last_peered":"2026-02-24T09:17:05.255220+0000","last_clean":"2026-02-24T09:17:05.255220+0000","last_became_active":"2026-02-24T09:16:59.240036+0000","last_became_peered":"2026-02-24T09:16:59.240036+0000","last_unstale":"2026-02-24T09:17:05.255220+0000","last_undegraded":"2026-02-24T09:17:05.255220+0000","last_fullsized":"2026-02-24T09:17:05.255220+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:10:20.710884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"92'2","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.256064+0000","last_change":"2026-02-24T09:16:59.235467+0000","last_active":"2026-02-24T09:17:05.256064+0000","last_peered":"2026-02-24T09:17:05.256064+0000","last_clean":"2026-02-24T09:17:05.256064+0000","last_became_active":"2026-02-24T09:16:59.235262+0000","last_became_peered":"2026-02-24T09:16:59.235262+0000","last_unstale":"2026-02-24T09:17:05.256064+0000","last_undegraded":"2026-02-24T09:17:05.256064+0000","last_fullsized":"2026-02-24T09:17:05.256064+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:15:01.906008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231788+0000","last_change":"2026-02-24T09:17:00.237830+0000","last_active":"2026-02-24T09:17:01.231788+0000","last_peered":"2026-02-24T09:17:01.231788+0000","last_clean":"2026-02-24T09:17:01.231788+0000","last_became_active":"2026-02-24T09:17:00.237730+0000","last_became_peered":"2026-02-24T09:17:00.237730+0000","last_unstale":"2026-02-24T09:17:01.231788+0000","last_undegraded":"2026-02-24T09:17:01.231788+0000","last_fullsized":"2026-02-24T09:17:01.231788+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:49:14.120510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"92'1","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:02.469482+0000","last_change":"2026-02-24T09:16:59.238783+0000","last_active":"2026-02-24T09:17:02.469482+0000","last_peered":"2026-02-24T09:17:02.469482+0000","last_clean":"2026-02-24T09:17:02.469482+0000","last_became_active":"2026-02-24T09:16:59.238700+0000","last_became_peered":"2026-02-24T09:16:59.238700+0000","last_unstale":"2026-02-24T09:17:02.469482+0000","last_undegraded":"2026-02-24T09:17:02.469482+0000","last_fullsized":"2026-02-24T09:17:02.469482+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:07:28.426507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375760+0000","last_change":"2026-02-24T09:17:00.240566+0000","last_active":"2026-02-24T09:17:01.375760+0000","last_peered":"2026-02-24T09:17:01.375760+0000","last_clean":"2026-02-24T09:17:01.375760+0000","last_became_active":"2026-02-24T09:17:00.239787+0000","last_became_peered":"2026-02-24T09:17:00.239787+0000","last_unstale":"2026-02-24T09:17:01.375760+0000","last_undegraded":"2026-02-24T09:17:01.375760+0000","last_fullsized":"2026-02-24T09:17:01.375760+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:37:55.629531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"92'3","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:14.578601+0000","last_change":"2026-02-24T09:16:59.239817+0000","last_active":"2026-02-24T09:17:14.578601+0000","last_peered":"2026-02-24T09:17:14.578601+0000","last_clean":"2026-02-24T09:17:14.578601+0000","last_became_active":"2026-02-24T09:16:59.239753+0000","last_became_peered":"2026-02-24T09:16:59.239753+0000","last_unstale":"2026-02-24T09:17:14.578601+0000","last_undegraded":"2026-02-24T09:17:14.578601+0000","last_fullsized":"2026-02-24T09:17:14.578601+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:25:15.726537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376407+0000","last_change":"2026-02-24T09:17:00.242220+0000","last_active":"2026-02-24T09:17:01.376407+0000","last_peered":"2026-02-24T09:17:01.376407+0000","last_clean":"2026-02-24T09:17:01.376407+0000","last_became_active":"2026-02-24T09:17:00.241795+0000","last_became_peered":"2026-02-24T09:17:00.241795+0000","last_unstale":"2026-02-24T09:17:01.376407+0000","last_undegraded":"2026-02-24T09:17:01.376407+0000","last_fullsized":"2026-02-24T09:17:01.376407+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:16:26.952516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"92'2","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:04.250229+0000","last_change":"2026-02-24T09:16:59.237294+0000","last_active":"2026-02-24T09:17:04.250229+0000","last_peered":"2026-02-24T09:17:04.250229+0000","last_clean":"2026-02-24T09:17:04.250229+0000","last_became_active":"2026-02-24T09:16:59.237192+0000","last_became_peered":"2026-02-24T09:16:59.237192+0000","last_unstale":"2026-02-24T09:17:04.250229+0000","last_undegraded":"2026-02-24T09:17:04.250229+0000","last_fullsized":"2026-02-24T09:17:04.250229+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:28:54.216539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375947+0000","last_change":"2026-02-24T09:17:00.244365+0000","last_active":"2026-02-24T09:17:01.375947+0000","last_peered":"2026-02-24T09:17:01.375947+0000","last_clean":"2026-02-24T09:17:01.375947+0000","last_became_active":"2026-02-24T09:17:00.244262+0000","last_became_peered":"2026-02-24T09:17:00.244262+0000","last_unstale":"2026-02-24T09:17:01.375947+0000","last_undegraded":"2026-02-24T09:17:01.375947+0000","last_fullsized":"2026-02-24T09:17:01.375947+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:46:44.145479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"92'4","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:04.250710+0000","last_change":"2026-02-24T09:16:59.240964+0000","last_active":"2026-02-24T09:17:04.250710+0000","last_peered":"2026-02-24T09:17:04.250710+0000","last_clean":"2026-02-24T09:17:04.250710+0000","last_became_active":"2026-02-24T09:16:59.240812+0000","last_became_peered":"2026-02-24T09:16:59.240812+0000","last_unstale":"2026-02-24T09:17:04.250710+0000","last_undegraded":"2026-02-24T09:17:04.250710+0000","last_fullsized":"2026-02-24T09:17:04.250710+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:07:51.752070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376252+0000","last_change":"2026-02-24T09:17:00.245692+0000","last_active":"2026-02-24T09:17:01.376252+0000","last_peered":"2026-02-24T09:17:01.376252+0000","last_clean":"2026-02-24T09:17:01.376252+0000","last_became_active":"2026-02-24T09:17:00.245616+0000","last_became_peered":"2026-02-24T09:17:00.245616+0000","last_unstale":"2026-02-24T09:17:01.376252+0000","last_undegraded":"2026-02-24T09:17:01.376252+0000","last_fullsized":"2026-02-24T09:17:01.376252+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:03:42.649936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"92'25","reported_seq":69,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:15.583090+0000","last_change":"2026-02-24T09:16:59.243723+0000","last_active":"2026-02-24T09:17:15.583090+0000","last_peered":"2026-02-24T09:17:15.583090+0000","last_clean":"2026-02-24T09:17:15.583090+0000","last_became_active":"2026-02-24T09:16:59.243606+0000","last_became_peered":"2026-02-24T09:16:59.243606+0000","last_unstale":"2026-02-24T09:17:15.583090+0000","last_undegraded":"2026-02-24T09:17:15.583090+0000","last_fullsized":"2026-02-24T09:17:15.583090+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:35:14.333104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57073,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":69,"num_write":26,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.377374+0000","last_change":"2026-02-24T09:17:00.237314+0000","last_active":"2026-02-24T09:17:01.377374+0000","last_peered":"2026-02-24T09:17:01.377374+0000","last_clean":"2026-02-24T09:17:01.377374+0000","last_became_active":"2026-02-24T09:17:00.237210+0000","last_became_peered":"2026-02-24T09:17:00.237210+0000","last_unstale":"2026-02-24T09:17:01.377374+0000","last_undegraded":"2026-02-24T09:17:01.377374+0000","last_fullsized":"2026-02-24T09:17:01.377374+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:03:03.936414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"92'6","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.257112+0000","last_change":"2026-02-24T09:16:59.242567+0000","last_active":"2026-02-24T09:17:05.257112+0000","last_peered":"2026-02-24T09:17:05.257112+0000","last_clean":"2026-02-24T09:17:05.257112+0000","last_became_active":"2026-02-24T09:16:59.242420+0000","last_became_peered":"2026-02-24T09:16:59.242420+0000","last_unstale":"2026-02-24T09:17:05.257112+0000","last_undegraded":"2026-02-24T09:17:05.257112+0000","last_fullsized":"2026-02-24T09:17:05.257112+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:58:16.881321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231844+0000","last_change":"2026-02-24T09:17:00.239405+0000","last_active":"2026-02-24T09:17:01.231844+0000","last_peered":"2026-02-24T09:17:01.231844+0000","last_clean":"2026-02-24T09:17:01.231844+0000","last_became_active":"2026-02-24T09:17:00.239281+0000","last_became_peered":"2026-02-24T09:17:00.239281+0000","last_unstale":"2026-02-24T09:17:01.231844+0000","last_undegraded":"2026-02-24T09:17:01.231844+0000","last_fullsized":"2026-02-24T09:17:01.231844+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:19:48.176289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"92'3","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:04.250578+0000","last_change":"2026-02-24T09:16:59.242394+0000","last_active":"2026-02-24T09:17:04.250578+0000","last_peered":"2026-02-24T09:17:04.250578+0000","last_clean":"2026-02-24T09:17:04.250578+0000","last_became_active":"2026-02-24T09:16:59.242199+0000","last_became_peered":"2026-02-24T09:16:59.242199+0000","last_unstale":"2026-02-24T09:17:04.250578+0000","last_undegraded":"2026-02-24T09:17:04.250578+0000","last_fullsized":"2026-02-24T09:17:04.250578+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:04:12.763715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.610151+0000","last_change":"2026-02-24T09:17:00.237820+0000","last_active":"2026-02-24T09:17:01.610151+0000","last_peered":"2026-02-24T09:17:01.610151+0000","last_clean":"2026-02-24T09:17:01.610151+0000","last_became_active":"2026-02-24T09:17:00.237711+0000","last_became_peered":"2026-02-24T09:17:00.237711+0000","last_unstale":"2026-02-24T09:17:01.610151+0000","last_undegraded":"2026-02-24T09:17:01.610151+0000","last_fullsized":"2026-02-24T09:17:01.610151+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:27:44.269231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"92'4","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:14.581922+0000","last_change":"2026-02-24T09:16:59.239787+0000","last_active":"2026-02-24T09:17:14.581922+0000","last_peered":"2026-02-24T09:17:14.581922+0000","last_clean":"2026-02-24T09:17:14.581922+0000","last_became_active":"2026-02-24T09:16:59.239066+0000","last_became_peered":"2026-02-24T09:16:59.239066+0000","last_unstale":"2026-02-24T09:17:14.581922+0000","last_undegraded":"2026-02-24T09:17:14.581922+0000","last_fullsized":"2026-02-24T09:17:14.581922+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:10:34.992034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.609694+0000","last_change":"2026-02-24T09:17:00.246515+0000","last_active":"2026-02-24T09:17:01.609694+0000","last_peered":"2026-02-24T09:17:01.609694+0000","last_clean":"2026-02-24T09:17:01.609694+0000","last_became_active":"2026-02-24T09:17:00.246222+0000","last_became_peered":"2026-02-24T09:17:00.246222+0000","last_unstale":"2026-02-24T09:17:01.609694+0000","last_undegraded":"2026-02-24T09:17:01.609694+0000","last_fullsized":"2026-02-24T09:17:01.609694+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:28:05.377985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"92'15","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.257255+0000","last_change":"2026-02-24T09:16:59.239752+0000","last_active":"2026-02-24T09:17:05.257255+0000","last_peered":"2026-02-24T09:17:05.257255+0000","last_clean":"2026-02-24T09:17:05.257255+0000","last_became_active":"2026-02-24T09:16:59.239609+0000","last_became_peered":"2026-02-24T09:16:59.239609+0000","last_unstale":"2026-02-24T09:17:05.257255+0000","last_undegraded":"2026-02-24T09:17:05.257255+0000","last_fullsized":"2026-02-24T09:17:05.257255+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:30:54.943423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.378159+0000","last_change":"2026-02-24T09:17:00.246053+0000","last_active":"2026-02-24T09:17:01.378159+0000","last_peered":"2026-02-24T09:17:01.378159+0000","last_clean":"2026-02-24T09:17:01.378159+0000","last_became_active":"2026-02-24T09:17:00.245905+0000","last_became_peered":"2026-02-24T09:17:00.245905+0000","last_unstale":"2026-02-24T09:17:01.378159+0000","last_undegraded":"2026-02-24T09:17:01.378159+0000","last_fullsized":"2026-02-24T09:17:01.378159+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:36:56.843524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"92'2","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.570884+0000","last_change":"2026-02-24T09:16:59.241232+0000","last_active":"2026-02-24T09:17:05.570884+0000","last_peered":"2026-02-24T09:17:05.570884+0000","last_clean":"2026-02-24T09:17:05.570884+0000","last_became_active":"2026-02-24T09:16:59.240754+0000","last_became_peered":"2026-02-24T09:16:59.240754+0000","last_unstale":"2026-02-24T09:17:05.570884+0000","last_undegraded":"2026-02-24T09:17:05.570884+0000","last_fullsized":"2026-02-24T09:17:05.570884+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:57:01.258617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376875+0000","last_change":"2026-02-24T09:17:00.246591+0000","last_active":"2026-02-24T09:17:01.376875+0000","last_peered":"2026-02-24T09:17:01.376875+0000","last_clean":"2026-02-24T09:17:01.376875+0000","last_became_active":"2026-02-24T09:17:00.246487+0000","last_became_peered":"2026-02-24T09:17:00.246487+0000","last_unstale":"2026-02-24T09:17:01.376875+0000","last_undegraded":"2026-02-24T09:17:01.376875+0000","last_fullsized":"2026-02-24T09:17:01.376875+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:58:37.854234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"91'2","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232200+0000","last_change":"2026-02-24T09:16:59.239102+0000","last_active":"2026-02-24T09:17:01.232200+0000","last_peered":"2026-02-24T09:17:01.232200+0000","last_clean":"2026-02-24T09:17:01.232200+0000","last_became_active":"2026-02-24T09:16:59.238978+0000","last_became_peered":"2026-02-24T09:16:59.238978+0000","last_unstale":"2026-02-24T09:17:01.232200+0000","last_undegraded":"2026-02-24T09:17:01.232200+0000","last_fullsized":"2026-02-24T09:17:01.232200+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:57:02.192151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.610201+0000","last_change":"2026-02-24T09:17:00.238578+0000","last_active":"2026-02-24T09:17:01.610201+0000","last_peered":"2026-02-24T09:17:01.610201+0000","last_clean":"2026-02-24T09:17:01.610201+0000","last_became_active":"2026-02-24T09:17:00.238465+0000","last_became_peered":"2026-02-24T09:17:00.238465+0000","last_unstale":"2026-02-24T09:17:01.610201+0000","last_undegraded":"2026-02-24T09:17:01.610201+0000","last_fullsized":"2026-02-24T09:17:01.610201+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:44:35.349567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"91'1","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:02.469552+0000","last_change":"2026-02-24T09:16:59.242643+0000","last_active":"2026-02-24T09:17:02.469552+0000","last_peered":"2026-02-24T09:17:02.469552+0000","last_clean":"2026-02-24T09:17:02.469552+0000","last_became_active":"2026-02-24T09:16:59.242376+0000","last_became_peered":"2026-02-24T09:16:59.242376+0000","last_unstale":"2026-02-24T09:17:02.469552+0000","last_undegraded":"2026-02-24T09:17:02.469552+0000","last_fullsized":"2026-02-24T09:17:02.469552+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:27:11.004972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"92'1","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.609794+0000","last_change":"2026-02-24T09:17:00.246332+0000","last_active":"2026-02-24T09:17:01.609794+0000","last_peered":"2026-02-24T09:17:01.609794+0000","last_clean":"2026-02-24T09:17:01.609794+0000","last_became_active":"2026-02-24T09:17:00.246194+0000","last_became_peered":"2026-02-24T09:17:00.246194+0000","last_unstale":"2026-02-24T09:17:01.609794+0000","last_undegraded":"2026-02-24T09:17:01.609794+0000","last_fullsized":"2026-02-24T09:17:01.609794+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:58:11.173666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"92'3","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.257225+0000","last_change":"2026-02-24T09:16:59.243374+0000","last_active":"2026-02-24T09:17:05.257225+0000","last_peered":"2026-02-24T09:17:05.257225+0000","last_clean":"2026-02-24T09:17:05.257225+0000","last_became_active":"2026-02-24T09:16:59.241003+0000","last_became_peered":"2026-02-24T09:16:59.241003+0000","last_unstale":"2026-02-24T09:17:05.257225+0000","last_undegraded":"2026-02-24T09:17:05.257225+0000","last_fullsized":"2026-02-24T09:17:05.257225+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:26:57.571616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.610188+0000","last_change":"2026-02-24T09:17:00.240655+0000","last_active":"2026-02-24T09:17:01.610188+0000","last_peered":"2026-02-24T09:17:01.610188+0000","last_clean":"2026-02-24T09:17:01.610188+0000","last_became_active":"2026-02-24T09:17:00.240419+0000","last_became_peered":"2026-02-24T09:17:00.240419+0000","last_unstale":"2026-02-24T09:17:01.610188+0000","last_undegraded":"2026-02-24T09:17:01.610188+0000","last_fullsized":"2026-02-24T09:17:01.610188+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:18:34.651497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"25'152","reported_seq":371,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.609797+0000","last_change":"2026-02-24T09:16:23.569634+0000","last_active":"2026-02-24T09:17:01.609797+0000","last_peered":"2026-02-24T09:17:01.609797+0000","last_clean":"2026-02-24T09:17:01.609797+0000","last_became_active":"2026-02-24T09:16:23.569284+0000","last_became_peered":"2026-02-24T09:16:23.569284+0000","last_unstale":"2026-02-24T09:17:01.609797+0000","last_undegraded":"2026-02-24T09:17:01.609797+0000","last_fullsized":"2026-02-24T09:17:01.609797+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:14:34.386267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:14:34.386267+0000","last_clean_scrub_stamp":"2026-02-24T09:14:34.386267+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:03:26.216331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"92'3","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.568942+0000","last_change":"2026-02-24T09:16:59.239216+0000","last_active":"2026-02-24T09:17:05.568942+0000","last_peered":"2026-02-24T09:17:05.568942+0000","last_clean":"2026-02-24T09:17:05.568942+0000","last_became_active":"2026-02-24T09:16:59.239009+0000","last_became_peered":"2026-02-24T09:16:59.239009+0000","last_unstale":"2026-02-24T09:17:05.568942+0000","last_undegraded":"2026-02-24T09:17:05.568942+0000","last_fullsized":"2026-02-24T09:17:05.568942+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:51:32.186590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231677+0000","last_change":"2026-02-24T09:17:00.242943+0000","last_active":"2026-02-24T09:17:01.231677+0000","last_peered":"2026-02-24T09:17:01.231677+0000","last_clean":"2026-02-24T09:17:01.231677+0000","last_became_active":"2026-02-24T09:17:00.242841+0000","last_became_peered":"2026-02-24T09:17:00.242841+0000","last_unstale":"2026-02-24T09:17:01.231677+0000","last_undegraded":"2026-02-24T09:17:01.231677+0000","last_fullsized":"2026-02-24T09:17:01.231677+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:27:23.973327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"92'3","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.254697+0000","last_change":"2026-02-24T09:16:59.239635+0000","last_active":"2026-02-24T09:17:05.254697+0000","last_peered":"2026-02-24T09:17:05.254697+0000","last_clean":"2026-02-24T09:17:05.254697+0000","last_became_active":"2026-02-24T09:16:59.239565+0000","last_became_peered":"2026-02-24T09:16:59.239565+0000","last_unstale":"2026-02-24T09:17:05.254697+0000","last_undegraded":"2026-02-24T09:17:05.254697+0000","last_fullsized":"2026-02-24T09:17:05.254697+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:33:03.541374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231556+0000","last_change":"2026-02-24T09:17:00.244300+0000","last_active":"2026-02-24T09:17:01.231556+0000","last_peered":"2026-02-24T09:17:01.231556+0000","last_clean":"2026-02-24T09:17:01.231556+0000","last_became_active":"2026-02-24T09:17:00.244133+0000","last_became_peered":"2026-02-24T09:17:00.244133+0000","last_unstale":"2026-02-24T09:17:01.231556+0000","last_undegraded":"2026-02-24T09:17:01.231556+0000","last_fullsized":"2026-02-24T09:17:01.231556+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:42:14.299522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"92'4","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:15.582901+0000","last_change":"2026-02-24T09:16:59.242539+0000","last_active":"2026-02-24T09:17:15.582901+0000","last_peered":"2026-02-24T09:17:15.582901+0000","last_clean":"2026-02-24T09:17:15.582901+0000","last_became_active":"2026-02-24T09:16:59.242210+0000","last_became_peered":"2026-02-24T09:16:59.242210+0000","last_unstale":"2026-02-24T09:17:15.582901+0000","last_undegraded":"2026-02-24T09:17:15.582901+0000","last_fullsized":"2026-02-24T09:17:15.582901+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:47:26.799485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.377784+0000","last_change":"2026-02-24T09:17:00.246745+0000","last_active":"2026-02-24T09:17:01.377784+0000","last_peered":"2026-02-24T09:17:01.377784+0000","last_clean":"2026-02-24T09:17:01.377784+0000","last_became_active":"2026-02-24T09:17:00.246652+0000","last_became_peered":"2026-02-24T09:17:00.246652+0000","last_unstale":"2026-02-24T09:17:01.377784+0000","last_undegraded":"2026-02-24T09:17:01.377784+0000","last_fullsized":"2026-02-24T09:17:01.377784+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:16:56.265530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"92'1","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.610257+0000","last_change":"2026-02-24T09:16:59.235982+0000","last_active":"2026-02-24T09:17:01.610257+0000","last_peered":"2026-02-24T09:17:01.610257+0000","last_clean":"2026-02-24T09:17:01.610257+0000","last_became_active":"2026-02-24T09:16:59.235893+0000","last_became_peered":"2026-02-24T09:16:59.235893+0000","last_unstale":"2026-02-24T09:17:01.610257+0000","last_undegraded":"2026-02-24T09:17:01.610257+0000","last_fullsized":"2026-02-24T09:17:01.610257+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:02:50.906502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231934+0000","last_change":"2026-02-24T09:17:00.237347+0000","last_active":"2026-02-24T09:17:01.231934+0000","last_peered":"2026-02-24T09:17:01.231934+0000","last_clean":"2026-02-24T09:17:01.231934+0000","last_became_active":"2026-02-24T09:17:00.237254+0000","last_became_peered":"2026-02-24T09:17:00.237254+0000","last_unstale":"2026-02-24T09:17:01.231934+0000","last_undegraded":"2026-02-24T09:17:01.231934+0000","last_fullsized":"2026-02-24T09:17:01.231934+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:26:24.955214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375984+0000","last_change":"2026-02-24T09:16:59.244271+0000","last_active":"2026-02-24T09:17:01.375984+0000","last_peered":"2026-02-24T09:17:01.375984+0000","last_clean":"2026-02-24T09:17:01.375984+0000","last_became_active":"2026-02-24T09:16:59.243995+0000","last_became_peered":"2026-02-24T09:16:59.243995+0000","last_unstale":"2026-02-24T09:17:01.375984+0000","last_undegraded":"2026-02-24T09:17:01.375984+0000","last_fullsized":"2026-02-24T09:17:01.375984+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:23:30.140261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"92'1","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231998+0000","last_change":"2026-02-24T09:17:00.238722+0000","last_active":"2026-02-24T09:17:01.231998+0000","last_peered":"2026-02-24T09:17:01.231998+0000","last_clean":"2026-02-24T09:17:01.231998+0000","last_became_active":"2026-02-24T09:17:00.238067+0000","last_became_peered":"2026-02-24T09:17:00.238067+0000","last_unstale":"2026-02-24T09:17:01.231998+0000","last_undegraded":"2026-02-24T09:17:01.231998+0000","last_fullsized":"2026-02-24T09:17:01.231998+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:15:12.608200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"92'1","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:04.250009+0000","last_change":"2026-02-24T09:16:59.240637+0000","last_active":"2026-02-24T09:17:04.250009+0000","last_peered":"2026-02-24T09:17:04.250009+0000","last_clean":"2026-02-24T09:17:04.250009+0000","last_became_active":"2026-02-24T09:16:59.240525+0000","last_became_peered":"2026-02-24T09:16:59.240525+0000","last_unstale":"2026-02-24T09:17:04.250009+0000","last_undegraded":"2026-02-24T09:17:04.250009+0000","last_fullsized":"2026-02-24T09:17:04.250009+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:19:39.812071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232103+0000","last_change":"2026-02-24T09:17:00.242384+0000","last_active":"2026-02-24T09:17:01.232103+0000","last_peered":"2026-02-24T09:17:01.232103+0000","last_clean":"2026-02-24T09:17:01.232103+0000","last_became_active":"2026-02-24T09:17:00.242252+0000","last_became_peered":"2026-02-24T09:17:00.242252+0000","last_unstale":"2026-02-24T09:17:01.232103+0000","last_undegraded":"2026-02-24T09:17:01.232103+0000","last_fullsized":"2026-02-24T09:17:01.232103+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:55:25.276787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"92'9","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:14.482300+0000","last_change":"2026-02-24T09:16:59.242386+0000","last_active":"2026-02-24T09:17:14.482300+0000","last_peered":"2026-02-24T09:17:14.482300+0000","last_clean":"2026-02-24T09:17:14.482300+0000","last_became_active":"2026-02-24T09:16:59.240737+0000","last_became_peered":"2026-02-24T09:16:59.240737+0000","last_unstale":"2026-02-24T09:17:14.482300+0000","last_undegraded":"2026-02-24T09:17:14.482300+0000","last_fullsized":"2026-02-24T09:17:14.482300+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:35:28.471311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232263+0000","last_change":"2026-02-24T09:17:00.239525+0000","last_active":"2026-02-24T09:17:01.232263+0000","last_peered":"2026-02-24T09:17:01.232263+0000","last_clean":"2026-02-24T09:17:01.232263+0000","last_became_active":"2026-02-24T09:17:00.239161+0000","last_became_peered":"2026-02-24T09:17:00.239161+0000","last_unstale":"2026-02-24T09:17:01.232263+0000","last_undegraded":"2026-02-24T09:17:01.232263+0000","last_fullsized":"2026-02-24T09:17:01.232263+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:35:14.881330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"92'4","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:04.248734+0000","last_change":"2026-02-24T09:16:59.233525+0000","last_active":"2026-02-24T09:17:04.248734+0000","last_peered":"2026-02-24T09:17:04.248734+0000","last_clean":"2026-02-24T09:17:04.248734+0000","last_became_active":"2026-02-24T09:16:59.233370+0000","last_became_peered":"2026-02-24T09:16:59.233370+0000","last_unstale":"2026-02-24T09:17:04.248734+0000","last_undegraded":"2026-02-24T09:17:04.248734+0000","last_fullsized":"2026-02-24T09:17:04.248734+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:49:37.491011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376128+0000","last_change":"2026-02-24T09:17:00.241506+0000","last_active":"2026-02-24T09:17:01.376128+0000","last_peered":"2026-02-24T09:17:01.376128+0000","last_clean":"2026-02-24T09:17:01.376128+0000","last_became_active":"2026-02-24T09:17:00.241385+0000","last_became_peered":"2026-02-24T09:17:00.241385+0000","last_unstale":"2026-02-24T09:17:01.376128+0000","last_undegraded":"2026-02-24T09:17:01.376128+0000","last_fullsized":"2026-02-24T09:17:01.376128+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:17:11.846529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"92'2","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:04.249681+0000","last_change":"2026-02-24T09:16:59.238575+0000","last_active":"2026-02-24T09:17:04.249681+0000","last_peered":"2026-02-24T09:17:04.249681+0000","last_clean":"2026-02-24T09:17:04.249681+0000","last_became_active":"2026-02-24T09:16:59.238286+0000","last_became_peered":"2026-02-24T09:16:59.238286+0000","last_unstale":"2026-02-24T09:17:04.249681+0000","last_undegraded":"2026-02-24T09:17:04.249681+0000","last_fullsized":"2026-02-24T09:17:04.249681+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:18:59.982647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376961+0000","last_change":"2026-02-24T09:17:00.238159+0000","last_active":"2026-02-24T09:17:01.376961+0000","last_peered":"2026-02-24T09:17:01.376961+0000","last_clean":"2026-02-24T09:17:01.376961+0000","last_became_active":"2026-02-24T09:17:00.238069+0000","last_became_peered":"2026-02-24T09:17:00.238069+0000","last_unstale":"2026-02-24T09:17:01.376961+0000","last_undegraded":"2026-02-24T09:17:01.376961+0000","last_fullsized":"2026-02-24T09:17:01.376961+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:45:21.584921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"92'3","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:04.250654+0000","last_change":"2026-02-24T09:16:59.241444+0000","last_active":"2026-02-24T09:17:04.250654+0000","last_peered":"2026-02-24T09:17:04.250654+0000","last_clean":"2026-02-24T09:17:04.250654+0000","last_became_active":"2026-02-24T09:16:59.241253+0000","last_became_peered":"2026-02-24T09:16:59.241253+0000","last_unstale":"2026-02-24T09:17:04.250654+0000","last_undegraded":"2026-02-24T09:17:04.250654+0000","last_fullsized":"2026-02-24T09:17:04.250654+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:07:34.833768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376780+0000","last_change":"2026-02-24T09:17:00.245603+0000","last_active":"2026-02-24T09:17:01.376780+0000","last_peered":"2026-02-24T09:17:01.376780+0000","last_clean":"2026-02-24T09:17:01.376780+0000","last_became_active":"2026-02-24T09:17:00.245409+0000","last_became_peered":"2026-02-24T09:17:00.245409+0000","last_unstale":"2026-02-24T09:17:01.376780+0000","last_undegraded":"2026-02-24T09:17:01.376780+0000","last_fullsized":"2026-02-24T09:17:01.376780+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:24:31.732634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"92'1","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:02.676977+0000","last_change":"2026-02-24T09:16:59.242808+0000","last_active":"2026-02-24T09:17:02.676977+0000","last_peered":"2026-02-24T09:17:02.676977+0000","last_clean":"2026-02-24T09:17:02.676977+0000","last_became_active":"2026-02-24T09:16:59.242717+0000","last_became_peered":"2026-02-24T09:16:59.242717+0000","last_unstale":"2026-02-24T09:17:02.676977+0000","last_undegraded":"2026-02-24T09:17:02.676977+0000","last_fullsized":"2026-02-24T09:17:02.676977+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:55:54.008569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.231613+0000","last_change":"2026-02-24T09:17:00.239253+0000","last_active":"2026-02-24T09:17:01.231613+0000","last_peered":"2026-02-24T09:17:01.231613+0000","last_clean":"2026-02-24T09:17:01.231613+0000","last_became_active":"2026-02-24T09:17:00.238983+0000","last_became_peered":"2026-02-24T09:17:00.238983+0000","last_unstale":"2026-02-24T09:17:01.231613+0000","last_undegraded":"2026-02-24T09:17:01.231613+0000","last_fullsized":"2026-02-24T09:17:01.231613+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:15:35.939863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"92'4","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:04.250062+0000","last_change":"2026-02-24T09:16:59.238537+0000","last_active":"2026-02-24T09:17:04.250062+0000","last_peered":"2026-02-24T09:17:04.250062+0000","last_clean":"2026-02-24T09:17:04.250062+0000","last_became_active":"2026-02-24T09:16:59.238413+0000","last_became_peered":"2026-02-24T09:16:59.238413+0000","last_unstale":"2026-02-24T09:17:04.250062+0000","last_undegraded":"2026-02-24T09:17:04.250062+0000","last_fullsized":"2026-02-24T09:17:04.250062+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:18:35.095699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.609986+0000","last_change":"2026-02-24T09:17:00.241138+0000","last_active":"2026-02-24T09:17:01.609986+0000","last_peered":"2026-02-24T09:17:01.609986+0000","last_clean":"2026-02-24T09:17:01.609986+0000","last_became_active":"2026-02-24T09:17:00.240131+0000","last_became_peered":"2026-02-24T09:17:00.240131+0000","last_unstale":"2026-02-24T09:17:01.609986+0000","last_undegraded":"2026-02-24T09:17:01.609986+0000","last_fullsized":"2026-02-24T09:17:01.609986+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:30:04.572939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.378006+0000","last_change":"2026-02-24T09:17:00.247807+0000","last_active":"2026-02-24T09:17:01.378006+0000","last_peered":"2026-02-24T09:17:01.378006+0000","last_clean":"2026-02-24T09:17:01.378006+0000","last_became_active":"2026-02-24T09:17:00.247294+0000","last_became_peered":"2026-02-24T09:17:00.247294+0000","last_unstale":"2026-02-24T09:17:01.378006+0000","last_undegraded":"2026-02-24T09:17:01.378006+0000","last_fullsized":"2026-02-24T09:17:01.378006+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:40:19.082811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"91'2","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.377087+0000","last_change":"2026-02-24T09:16:59.241010+0000","last_active":"2026-02-24T09:17:01.377087+0000","last_peered":"2026-02-24T09:17:01.377087+0000","last_clean":"2026-02-24T09:17:01.377087+0000","last_became_active":"2026-02-24T09:16:59.240857+0000","last_became_peered":"2026-02-24T09:16:59.240857+0000","last_unstale":"2026-02-24T09:17:01.377087+0000","last_undegraded":"2026-02-24T09:17:01.377087+0000","last_fullsized":"2026-02-24T09:17:01.377087+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:00:21.995413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.376275+0000","last_change":"2026-02-24T09:17:00.239878+0000","last_active":"2026-02-24T09:17:01.376275+0000","last_peered":"2026-02-24T09:17:01.376275+0000","last_clean":"2026-02-24T09:17:01.376275+0000","last_became_active":"2026-02-24T09:17:00.239782+0000","last_became_peered":"2026-02-24T09:17:00.239782+0000","last_unstale":"2026-02-24T09:17:01.376275+0000","last_undegraded":"2026-02-24T09:17:01.376275+0000","last_fullsized":"2026-02-24T09:17:01.376275+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:20:28.594190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"92'4","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.255383+0000","last_change":"2026-02-24T09:16:59.238466+0000","last_active":"2026-02-24T09:17:05.255383+0000","last_peered":"2026-02-24T09:17:05.255383+0000","last_clean":"2026-02-24T09:17:05.255383+0000","last_became_active":"2026-02-24T09:16:59.238371+0000","last_became_peered":"2026-02-24T09:16:59.238371+0000","last_unstale":"2026-02-24T09:17:05.255383+0000","last_undegraded":"2026-02-24T09:17:05.255383+0000","last_fullsized":"2026-02-24T09:17:05.255383+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:25:57.207215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.375857+0000","last_change":"2026-02-24T09:17:00.242538+0000","last_active":"2026-02-24T09:17:01.375857+0000","last_peered":"2026-02-24T09:17:01.375857+0000","last_clean":"2026-02-24T09:17:01.375857+0000","last_became_active":"2026-02-24T09:17:00.241119+0000","last_became_peered":"2026-02-24T09:17:00.241119+0000","last_unstale":"2026-02-24T09:17:01.375857+0000","last_undegraded":"2026-02-24T09:17:01.375857+0000","last_fullsized":"2026-02-24T09:17:01.375857+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:03:23.360618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"92'2","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.545231+0000","last_change":"2026-02-24T09:16:59.243406+0000","last_active":"2026-02-24T09:17:01.545231+0000","last_peered":"2026-02-24T09:17:01.545231+0000","last_clean":"2026-02-24T09:17:01.545231+0000","last_became_active":"2026-02-24T09:16:59.243275+0000","last_became_peered":"2026-02-24T09:16:59.243275+0000","last_unstale":"2026-02-24T09:17:01.545231+0000","last_undegraded":"2026-02-24T09:17:01.545231+0000","last_fullsized":"2026-02-24T09:17:01.545231+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:11:58.812932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:01.232102+0000","last_change":"2026-02-24T09:17:00.242628+0000","last_active":"2026-02-24T09:17:01.232102+0000","last_peered":"2026-02-24T09:17:01.232102+0000","last_clean":"2026-02-24T09:17:01.232102+0000","last_became_active":"2026-02-24T09:17:00.242482+0000","last_became_peered":"2026-02-24T09:17:00.242482+0000","last_unstale":"2026-02-24T09:17:01.232102+0000","last_undegraded":"2026-02-24T09:17:01.232102+0000","last_fullsized":"2026-02-24T09:17:01.232102+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:59.224384+0000","last_clean_scrub_stamp":"2026-02-24T09:16:59.224384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:28:11.567636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"92'9","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2026-02-24T09:17:05.255500+0000","last_change":"2026-02-24T09:16:59.238503+0000","last_active":"2026-02-24T09:17:05.255500+0000","last_peered":"2026-02-24T09:17:05.255500+0000","last_clean":"2026-02-24T09:17:05.255500+0000","last_became_active":"2026-02-24T09:16:59.238321+0000","last_became_peered":"2026-02-24T09:16:59.238321+0000","last_unstale":"2026-02-24T09:17:05.255500+0000","last_undegraded":"2026-02-24T09:17:05.255500+0000","last_fullsized":"2026-02-24T09:17:05.255500+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:16:58.221683+0000","last_clean_scrub_stamp":"2026-02-24T09:16:58.221683+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:25:06.302717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":61533,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":94,"num_read_kb":112,"num_write":156,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":184599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":130390,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":261676,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":87,"seq":373662154763,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28188,"kb_used_data":968,"kb_used_omap":10,"kb_used_meta":27189,"kb_avail":733975012,"statfs":{"total":751619276800,"available":751590412288,"internally_reserved":0,"allocated":991232,"data_stored":492629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10767,"internal_metadata":27842033},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":79,"seq":339302416397,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28332,"kb_used_data":1112,"kb_used_omap":28,"kb_used_meta":27171,"kb_avail":733974868,"statfs":{"total":751619276800,"available":751590264832,"internally_reserved":0,"allocated":1138688,"data_stored":1141593,"data_compressed":37836,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":28890,"internal_metadata":27823910},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":74,"seq":317827579921,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28204,"kb_used_data":984,"kb_used_omap":26,"kb_used_meta":27173,"kb_avail":733974996,"statfs":{"total":751619276800,"available":751590395904,"internally_reserved":0,"allocated":1007616,"data_stored":492865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27137,"internal_metadata":27825663},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":66,"seq":283467841555,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28204,"kb_used_data":984,"kb_used_omap":16,"kb_used_meta":27183,"kb_avail":733974996,"statfs":{"total":751619276800,"available":751590395904,"internally_reserved":0,"allocated":1007616,"data_stored":492785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16555,"internal_metadata":27836245},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":58,"seq":249108103189,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28252,"kb_used_data":1032,"kb_used_omap":35,"kb_used_meta":27164,"kb_avail":733974948,"statfs":{"total":751619276800,"available":751590346752,"internally_reserved":0,"allocated":1056768,"data_stored":1085144,"data_compressed":37836,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":36450,"internal_metadata":27816350},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":53,"seq":227633266712,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28192,"kb_used_data":972,"kb_used_omap":32,"kb_used_meta":27167,"kb_avail":733975008,"statfs":{"total":751619276800,"available":751590408192,"internally_reserved":0,"allocated":995328,"data_stored":492244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33261,"internal_metadata":27819539},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":45,"seq":193273528347,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28264,"kb_used_data":1044,"kb_used_omap":36,"kb_used_meta":27163,"kb_avail":733974936,"statfs":{"total":751619276800,"available":751590334464,"internally_reserved":0,"allocated":1069056,"data_stored":1084418,"data_compressed":37836,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":37621,"internal_metadata":27815179},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":38,"seq":163208757277,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28196,"kb_used_data":976,"kb_used_omap":44,"kb_used_meta":27155,"kb_avail":733975004,"statfs":{"total":751619276800,"available":751590404096,"internally_reserved":0,"allocated":999424,"data_stored":493091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45564,"internal_metadata":27807236},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":30,"seq":128849018912,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28208,"kb_used_data":988,"kb_used_omap":54,"kb_used_meta":27145,"kb_avail":733974992,"statfs":{"total":751619276800,"available":751590391808,"internally_reserved":0,"allocated":1011712,"data_stored":492555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":55833,"internal_metadata":27796967},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280547,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28272,"kb_used_data":1052,"kb_used_omap":65,"kb_used_meta":27134,"kb_avail":733974928,"statfs":{"total":751619276800,"available":751590326272,"internally_reserved":0,"allocated":1077248,"data_stored":550880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":66689,"internal_metadata":27786111},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476774,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28248,"kb_used_data":1028,"kb_used_omap":54,"kb_used_meta":27145,"kb_avail":733974952,"statfs":{"total":751619276800,"available":751590350848,"internally_reserved":0,"allocated":1052672,"data_stored":549110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":55708,"internal_metadata":27797092},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673001,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28212,"kb_used_data":992,"kb_used_omap":35,"kb_used_meta":27164,"kb_avail":733974988,"statfs":{"total":751619276800,"available":751590387712,"internally_reserved":0,"allocated":1015808,"data_stored":493535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36536,"internal_metadata":27816264},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36248,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37836,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37836,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37836,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37836,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37836,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1431,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":57073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1713,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":58843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12982,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14142,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12139,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3482,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4590,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33104,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5258,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17306,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":59071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22881,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1362,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T09:17:21.106 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-24T09:17:21.106 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-24T09:17:21.106 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-02-24T09:17:21.106 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph health --format=json 2026-02-24T09:17:21.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:20 trial159 ceph-mon[44242]: from='client.25103 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:17:21.320 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:21.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:20 trial028 ceph-mon[40371]: from='client.25103 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:17:21.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:20 trial074 ceph-mon[44412]: from='client.25103 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:17:21.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.483+0000 7fa5e9d1f640 1 -- 10.20.193.28:0/1201237568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa5e4111540 msgr2=0x7fa5e41119e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:21.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.483+0000 7fa5e9d1f640 1 --2- 10.20.193.28:0/1201237568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa5e4111540 0x7fa5e41119e0 secure :-1 s=READY pgs=315 gs=1 cs=0 l=1 c_cookie=8383453505238589032 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5d800aa60 tx=0x7fa5d80302b0 comp rx=0 tx=0).stop 2026-02-24T09:17:21.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.483+0000 7fa5e9d1f640 1 -- 10.20.193.28:0/1201237568 shutdown_connections 2026-02-24T09:17:21.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.483+0000 7fa5e9d1f640 1 --2- 10.20.193.28:0/1201237568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa5e4111540 0x7fa5e41119e0 unknown :-1 s=CLOSED pgs=315 gs=1 cs=0 l=1 c_cookie=8383453505238589032 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:21.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.483+0000 7fa5e9d1f640 1 --2- 10.20.193.28:0/1201237568 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa5e410c950 0x7fa5e4110f20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:21.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.483+0000 7fa5e9d1f640 1 --2- 10.20.193.28:0/1201237568 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa5e410bf60 0x7fa5e410c330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:21.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.483+0000 7fa5e9d1f640 1 -- 10.20.193.28:0/1201237568 >> 10.20.193.28:0/1201237568 conn(0x7fa5e40e9bf0 msgr2=0x7fa5e410a000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:21.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.483+0000 7fa5e9d1f640 1 -- 10.20.193.28:0/1201237568 shutdown_connections 2026-02-24T09:17:21.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.483+0000 7fa5e9d1f640 1 -- 10.20.193.28:0/1201237568 wait complete. 2026-02-24T09:17:21.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.484+0000 7fa5e9d1f640 1 Processor -- start 2026-02-24T09:17:21.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.484+0000 7fa5e9d1f640 1 -- start start 2026-02-24T09:17:21.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.484+0000 7fa5e9d1f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa5e410bf60 0x7fa5e4122910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:21.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.484+0000 7fa5e9d1f640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa5e410c950 0x7fa5e4122e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:21.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.484+0000 7fa5e9d1f640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa5e4111540 0x7fa5e4128220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:21.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.484+0000 7fa5e9d1f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e4128840 con 0x7fa5e410bf60 2026-02-24T09:17:21.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.484+0000 7fa5e9d1f640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e41289b0 con 0x7fa5e410c950 2026-02-24T09:17:21.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.484+0000 7fa5e9d1f640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e4128b70 con 0x7fa5e4111540 2026-02-24T09:17:21.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.485+0000 7fa5e37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa5e410bf60 0x7fa5e4122910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:21.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.485+0000 7fa5e2ffd640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa5e410c950 0x7fa5e4122e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:21.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.485+0000 7fa5e37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa5e410bf60 0x7fa5e4122910 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40386/0 (socket says 10.20.193.28:40386) 2026-02-24T09:17:21.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.485+0000 7fa5e37fe640 1 -- 10.20.193.28:0/145569774 learned_addr learned my addr 10.20.193.28:0/145569774 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:21.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.485+0000 7fa5e3fff640 1 --2- 10.20.193.28:0/145569774 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa5e4111540 0x7fa5e4128220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:21.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.485+0000 7fa5e37fe640 1 -- 10.20.193.28:0/145569774 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa5e4111540 msgr2=0x7fa5e4128220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:21.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.485+0000 7fa5e37fe640 1 --2- 10.20.193.28:0/145569774 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa5e4111540 0x7fa5e4128220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:21.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.485+0000 7fa5e37fe640 1 -- 10.20.193.28:0/145569774 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa5e410c950 msgr2=0x7fa5e4122e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:21.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.485+0000 7fa5e37fe640 1 --2- 10.20.193.28:0/145569774 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa5e410c950 0x7fa5e4122e50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:21.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.485+0000 7fa5e37fe640 1 -- 10.20.193.28:0/145569774 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5d800a650 con 0x7fa5e410bf60 2026-02-24T09:17:21.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.485+0000 7fa5e3fff640 1 --2- 10.20.193.28:0/145569774 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa5e4111540 0x7fa5e4128220 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:17:21.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.485+0000 7fa5e37fe640 1 --2- 10.20.193.28:0/145569774 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa5e410bf60 0x7fa5e4122910 secure :-1 s=READY pgs=316 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5d000d950 tx=0x7fa5d000de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:21.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.486+0000 7fa5e0ff9640 1 -- 10.20.193.28:0/145569774 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa5d0004540 con 0x7fa5e410bf60 2026-02-24T09:17:21.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.486+0000 7fa5e0ff9640 1 -- 10.20.193.28:0/145569774 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fa5d0009ce0 con 0x7fa5e410bf60 2026-02-24T09:17:21.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.486+0000 7fa5e0ff9640 1 -- 10.20.193.28:0/145569774 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa5d00106e0 con 0x7fa5e410bf60 2026-02-24T09:17:21.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.486+0000 7fa5e9d1f640 1 -- 10.20.193.28:0/145569774 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5e4128e50 con 0x7fa5e410bf60 2026-02-24T09:17:21.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.486+0000 7fa5e9d1f640 1 -- 10.20.193.28:0/145569774 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5e4169550 con 0x7fa5e410bf60 2026-02-24T09:17:21.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.486+0000 7fa5e9d1f640 1 -- 10.20.193.28:0/145569774 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5a8005300 con 0x7fa5e410bf60 2026-02-24T09:17:21.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.488+0000 7fa5e0ff9640 1 -- 10.20.193.28:0/145569774 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7fa5d00097c0 con 0x7fa5e410bf60 2026-02-24T09:17:21.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.490+0000 7fa5e0ff9640 1 --2- 10.20.193.28:0/145569774 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa5b80b5840 0x7fa5b80d5cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:21.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.490+0000 7fa5e0ff9640 1 -- 10.20.193.28:0/145569774 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7fa5d00e7250 con 0x7fa5e410bf60 2026-02-24T09:17:21.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.490+0000 7fa5e0ff9640 1 -- 10.20.193.28:0/145569774 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fa5d00e7740 con 0x7fa5e410bf60 2026-02-24T09:17:21.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.490+0000 7fa5e2ffd640 1 --2- 10.20.193.28:0/145569774 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa5b80b5840 0x7fa5b80d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:21.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.491+0000 7fa5e2ffd640 1 --2- 10.20.193.28:0/145569774 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa5b80b5840 0x7fa5b80d5cf0 secure :-1 s=READY pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5e41292b0 tx=0x7fa5d400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:21.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.634+0000 7fa5e9d1f640 1 -- 10.20.193.28:0/145569774 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa5a8005950 con 0x7fa5e410bf60 2026-02-24T09:17:21.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.634+0000 7fa5e0ff9640 1 -- 10.20.193.28:0/145569774 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fa5d00a9c30 con 0x7fa5e410bf60 2026-02-24T09:17:21.636 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:17:21.636 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-24T09:17:21.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.636+0000 7fa5e9d1f640 1 -- 10.20.193.28:0/145569774 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa5b80b5840 msgr2=0x7fa5b80d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:21.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.636+0000 7fa5e9d1f640 1 --2- 10.20.193.28:0/145569774 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa5b80b5840 0x7fa5b80d5cf0 secure :-1 s=READY pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5e41292b0 tx=0x7fa5d400b410 comp rx=0 tx=0).stop 2026-02-24T09:17:21.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.636+0000 7fa5e9d1f640 1 -- 10.20.193.28:0/145569774 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa5e410bf60 msgr2=0x7fa5e4122910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:21.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.636+0000 7fa5e9d1f640 1 --2- 10.20.193.28:0/145569774 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa5e410bf60 0x7fa5e4122910 secure :-1 s=READY pgs=316 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5d000d950 tx=0x7fa5d000de20 comp rx=0 tx=0).stop 2026-02-24T09:17:21.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.636+0000 7fa5e9d1f640 1 -- 10.20.193.28:0/145569774 shutdown_connections 2026-02-24T09:17:21.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.636+0000 7fa5e9d1f640 1 --2- 10.20.193.28:0/145569774 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa5b80b5840 0x7fa5b80d5cf0 unknown :-1 s=CLOSED pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:21.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.636+0000 7fa5e9d1f640 1 --2- 10.20.193.28:0/145569774 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa5e4111540 0x7fa5e4128220 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:21.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.636+0000 7fa5e9d1f640 1 --2- 10.20.193.28:0/145569774 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa5e410c950 0x7fa5e4122e50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:21.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.636+0000 7fa5e9d1f640 1 --2- 10.20.193.28:0/145569774 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa5e410bf60 0x7fa5e4122910 unknown :-1 s=CLOSED pgs=316 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:21.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.636+0000 7fa5e9d1f640 1 -- 10.20.193.28:0/145569774 >> 10.20.193.28:0/145569774 conn(0x7fa5e40e9bf0 msgr2=0x7fa5e4109fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:21.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.637+0000 7fa5e9d1f640 1 -- 10.20.193.28:0/145569774 shutdown_connections 2026-02-24T09:17:21.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:21.637+0000 7fa5e9d1f640 1 -- 10.20.193.28:0/145569774 wait complete. 2026-02-24T09:17:21.735 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2026-02-24T09:17:21.736 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:17:21.926 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:22.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.097+0000 7f547eaca640 1 -- 10.20.193.28:0/1911190743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f547810c780 msgr2=0x7f5478155660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:22.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.097+0000 7f547eaca640 1 --2- 10.20.193.28:0/1911190743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f547810c780 0x7f5478155660 secure :-1 s=READY pgs=317 gs=1 cs=0 l=1 c_cookie=12596776059289709278 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f546c009950 tx=0x7f546c02f190 comp rx=0 tx=0).stop 2026-02-24T09:17:22.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.098+0000 7f547eaca640 1 -- 10.20.193.28:0/1911190743 shutdown_connections 2026-02-24T09:17:22.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.098+0000 7f547eaca640 1 --2- 10.20.193.28:0/1911190743 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5478155ba0 0x7f5478175f80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:22.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.098+0000 7f547eaca640 1 --2- 10.20.193.28:0/1911190743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f547810c780 0x7f5478155660 unknown :-1 s=CLOSED pgs=317 gs=1 cs=0 l=1 c_cookie=12596776059289709278 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:22.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.098+0000 7f547eaca640 1 --2- 10.20.193.28:0/1911190743 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f547810be70 0x7f547810c240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:22.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.098+0000 7f547eaca640 1 -- 10.20.193.28:0/1911190743 >> 10.20.193.28:0/1911190743 conn(0x7f54780e9b70 msgr2=0x7f5478109f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:22.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.098+0000 7f547eaca640 1 -- 10.20.193.28:0/1911190743 shutdown_connections 2026-02-24T09:17:22.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.098+0000 7f547eaca640 1 -- 10.20.193.28:0/1911190743 wait complete. 2026-02-24T09:17:22.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.098+0000 7f547eaca640 1 Processor -- start 2026-02-24T09:17:22.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.098+0000 7f547eaca640 1 -- start start 2026-02-24T09:17:22.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.099+0000 7f547eaca640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f547810be70 0x7f54781612d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:22.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.099+0000 7f547eaca640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f547810c780 0x7f5478161810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:22.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.099+0000 7f547eaca640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5478155ba0 0x7f5478166be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:22.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.099+0000 7f547eaca640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5478167170 con 0x7f547810be70 2026-02-24T09:17:22.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.099+0000 7f547eaca640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f54781672e0 con 0x7f547810c780 2026-02-24T09:17:22.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.099+0000 7f547eaca640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f54781674a0 con 0x7f5478155ba0 2026-02-24T09:17:22.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.099+0000 7f547dac8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f547810be70 0x7f54781612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:22.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.099+0000 7f547dac8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f547810be70 0x7f54781612d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40408/0 (socket says 10.20.193.28:40408) 2026-02-24T09:17:22.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.099+0000 7f547dac8640 1 -- 10.20.193.28:0/1876608613 learned_addr learned my addr 10.20.193.28:0/1876608613 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:22.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.099+0000 7f547d2c7640 1 --2- 10.20.193.28:0/1876608613 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f547810c780 0x7f5478161810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:22.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.099+0000 7f547dac8640 1 -- 10.20.193.28:0/1876608613 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5478155ba0 msgr2=0x7f5478166be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:22.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.099+0000 7f547dac8640 1 --2- 10.20.193.28:0/1876608613 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5478155ba0 0x7f5478166be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:22.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.099+0000 7f547dac8640 1 -- 10.20.193.28:0/1876608613 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f547810c780 msgr2=0x7f5478161810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:22.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.099+0000 7f547dac8640 1 --2- 10.20.193.28:0/1876608613 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f547810c780 0x7f5478161810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:22.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.099+0000 7f547dac8640 1 -- 10.20.193.28:0/1876608613 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f546c009570 con 0x7f547810be70 2026-02-24T09:17:22.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.099+0000 7f547d2c7640 1 --2- 10.20.193.28:0/1876608613 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f547810c780 0x7f5478161810 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:22.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.099+0000 7f547dac8640 1 --2- 10.20.193.28:0/1876608613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f547810be70 0x7f54781612d0 secure :-1 s=READY pgs=318 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f546800b500 tx=0x7f546800b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:22.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.099+0000 7f5466ffd640 1 -- 10.20.193.28:0/1876608613 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f54680044a0 con 0x7f547810be70 2026-02-24T09:17:22.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.099+0000 7f5466ffd640 1 -- 10.20.193.28:0/1876608613 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f5468002b60 con 0x7f547810be70 2026-02-24T09:17:22.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.099+0000 7f5466ffd640 1 -- 10.20.193.28:0/1876608613 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f546800fd20 con 0x7f547810be70 2026-02-24T09:17:22.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.099+0000 7f547eaca640 1 -- 10.20.193.28:0/1876608613 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5478167780 con 0x7f547810be70 2026-02-24T09:17:22.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.100+0000 7f547eaca640 1 -- 10.20.193.28:0/1876608613 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5478167a60 con 0x7f547810be70 2026-02-24T09:17:22.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.100+0000 7f547eaca640 1 -- 10.20.193.28:0/1876608613 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54780603a0 con 0x7f547810be70 2026-02-24T09:17:22.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.102+0000 7f5466ffd640 1 -- 10.20.193.28:0/1876608613 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f5468002cd0 con 0x7f547810be70 2026-02-24T09:17:22.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.104+0000 7f5466ffd640 1 --2- 10.20.193.28:0/1876608613 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f54540b5840 0x7f54540d5cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:22.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.104+0000 7f5466ffd640 1 -- 10.20.193.28:0/1876608613 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f54680e67f0 con 0x7f547810be70 2026-02-24T09:17:22.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.104+0000 7f547d2c7640 1 --2- 10.20.193.28:0/1876608613 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f54540b5840 0x7f54540d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:22.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.104+0000 7f5466ffd640 1 -- 10.20.193.28:0/1876608613 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f54680e6c70 con 0x7f547810be70 2026-02-24T09:17:22.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.104+0000 7f547d2c7640 1 --2- 10.20.193.28:0/1876608613 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f54540b5840 0x7f54540d5cf0 secure :-1 s=READY pgs=196 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f546c0098a0 tx=0x7f546c031040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:22.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.246+0000 7f547eaca640 1 -- 10.20.193.28:0/1876608613 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5478062010 con 0x7f547810be70 2026-02-24T09:17:22.247 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:21 trial028 ceph-mon[40371]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:17:22.248 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:21 trial028 ceph-mon[40371]: pgmap v191: 97 pgs: 97 active+clean; 645 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 9.4 KiB/s rd, 6.9 KiB/s wr, 10 op/s 2026-02-24T09:17:22.248 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:21 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/145569774' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-24T09:17:22.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.246+0000 7f5466ffd640 1 -- 10.20.193.28:0/1876608613 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11901 (secure 0 0 0) 0x7f54680a9190 con 0x7f547810be70 2026-02-24T09:17:22.249 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:17:22.249 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":22,"btime":"2026-02-24T09:17:06:566638+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14856,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/3473030842","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":3473030842},{"type":"v1","addr":"10.20.193.28:6835","nonce":3473030842}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14862,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/4120804601","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":4120804601},{"type":"v1","addr":"10.20.193.28:6837","nonce":4120804601}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14910,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/1354296520","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1354296520},{"type":"v1","addr":"10.20.193.28:6839","nonce":1354296520}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24691,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.159:6833/3049112106","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6832","nonce":3049112106},{"type":"v1","addr":"10.20.193.159:6833","nonce":3049112106}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24710,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.74:6833/1426135976","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6832","nonce":1426135976},{"type":"v1","addr":"10.20.193.74:6833","nonce":1426135976}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24721,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.159:6835/3999384392","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6834","nonce":3999384392},{"type":"v1","addr":"10.20.193.159:6835","nonce":3999384392}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:16:59.889500+0000","modified":"2026-02-24T09:17:05.859296+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24788,"mds_1":24761,"mds_2":24760},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24727":{"gid":24727,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.159:6837/2059577520","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6836","nonce":2059577520},{"type":"v1","addr":"10.20.193.159:6837","nonce":2059577520}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24734":{"gid":24734,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.74:6835/2067708838","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6834","nonce":2067708838},{"type":"v1","addr":"10.20.193.74:6835","nonce":2067708838}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24745":{"gid":24745,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.159:6839/533862317","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6838","nonce":533862317},{"type":"v1","addr":"10.20.193.159:6839","nonce":533862317}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24760":{"gid":24760,"name":"a","rank":2,"incarnation":20,"state":"up:active","state_seq":5,"addr":"10.20.193.28:6841/492586680","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":492586680},{"type":"v1","addr":"10.20.193.28:6841","nonce":492586680}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24761":{"gid":24761,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"10.20.193.74:6837/958749351","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6836","nonce":958749351},{"type":"v1","addr":"10.20.193.74:6837","nonce":958749351}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24788":{"gid":24788,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"10.20.193.74:6839/828566790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6838","nonce":828566790},{"type":"v1","addr":"10.20.193.74:6839","nonce":828566790}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24788,"qdb_cluster":[24788,24761,24760]},"id":1}]} 2026-02-24T09:17:22.250 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 22 2026-02-24T09:17:22.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.248+0000 7f547eaca640 1 -- 10.20.193.28:0/1876608613 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f54540b5840 msgr2=0x7f54540d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:22.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.248+0000 7f547eaca640 1 --2- 10.20.193.28:0/1876608613 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f54540b5840 0x7f54540d5cf0 secure :-1 s=READY pgs=196 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f546c0098a0 tx=0x7f546c031040 comp rx=0 tx=0).stop 2026-02-24T09:17:22.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.248+0000 7f547eaca640 1 -- 10.20.193.28:0/1876608613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f547810be70 msgr2=0x7f54781612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:22.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.248+0000 7f547eaca640 1 --2- 10.20.193.28:0/1876608613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f547810be70 0x7f54781612d0 secure :-1 s=READY pgs=318 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f546800b500 tx=0x7f546800b9d0 comp rx=0 tx=0).stop 2026-02-24T09:17:22.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.248+0000 7f547eaca640 1 -- 10.20.193.28:0/1876608613 shutdown_connections 2026-02-24T09:17:22.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.248+0000 7f547eaca640 1 --2- 10.20.193.28:0/1876608613 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f54540b5840 0x7f54540d5cf0 unknown :-1 s=CLOSED pgs=196 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:22.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.248+0000 7f547eaca640 1 --2- 10.20.193.28:0/1876608613 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5478155ba0 0x7f5478166be0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:22.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.248+0000 7f547eaca640 1 --2- 10.20.193.28:0/1876608613 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f547810c780 0x7f5478161810 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:22.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.248+0000 7f547eaca640 1 --2- 10.20.193.28:0/1876608613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f547810be70 0x7f54781612d0 unknown :-1 s=CLOSED pgs=318 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:22.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.248+0000 7f547eaca640 1 -- 10.20.193.28:0/1876608613 >> 10.20.193.28:0/1876608613 conn(0x7f54780e9b70 msgr2=0x7f5478109f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:22.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.248+0000 7f547eaca640 1 -- 10.20.193.28:0/1876608613 shutdown_connections 2026-02-24T09:17:22.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.248+0000 7f547eaca640 1 -- 10.20.193.28:0/1876608613 wait complete. 2026-02-24T09:17:22.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:21 trial159 ceph-mon[44242]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:17:22.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:21 trial159 ceph-mon[44242]: pgmap v191: 97 pgs: 97 active+clean; 645 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 9.4 KiB/s rd, 6.9 KiB/s wr, 10 op/s 2026-02-24T09:17:22.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:21 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/145569774' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-24T09:17:22.349 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:17:22.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:21 trial074 ceph-mon[44412]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:17:22.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:21 trial074 ceph-mon[44412]: pgmap v191: 97 pgs: 97 active+clean; 645 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 9.4 KiB/s rd, 6.9 KiB/s wr, 10 op/s 2026-02-24T09:17:22.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:21 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/145569774' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-24T09:17:22.531 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:22.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.715+0000 7f3bdf66e640 1 -- 10.20.193.28:0/3985468968 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3bd81158b0 msgr2=0x7f3bd8176280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:22.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.715+0000 7f3bdf66e640 1 --2- 10.20.193.28:0/3985468968 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3bd81158b0 0x7f3bd8176280 secure :-1 s=READY pgs=319 gs=1 cs=0 l=1 c_cookie=6403267885483695179 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3bd400aa30 tx=0x7f3bd4030290 comp rx=0 tx=0).stop 2026-02-24T09:17:22.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.715+0000 7f3bdf66e640 1 -- 10.20.193.28:0/3985468968 shutdown_connections 2026-02-24T09:17:22.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.715+0000 7f3bdf66e640 1 --2- 10.20.193.28:0/3985468968 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3bd81158b0 0x7f3bd8176280 unknown :-1 s=CLOSED pgs=319 gs=1 cs=0 l=1 c_cookie=6403267885483695179 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:22.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.715+0000 7f3bdf66e640 1 --2- 10.20.193.28:0/3985468968 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3bd81100b0 0x7f3bd8115100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:22.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.715+0000 7f3bdf66e640 1 --2- 10.20.193.28:0/3985468968 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3bd810f6c0 0x7f3bd810fa90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:22.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.715+0000 7f3bdf66e640 1 -- 10.20.193.28:0/3985468968 >> 10.20.193.28:0/3985468968 conn(0x7f3bd80ecfd0 msgr2=0x7f3bd810d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:22.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.715+0000 7f3bdf66e640 1 -- 10.20.193.28:0/3985468968 shutdown_connections 2026-02-24T09:17:22.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.716+0000 7f3bdf66e640 1 -- 10.20.193.28:0/3985468968 wait complete. 2026-02-24T09:17:22.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.716+0000 7f3bdf66e640 1 Processor -- start 2026-02-24T09:17:22.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.716+0000 7f3bdf66e640 1 -- start start 2026-02-24T09:17:22.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.717+0000 7f3bdf66e640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3bd810f6c0 0x7f3bd80f59f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:22.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.717+0000 7f3bdf66e640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3bd81100b0 0x7f3bd8176180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:22.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.717+0000 7f3bdf66e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3bd81158b0 0x7f3bd80f60f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:22.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.717+0000 7f3bdf66e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd80fb300 con 0x7f3bd81158b0 2026-02-24T09:17:22.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.717+0000 7f3bdf66e640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd80fb470 con 0x7f3bd81100b0 2026-02-24T09:17:22.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.717+0000 7f3bdf66e640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd80fb630 con 0x7f3bd810f6c0 2026-02-24T09:17:22.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.717+0000 7f3bddbe4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3bd81158b0 0x7f3bd80f60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:22.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.717+0000 7f3bddbe4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3bd81158b0 0x7f3bd80f60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40428/0 (socket says 10.20.193.28:40428) 2026-02-24T09:17:22.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.717+0000 7f3bddbe4640 1 -- 10.20.193.28:0/3428850004 learned_addr learned my addr 10.20.193.28:0/3428850004 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:22.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.717+0000 7f3bdd3e3640 1 --2- 10.20.193.28:0/3428850004 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3bd810f6c0 0x7f3bd80f59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:22.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.717+0000 7f3bdcbe2640 1 --2- 10.20.193.28:0/3428850004 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3bd81100b0 0x7f3bd8176180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:22.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.717+0000 7f3bddbe4640 1 -- 10.20.193.28:0/3428850004 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3bd810f6c0 msgr2=0x7f3bd80f59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:22.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.717+0000 7f3bddbe4640 1 --2- 10.20.193.28:0/3428850004 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3bd810f6c0 0x7f3bd80f59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:22.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.717+0000 7f3bddbe4640 1 -- 10.20.193.28:0/3428850004 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3bd81100b0 msgr2=0x7f3bd8176180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:22.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.717+0000 7f3bddbe4640 1 --2- 10.20.193.28:0/3428850004 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3bd81100b0 0x7f3bd8176180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:22.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.717+0000 7f3bddbe4640 1 -- 10.20.193.28:0/3428850004 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd400a650 con 0x7f3bd81158b0 2026-02-24T09:17:22.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.717+0000 7f3bdcbe2640 1 --2- 10.20.193.28:0/3428850004 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3bd81100b0 0x7f3bd8176180 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:17:22.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.717+0000 7f3bddbe4640 1 --2- 10.20.193.28:0/3428850004 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3bd81158b0 0x7f3bd80f60f0 secure :-1 s=READY pgs=320 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3bd400a360 tx=0x7f3bd4030d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:22.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.718+0000 7f3bc67fc640 1 -- 10.20.193.28:0/3428850004 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3bd403e070 con 0x7f3bd81158b0 2026-02-24T09:17:22.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.718+0000 7f3bc67fc640 1 -- 10.20.193.28:0/3428850004 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3bd4003ad0 con 0x7f3bd81158b0 2026-02-24T09:17:22.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.718+0000 7f3bc67fc640 1 -- 10.20.193.28:0/3428850004 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3bd4005e00 con 0x7f3bd81158b0 2026-02-24T09:17:22.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.718+0000 7f3bdf66e640 1 -- 10.20.193.28:0/3428850004 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd80fb8b0 con 0x7f3bd81158b0 2026-02-24T09:17:22.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.718+0000 7f3bdf66e640 1 -- 10.20.193.28:0/3428850004 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd80fbcd0 con 0x7f3bd81158b0 2026-02-24T09:17:22.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.718+0000 7f3bdf66e640 1 -- 10.20.193.28:0/3428850004 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ba0005300 con 0x7f3bd81158b0 2026-02-24T09:17:22.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.721+0000 7f3bc67fc640 1 -- 10.20.193.28:0/3428850004 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f3bd404a060 con 0x7f3bd81158b0 2026-02-24T09:17:22.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.722+0000 7f3bc67fc640 1 --2- 10.20.193.28:0/3428850004 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3bb40b5830 0x7f3bb40d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:22.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.723+0000 7f3bc67fc640 1 -- 10.20.193.28:0/3428850004 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f3bd410ca90 con 0x7f3bd81158b0 2026-02-24T09:17:22.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.723+0000 7f3bc67fc640 1 -- 10.20.193.28:0/3428850004 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f3bd4145930 con 0x7f3bd81158b0 2026-02-24T09:17:22.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.723+0000 7f3bdd3e3640 1 --2- 10.20.193.28:0/3428850004 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3bb40b5830 0x7f3bb40d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:22.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.723+0000 7f3bdd3e3640 1 --2- 10.20.193.28:0/3428850004 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3bb40b5830 0x7f3bb40d5ce0 secure :-1 s=READY pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3bc8004740 tx=0x7f3bc8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:22.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.865+0000 7f3bdf66e640 1 -- 10.20.193.28:0/3428850004 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ba0005950 con 0x7f3bd81158b0 2026-02-24T09:17:22.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.865+0000 7f3bc67fc640 1 -- 10.20.193.28:0/3428850004 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11901 (secure 0 0 0) 0x7f3bd40cf430 con 0x7f3bd81158b0 2026-02-24T09:17:22.867 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:17:22.867 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":22,"btime":"2026-02-24T09:17:06:566638+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14856,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/3473030842","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":3473030842},{"type":"v1","addr":"10.20.193.28:6835","nonce":3473030842}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14862,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/4120804601","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":4120804601},{"type":"v1","addr":"10.20.193.28:6837","nonce":4120804601}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14910,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/1354296520","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1354296520},{"type":"v1","addr":"10.20.193.28:6839","nonce":1354296520}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24691,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.159:6833/3049112106","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6832","nonce":3049112106},{"type":"v1","addr":"10.20.193.159:6833","nonce":3049112106}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24710,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.74:6833/1426135976","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6832","nonce":1426135976},{"type":"v1","addr":"10.20.193.74:6833","nonce":1426135976}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24721,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.159:6835/3999384392","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6834","nonce":3999384392},{"type":"v1","addr":"10.20.193.159:6835","nonce":3999384392}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:16:59.889500+0000","modified":"2026-02-24T09:17:05.859296+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24788,"mds_1":24761,"mds_2":24760},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24727":{"gid":24727,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.159:6837/2059577520","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6836","nonce":2059577520},{"type":"v1","addr":"10.20.193.159:6837","nonce":2059577520}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24734":{"gid":24734,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.74:6835/2067708838","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6834","nonce":2067708838},{"type":"v1","addr":"10.20.193.74:6835","nonce":2067708838}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24745":{"gid":24745,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.159:6839/533862317","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6838","nonce":533862317},{"type":"v1","addr":"10.20.193.159:6839","nonce":533862317}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24760":{"gid":24760,"name":"a","rank":2,"incarnation":20,"state":"up:active","state_seq":5,"addr":"10.20.193.28:6841/492586680","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":492586680},{"type":"v1","addr":"10.20.193.28:6841","nonce":492586680}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24761":{"gid":24761,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"10.20.193.74:6837/958749351","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6836","nonce":958749351},{"type":"v1","addr":"10.20.193.74:6837","nonce":958749351}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24788":{"gid":24788,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"10.20.193.74:6839/828566790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6838","nonce":828566790},{"type":"v1","addr":"10.20.193.74:6839","nonce":828566790}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24788,"qdb_cluster":[24788,24761,24760]},"id":1}]} 2026-02-24T09:17:22.867 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 22 2026-02-24T09:17:22.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.866+0000 7f3bdf66e640 1 -- 10.20.193.28:0/3428850004 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3bb40b5830 msgr2=0x7f3bb40d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:22.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.866+0000 7f3bdf66e640 1 --2- 10.20.193.28:0/3428850004 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3bb40b5830 0x7f3bb40d5ce0 secure :-1 s=READY pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3bc8004740 tx=0x7f3bc8005f90 comp rx=0 tx=0).stop 2026-02-24T09:17:22.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.866+0000 7f3bdf66e640 1 -- 10.20.193.28:0/3428850004 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3bd81158b0 msgr2=0x7f3bd80f60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:22.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.866+0000 7f3bdf66e640 1 --2- 10.20.193.28:0/3428850004 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3bd81158b0 0x7f3bd80f60f0 secure :-1 s=READY pgs=320 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3bd400a360 tx=0x7f3bd4030d90 comp rx=0 tx=0).stop 2026-02-24T09:17:22.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.867+0000 7f3bdf66e640 1 -- 10.20.193.28:0/3428850004 shutdown_connections 2026-02-24T09:17:22.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.867+0000 7f3bdf66e640 1 --2- 10.20.193.28:0/3428850004 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3bb40b5830 0x7f3bb40d5ce0 unknown :-1 s=CLOSED pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:22.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.867+0000 7f3bdf66e640 1 --2- 10.20.193.28:0/3428850004 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3bd81158b0 0x7f3bd80f60f0 unknown :-1 s=CLOSED pgs=320 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:22.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.867+0000 7f3bdf66e640 1 --2- 10.20.193.28:0/3428850004 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3bd81100b0 0x7f3bd8176180 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:22.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.867+0000 7f3bdf66e640 1 --2- 10.20.193.28:0/3428850004 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3bd810f6c0 0x7f3bd80f59f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:22.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.867+0000 7f3bdf66e640 1 -- 10.20.193.28:0/3428850004 >> 10.20.193.28:0/3428850004 conn(0x7f3bd80ecfd0 msgr2=0x7f3bd810db90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:22.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.867+0000 7f3bdf66e640 1 -- 10.20.193.28:0/3428850004 shutdown_connections 2026-02-24T09:17:22.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:22.867+0000 7f3bdf66e640 1 -- 10.20.193.28:0/3428850004 wait complete. 2026-02-24T09:17:22.965 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T09:17:23.149 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:23.190 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:22 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/1876608613' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:17:23.190 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:22 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/3428850004' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:17:23.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:22 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/1876608613' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:17:23.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:22 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/3428850004' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:17:23.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.326+0000 7f5f557ab640 1 -- 10.20.193.28:0/3217980625 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f5010f240 msgr2=0x7f5f5010f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:23.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.326+0000 7f5f557ab640 1 --2- 10.20.193.28:0/3217980625 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f5010f240 0x7f5f5010f610 secure :-1 s=READY pgs=321 gs=1 cs=0 l=1 c_cookie=2454539558053069495 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f3c009950 tx=0x7f5f3c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:17:23.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.327+0000 7f5f557ab640 1 -- 10.20.193.28:0/3217980625 shutdown_connections 2026-02-24T09:17:23.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.327+0000 7f5f557ab640 1 --2- 10.20.193.28:0/3217980625 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5f50115430 0x7f5f50175e00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:23.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.327+0000 7f5f557ab640 1 --2- 10.20.193.28:0/3217980625 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5f5010fc30 0x7f5f50114c80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:23.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.327+0000 7f5f557ab640 1 --2- 10.20.193.28:0/3217980625 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f5010f240 0x7f5f5010f610 unknown :-1 s=CLOSED pgs=321 gs=1 cs=0 l=1 c_cookie=2454539558053069495 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:23.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.327+0000 7f5f557ab640 1 -- 10.20.193.28:0/3217980625 >> 10.20.193.28:0/3217980625 conn(0x7f5f500ecaf0 msgr2=0x7f5f5010cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:23.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.327+0000 7f5f557ab640 1 -- 10.20.193.28:0/3217980625 shutdown_connections 2026-02-24T09:17:23.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.327+0000 7f5f557ab640 1 -- 10.20.193.28:0/3217980625 wait complete. 2026-02-24T09:17:23.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.327+0000 7f5f557ab640 1 Processor -- start 2026-02-24T09:17:23.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.327+0000 7f5f557ab640 1 -- start start 2026-02-24T09:17:23.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.328+0000 7f5f557ab640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5f5010f240 0x7f5f5011dba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:23.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.328+0000 7f5f557ab640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f5010fc30 0x7f5f5011e0e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:23.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.328+0000 7f5f557ab640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5f50115430 0x7f5f501234b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:23.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.328+0000 7f5f557ab640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5f50123ad0 con 0x7f5f5010fc30 2026-02-24T09:17:23.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.328+0000 7f5f557ab640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f5f50123c40 con 0x7f5f5010f240 2026-02-24T09:17:23.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.328+0000 7f5f557ab640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5f50123e00 con 0x7f5f50115430 2026-02-24T09:17:23.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.328+0000 7f5f4f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f5010fc30 0x7f5f5011e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:23.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.328+0000 7f5f4ffff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5f5010f240 0x7f5f5011dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:23.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.328+0000 7f5f4ffff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5f5010f240 0x7f5f5011dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:44260/0 (socket says 10.20.193.28:44260) 2026-02-24T09:17:23.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.328+0000 7f5f4ffff640 1 -- 10.20.193.28:0/3610482961 learned_addr learned my addr 10.20.193.28:0/3610482961 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:23.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.328+0000 7f5f54faa640 1 --2- 10.20.193.28:0/3610482961 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5f50115430 0x7f5f501234b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:23.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.328+0000 7f5f4ffff640 1 -- 10.20.193.28:0/3610482961 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5f50115430 msgr2=0x7f5f501234b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:23.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.328+0000 7f5f4ffff640 1 --2- 10.20.193.28:0/3610482961 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5f50115430 0x7f5f501234b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:23.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.328+0000 7f5f4ffff640 1 -- 10.20.193.28:0/3610482961 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f5010fc30 msgr2=0x7f5f5011e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:23.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.328+0000 7f5f4ffff640 1 --2- 10.20.193.28:0/3610482961 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f5010fc30 0x7f5f5011e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:23.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.328+0000 7f5f4ffff640 1 -- 10.20.193.28:0/3610482961 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f3c009570 con 0x7f5f5010f240 2026-02-24T09:17:23.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.328+0000 7f5f4f7fe640 1 --2- 10.20.193.28:0/3610482961 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f5010fc30 0x7f5f5011e0e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:17:23.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.329+0000 7f5f4ffff640 1 --2- 10.20.193.28:0/3610482961 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5f5010f240 0x7f5f5011dba0 secure :-1 s=READY pgs=103 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f3c0098a0 tx=0x7f5f3c0028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:23.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.329+0000 7f5f4d7fa640 1 -- 10.20.193.28:0/3610482961 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5f3c03d070 con 0x7f5f5010f240 2026-02-24T09:17:23.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.329+0000 7f5f557ab640 1 -- 10.20.193.28:0/3610482961 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f50124080 con 0x7f5f5010f240 2026-02-24T09:17:23.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.329+0000 7f5f4d7fa640 1 -- 10.20.193.28:0/3610482961 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f5f3c002a40 con 0x7f5f5010f240 2026-02-24T09:17:23.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.329+0000 7f5f4d7fa640 1 -- 10.20.193.28:0/3610482961 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5f3c041720 con 0x7f5f5010f240 2026-02-24T09:17:23.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.329+0000 7f5f557ab640 1 -- 10.20.193.28:0/3610482961 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f501647e0 con 0x7f5f5010f240 2026-02-24T09:17:23.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.329+0000 7f5f22ffd640 1 -- 10.20.193.28:0/3610482961 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f50110520 con 0x7f5f5010f240 2026-02-24T09:17:23.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.332+0000 7f5f4d7fa640 1 -- 10.20.193.28:0/3610482961 <== mon.2 v2:10.20.193.74:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f5f3c0386a0 con 0x7f5f5010f240 2026-02-24T09:17:23.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.334+0000 7f5f4d7fa640 1 --2- 10.20.193.28:0/3610482961 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5f240b5840 0x7f5f240d5cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:23.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.334+0000 7f5f4d7fa640 1 -- 10.20.193.28:0/3610482961 <== mon.2 v2:10.20.193.74:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f5f3c10b3a0 con 0x7f5f5010f240 2026-02-24T09:17:23.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.334+0000 7f5f4f7fe640 1 --2- 10.20.193.28:0/3610482961 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5f240b5840 0x7f5f240d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:23.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.334+0000 7f5f4d7fa640 1 -- 10.20.193.28:0/3610482961 <== mon.2 v2:10.20.193.74:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f5f3c10b820 con 0x7f5f5010f240 2026-02-24T09:17:23.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.335+0000 7f5f4f7fe640 1 --2- 10.20.193.28:0/3610482961 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5f240b5840 0x7f5f240d5cf0 secure :-1 s=READY pgs=198 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f50124540 tx=0x7f5f40005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:23.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:22 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/1876608613' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:17:23.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:22 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/3428850004' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:17:23.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.449+0000 7f5f22ffd640 1 -- 10.20.193.28:0/3610482961 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5f5011ed00 con 0x7f5f5010f240 2026-02-24T09:17:23.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.450+0000 7f5f4d7fa640 1 -- 10.20.193.28:0/3610482961 <== mon.2 v2:10.20.193.74:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+22632 (secure 0 0 0) 0x7f5f3c0cdd40 con 0x7f5f5010f240 2026-02-24T09:17:23.451 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:17:23.451 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":92,"fsid":"e9ad50af-1160-11f1-800e-d404e6e7d460","created":"2026-02-24T09:12:33.966733+0000","modified":"2026-02-24T09:17:01.228853+0000","last_up_change":"2026-02-24T09:16:34.222008+0000","last_in_change":"2026-02-24T09:16:20.530109+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":38,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T09:14:33.468078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-24T09:16:57.259549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-24T09:16:58.835796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7836f68-f25a-4aea-830a-3c2ce8ac79e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6803","nonce":2124354447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6805","nonce":2124354447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6809","nonce":2124354447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6807","nonce":2124354447}]},"public_addr":"10.20.193.28:6803/2124354447","cluster_addr":"10.20.193.28:6805/2124354447","heartbeat_back_addr":"10.20.193.28:6809/2124354447","heartbeat_front_addr":"10.20.193.28:6807/2124354447","state":["exists","up"]},{"osd":1,"uuid":"04273ff8-91e3-4e70-8041-cc8c205b9a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6800","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6801","nonce":267363486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6802","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6803","nonce":267363486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6806","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6807","nonce":267363486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6804","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6805","nonce":267363486}]},"public_addr":"10.20.193.74:6801/267363486","cluster_addr":"10.20.193.74:6803/267363486","heartbeat_back_addr":"10.20.193.74:6807/267363486","heartbeat_front_addr":"10.20.193.74:6805/267363486","state":["exists","up"]},{"osd":2,"uuid":"dea96db1-588b-4d08-8e52-52c4c995bdc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6800","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6801","nonce":3320466721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6802","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6803","nonce":3320466721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6806","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6807","nonce":3320466721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6804","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6805","nonce":3320466721}]},"public_addr":"10.20.193.159:6801/3320466721","cluster_addr":"10.20.193.159:6803/3320466721","heartbeat_back_addr":"10.20.193.159:6807/3320466721","heartbeat_front_addr":"10.20.193.159:6805/3320466721","state":["exists","up"]},{"osd":3,"uuid":"c785c244-eb3f-4af5-83c6-cd492459f75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6811","nonce":1790609615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6813","nonce":1790609615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6817","nonce":1790609615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6815","nonce":1790609615}]},"public_addr":"10.20.193.28:6811/1790609615","cluster_addr":"10.20.193.28:6813/1790609615","heartbeat_back_addr":"10.20.193.28:6817/1790609615","heartbeat_front_addr":"10.20.193.28:6815/1790609615","state":["exists","up"]},{"osd":4,"uuid":"041239c2-6187-4154-9557-b1b5846f9e0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6808","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6809","nonce":610990618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6810","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6811","nonce":610990618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6814","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6815","nonce":610990618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6812","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6813","nonce":610990618}]},"public_addr":"10.20.193.74:6809/610990618","cluster_addr":"10.20.193.74:6811/610990618","heartbeat_back_addr":"10.20.193.74:6815/610990618","heartbeat_front_addr":"10.20.193.74:6813/610990618","state":["exists","up"]},{"osd":5,"uuid":"ffeeb021-0924-4421-aecf-bac2e74364a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6808","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6809","nonce":1653417923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6810","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6811","nonce":1653417923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6814","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6815","nonce":1653417923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6812","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6813","nonce":1653417923}]},"public_addr":"10.20.193.159:6809/1653417923","cluster_addr":"10.20.193.159:6811/1653417923","heartbeat_back_addr":"10.20.193.159:6815/1653417923","heartbeat_front_addr":"10.20.193.159:6813/1653417923","state":["exists","up"]},{"osd":6,"uuid":"f3736156-4951-4901-9323-7930fb73b8dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6819","nonce":1891043856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6821","nonce":1891043856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6825","nonce":1891043856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6823","nonce":1891043856}]},"public_addr":"10.20.193.28:6819/1891043856","cluster_addr":"10.20.193.28:6821/1891043856","heartbeat_back_addr":"10.20.193.28:6825/1891043856","heartbeat_front_addr":"10.20.193.28:6823/1891043856","state":["exists","up"]},{"osd":7,"uuid":"214b27ee-75f9-4a54-a59b-e8bfbb895903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6816","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6817","nonce":2328869739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6818","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6819","nonce":2328869739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6822","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6823","nonce":2328869739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6820","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6821","nonce":2328869739}]},"public_addr":"10.20.193.74:6817/2328869739","cluster_addr":"10.20.193.74:6819/2328869739","heartbeat_back_addr":"10.20.193.74:6823/2328869739","heartbeat_front_addr":"10.20.193.74:6821/2328869739","state":["exists","up"]},{"osd":8,"uuid":"76599c26-6778-4fa2-b85d-feea8baac7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6816","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6817","nonce":3877834753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6818","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6819","nonce":3877834753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6822","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6823","nonce":3877834753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6820","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6821","nonce":3877834753}]},"public_addr":"10.20.193.159:6817/3877834753","cluster_addr":"10.20.193.159:6819/3877834753","heartbeat_back_addr":"10.20.193.159:6823/3877834753","heartbeat_front_addr":"10.20.193.159:6821/3877834753","state":["exists","up"]},{"osd":9,"uuid":"52b52b35-2d65-4e53-b7d8-fd7385d5ae88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6827","nonce":4207785690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6829","nonce":4207785690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6833","nonce":4207785690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6831","nonce":4207785690}]},"public_addr":"10.20.193.28:6827/4207785690","cluster_addr":"10.20.193.28:6829/4207785690","heartbeat_back_addr":"10.20.193.28:6833/4207785690","heartbeat_front_addr":"10.20.193.28:6831/4207785690","state":["exists","up"]},{"osd":10,"uuid":"65c8e576-a1c7-4c03-bbf6-57c775f2860f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6824","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6825","nonce":2590408209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6826","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6827","nonce":2590408209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6830","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6831","nonce":2590408209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6828","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6829","nonce":2590408209}]},"public_addr":"10.20.193.74:6825/2590408209","cluster_addr":"10.20.193.74:6827/2590408209","heartbeat_back_addr":"10.20.193.74:6831/2590408209","heartbeat_front_addr":"10.20.193.74:6829/2590408209","state":["exists","up"]},{"osd":11,"uuid":"e2305377-fadb-4cf0-8384-87387f116255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":87,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6824","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6825","nonce":709820718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6826","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6827","nonce":709820718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6830","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6831","nonce":709820718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6828","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6829","nonce":709820718}]},"public_addr":"10.20.193.159:6825/709820718","cluster_addr":"10.20.193.159:6827/709820718","heartbeat_back_addr":"10.20.193.159:6831/709820718","heartbeat_front_addr":"10.20.193.159:6829/709820718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:02.414561+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:16.784172+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:30.639920+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:44.510387+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:58.186053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:11.714819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:25.188981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:38.602303+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:51.899864+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:16:05.444224+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:16:18.900719+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:16:32.290361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:0/3696280830":"2026-02-25T09:13:39.242729+0000","10.20.193.28:6801/3539300247":"2026-02-25T09:13:39.242729+0000","10.20.193.28:0/3799405177":"2026-02-25T09:12:46.171932+0000","10.20.193.28:0/1189576634":"2026-02-25T09:12:46.171932+0000","10.20.193.28:6800/1682009277":"2026-02-25T09:12:46.171932+0000","10.20.193.28:6800/3539300247":"2026-02-25T09:13:39.242729+0000","10.20.193.28:6801/1682009277":"2026-02-25T09:12:46.171932+0000","10.20.193.28:0/673213915":"2026-02-25T09:12:59.028609+0000","10.20.193.28:0/857248143":"2026-02-25T09:13:39.242729+0000","10.20.193.28:0/1541006046":"2026-02-25T09:12:46.171932+0000","10.20.193.28:0/264576041":"2026-02-25T09:12:59.028609+0000","10.20.193.28:6800/2303472235":"2026-02-25T09:12:59.028609+0000","10.20.193.28:6801/2303472235":"2026-02-25T09:12:59.028609+0000","10.20.193.28:0/2622827224":"2026-02-25T09:12:59.028609+0000","10.20.193.28:0/3614117448":"2026-02-25T09:13:39.242729+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T09:17:23.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.451+0000 7f5f22ffd640 1 -- 10.20.193.28:0/3610482961 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5f240b5840 msgr2=0x7f5f240d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:23.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.451+0000 7f5f22ffd640 1 --2- 10.20.193.28:0/3610482961 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5f240b5840 0x7f5f240d5cf0 secure :-1 s=READY pgs=198 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f50124540 tx=0x7f5f40005f90 comp rx=0 tx=0).stop 2026-02-24T09:17:23.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.451+0000 7f5f22ffd640 1 -- 10.20.193.28:0/3610482961 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5f5010f240 msgr2=0x7f5f5011dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:23.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.451+0000 7f5f22ffd640 1 --2- 10.20.193.28:0/3610482961 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5f5010f240 0x7f5f5011dba0 secure :-1 s=READY pgs=103 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f3c0098a0 tx=0x7f5f3c0028d0 comp rx=0 tx=0).stop 2026-02-24T09:17:23.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.451+0000 7f5f22ffd640 1 -- 10.20.193.28:0/3610482961 shutdown_connections 2026-02-24T09:17:23.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.451+0000 7f5f22ffd640 1 --2- 10.20.193.28:0/3610482961 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5f240b5840 0x7f5f240d5cf0 unknown :-1 s=CLOSED pgs=198 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:23.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.451+0000 7f5f22ffd640 1 --2- 10.20.193.28:0/3610482961 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5f50115430 0x7f5f501234b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:23.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.451+0000 7f5f22ffd640 1 --2- 10.20.193.28:0/3610482961 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f5010fc30 0x7f5f5011e0e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:23.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.451+0000 7f5f22ffd640 1 --2- 10.20.193.28:0/3610482961 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5f5010f240 0x7f5f5011dba0 unknown :-1 s=CLOSED pgs=103 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:23.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.452+0000 7f5f22ffd640 1 -- 10.20.193.28:0/3610482961 >> 10.20.193.28:0/3610482961 conn(0x7f5f500ecaf0 msgr2=0x7f5f5010ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:23.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.452+0000 7f5f22ffd640 1 -- 10.20.193.28:0/3610482961 shutdown_connections 2026-02-24T09:17:23.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.452+0000 7f5f22ffd640 1 -- 10.20.193.28:0/3610482961 wait complete. 2026-02-24T09:17:23.553 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:17:23.737 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:23.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.913+0000 7fde2479a640 1 -- 10.20.193.28:0/1593898257 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde1c1100b0 msgr2=0x7fde1c115100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:23.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.913+0000 7fde2479a640 1 --2- 10.20.193.28:0/1593898257 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde1c1100b0 0x7fde1c115100 secure :-1 s=READY pgs=322 gs=1 cs=0 l=1 c_cookie=8839697091175388199 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde10009950 tx=0x7fde1002f190 comp rx=0 tx=0).stop 2026-02-24T09:17:23.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.914+0000 7fde2479a640 1 -- 10.20.193.28:0/1593898257 shutdown_connections 2026-02-24T09:17:23.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.914+0000 7fde2479a640 1 --2- 10.20.193.28:0/1593898257 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fde1c1158b0 0x7fde1c176280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:23.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.914+0000 7fde2479a640 1 --2- 10.20.193.28:0/1593898257 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde1c1100b0 0x7fde1c115100 unknown :-1 s=CLOSED pgs=322 gs=1 cs=0 l=1 c_cookie=8839697091175388199 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:23.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.914+0000 7fde2479a640 1 --2- 10.20.193.28:0/1593898257 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fde1c10f6c0 0x7fde1c10fa90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:23.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.914+0000 7fde2479a640 1 -- 10.20.193.28:0/1593898257 >> 10.20.193.28:0/1593898257 conn(0x7fde1c0ecfd0 msgr2=0x7fde1c10d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:23.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.914+0000 7fde2479a640 1 -- 10.20.193.28:0/1593898257 shutdown_connections 2026-02-24T09:17:23.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.914+0000 7fde2479a640 1 -- 10.20.193.28:0/1593898257 wait complete. 2026-02-24T09:17:23.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.915+0000 7fde2479a640 1 Processor -- start 2026-02-24T09:17:23.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.915+0000 7fde2479a640 1 -- start start 2026-02-24T09:17:23.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.915+0000 7fde2479a640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fde1c10f6c0 0x7fde1c0f5a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:23.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.915+0000 7fde2479a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde1c1100b0 0x7fde1c176180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:23.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.915+0000 7fde2479a640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fde1c1158b0 0x7fde1c0f6190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:23.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.915+0000 7fde2479a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fde1c0fb3a0 con 0x7fde1c1100b0 2026-02-24T09:17:23.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.915+0000 7fde2479a640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fde1c0fb510 con 0x7fde1c1158b0 2026-02-24T09:17:23.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.915+0000 7fde2479a640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fde1c0fb6d0 con 0x7fde1c10f6c0 2026-02-24T09:17:23.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.916+0000 7fde2250f640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fde1c10f6c0 0x7fde1c0f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:23.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.916+0000 7fde21d0e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde1c1100b0 0x7fde1c176180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:23.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.916+0000 7fde2250f640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fde1c10f6c0 0x7fde1c0f5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:35330/0 (socket says 10.20.193.28:35330) 2026-02-24T09:17:23.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.916+0000 7fde2250f640 1 -- 10.20.193.28:0/1058612683 learned_addr learned my addr 10.20.193.28:0/1058612683 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:23.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.916+0000 7fde22d10640 1 --2- 10.20.193.28:0/1058612683 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fde1c1158b0 0x7fde1c0f6190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:23.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.916+0000 7fde21d0e640 1 -- 10.20.193.28:0/1058612683 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fde1c10f6c0 msgr2=0x7fde1c0f5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:23.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.916+0000 7fde21d0e640 1 --2- 10.20.193.28:0/1058612683 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fde1c10f6c0 0x7fde1c0f5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:23.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.916+0000 7fde21d0e640 1 -- 10.20.193.28:0/1058612683 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fde1c1158b0 msgr2=0x7fde1c0f6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:23.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.916+0000 7fde21d0e640 1 --2- 10.20.193.28:0/1058612683 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fde1c1158b0 0x7fde1c0f6190 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:23.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.916+0000 7fde21d0e640 1 -- 10.20.193.28:0/1058612683 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde10009570 con 0x7fde1c1100b0 2026-02-24T09:17:23.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.916+0000 7fde22d10640 1 --2- 10.20.193.28:0/1058612683 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fde1c1158b0 0x7fde1c0f6190 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:23.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.916+0000 7fde21d0e640 1 --2- 10.20.193.28:0/1058612683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde1c1100b0 0x7fde1c176180 secure :-1 s=READY pgs=323 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde10009950 tx=0x7fde100028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:23.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.916+0000 7fde037fe640 1 -- 10.20.193.28:0/1058612683 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fde1003d070 con 0x7fde1c1100b0 2026-02-24T09:17:23.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.916+0000 7fde037fe640 1 -- 10.20.193.28:0/1058612683 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fde100043b0 con 0x7fde1c1100b0 2026-02-24T09:17:23.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.916+0000 7fde037fe640 1 -- 10.20.193.28:0/1058612683 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fde10041800 con 0x7fde1c1100b0 2026-02-24T09:17:23.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.916+0000 7fde2479a640 1 -- 10.20.193.28:0/1058612683 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde1c0fb950 con 0x7fde1c1100b0 2026-02-24T09:17:23.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.916+0000 7fde2479a640 1 -- 10.20.193.28:0/1058612683 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde1c0fbd70 con 0x7fde1c1100b0 2026-02-24T09:17:23.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.917+0000 7fde2479a640 1 -- 10.20.193.28:0/1058612683 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdde4005300 con 0x7fde1c1100b0 2026-02-24T09:17:23.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.919+0000 7fde037fe640 1 -- 10.20.193.28:0/1058612683 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7fde100386a0 con 0x7fde1c1100b0 2026-02-24T09:17:23.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.920+0000 7fde037fe640 1 --2- 10.20.193.28:0/1058612683 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fddf80b5830 0x7fddf80d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:23.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.920+0000 7fde037fe640 1 -- 10.20.193.28:0/1058612683 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7fde1010b580 con 0x7fde1c1100b0 2026-02-24T09:17:23.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.920+0000 7fde037fe640 1 -- 10.20.193.28:0/1058612683 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fde1010ba00 con 0x7fde1c1100b0 2026-02-24T09:17:23.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.921+0000 7fde2250f640 1 --2- 10.20.193.28:0/1058612683 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fddf80b5830 0x7fddf80d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:23.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:23.921+0000 7fde2250f640 1 --2- 10.20.193.28:0/1058612683 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fddf80b5830 0x7fddf80d5ce0 secure :-1 s=READY pgs=199 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde0c00b2a0 tx=0x7fde0c00b480 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:24.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.063+0000 7fde2479a640 1 -- 10.20.193.28:0/1058612683 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdde4005950 con 0x7fde1c1100b0 2026-02-24T09:17:24.064 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:23 trial028 ceph-mon[40371]: pgmap v192: 97 pgs: 97 active+clean; 645 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2026-02-24T09:17:24.064 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:23 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/3610482961' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:17:24.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.063+0000 7fde037fe640 1 -- 10.20.193.28:0/1058612683 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11901 (secure 0 0 0) 0x7fde100cdf20 con 0x7fde1c1100b0 2026-02-24T09:17:24.065 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:17:24.066 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":22,"btime":"2026-02-24T09:17:06:566638+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14856,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/3473030842","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":3473030842},{"type":"v1","addr":"10.20.193.28:6835","nonce":3473030842}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14862,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/4120804601","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":4120804601},{"type":"v1","addr":"10.20.193.28:6837","nonce":4120804601}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14910,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/1354296520","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1354296520},{"type":"v1","addr":"10.20.193.28:6839","nonce":1354296520}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24691,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.159:6833/3049112106","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6832","nonce":3049112106},{"type":"v1","addr":"10.20.193.159:6833","nonce":3049112106}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24710,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.74:6833/1426135976","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6832","nonce":1426135976},{"type":"v1","addr":"10.20.193.74:6833","nonce":1426135976}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24721,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.159:6835/3999384392","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6834","nonce":3999384392},{"type":"v1","addr":"10.20.193.159:6835","nonce":3999384392}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:16:59.889500+0000","modified":"2026-02-24T09:17:05.859296+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24788,"mds_1":24761,"mds_2":24760},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24727":{"gid":24727,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.159:6837/2059577520","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6836","nonce":2059577520},{"type":"v1","addr":"10.20.193.159:6837","nonce":2059577520}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24734":{"gid":24734,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.74:6835/2067708838","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6834","nonce":2067708838},{"type":"v1","addr":"10.20.193.74:6835","nonce":2067708838}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24745":{"gid":24745,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.159:6839/533862317","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6838","nonce":533862317},{"type":"v1","addr":"10.20.193.159:6839","nonce":533862317}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24760":{"gid":24760,"name":"a","rank":2,"incarnation":20,"state":"up:active","state_seq":5,"addr":"10.20.193.28:6841/492586680","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":492586680},{"type":"v1","addr":"10.20.193.28:6841","nonce":492586680}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24761":{"gid":24761,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"10.20.193.74:6837/958749351","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6836","nonce":958749351},{"type":"v1","addr":"10.20.193.74:6837","nonce":958749351}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24788":{"gid":24788,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"10.20.193.74:6839/828566790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6838","nonce":828566790},{"type":"v1","addr":"10.20.193.74:6839","nonce":828566790}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24788,"qdb_cluster":[24788,24761,24760]},"id":1}]} 2026-02-24T09:17:24.067 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 22 2026-02-24T09:17:24.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.065+0000 7fde2479a640 1 -- 10.20.193.28:0/1058612683 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fddf80b5830 msgr2=0x7fddf80d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:24.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.065+0000 7fde2479a640 1 --2- 10.20.193.28:0/1058612683 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fddf80b5830 0x7fddf80d5ce0 secure :-1 s=READY pgs=199 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde0c00b2a0 tx=0x7fde0c00b480 comp rx=0 tx=0).stop 2026-02-24T09:17:24.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.065+0000 7fde2479a640 1 -- 10.20.193.28:0/1058612683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde1c1100b0 msgr2=0x7fde1c176180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:24.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.065+0000 7fde2479a640 1 --2- 10.20.193.28:0/1058612683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde1c1100b0 0x7fde1c176180 secure :-1 s=READY pgs=323 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde10009950 tx=0x7fde100028d0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.065+0000 7fde2479a640 1 -- 10.20.193.28:0/1058612683 shutdown_connections 2026-02-24T09:17:24.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.065+0000 7fde2479a640 1 --2- 10.20.193.28:0/1058612683 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fddf80b5830 0x7fddf80d5ce0 unknown :-1 s=CLOSED pgs=199 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.065+0000 7fde2479a640 1 --2- 10.20.193.28:0/1058612683 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fde1c1158b0 0x7fde1c0f6190 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.065+0000 7fde2479a640 1 --2- 10.20.193.28:0/1058612683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde1c1100b0 0x7fde1c176180 unknown :-1 s=CLOSED pgs=323 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.065+0000 7fde2479a640 1 --2- 10.20.193.28:0/1058612683 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fde1c10f6c0 0x7fde1c0f5a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.065+0000 7fde2479a640 1 -- 10.20.193.28:0/1058612683 >> 10.20.193.28:0/1058612683 conn(0x7fde1c0ecfd0 msgr2=0x7fde1c111ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:24.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.065+0000 7fde2479a640 1 -- 10.20.193.28:0/1058612683 shutdown_connections 2026-02-24T09:17:24.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.065+0000 7fde2479a640 1 -- 10.20.193.28:0/1058612683 wait complete. 2026-02-24T09:17:24.167 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2026-02-24T09:16:59.889500+0000', 'modified': '2026-02-24T09:17:05.859296+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24788, 'mds_1': 24761, 'mds_2': 24760}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24727': {'gid': 24727, 'name': 'c', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.159:6837/2059577520', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.159:6836', 'nonce': 2059577520}, {'type': 'v1', 'addr': '10.20.193.159:6837', 'nonce': 2059577520}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24734': {'gid': 24734, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.74:6835/2067708838', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.74:6834', 'nonce': 2067708838}, {'type': 'v1', 'addr': '10.20.193.74:6835', 'nonce': 2067708838}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24745': {'gid': 24745, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.159:6839/533862317', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.159:6838', 'nonce': 533862317}, {'type': 'v1', 'addr': '10.20.193.159:6839', 'nonce': 533862317}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24760': {'gid': 24760, 'name': 'a', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 5, 'addr': '10.20.193.28:6841/492586680', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.28:6840', 'nonce': 492586680}, {'type': 'v1', 'addr': '10.20.193.28:6841', 'nonce': 492586680}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24761': {'gid': 24761, 'name': 'h', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 5, 'addr': '10.20.193.74:6837/958749351', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.74:6836', 'nonce': 958749351}, {'type': 'v1', 'addr': '10.20.193.74:6837', 'nonce': 958749351}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24788': {'gid': 24788, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '10.20.193.74:6839/828566790', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.74:6838', 'nonce': 828566790}, {'type': 'v1', 'addr': '10.20.193.74:6839', 'nonce': 828566790}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24788, 'qdb_cluster': [24788, 24761, 24760]} 2026-02-24T09:17:24.167 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2026-02-24T09:17:24.167 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph tell mds.a status 2026-02-24T09:17:24.279 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:23 trial159 ceph-mon[44242]: pgmap v192: 97 pgs: 97 active+clean; 645 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2026-02-24T09:17:24.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:23 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/3610482961' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:17:24.355 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:24.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:23 trial074 ceph-mon[44412]: pgmap v192: 97 pgs: 97 active+clean; 645 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2026-02-24T09:17:24.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:23 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/3610482961' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:17:24.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.534+0000 7f7bd995e640 1 -- 10.20.193.28:0/3464080240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7bd4114a10 msgr2=0x7f7bd41191f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:24.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.534+0000 7f7bd995e640 1 --2- 10.20.193.28:0/3464080240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7bd4114a10 0x7f7bd41191f0 secure :-1 s=READY pgs=324 gs=1 cs=0 l=1 c_cookie=13811737192506566160 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bbc009950 tx=0x7f7bbc02f190 comp rx=0 tx=0).stop 2026-02-24T09:17:24.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.534+0000 7f7bd995e640 1 -- 10.20.193.28:0/3464080240 shutdown_connections 2026-02-24T09:17:24.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.534+0000 7f7bd995e640 1 --2- 10.20.193.28:0/3464080240 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7bd41199a0 0x7f7bd417a370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.534+0000 7f7bd995e640 1 --2- 10.20.193.28:0/3464080240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7bd4114a10 0x7f7bd41191f0 unknown :-1 s=CLOSED pgs=324 gs=1 cs=0 l=1 c_cookie=13811737192506566160 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.534+0000 7f7bd995e640 1 --2- 10.20.193.28:0/3464080240 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7bd4114020 0x7f7bd41143f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.534+0000 7f7bd995e640 1 -- 10.20.193.28:0/3464080240 >> 10.20.193.28:0/3464080240 conn(0x7f7bd4064810 msgr2=0x7f7bd4064c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:24.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.534+0000 7f7bd995e640 1 -- 10.20.193.28:0/3464080240 shutdown_connections 2026-02-24T09:17:24.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.534+0000 7f7bd995e640 1 -- 10.20.193.28:0/3464080240 wait complete. 2026-02-24T09:17:24.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.535+0000 7f7bd995e640 1 Processor -- start 2026-02-24T09:17:24.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.535+0000 7f7bd995e640 1 -- start start 2026-02-24T09:17:24.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.535+0000 7f7bd995e640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7bd4114020 0x7f7bd40fbd80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:24.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.535+0000 7f7bd995e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7bd4114a10 0x7f7bd417a270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:24.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.535+0000 7f7bd995e640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7bd41199a0 0x7f7bd40fc480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:24.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.535+0000 7f7bd995e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd4101640 con 0x7f7bd4114a10 2026-02-24T09:17:24.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.535+0000 7f7bd995e640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd41017b0 con 0x7f7bd4114020 2026-02-24T09:17:24.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.535+0000 7f7bd995e640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd4101970 con 0x7f7bd41199a0 2026-02-24T09:17:24.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.536+0000 7f7bcbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7bd4114a10 0x7f7bd417a270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:24.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.536+0000 7f7bcbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7bd4114a10 0x7f7bd417a270 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40472/0 (socket says 10.20.193.28:40472) 2026-02-24T09:17:24.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.536+0000 7f7bcbfff640 1 -- 10.20.193.28:0/2675071599 learned_addr learned my addr 10.20.193.28:0/2675071599 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:24.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.536+0000 7f7bd895c640 1 --2- 10.20.193.28:0/2675071599 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7bd4114020 0x7f7bd40fbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:24.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.536+0000 7f7bcbfff640 1 -- 10.20.193.28:0/2675071599 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7bd41199a0 msgr2=0x7f7bd40fc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:24.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.536+0000 7f7bcbfff640 1 --2- 10.20.193.28:0/2675071599 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7bd41199a0 0x7f7bd40fc480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.536+0000 7f7bcbfff640 1 -- 10.20.193.28:0/2675071599 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7bd4114020 msgr2=0x7f7bd40fbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:24.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.536+0000 7f7bcbfff640 1 --2- 10.20.193.28:0/2675071599 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7bd4114020 0x7f7bd40fbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.536+0000 7f7bcbfff640 1 -- 10.20.193.28:0/2675071599 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bbc009570 con 0x7f7bd4114a10 2026-02-24T09:17:24.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.536+0000 7f7bcbfff640 1 --2- 10.20.193.28:0/2675071599 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7bd4114a10 0x7f7bd417a270 secure :-1 s=READY pgs=325 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bbc0098a0 tx=0x7f7bbc0028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:24.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.536+0000 7f7bc9ffb640 1 -- 10.20.193.28:0/2675071599 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bbc03d070 con 0x7f7bd4114a10 2026-02-24T09:17:24.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.536+0000 7f7bc9ffb640 1 -- 10.20.193.28:0/2675071599 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7bbc002a70 con 0x7f7bd4114a10 2026-02-24T09:17:24.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.536+0000 7f7bc9ffb640 1 -- 10.20.193.28:0/2675071599 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bbc041890 con 0x7f7bd4114a10 2026-02-24T09:17:24.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.536+0000 7f7bd995e640 1 -- 10.20.193.28:0/2675071599 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bd4101bf0 con 0x7f7bd4114a10 2026-02-24T09:17:24.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.536+0000 7f7bd995e640 1 -- 10.20.193.28:0/2675071599 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bd4102010 con 0x7f7bd4114a10 2026-02-24T09:17:24.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.541+0000 7f7bc9ffb640 1 -- 10.20.193.28:0/2675071599 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f7bbc041a20 con 0x7f7bd4114a10 2026-02-24T09:17:24.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.542+0000 7f7bdcbe1e00 1 Processor -- start 2026-02-24T09:17:24.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.542+0000 7f7bdcbe1e00 1 -- start start 2026-02-24T09:17:24.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.542+0000 7f7bdcbe1e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x555af7662390 0x555af7662760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:24.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.542+0000 7f7bdcbe1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555af7662ca0 0x555af76a7400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:24.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.542+0000 7f7bdcbe1e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x555af76a7940 0x555af76c7d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:24.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.542+0000 7f7bdcbe1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555af7578910 con 0x555af7662ca0 2026-02-24T09:17:24.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.542+0000 7f7bdcbe1e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x555af7574640 con 0x555af7662390 2026-02-24T09:17:24.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.542+0000 7f7bdcbe1e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x555af756e7a0 con 0x555af76a7940 2026-02-24T09:17:24.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.543+0000 7f7bd895c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555af7662ca0 0x555af76a7400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:24.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.543+0000 7f7bd895c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555af7662ca0 0x555af76a7400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40484/0 (socket says 10.20.193.28:40484) 2026-02-24T09:17:24.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.543+0000 7f7bd895c640 1 -- 10.20.193.28:0/4035797770 learned_addr learned my addr 10.20.193.28:0/4035797770 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:24.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.543+0000 7f7bd915d640 1 --2- 10.20.193.28:0/4035797770 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x555af7662390 0x555af7662760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:24.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.543+0000 7f7bcbfff640 1 --2- 10.20.193.28:0/4035797770 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x555af76a7940 0x555af76c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:24.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.543+0000 7f7bd895c640 1 -- 10.20.193.28:0/4035797770 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x555af76a7940 msgr2=0x555af76c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:24.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.543+0000 7f7bd895c640 1 --2- 10.20.193.28:0/4035797770 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x555af76a7940 0x555af76c7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.543+0000 7f7bd895c640 1 -- 10.20.193.28:0/4035797770 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x555af7662390 msgr2=0x555af7662760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:24.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.543+0000 7f7bd895c640 1 --2- 10.20.193.28:0/4035797770 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x555af7662390 0x555af7662760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.543+0000 7f7bd895c640 1 -- 10.20.193.28:0/4035797770 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555af7519d00 con 0x555af7662ca0 2026-02-24T09:17:24.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.543+0000 7f7bcbfff640 1 --2- 10.20.193.28:0/4035797770 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x555af76a7940 0x555af76c7d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:24.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.543+0000 7f7bd895c640 1 --2- 10.20.193.28:0/4035797770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555af7662ca0 0x555af76a7400 secure :-1 s=READY pgs=326 gs=1 cs=0 l=1 c_cookie=7365495067712638047 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bc4002b60 tx=0x7f7bc400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66377ebd71e74c5f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:24.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.543+0000 7f7bc9ffb640 1 --2- 10.20.193.28:0/2675071599 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f7bb00b5840 0x7f7bb00d5cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:24.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.543+0000 7f7ba14e4640 1 -- 10.20.193.28:0/4035797770 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bc4002e80 con 0x555af7662ca0 2026-02-24T09:17:24.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.543+0000 7f7ba14e4640 1 -- 10.20.193.28:0/4035797770 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7bc4011900 con 0x555af7662ca0 2026-02-24T09:17:24.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.543+0000 7f7ba14e4640 1 -- 10.20.193.28:0/4035797770 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bc4019950 con 0x555af7662ca0 2026-02-24T09:17:24.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.543+0000 7f7bc9ffb640 1 -- 10.20.193.28:0/2675071599 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f7bbc10b260 con 0x7f7bd4114a10 2026-02-24T09:17:24.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.543+0000 7f7bd915d640 1 --2- 10.20.193.28:0/2675071599 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f7bb00b5840 0x7f7bb00d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:24.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.544+0000 7f7bdcbe1e00 1 -- 10.20.193.28:0/4035797770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555af7662ca0 msgr2=0x555af76a7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:24.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.544+0000 7f7bdcbe1e00 1 --2- 10.20.193.28:0/4035797770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555af7662ca0 0x555af76a7400 secure :-1 s=READY pgs=326 gs=1 cs=0 l=1 c_cookie=7365495067712638047 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bc4002b60 tx=0x7f7bc400f730 comp rx=0 tx=0).stop 2026-02-24T09:17:24.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.544+0000 7f7bdcbe1e00 1 -- 10.20.193.28:0/4035797770 shutdown_connections 2026-02-24T09:17:24.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.544+0000 7f7bdcbe1e00 1 --2- 10.20.193.28:0/4035797770 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x555af76a7940 0x555af76c7d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.544+0000 7f7bdcbe1e00 1 --2- 10.20.193.28:0/4035797770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555af7662ca0 0x555af76a7400 unknown :-1 s=CLOSED pgs=326 gs=1 cs=0 l=1 c_cookie=7365495067712638047 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.544+0000 7f7bdcbe1e00 1 --2- 10.20.193.28:0/4035797770 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x555af7662390 0x555af7662760 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.544+0000 7f7bdcbe1e00 1 -- 10.20.193.28:0/4035797770 >> 10.20.193.28:0/4035797770 conn(0x555af75818a0 msgr2=0x555af7660c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:24.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.544+0000 7f7bdcbe1e00 1 -- 10.20.193.28:0/4035797770 shutdown_connections 2026-02-24T09:17:24.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.544+0000 7f7bdcbe1e00 1 -- 10.20.193.28:0/4035797770 wait complete. 2026-02-24T09:17:24.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.544+0000 7f7bd915d640 1 --2- 10.20.193.28:0/2675071599 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f7bb00b5840 0x7f7bb00d5cf0 secure :-1 s=READY pgs=200 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bd0005820 tx=0x7f7bd000b380 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:24.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.545+0000 7f7bdcbe1e00 1 -- start start 2026-02-24T09:17:24.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.545+0000 7f7bdcbe1e00 1 Processor -- start 2026-02-24T09:17:24.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.546+0000 7f7bdcbe1e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x555af7662390 0x555af76bf130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:24.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.546+0000 7f7bdcbe1e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x555af7662ca0 0x555af76bf670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:24.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.546+0000 7f7bdcbe1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555af76a7940 0x555af76c4660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:24.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.546+0000 7f7bdcbe1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555af76c4ba0 con 0x555af76a7940 2026-02-24T09:17:24.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.546+0000 7f7bdcbe1e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x555af76c4d10 con 0x555af7662ca0 2026-02-24T09:17:24.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.546+0000 7f7bdcbe1e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x555af76c4ed0 con 0x555af7662390 2026-02-24T09:17:24.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.546+0000 7f7bd915d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555af76a7940 0x555af76c4660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:24.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.546+0000 7f7bd915d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555af76a7940 0x555af76c4660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40492/0 (socket says 10.20.193.28:40492) 2026-02-24T09:17:24.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.546+0000 7f7bd915d640 1 -- 10.20.193.28:0/2727312884 learned_addr learned my addr 10.20.193.28:0/2727312884 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:24.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.546+0000 7f7bd895c640 1 --2- 10.20.193.28:0/2727312884 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x555af7662390 0x555af76bf130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:24.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.546+0000 7f7bd915d640 1 -- 10.20.193.28:0/2727312884 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x555af7662390 msgr2=0x555af76bf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:24.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.546+0000 7f7bd915d640 1 --2- 10.20.193.28:0/2727312884 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x555af7662390 0x555af76bf130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.546+0000 7f7bd915d640 1 -- 10.20.193.28:0/2727312884 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x555af7662ca0 msgr2=0x555af76bf670 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:17:24.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.546+0000 7f7bd915d640 1 --2- 10.20.193.28:0/2727312884 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x555af7662ca0 0x555af76bf670 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.546+0000 7f7bd915d640 1 -- 10.20.193.28:0/2727312884 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555af74f23b0 con 0x555af76a7940 2026-02-24T09:17:24.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.546+0000 7f7bd915d640 1 --2- 10.20.193.28:0/2727312884 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555af76a7940 0x555af76c4660 secure :-1 s=READY pgs=327 gs=1 cs=0 l=1 c_cookie=15548607012275826412 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bd0011730 tx=0x7f7bd0005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c7bfb296d92eec server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:24.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.547+0000 7f7b927fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:17:24.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.547+0000 7f7b927fc640 1 -- 10.20.193.28:0/2727312884 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bd0010b60 con 0x555af76a7940 2026-02-24T09:17:24.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.547+0000 7f7bdcbe1e00 1 -- 10.20.193.28:0/2727312884 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bc4002780 con 0x555af76a7940 2026-02-24T09:17:24.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.547+0000 7f7bdcbe1e00 10 client.15318 _ll_register_callbacks cb 0x555af74f6510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:24.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.547+0000 7f7bdcbe1e00 1 -- 10.20.193.28:0/2727312884 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555af7204600 con 0x555af76a7940 2026-02-24T09:17:24.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.547+0000 7f7b927fc640 1 -- 10.20.193.28:0/2727312884 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7bd0015070 con 0x555af76a7940 2026-02-24T09:17:24.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.547+0000 7f7b927fc640 1 -- 10.20.193.28:0/2727312884 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bd0026680 con 0x555af76a7940 2026-02-24T09:17:24.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.547+0000 7f7b927fc640 1 -- 10.20.193.28:0/2727312884 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f7bd0017070 con 0x555af76a7940 2026-02-24T09:17:24.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.547+0000 7f7b927fc640 1 -- 10.20.193.28:0/2727312884 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f7bd001ee70 con 0x555af76a7940 2026-02-24T09:17:24.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.547+0000 7f7bdcbe1e00 10 client.15318 fetch_fsmap learned FSMap version 22 2026-02-24T09:17:24.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.547+0000 7f7bdcbe1e00 1 -- 10.20.193.28:0/2727312884 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=22}) -- 0x555af75040d0 con 0x555af76a7940 2026-02-24T09:17:24.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.547+0000 7f7b927fc640 1 -- 10.20.193.28:0/2727312884 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 22) ==== 8346+0+0 (secure 0 0 0) 0x7f7bd0024020 con 0x555af76a7940 2026-02-24T09:17:24.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.547+0000 7f7bdcbe1e00 10 client.15318 fetch_fsmap finished waiting for FSMap version 22 2026-02-24T09:17:24.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.547+0000 7f7bdcbe1e00 10 client.15318 resolve_mds: resolved name 'a' to daemon mds.a 2026-02-24T09:17:24.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.547+0000 7f7bdcbe1e00 20 client.15318 populate_metadata read hostname 'trial028' 2026-02-24T09:17:24.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.547+0000 7f7bdcbe1e00 1 --2- 10.20.193.28:0/2727312884 >> [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] conn(0x555af76a5970 0x555af76a6de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:24.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.547+0000 7f7bdcbe1e00 4 client.15318 mds_command: new command op to 24760 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:17:24.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.547+0000 7f7bdcbe1e00 1 -- 10.20.193.28:0/2727312884 --> [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555af75412e0 con 0x555af76a5970 2026-02-24T09:17:24.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.548+0000 7f7bd895c640 1 --2- 10.20.193.28:0/2727312884 >> [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] conn(0x555af76a5970 0x555af76a6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:24.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.548+0000 7f7bd895c640 1 --2- 10.20.193.28:0/2727312884 >> [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] conn(0x555af76a5970 0x555af76a6de0 crc :-1 s=READY pgs=17 gs=3 cs=0 l=0 c_cookie=6246419209100465542 s_cookie=2500910666335066342 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=56afbd2cfc9c1586 server_cookie=22b5050029e318e6 in_seq=0 out_seq=0 2026-02-24T09:17:24.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.548+0000 7f7b927fc640 10 client.15318 ms_handle_connect on v2:10.20.193.28:6840/492586680 2026-02-24T09:17:24.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.549+0000 7f7b927fc640 1 -- 10.20.193.28:0/2727312884 <== mds.2 v2:10.20.193.28:6840/492586680 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x555af75412e0 con 0x555af76a5970 2026-02-24T09:17:24.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.549+0000 7f7b927fc640 10 client.15318 handle_command_reply: tid=0 2026-02-24T09:17:24.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.549+0000 7f7bdcbe1e00 1 client.15318 shutdown 2026-02-24T09:17:24.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.549+0000 7f7bdcbe1e00 1 -- 10.20.193.28:0/2727312884 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555af76a7940 msgr2=0x555af76c4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:24.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.549+0000 7f7bdcbe1e00 1 --2- 10.20.193.28:0/2727312884 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555af76a7940 0x555af76c4660 secure :-1 s=READY pgs=327 gs=1 cs=0 l=1 c_cookie=15548607012275826412 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bd0011730 tx=0x7f7bd0005850 comp rx=0 tx=0).stop 2026-02-24T09:17:24.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.549+0000 7f7bdcbe1e00 1 -- 10.20.193.28:0/2727312884 shutdown_connections 2026-02-24T09:17:24.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.549+0000 7f7bdcbe1e00 1 --2- 10.20.193.28:0/2727312884 >> [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] conn(0x555af76a5970 0x555af76a6de0 crc :-1 s=READY pgs=17 gs=3 cs=0 l=0 c_cookie=6246419209100465542 s_cookie=2500910666335066342 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.549+0000 7f7bdcbe1e00 1 --2- 10.20.193.28:0/2727312884 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555af76a7940 0x555af76c4660 unknown :-1 s=CLOSED pgs=327 gs=1 cs=0 l=1 c_cookie=15548607012275826412 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.549+0000 7f7bdcbe1e00 1 --2- 10.20.193.28:0/2727312884 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x555af7662ca0 0x555af76bf670 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.549+0000 7f7bdcbe1e00 1 --2- 10.20.193.28:0/2727312884 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x555af7662390 0x555af76bf130 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.549+0000 7f7b927fc640 0 client.15318 ms_handle_reset on v2:10.20.193.28:6840/492586680 2026-02-24T09:17:24.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.549+0000 7f7bdcbe1e00 1 -- 10.20.193.28:0/2727312884 >> 10.20.193.28:0/2727312884 conn(0x555af75818a0 msgr2=0x555af7660480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:24.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.549+0000 7f7bdcbe1e00 1 -- 10.20.193.28:0/2727312884 shutdown_connections 2026-02-24T09:17:24.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.549+0000 7f7bdcbe1e00 1 -- 10.20.193.28:0/2727312884 wait complete. 2026-02-24T09:17:24.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.549+0000 7f7bdcbe1e00 20 client.15318 trim_cache size 0 max 16384 2026-02-24T09:17:24.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.559+0000 7f7bdcbe1e00 1 Processor -- start 2026-02-24T09:17:24.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.559+0000 7f7bdcbe1e00 1 -- start start 2026-02-24T09:17:24.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.559+0000 7f7bdcbe1e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x555af7662390 0x555af76aa430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:24.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.559+0000 7f7bdcbe1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555af7662ca0 0x555af76b10e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:24.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.559+0000 7f7bdcbe1e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x555af76a7940 0x555af76ac790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:24.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.559+0000 7f7bdcbe1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555af756c3d0 con 0x555af7662ca0 2026-02-24T09:17:24.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.559+0000 7f7bdcbe1e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x555af722c610 con 0x555af7662390 2026-02-24T09:17:24.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.559+0000 7f7bdcbe1e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x555af76b83f0 con 0x555af76a7940 2026-02-24T09:17:24.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.559+0000 7f7bcbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555af7662ca0 0x555af76b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:24.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.559+0000 7f7bd895c640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x555af7662390 0x555af76aa430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:24.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.559+0000 7f7bd895c640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x555af7662390 0x555af76aa430 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:44314/0 (socket says 10.20.193.28:44314) 2026-02-24T09:17:24.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.559+0000 7f7bd895c640 1 -- 10.20.193.28:0/326950155 learned_addr learned my addr 10.20.193.28:0/326950155 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:24.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.559+0000 7f7bd915d640 1 --2- 10.20.193.28:0/326950155 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x555af76a7940 0x555af76ac790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:24.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.559+0000 7f7bcbfff640 1 -- 10.20.193.28:0/326950155 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x555af76a7940 msgr2=0x555af76ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:24.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.559+0000 7f7bcbfff640 1 --2- 10.20.193.28:0/326950155 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x555af76a7940 0x555af76ac790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.560+0000 7f7bcbfff640 1 -- 10.20.193.28:0/326950155 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x555af7662390 msgr2=0x555af76aa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:24.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.560+0000 7f7bcbfff640 1 --2- 10.20.193.28:0/326950155 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x555af7662390 0x555af76aa430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.560+0000 7f7bcbfff640 1 -- 10.20.193.28:0/326950155 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555af74feb50 con 0x555af7662ca0 2026-02-24T09:17:24.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.560+0000 7f7bd895c640 1 --2- 10.20.193.28:0/326950155 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x555af7662390 0x555af76aa430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:17:24.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.560+0000 7f7bcbfff640 1 --2- 10.20.193.28:0/326950155 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555af7662ca0 0x555af76b10e0 secure :-1 s=READY pgs=328 gs=2 cs=0 l=1 c_cookie=5897960234286670917 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x555af74f6c60 tx=0x7f7bbc005ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d9c39598096445 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:24.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.560+0000 7f7ba0ce3640 1 -- 10.20.193.28:0/326950155 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bbc0d0f90 con 0x555af7662ca0 2026-02-24T09:17:24.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.560+0000 7f7ba0ce3640 1 -- 10.20.193.28:0/326950155 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7bbc0d0db0 con 0x555af7662ca0 2026-02-24T09:17:24.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.560+0000 7f7ba0ce3640 1 -- 10.20.193.28:0/326950155 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bbc0d9940 con 0x555af7662ca0 2026-02-24T09:17:24.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.560+0000 7f7bdcbe1e00 1 -- 10.20.193.28:0/326950155 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555af7662ca0 msgr2=0x555af76b10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:24.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.560+0000 7f7bdcbe1e00 1 --2- 10.20.193.28:0/326950155 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555af7662ca0 0x555af76b10e0 secure :-1 s=READY pgs=328 gs=2 cs=0 l=1 c_cookie=5897960234286670917 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x555af74f6c60 tx=0x7f7bbc005ab0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.560+0000 7f7bdcbe1e00 1 -- 10.20.193.28:0/326950155 shutdown_connections 2026-02-24T09:17:24.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.560+0000 7f7bdcbe1e00 1 --2- 10.20.193.28:0/326950155 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x555af76a7940 0x555af76ac790 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.560+0000 7f7bdcbe1e00 1 --2- 10.20.193.28:0/326950155 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555af7662ca0 0x555af76b10e0 unknown :-1 s=CLOSED pgs=328 gs=2 cs=0 l=1 c_cookie=5897960234286670917 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.560+0000 7f7bdcbe1e00 1 --2- 10.20.193.28:0/326950155 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x555af7662390 0x555af76aa430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.560+0000 7f7bdcbe1e00 1 -- 10.20.193.28:0/326950155 >> 10.20.193.28:0/326950155 conn(0x555af75818a0 msgr2=0x555af76a9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:24.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.560+0000 7f7bdcbe1e00 1 -- 10.20.193.28:0/326950155 shutdown_connections 2026-02-24T09:17:24.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.560+0000 7f7bdcbe1e00 1 -- 10.20.193.28:0/326950155 wait complete. 2026-02-24T09:17:24.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.561+0000 7f7bdcbe1e00 1 -- start start 2026-02-24T09:17:24.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.561+0000 7f7bdcbe1e00 1 Processor -- start 2026-02-24T09:17:24.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.561+0000 7f7bdcbe1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555af7662390 0x555af76c85c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:24.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.561+0000 7f7bdcbe1e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x555af7662ca0 0x555af76c8b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:24.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.561+0000 7f7bdcbe1e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x555af76a7940 0x555af76cd460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:24.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.561+0000 7f7bdcbe1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555af756c3d0 con 0x555af7662390 2026-02-24T09:17:24.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.561+0000 7f7bdcbe1e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x555af76cd9a0 con 0x555af7662ca0 2026-02-24T09:17:24.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.561+0000 7f7bdcbe1e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x555af76cdb60 con 0x555af76a7940 2026-02-24T09:17:24.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.562+0000 7f7bd895c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555af7662390 0x555af76c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:24.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.562+0000 7f7bcbfff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x555af7662ca0 0x555af76c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:24.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.562+0000 7f7bd895c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555af7662390 0x555af76c85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40506/0 (socket says 10.20.193.28:40506) 2026-02-24T09:17:24.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.562+0000 7f7bd895c640 1 -- 10.20.193.28:0/880560975 learned_addr learned my addr 10.20.193.28:0/880560975 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:24.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.562+0000 7f7bd915d640 1 --2- 10.20.193.28:0/880560975 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x555af76a7940 0x555af76cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:24.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.562+0000 7f7bd895c640 1 -- 10.20.193.28:0/880560975 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x555af76a7940 msgr2=0x555af76cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:24.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.562+0000 7f7bd895c640 1 --2- 10.20.193.28:0/880560975 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x555af76a7940 0x555af76cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.562+0000 7f7bd895c640 1 -- 10.20.193.28:0/880560975 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x555af7662ca0 msgr2=0x555af76c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:24.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.562+0000 7f7bd895c640 1 --2- 10.20.193.28:0/880560975 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x555af7662ca0 0x555af76c8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.562+0000 7f7bd895c640 1 -- 10.20.193.28:0/880560975 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd4102010 con 0x555af7662390 2026-02-24T09:17:24.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.562+0000 7f7bd915d640 1 --2- 10.20.193.28:0/880560975 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x555af76a7940 0x555af76cd460 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:17:24.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.562+0000 7f7bd895c640 1 --2- 10.20.193.28:0/880560975 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555af7662390 0x555af76c85c0 secure :-1 s=READY pgs=329 gs=1 cs=0 l=1 c_cookie=14716049467962723856 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bc40046f0 tx=0x7f7bc4002390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc39e905aafe8e10 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:24.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.562+0000 7f7b927fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:17:24.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.562+0000 7f7b927fc640 1 -- 10.20.193.28:0/880560975 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bc401d040 con 0x555af7662390 2026-02-24T09:17:24.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.562+0000 7f7b927fc640 1 -- 10.20.193.28:0/880560975 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7bc4004740 con 0x555af7662390 2026-02-24T09:17:24.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.562+0000 7f7b927fc640 1 -- 10.20.193.28:0/880560975 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bc4027860 con 0x555af7662390 2026-02-24T09:17:24.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.562+0000 7f7bdcbe1e00 1 -- 10.20.193.28:0/880560975 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555af7519d00 con 0x555af7662390 2026-02-24T09:17:24.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.562+0000 7f7b927fc640 1 -- 10.20.193.28:0/880560975 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f7bc40279f0 con 0x555af7662390 2026-02-24T09:17:24.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.562+0000 7f7bdcbe1e00 10 client.15324 _ll_register_callbacks cb 0x555af74f6510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:24.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.562+0000 7f7bdcbe1e00 1 -- 10.20.193.28:0/880560975 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555af757bb90 con 0x555af7662390 2026-02-24T09:17:24.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.563+0000 7f7b927fc640 1 -- 10.20.193.28:0/880560975 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f7bc4004b60 con 0x555af7662390 2026-02-24T09:17:24.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.563+0000 7f7bdcbe1e00 10 client.15324 fetch_fsmap learned FSMap version 22 2026-02-24T09:17:24.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.563+0000 7f7bdcbe1e00 1 -- 10.20.193.28:0/880560975 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=22}) -- 0x555af74f26e0 con 0x555af7662390 2026-02-24T09:17:24.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.563+0000 7f7b927fc640 1 -- 10.20.193.28:0/880560975 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 22) ==== 8346+0+0 (secure 0 0 0) 0x7f7bc4017020 con 0x555af7662390 2026-02-24T09:17:24.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.563+0000 7f7bdcbe1e00 10 client.15324 fetch_fsmap finished waiting for FSMap version 22 2026-02-24T09:17:24.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.563+0000 7f7bdcbe1e00 10 client.15324 resolve_mds: resolved name 'a' to daemon mds.a 2026-02-24T09:17:24.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.563+0000 7f7bdcbe1e00 20 client.15324 populate_metadata read hostname 'trial028' 2026-02-24T09:17:24.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.563+0000 7f7bdcbe1e00 1 --2- 10.20.193.28:0/880560975 >> [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] conn(0x555af775a2a0 0x555af7758fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:24.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.563+0000 7f7bdcbe1e00 4 client.15324 mds_command: new command op to 24760 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-24T09:17:24.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.563+0000 7f7bdcbe1e00 1 -- 10.20.193.28:0/880560975 --> [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] -- command(tid 0: {"prefix": "status"}) -- 0x555af7201e50 con 0x555af775a2a0 2026-02-24T09:17:24.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.563+0000 7f7bcbfff640 1 --2- 10.20.193.28:0/880560975 >> [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] conn(0x555af775a2a0 0x555af7758fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:24.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.564+0000 7f7bcbfff640 1 --2- 10.20.193.28:0/880560975 >> [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] conn(0x555af775a2a0 0x555af7758fb0 crc :-1 s=READY pgs=18 gs=4 cs=0 l=0 c_cookie=6640793214640017074 s_cookie=15618056064524880482 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5c28d63e89714eb2 server_cookie=d8be7b3e20240a62 in_seq=0 out_seq=0 2026-02-24T09:17:24.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.564+0000 7f7b927fc640 10 client.15324 ms_handle_connect on v2:10.20.193.28:6840/492586680 2026-02-24T09:17:24.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.564+0000 7f7b927fc640 1 -- 10.20.193.28:0/880560975 <== mds.2 v2:10.20.193.28:6840/492586680 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1223 (crc 0 0 0) 0x555af7201e50 con 0x555af775a2a0 2026-02-24T09:17:24.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.564+0000 7f7b927fc640 10 client.15324 handle_command_reply: tid=0 2026-02-24T09:17:24.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.564+0000 7f7bdcbe1e00 1 client.15324 shutdown 2026-02-24T09:17:24.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.564+0000 7f7bdcbe1e00 1 -- 10.20.193.28:0/880560975 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555af7662390 msgr2=0x555af76c85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:24.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.564+0000 7f7bdcbe1e00 1 --2- 10.20.193.28:0/880560975 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555af7662390 0x555af76c85c0 secure :-1 s=READY pgs=329 gs=1 cs=0 l=1 c_cookie=14716049467962723856 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bc40046f0 tx=0x7f7bc4002390 comp rx=0 tx=0).stop 2026-02-24T09:17:24.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.564+0000 7f7bdcbe1e00 1 -- 10.20.193.28:0/880560975 shutdown_connections 2026-02-24T09:17:24.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.564+0000 7f7bdcbe1e00 1 --2- 10.20.193.28:0/880560975 >> [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] conn(0x555af775a2a0 0x555af7758fb0 crc :-1 s=READY pgs=18 gs=4 cs=0 l=0 c_cookie=6640793214640017074 s_cookie=15618056064524880482 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.564+0000 7f7bdcbe1e00 1 --2- 10.20.193.28:0/880560975 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x555af76a7940 0x555af76cd460 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.564+0000 7f7bdcbe1e00 1 --2- 10.20.193.28:0/880560975 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x555af7662ca0 0x555af76c8b00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.564+0000 7f7bdcbe1e00 1 --2- 10.20.193.28:0/880560975 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555af7662390 0x555af76c85c0 unknown :-1 s=CLOSED pgs=329 gs=1 cs=0 l=1 c_cookie=14716049467962723856 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.564+0000 7f7b927fc640 0 client.15324 ms_handle_reset on v2:10.20.193.28:6840/492586680 2026-02-24T09:17:24.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.564+0000 7f7bdcbe1e00 1 -- 10.20.193.28:0/880560975 >> 10.20.193.28:0/880560975 conn(0x555af75818a0 msgr2=0x555af76bb4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:24.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.564+0000 7f7bdcbe1e00 1 -- 10.20.193.28:0/880560975 shutdown_connections 2026-02-24T09:17:24.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.564+0000 7f7bdcbe1e00 1 -- 10.20.193.28:0/880560975 wait complete. 2026-02-24T09:17:24.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.564+0000 7f7bdcbe1e00 20 client.15324 trim_cache size 0 max 16384 2026-02-24T09:17:24.573 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-24T09:17:24.573 INFO:teuthology.orchestra.run.trial028.stdout: "cluster_fsid": "e9ad50af-1160-11f1-800e-d404e6e7d460", 2026-02-24T09:17:24.573 INFO:teuthology.orchestra.run.trial028.stdout: "whoami": 2, 2026-02-24T09:17:24.573 INFO:teuthology.orchestra.run.trial028.stdout: "id": 24760, 2026-02-24T09:17:24.573 INFO:teuthology.orchestra.run.trial028.stdout: "want_state": "up:active", 2026-02-24T09:17:24.573 INFO:teuthology.orchestra.run.trial028.stdout: "state": "up:active", 2026-02-24T09:17:24.573 INFO:teuthology.orchestra.run.trial028.stdout: "fs_name": "cephfs", 2026-02-24T09:17:24.573 INFO:teuthology.orchestra.run.trial028.stdout: "rank_uptime": 19.315657355999999, 2026-02-24T09:17:24.573 INFO:teuthology.orchestra.run.trial028.stdout: "mdsmap_epoch": 22, 2026-02-24T09:17:24.574 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch": 92, 2026-02-24T09:17:24.574 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch_barrier": 92, 2026-02-24T09:17:24.574 INFO:teuthology.orchestra.run.trial028.stdout: "uptime": 31.706029408999999, 2026-02-24T09:17:24.574 INFO:teuthology.orchestra.run.trial028.stdout: "sysinfo": { 2026-02-24T09:17:24.574 INFO:teuthology.orchestra.run.trial028.stdout: "arch": "x86_64", 2026-02-24T09:17:24.574 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_release": "tentacle", 2026-02-24T09:17:24.574 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version": "ceph version 20.3.0-5537-g5bc9a1ff (5bc9a1ffc19df681248ece8c3c8c7191a571745b) tentacle (dev - RelWithDebInfo)", 2026-02-24T09:17:24.574 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version_short": "20.3.0-5537-g5bc9a1ff", 2026-02-24T09:17:24.574 INFO:teuthology.orchestra.run.trial028.stdout: "container_hostname": "trial028", 2026-02-24T09:17:24.574 INFO:teuthology.orchestra.run.trial028.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b", 2026-02-24T09:17:24.574 INFO:teuthology.orchestra.run.trial028.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-24T09:17:24.574 INFO:teuthology.orchestra.run.trial028.stdout: "distro": "centos", 2026-02-24T09:17:24.574 INFO:teuthology.orchestra.run.trial028.stdout: "distro_description": "CentOS Stream 9", 2026-02-24T09:17:24.575 INFO:teuthology.orchestra.run.trial028.stdout: "distro_version": "9", 2026-02-24T09:17:24.575 INFO:teuthology.orchestra.run.trial028.stdout: "hostname": "trial028", 2026-02-24T09:17:24.575 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Thu Feb 12 10:25:42 EST 2026", 2026-02-24T09:17:24.575 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_version": "6.19.0-g8dec4b357aab", 2026-02-24T09:17:24.575 INFO:teuthology.orchestra.run.trial028.stdout: "mem_swap_kb": "8388604", 2026-02-24T09:17:24.575 INFO:teuthology.orchestra.run.trial028.stdout: "mem_total_kb": "130448336", 2026-02-24T09:17:24.575 INFO:teuthology.orchestra.run.trial028.stdout: "os": "Linux" 2026-02-24T09:17:24.575 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:17:24.575 INFO:teuthology.orchestra.run.trial028.stdout: "endian": "little" 2026-02-24T09:17:24.575 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-24T09:17:24.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.565+0000 7f7bd995e640 1 -- 10.20.193.28:0/2675071599 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f7bb00b5840 msgr2=0x7f7bb00d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:24.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.565+0000 7f7bd995e640 1 --2- 10.20.193.28:0/2675071599 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f7bb00b5840 0x7f7bb00d5cf0 secure :-1 s=READY pgs=200 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bd0005820 tx=0x7f7bd000b380 comp rx=0 tx=0).stop 2026-02-24T09:17:24.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.565+0000 7f7bd995e640 1 -- 10.20.193.28:0/2675071599 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7bd4114a10 msgr2=0x7f7bd417a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:24.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.565+0000 7f7bd995e640 1 --2- 10.20.193.28:0/2675071599 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7bd4114a10 0x7f7bd417a270 secure :-1 s=READY pgs=325 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bbc0098a0 tx=0x7f7bbc0028d0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.565+0000 7f7bd995e640 1 -- 10.20.193.28:0/2675071599 shutdown_connections 2026-02-24T09:17:24.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.565+0000 7f7bd995e640 1 --2- 10.20.193.28:0/2675071599 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f7bb00b5840 0x7f7bb00d5cf0 unknown :-1 s=CLOSED pgs=200 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.565+0000 7f7bd995e640 1 --2- 10.20.193.28:0/2675071599 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7bd41199a0 0x7f7bd40fc480 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.565+0000 7f7bd995e640 1 --2- 10.20.193.28:0/2675071599 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7bd4114a10 0x7f7bd417a270 unknown :-1 s=CLOSED pgs=325 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.565+0000 7f7bd995e640 1 --2- 10.20.193.28:0/2675071599 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7bd4114020 0x7f7bd40fbd80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:24.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.565+0000 7f7bd995e640 1 -- 10.20.193.28:0/2675071599 >> 10.20.193.28:0/2675071599 conn(0x7f7bd4064810 msgr2=0x7f7bd4117780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:24.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.566+0000 7f7bd995e640 1 -- 10.20.193.28:0/2675071599 shutdown_connections 2026-02-24T09:17:24.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:24.566+0000 7f7bd995e640 1 -- 10.20.193.28:0/2675071599 wait complete. 2026-02-24T09:17:24.701 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph tell mds.h status 2026-02-24T09:17:24.887 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:25.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.073+0000 7f666f577640 1 -- 10.20.193.28:0/4035446856 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f66701112e0 msgr2=0x7f6670111cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:25.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.073+0000 7f666f577640 1 --2- 10.20.193.28:0/4035446856 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f66701112e0 0x7f6670111cc0 secure :-1 s=READY pgs=330 gs=2 cs=0 l=1 c_cookie=15275580386753572887 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f666000aa30 tx=0x7f6660030270 comp rx=0 tx=0).stop 2026-02-24T09:17:25.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.073+0000 7f666f577640 1 -- 10.20.193.28:0/4035446856 shutdown_connections 2026-02-24T09:17:25.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.073+0000 7f666f577640 1 --2- 10.20.193.28:0/4035446856 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f66701112e0 0x7f6670111cc0 unknown :-1 s=CLOSED pgs=330 gs=2 cs=0 l=1 c_cookie=15275580386753572887 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.073+0000 7f666f577640 1 --2- 10.20.193.28:0/4035446856 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f667010bcc0 0x7f6670110b50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.073+0000 7f666f577640 1 --2- 10.20.193.28:0/4035446856 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f667010b2d0 0x7f667010b6a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.073+0000 7f666f577640 1 -- 10.20.193.28:0/4035446856 >> 10.20.193.28:0/4035446856 conn(0x7f66700e8e40 msgr2=0x7f6670109250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:25.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.074+0000 7f666f577640 1 -- 10.20.193.28:0/4035446856 shutdown_connections 2026-02-24T09:17:25.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.074+0000 7f666f577640 1 -- 10.20.193.28:0/4035446856 wait complete. 2026-02-24T09:17:25.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.074+0000 7f666f577640 1 Processor -- start 2026-02-24T09:17:25.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.074+0000 7f666f577640 1 -- start start 2026-02-24T09:17:25.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.075+0000 7f666f577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f667010b2d0 0x7f6670123510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.075+0000 7f666f577640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f667010bcc0 0x7f6670123a50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.075+0000 7f666f577640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f66701112e0 0x7f6670128e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.075+0000 7f666f577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6670129440 con 0x7f667010b2d0 2026-02-24T09:17:25.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.075+0000 7f666f577640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f66701295b0 con 0x7f66701112e0 2026-02-24T09:17:25.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.075+0000 7f666f577640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6670129770 con 0x7f667010bcc0 2026-02-24T09:17:25.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.075+0000 7f666e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f667010b2d0 0x7f6670123510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.075+0000 7f666dd74640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f667010bcc0 0x7f6670123a50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.075+0000 7f666e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f667010b2d0 0x7f6670123510 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40526/0 (socket says 10.20.193.28:40526) 2026-02-24T09:17:25.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.075+0000 7f666e575640 1 -- 10.20.193.28:0/1683565501 learned_addr learned my addr 10.20.193.28:0/1683565501 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:25.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.075+0000 7f666dd74640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f667010bcc0 0x7f6670123a50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:35418/0 (socket says 10.20.193.28:35418) 2026-02-24T09:17:25.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.075+0000 7f666e575640 1 -- 10.20.193.28:0/1683565501 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f667010bcc0 msgr2=0x7f6670123a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:25.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.075+0000 7f666e575640 1 --2- 10.20.193.28:0/1683565501 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f667010bcc0 0x7f6670123a50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.075+0000 7f666e575640 1 -- 10.20.193.28:0/1683565501 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f66701112e0 msgr2=0x7f6670128e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:25.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.075+0000 7f666e575640 1 --2- 10.20.193.28:0/1683565501 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f66701112e0 0x7f6670128e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.075+0000 7f666e575640 1 -- 10.20.193.28:0/1683565501 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f666000a650 con 0x7f667010b2d0 2026-02-24T09:17:25.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.075+0000 7f666e575640 1 --2- 10.20.193.28:0/1683565501 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f667010b2d0 0x7f6670123510 secure :-1 s=READY pgs=331 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f666400d950 tx=0x7f666400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:25.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.076+0000 7f66577fe640 1 -- 10.20.193.28:0/1683565501 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6664004540 con 0x7f667010b2d0 2026-02-24T09:17:25.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.076+0000 7f66577fe640 1 -- 10.20.193.28:0/1683565501 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6664009ce0 con 0x7f667010b2d0 2026-02-24T09:17:25.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.076+0000 7f66577fe640 1 -- 10.20.193.28:0/1683565501 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66640106e0 con 0x7f667010b2d0 2026-02-24T09:17:25.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.076+0000 7f666f577640 1 -- 10.20.193.28:0/1683565501 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6670129a50 con 0x7f667010b2d0 2026-02-24T09:17:25.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.076+0000 7f666f577640 1 -- 10.20.193.28:0/1683565501 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f667016a150 con 0x7f667010b2d0 2026-02-24T09:17:25.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.079+0000 7f66577fe640 1 -- 10.20.193.28:0/1683565501 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f66640097c0 con 0x7f667010b2d0 2026-02-24T09:17:25.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.080+0000 7f66577fe640 1 --2- 10.20.193.28:0/1683565501 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f66480b5840 0x7f66480d5cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.080+0000 7f66577fe640 1 -- 10.20.193.28:0/1683565501 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f66640e6800 con 0x7f667010b2d0 2026-02-24T09:17:25.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.081+0000 7f6676c02e00 1 Processor -- start 2026-02-24T09:17:25.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.081+0000 7f666dd74640 1 --2- 10.20.193.28:0/1683565501 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f66480b5840 0x7f66480d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.081+0000 7f6676c02e00 1 -- start start 2026-02-24T09:17:25.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.082+0000 7f6676c02e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55c0fbdec390 0x55c0fbdec760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.082+0000 7f666dd74640 1 --2- 10.20.193.28:0/1683565501 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f66480b5840 0x7f66480d5cf0 secure :-1 s=READY pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6670129eb0 tx=0x7f6658005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:25.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.082+0000 7f6676c02e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0fbdecca0 0x55c0fbe31400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.082+0000 7f6676c02e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55c0fbe31940 0x55c0fbe51d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.082+0000 7f6676c02e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c0fbd02910 con 0x55c0fbdecca0 2026-02-24T09:17:25.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.082+0000 7f6676c02e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55c0fbcfe640 con 0x55c0fbe31940 2026-02-24T09:17:25.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.082+0000 7f6676c02e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55c0fbcf87a0 con 0x55c0fbdec390 2026-02-24T09:17:25.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.082+0000 7f666dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0fbdecca0 0x55c0fbe31400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.082+0000 7f666e575640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55c0fbdec390 0x55c0fbdec760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.082+0000 7f666e575640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55c0fbdec390 0x55c0fbdec760 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:35420/0 (socket says 10.20.193.28:35420) 2026-02-24T09:17:25.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.082+0000 7f666e575640 1 -- 10.20.193.28:0/2591116739 learned_addr learned my addr 10.20.193.28:0/2591116739 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:25.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.082+0000 7f666ed76640 1 --2- 10.20.193.28:0/2591116739 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55c0fbe31940 0x55c0fbe51d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.082+0000 7f666e575640 1 -- 10.20.193.28:0/2591116739 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55c0fbe31940 msgr2=0x55c0fbe51d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:25.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.082+0000 7f666e575640 1 --2- 10.20.193.28:0/2591116739 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55c0fbe31940 0x55c0fbe51d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.082+0000 7f666e575640 1 -- 10.20.193.28:0/2591116739 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0fbdecca0 msgr2=0x55c0fbe31400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:25.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.082+0000 7f666e575640 1 --2- 10.20.193.28:0/2591116739 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0fbdecca0 0x55c0fbe31400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.082+0000 7f666e575640 1 -- 10.20.193.28:0/2591116739 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0fbca3d00 con 0x55c0fbdec390 2026-02-24T09:17:25.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.083+0000 7f666e575640 1 --2- 10.20.193.28:0/2591116739 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55c0fbdec390 0x55c0fbdec760 secure :-1 s=READY pgs=104 gs=2 cs=0 l=1 c_cookie=10537147036141901995 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66640e4300 tx=0x7f66640a8ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=923b7766b34c58ab server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:25.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.083+0000 7f6654ff9640 1 -- 10.20.193.28:0/2591116739 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6664009e50 con 0x55c0fbdec390 2026-02-24T09:17:25.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.083+0000 7f6654ff9640 1 -- 10.20.193.28:0/2591116739 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f66640ad550 con 0x55c0fbdec390 2026-02-24T09:17:25.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.083+0000 7f6654ff9640 1 -- 10.20.193.28:0/2591116739 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66640a8dc0 con 0x55c0fbdec390 2026-02-24T09:17:25.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.083+0000 7f6676c02e00 1 -- 10.20.193.28:0/2591116739 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55c0fbdec390 msgr2=0x55c0fbdec760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:25.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.083+0000 7f6676c02e00 1 --2- 10.20.193.28:0/2591116739 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55c0fbdec390 0x55c0fbdec760 secure :-1 s=READY pgs=104 gs=2 cs=0 l=1 c_cookie=10537147036141901995 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66640e4300 tx=0x7f66640a8ac0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.083+0000 7f6676c02e00 1 -- 10.20.193.28:0/2591116739 shutdown_connections 2026-02-24T09:17:25.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.083+0000 7f6676c02e00 1 --2- 10.20.193.28:0/2591116739 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55c0fbe31940 0x55c0fbe51d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.083+0000 7f6676c02e00 1 --2- 10.20.193.28:0/2591116739 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0fbdecca0 0x55c0fbe31400 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.083+0000 7f6676c02e00 1 --2- 10.20.193.28:0/2591116739 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55c0fbdec390 0x55c0fbdec760 unknown :-1 s=CLOSED pgs=104 gs=2 cs=0 l=1 c_cookie=10537147036141901995 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.083+0000 7f6676c02e00 1 -- 10.20.193.28:0/2591116739 >> 10.20.193.28:0/2591116739 conn(0x55c0fbd0b8a0 msgr2=0x55c0fbdeac70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:25.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.083+0000 7f6676c02e00 1 -- 10.20.193.28:0/2591116739 shutdown_connections 2026-02-24T09:17:25.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.083+0000 7f6676c02e00 1 -- 10.20.193.28:0/2591116739 wait complete. 2026-02-24T09:17:25.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.085+0000 7f6676c02e00 1 -- start start 2026-02-24T09:17:25.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.085+0000 7f6676c02e00 1 Processor -- start 2026-02-24T09:17:25.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.085+0000 7f6676c02e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55c0fbdec390 0x55c0fbe49200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.085+0000 7f6676c02e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55c0fbdecca0 0x55c0fbe49740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.085+0000 7f6676c02e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0fbe31940 0x55c0fbe4e730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.085+0000 7f6676c02e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c0fbe4ec70 con 0x55c0fbe31940 2026-02-24T09:17:25.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.085+0000 7f6676c02e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55c0fbe4ede0 con 0x55c0fbdecca0 2026-02-24T09:17:25.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.085+0000 7f6676c02e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55c0fbe4efa0 con 0x55c0fbdec390 2026-02-24T09:17:25.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.085+0000 7f666ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0fbe31940 0x55c0fbe4e730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.085+0000 7f666ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0fbe31940 0x55c0fbe4e730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40540/0 (socket says 10.20.193.28:40540) 2026-02-24T09:17:25.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.085+0000 7f666ed76640 1 -- 10.20.193.28:0/1945251192 learned_addr learned my addr 10.20.193.28:0/1945251192 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:25.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.085+0000 7f666e575640 1 --2- 10.20.193.28:0/1945251192 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55c0fbdec390 0x55c0fbe49200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.085+0000 7f666dd74640 1 --2- 10.20.193.28:0/1945251192 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55c0fbdecca0 0x55c0fbe49740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.086+0000 7f666ed76640 1 -- 10.20.193.28:0/1945251192 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55c0fbdec390 msgr2=0x55c0fbe49200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:25.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.086+0000 7f666ed76640 1 --2- 10.20.193.28:0/1945251192 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55c0fbdec390 0x55c0fbe49200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.086+0000 7f666ed76640 1 -- 10.20.193.28:0/1945251192 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55c0fbdecca0 msgr2=0x55c0fbe49740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:25.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.086+0000 7f666ed76640 1 --2- 10.20.193.28:0/1945251192 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55c0fbdecca0 0x55c0fbe49740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.086+0000 7f666ed76640 1 -- 10.20.193.28:0/1945251192 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0fbc7c3b0 con 0x55c0fbe31940 2026-02-24T09:17:25.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.086+0000 7f666ed76640 1 --2- 10.20.193.28:0/1945251192 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0fbe31940 0x55c0fbe4e730 secure :-1 s=READY pgs=332 gs=2 cs=0 l=1 c_cookie=15996018358348989387 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f666000a230 tx=0x7f6660039470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddfd45f24604c3cb server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:25.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.086+0000 7f661ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:17:25.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.086+0000 7f661ffff640 1 -- 10.20.193.28:0/1945251192 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f666003e040 con 0x55c0fbe31940 2026-02-24T09:17:25.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.086+0000 7f661ffff640 1 -- 10.20.193.28:0/1945251192 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6660039de0 con 0x55c0fbe31940 2026-02-24T09:17:25.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.086+0000 7f661ffff640 1 -- 10.20.193.28:0/1945251192 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6660042420 con 0x55c0fbe31940 2026-02-24T09:17:25.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.086+0000 7f6676c02e00 1 -- 10.20.193.28:0/1945251192 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f667016a150 con 0x55c0fbe31940 2026-02-24T09:17:25.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.086+0000 7f661ffff640 1 -- 10.20.193.28:0/1945251192 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f66600425b0 con 0x55c0fbe31940 2026-02-24T09:17:25.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.086+0000 7f6676c02e00 10 client.15336 _ll_register_callbacks cb 0x55c0fbc80510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:25.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.086+0000 7f6676c02e00 1 -- 10.20.193.28:0/1945251192 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c0fb98e600 con 0x55c0fbe31940 2026-02-24T09:17:25.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.087+0000 7f661ffff640 1 -- 10.20.193.28:0/1945251192 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f66600039a0 con 0x55c0fbe31940 2026-02-24T09:17:25.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.087+0000 7f6676c02e00 10 client.15336 fetch_fsmap learned FSMap version 22 2026-02-24T09:17:25.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.087+0000 7f6676c02e00 1 -- 10.20.193.28:0/1945251192 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=22}) -- 0x55c0fbc8e0d0 con 0x55c0fbe31940 2026-02-24T09:17:25.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.087+0000 7f661ffff640 1 -- 10.20.193.28:0/1945251192 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 22) ==== 8346+0+0 (secure 0 0 0) 0x7f6660039920 con 0x55c0fbe31940 2026-02-24T09:17:25.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.087+0000 7f6676c02e00 10 client.15336 fetch_fsmap finished waiting for FSMap version 22 2026-02-24T09:17:25.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.087+0000 7f6676c02e00 10 client.15336 resolve_mds: resolved name 'h' to daemon mds.h 2026-02-24T09:17:25.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.087+0000 7f6676c02e00 20 client.15336 populate_metadata read hostname 'trial028' 2026-02-24T09:17:25.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.087+0000 7f6676c02e00 1 --2- 10.20.193.28:0/1945251192 >> [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] conn(0x55c0fbe2f980 0x55c0fbe30df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.087+0000 7f6676c02e00 4 client.15336 mds_command: new command op to 24761 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:17:25.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.087+0000 7f6676c02e00 1 -- 10.20.193.28:0/1945251192 --> [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c0fbccb2e0 con 0x55c0fbe2f980 2026-02-24T09:17:25.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.087+0000 7f666e575640 1 --2- 10.20.193.28:0/1945251192 >> [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] conn(0x55c0fbe2f980 0x55c0fbe30df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.088+0000 7f666e575640 1 --2- 10.20.193.28:0/1945251192 >> [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] conn(0x55c0fbe2f980 0x55c0fbe30df0 crc :-1 s=READY pgs=17 gs=4 cs=0 l=0 c_cookie=7396711209461860980 s_cookie=16559149550912009131 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=66a665a7d21fca74 server_cookie=e5cdeac84cadf3ab in_seq=0 out_seq=0 2026-02-24T09:17:25.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.088+0000 7f661ffff640 10 client.15336 ms_handle_connect on v2:10.20.193.74:6836/958749351 2026-02-24T09:17:25.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.089+0000 7f661ffff640 1 -- 10.20.193.28:0/1945251192 <== mds.1 v2:10.20.193.74:6836/958749351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55c0fbccb2e0 con 0x55c0fbe2f980 2026-02-24T09:17:25.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.089+0000 7f661ffff640 10 client.15336 handle_command_reply: tid=0 2026-02-24T09:17:25.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.089+0000 7f6676c02e00 1 client.15336 shutdown 2026-02-24T09:17:25.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.089+0000 7f6676c02e00 1 -- 10.20.193.28:0/1945251192 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0fbe31940 msgr2=0x55c0fbe4e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:25.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.089+0000 7f6676c02e00 1 --2- 10.20.193.28:0/1945251192 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0fbe31940 0x55c0fbe4e730 secure :-1 s=READY pgs=332 gs=2 cs=0 l=1 c_cookie=15996018358348989387 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f666000a230 tx=0x7f6660039470 comp rx=0 tx=0).stop 2026-02-24T09:17:25.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.089+0000 7f6676c02e00 1 -- 10.20.193.28:0/1945251192 shutdown_connections 2026-02-24T09:17:25.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.089+0000 7f6676c02e00 1 --2- 10.20.193.28:0/1945251192 >> [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] conn(0x55c0fbe2f980 0x55c0fbe30df0 crc :-1 s=READY pgs=17 gs=4 cs=0 l=0 c_cookie=7396711209461860980 s_cookie=16559149550912009131 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.089+0000 7f6676c02e00 1 --2- 10.20.193.28:0/1945251192 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0fbe31940 0x55c0fbe4e730 unknown :-1 s=CLOSED pgs=332 gs=2 cs=0 l=1 c_cookie=15996018358348989387 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.089+0000 7f6676c02e00 1 --2- 10.20.193.28:0/1945251192 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55c0fbdecca0 0x55c0fbe49740 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.089+0000 7f6676c02e00 1 --2- 10.20.193.28:0/1945251192 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55c0fbdec390 0x55c0fbe49200 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.089+0000 7f6676c02e00 1 -- 10.20.193.28:0/1945251192 >> 10.20.193.28:0/1945251192 conn(0x55c0fbd0b8a0 msgr2=0x55c0fbdea480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:25.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.089+0000 7f661ffff640 0 client.15336 ms_handle_reset on v2:10.20.193.74:6836/958749351 2026-02-24T09:17:25.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.090+0000 7f6676c02e00 1 -- 10.20.193.28:0/1945251192 shutdown_connections 2026-02-24T09:17:25.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.090+0000 7f6676c02e00 1 -- 10.20.193.28:0/1945251192 wait complete. 2026-02-24T09:17:25.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.090+0000 7f6676c02e00 20 client.15336 trim_cache size 0 max 16384 2026-02-24T09:17:25.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.099+0000 7f6676c02e00 1 Processor -- start 2026-02-24T09:17:25.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.099+0000 7f6676c02e00 1 -- start start 2026-02-24T09:17:25.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.099+0000 7f6676c02e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55c0fbdec390 0x55c0fbe3b140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.099+0000 7f6676c02e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0fbdecca0 0x55c0fbe465f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.099+0000 7f6676c02e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55c0fbe31940 0x55c0fbe46b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.099+0000 7f6676c02e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c0fbcf63d0 con 0x55c0fbdecca0 2026-02-24T09:17:25.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.099+0000 7f6676c02e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55c0fb9b6610 con 0x55c0fbdec390 2026-02-24T09:17:25.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.099+0000 7f6676c02e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55c0fbd5bb30 con 0x55c0fbe31940 2026-02-24T09:17:25.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.100+0000 7f666dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0fbdecca0 0x55c0fbe465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.100+0000 7f666dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0fbdecca0 0x55c0fbe465f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40548/0 (socket says 10.20.193.28:40548) 2026-02-24T09:17:25.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.100+0000 7f666dd74640 1 -- 10.20.193.28:0/890382113 learned_addr learned my addr 10.20.193.28:0/890382113 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:25.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.100+0000 7f666e575640 1 --2- 10.20.193.28:0/890382113 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55c0fbdec390 0x55c0fbe3b140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.100+0000 7f666ed76640 1 --2- 10.20.193.28:0/890382113 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55c0fbe31940 0x55c0fbe46b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.100+0000 7f666dd74640 1 -- 10.20.193.28:0/890382113 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55c0fbe31940 msgr2=0x55c0fbe46b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:25.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.100+0000 7f666dd74640 1 --2- 10.20.193.28:0/890382113 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55c0fbe31940 0x55c0fbe46b30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.100+0000 7f666dd74640 1 -- 10.20.193.28:0/890382113 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55c0fbdec390 msgr2=0x55c0fbe3b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:25.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.100+0000 7f666dd74640 1 --2- 10.20.193.28:0/890382113 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55c0fbdec390 0x55c0fbe3b140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.100+0000 7f666dd74640 1 -- 10.20.193.28:0/890382113 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0fbe3b910 con 0x55c0fbdecca0 2026-02-24T09:17:25.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.100+0000 7f666ed76640 1 --2- 10.20.193.28:0/890382113 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55c0fbe31940 0x55c0fbe46b30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:25.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.100+0000 7f666dd74640 1 --2- 10.20.193.28:0/890382113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0fbdecca0 0x55c0fbe465f0 secure :-1 s=READY pgs=333 gs=1 cs=0 l=1 c_cookie=16254806497516861220 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6658009d00 tx=0x7f665800e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e194ac6349343724 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:25.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.100+0000 7f663a4e6640 1 -- 10.20.193.28:0/890382113 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6658021040 con 0x55c0fbdecca0 2026-02-24T09:17:25.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.100+0000 7f663a4e6640 1 -- 10.20.193.28:0/890382113 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6658011e60 con 0x55c0fbdecca0 2026-02-24T09:17:25.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.100+0000 7f663a4e6640 1 -- 10.20.193.28:0/890382113 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66580259a0 con 0x55c0fbdecca0 2026-02-24T09:17:25.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.101+0000 7f6676c02e00 1 -- 10.20.193.28:0/890382113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0fbdecca0 msgr2=0x55c0fbe465f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:25.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.101+0000 7f6676c02e00 1 --2- 10.20.193.28:0/890382113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0fbdecca0 0x55c0fbe465f0 secure :-1 s=READY pgs=333 gs=1 cs=0 l=1 c_cookie=16254806497516861220 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6658009d00 tx=0x7f665800e000 comp rx=0 tx=0).stop 2026-02-24T09:17:25.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.101+0000 7f6676c02e00 1 -- 10.20.193.28:0/890382113 shutdown_connections 2026-02-24T09:17:25.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.101+0000 7f6676c02e00 1 --2- 10.20.193.28:0/890382113 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55c0fbe31940 0x55c0fbe46b30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.101+0000 7f6676c02e00 1 --2- 10.20.193.28:0/890382113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0fbdecca0 0x55c0fbe465f0 unknown :-1 s=CLOSED pgs=333 gs=1 cs=0 l=1 c_cookie=16254806497516861220 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.101+0000 7f6676c02e00 1 --2- 10.20.193.28:0/890382113 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55c0fbdec390 0x55c0fbe3b140 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.101+0000 7f6676c02e00 1 -- 10.20.193.28:0/890382113 >> 10.20.193.28:0/890382113 conn(0x55c0fbd0b8a0 msgr2=0x55c0fbe47630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:25.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.101+0000 7f6676c02e00 1 -- 10.20.193.28:0/890382113 shutdown_connections 2026-02-24T09:17:25.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.101+0000 7f6676c02e00 1 -- 10.20.193.28:0/890382113 wait complete. 2026-02-24T09:17:25.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.101+0000 7f6676c02e00 1 -- start start 2026-02-24T09:17:25.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.102+0000 7f6676c02e00 1 Processor -- start 2026-02-24T09:17:25.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.102+0000 7f6676c02e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55c0fbdec390 0x55c0fbe525c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.102+0000 7f6676c02e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55c0fbdecca0 0x55c0fbe52b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.102+0000 7f6676c02e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0fbe31940 0x55c0fbe57460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.102+0000 7f6676c02e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c0fbe4e840 con 0x55c0fbe31940 2026-02-24T09:17:25.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.102+0000 7f6676c02e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55c0fbdec9a0 con 0x55c0fbdec390 2026-02-24T09:17:25.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.102+0000 7f6676c02e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55c0fbe579f0 con 0x55c0fbdecca0 2026-02-24T09:17:25.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.102+0000 7f666ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0fbe31940 0x55c0fbe57460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.102+0000 7f666ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0fbe31940 0x55c0fbe57460 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40562/0 (socket says 10.20.193.28:40562) 2026-02-24T09:17:25.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.102+0000 7f666ed76640 1 -- 10.20.193.28:0/3322565868 learned_addr learned my addr 10.20.193.28:0/3322565868 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:25.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.102+0000 7f666e575640 1 --2- 10.20.193.28:0/3322565868 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55c0fbdec390 0x55c0fbe525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.102+0000 7f666dd74640 1 --2- 10.20.193.28:0/3322565868 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55c0fbdecca0 0x55c0fbe52b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.102+0000 7f666ed76640 1 -- 10.20.193.28:0/3322565868 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55c0fbdecca0 msgr2=0x55c0fbe52b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:25.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.102+0000 7f666ed76640 1 --2- 10.20.193.28:0/3322565868 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55c0fbdecca0 0x55c0fbe52b00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.103+0000 7f666ed76640 1 -- 10.20.193.28:0/3322565868 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55c0fbdec390 msgr2=0x55c0fbe525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:25.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.103+0000 7f666ed76640 1 --2- 10.20.193.28:0/3322565868 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55c0fbdec390 0x55c0fbe525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.103+0000 7f666ed76640 1 -- 10.20.193.28:0/3322565868 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0fbc88b50 con 0x55c0fbe31940 2026-02-24T09:17:25.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.103+0000 7f666e575640 1 --2- 10.20.193.28:0/3322565868 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55c0fbdec390 0x55c0fbe525c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:17:25.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.103+0000 7f666ed76640 1 --2- 10.20.193.28:0/3322565868 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0fbe31940 0x55c0fbe57460 secure :-1 s=READY pgs=334 gs=2 cs=0 l=1 c_cookie=9357273809748741537 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f666004b660 tx=0x7f6660006a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81dbb6f3f823cda1 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:25.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.103+0000 7f661ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:17:25.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.103+0000 7f661ffff640 1 -- 10.20.193.28:0/3322565868 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f666005c070 con 0x55c0fbe31940 2026-02-24T09:17:25.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.103+0000 7f6676c02e00 1 -- 10.20.193.28:0/3322565868 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66580099a0 con 0x55c0fbe31940 2026-02-24T09:17:25.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.103+0000 7f661ffff640 1 -- 10.20.193.28:0/3322565868 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x55c0fb98e600 con 0x55c0fbe31940 2026-02-24T09:17:25.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.103+0000 7f661ffff640 1 -- 10.20.193.28:0/3322565868 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f666003e030 con 0x55c0fbe31940 2026-02-24T09:17:25.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.103+0000 7f6676c02e00 10 client.15342 _ll_register_callbacks cb 0x55c0fbc80510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:25.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.103+0000 7f6676c02e00 1 -- 10.20.193.28:0/3322565868 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c0fba503b0 con 0x55c0fbe31940 2026-02-24T09:17:25.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.103+0000 7f661ffff640 1 -- 10.20.193.28:0/3322565868 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f6660005370 con 0x55c0fbe31940 2026-02-24T09:17:25.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.103+0000 7f661ffff640 1 -- 10.20.193.28:0/3322565868 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f6660005570 con 0x55c0fbe31940 2026-02-24T09:17:25.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.103+0000 7f6676c02e00 10 client.15342 fetch_fsmap learned FSMap version 22 2026-02-24T09:17:25.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.103+0000 7f6676c02e00 1 -- 10.20.193.28:0/3322565868 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=22}) -- 0x55c0fbc7c6e0 con 0x55c0fbe31940 2026-02-24T09:17:25.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.103+0000 7f661ffff640 1 -- 10.20.193.28:0/3322565868 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 22) ==== 8346+0+0 (secure 0 0 0) 0x7f666004b810 con 0x55c0fbe31940 2026-02-24T09:17:25.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.104+0000 7f6676c02e00 10 client.15342 fetch_fsmap finished waiting for FSMap version 22 2026-02-24T09:17:25.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.104+0000 7f6676c02e00 10 client.15342 resolve_mds: resolved name 'h' to daemon mds.h 2026-02-24T09:17:25.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.104+0000 7f6676c02e00 20 client.15342 populate_metadata read hostname 'trial028' 2026-02-24T09:17:25.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.104+0000 7f6676c02e00 1 --2- 10.20.193.28:0/3322565868 >> [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] conn(0x55c0fbee4110 0x55c0fbee2e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.104+0000 7f6676c02e00 4 client.15342 mds_command: new command op to 24761 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-24T09:17:25.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.104+0000 7f6676c02e00 1 -- 10.20.193.28:0/3322565868 --> [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] -- command(tid 0: {"prefix": "status"}) -- 0x55c0fbd05b90 con 0x55c0fbee4110 2026-02-24T09:17:25.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.104+0000 7f666e575640 1 --2- 10.20.193.28:0/3322565868 >> [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] conn(0x55c0fbee4110 0x55c0fbee2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.105+0000 7f666e575640 1 --2- 10.20.193.28:0/3322565868 >> [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] conn(0x55c0fbee4110 0x55c0fbee2e20 crc :-1 s=READY pgs=18 gs=4 cs=0 l=0 c_cookie=887107524035895352 s_cookie=7434961259162790704 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c4fa397cfbc6038 server_cookie=672e49df83306b30 in_seq=0 out_seq=0 2026-02-24T09:17:25.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.105+0000 7f661ffff640 10 client.15342 ms_handle_connect on v2:10.20.193.74:6836/958749351 2026-02-24T09:17:25.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.105+0000 7f661ffff640 1 -- 10.20.193.28:0/3322565868 <== mds.1 v2:10.20.193.74:6836/958749351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1223 (crc 0 0 0) 0x55c0fbd05b90 con 0x55c0fbee4110 2026-02-24T09:17:25.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.105+0000 7f661ffff640 10 client.15342 handle_command_reply: tid=0 2026-02-24T09:17:25.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.105+0000 7f6676c02e00 1 client.15342 shutdown 2026-02-24T09:17:25.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.105+0000 7f6676c02e00 1 -- 10.20.193.28:0/3322565868 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0fbe31940 msgr2=0x55c0fbe57460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:25.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.105+0000 7f6676c02e00 1 --2- 10.20.193.28:0/3322565868 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0fbe31940 0x55c0fbe57460 secure :-1 s=READY pgs=334 gs=2 cs=0 l=1 c_cookie=9357273809748741537 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f666004b660 tx=0x7f6660006a00 comp rx=0 tx=0).stop 2026-02-24T09:17:25.111 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-24T09:17:25.111 INFO:teuthology.orchestra.run.trial028.stdout: "cluster_fsid": "e9ad50af-1160-11f1-800e-d404e6e7d460", 2026-02-24T09:17:25.111 INFO:teuthology.orchestra.run.trial028.stdout: "whoami": 1, 2026-02-24T09:17:25.111 INFO:teuthology.orchestra.run.trial028.stdout: "id": 24761, 2026-02-24T09:17:25.112 INFO:teuthology.orchestra.run.trial028.stdout: "want_state": "up:active", 2026-02-24T09:17:25.112 INFO:teuthology.orchestra.run.trial028.stdout: "state": "up:active", 2026-02-24T09:17:25.112 INFO:teuthology.orchestra.run.trial028.stdout: "fs_name": "cephfs", 2026-02-24T09:17:25.112 INFO:teuthology.orchestra.run.trial028.stdout: "rank_uptime": 20.862607029999999, 2026-02-24T09:17:25.112 INFO:teuthology.orchestra.run.trial028.stdout: "mdsmap_epoch": 22, 2026-02-24T09:17:25.112 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch": 92, 2026-02-24T09:17:25.112 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch_barrier": 92, 2026-02-24T09:17:25.112 INFO:teuthology.orchestra.run.trial028.stdout: "uptime": 36.022379340000001, 2026-02-24T09:17:25.112 INFO:teuthology.orchestra.run.trial028.stdout: "sysinfo": { 2026-02-24T09:17:25.112 INFO:teuthology.orchestra.run.trial028.stdout: "arch": "x86_64", 2026-02-24T09:17:25.112 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_release": "tentacle", 2026-02-24T09:17:25.113 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version": "ceph version 20.3.0-5537-g5bc9a1ff (5bc9a1ffc19df681248ece8c3c8c7191a571745b) tentacle (dev - RelWithDebInfo)", 2026-02-24T09:17:25.113 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version_short": "20.3.0-5537-g5bc9a1ff", 2026-02-24T09:17:25.113 INFO:teuthology.orchestra.run.trial028.stdout: "container_hostname": "trial074", 2026-02-24T09:17:25.113 INFO:teuthology.orchestra.run.trial028.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b", 2026-02-24T09:17:25.113 INFO:teuthology.orchestra.run.trial028.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-24T09:17:25.113 INFO:teuthology.orchestra.run.trial028.stdout: "distro": "centos", 2026-02-24T09:17:25.113 INFO:teuthology.orchestra.run.trial028.stdout: "distro_description": "CentOS Stream 9", 2026-02-24T09:17:25.113 INFO:teuthology.orchestra.run.trial028.stdout: "distro_version": "9", 2026-02-24T09:17:25.113 INFO:teuthology.orchestra.run.trial028.stdout: "hostname": "trial074", 2026-02-24T09:17:25.113 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Thu Feb 12 10:25:42 EST 2026", 2026-02-24T09:17:25.113 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_version": "6.19.0-g8dec4b357aab", 2026-02-24T09:17:25.113 INFO:teuthology.orchestra.run.trial028.stdout: "mem_swap_kb": "8388604", 2026-02-24T09:17:25.113 INFO:teuthology.orchestra.run.trial028.stdout: "mem_total_kb": "130448332", 2026-02-24T09:17:25.114 INFO:teuthology.orchestra.run.trial028.stdout: "os": "Linux" 2026-02-24T09:17:25.114 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:17:25.114 INFO:teuthology.orchestra.run.trial028.stdout: "endian": "little" 2026-02-24T09:17:25.114 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-24T09:17:25.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.105+0000 7f6676c02e00 1 -- 10.20.193.28:0/3322565868 shutdown_connections 2026-02-24T09:17:25.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.105+0000 7f6676c02e00 1 --2- 10.20.193.28:0/3322565868 >> [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] conn(0x55c0fbee4110 0x55c0fbee2e20 crc :-1 s=READY pgs=18 gs=4 cs=0 l=0 c_cookie=887107524035895352 s_cookie=7434961259162790704 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.105+0000 7f6676c02e00 1 --2- 10.20.193.28:0/3322565868 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0fbe31940 0x55c0fbe57460 unknown :-1 s=CLOSED pgs=334 gs=2 cs=0 l=1 c_cookie=9357273809748741537 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.105+0000 7f6676c02e00 1 --2- 10.20.193.28:0/3322565868 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55c0fbdecca0 0x55c0fbe52b00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.105+0000 7f6676c02e00 1 --2- 10.20.193.28:0/3322565868 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55c0fbdec390 0x55c0fbe525c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.105+0000 7f6676c02e00 1 -- 10.20.193.28:0/3322565868 >> 10.20.193.28:0/3322565868 conn(0x55c0fbd0b8a0 msgr2=0x55c0fbe47e20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:25.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.105+0000 7f661ffff640 0 client.15342 ms_handle_reset on v2:10.20.193.74:6836/958749351 2026-02-24T09:17:25.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.105+0000 7f6676c02e00 1 -- 10.20.193.28:0/3322565868 shutdown_connections 2026-02-24T09:17:25.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.106+0000 7f6676c02e00 1 -- 10.20.193.28:0/3322565868 wait complete. 2026-02-24T09:17:25.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.106+0000 7f6676c02e00 20 client.15342 trim_cache size 0 max 16384 2026-02-24T09:17:25.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.106+0000 7f666f577640 1 -- 10.20.193.28:0/1683565501 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f66480b5840 msgr2=0x7f66480d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:25.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.106+0000 7f666f577640 1 --2- 10.20.193.28:0/1683565501 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f66480b5840 0x7f66480d5cf0 secure :-1 s=READY pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6670129eb0 tx=0x7f6658005f90 comp rx=0 tx=0).stop 2026-02-24T09:17:25.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.106+0000 7f666f577640 1 -- 10.20.193.28:0/1683565501 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f667010b2d0 msgr2=0x7f6670123510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:25.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.106+0000 7f666f577640 1 --2- 10.20.193.28:0/1683565501 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f667010b2d0 0x7f6670123510 secure :-1 s=READY pgs=331 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f666400d950 tx=0x7f666400de20 comp rx=0 tx=0).stop 2026-02-24T09:17:25.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.106+0000 7f666f577640 1 -- 10.20.193.28:0/1683565501 shutdown_connections 2026-02-24T09:17:25.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.106+0000 7f666f577640 1 --2- 10.20.193.28:0/1683565501 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f66480b5840 0x7f66480d5cf0 unknown :-1 s=CLOSED pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.106+0000 7f666f577640 1 --2- 10.20.193.28:0/1683565501 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f66701112e0 0x7f6670128e20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.106+0000 7f666f577640 1 --2- 10.20.193.28:0/1683565501 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f667010bcc0 0x7f6670123a50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.106+0000 7f666f577640 1 --2- 10.20.193.28:0/1683565501 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f667010b2d0 0x7f6670123510 unknown :-1 s=CLOSED pgs=331 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.106+0000 7f666f577640 1 -- 10.20.193.28:0/1683565501 >> 10.20.193.28:0/1683565501 conn(0x7f66700e8e40 msgr2=0x7f6670109220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:25.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.106+0000 7f666f577640 1 -- 10.20.193.28:0/1683565501 shutdown_connections 2026-02-24T09:17:25.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.106+0000 7f666f577640 1 -- 10.20.193.28:0/1683565501 wait complete. 2026-02-24T09:17:25.202 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:24 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/1058612683' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:17:25.204 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph tell mds.b status 2026-02-24T09:17:25.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:24 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/1058612683' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:17:25.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:24 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/1058612683' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:17:25.387 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:25.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.566+0000 7f2a76f8c640 1 -- 10.20.193.28:0/1932840136 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a7010b7b0 msgr2=0x7f2a7010bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:25.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.566+0000 7f2a76f8c640 1 --2- 10.20.193.28:0/1932840136 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a7010b7b0 0x7f2a7010bb80 secure :-1 s=READY pgs=335 gs=2 cs=0 l=1 c_cookie=10996716043710376958 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a60009950 tx=0x7f2a6002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.566+0000 7f2a76f8c640 1 -- 10.20.193.28:0/1932840136 shutdown_connections 2026-02-24T09:17:25.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.566+0000 7f2a76f8c640 1 --2- 10.20.193.28:0/1932840136 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2a70113500 0x7f2a70173ed0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.566+0000 7f2a76f8c640 1 --2- 10.20.193.28:0/1932840136 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f2a7010c1a0 0x7f2a70112d50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.566+0000 7f2a76f8c640 1 --2- 10.20.193.28:0/1932840136 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a7010b7b0 0x7f2a7010bb80 unknown :-1 s=CLOSED pgs=335 gs=2 cs=0 l=1 c_cookie=10996716043710376958 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.566+0000 7f2a76f8c640 1 -- 10.20.193.28:0/1932840136 >> 10.20.193.28:0/1932840136 conn(0x7f2a700e9260 msgr2=0x7f2a70109670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:25.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.566+0000 7f2a76f8c640 1 -- 10.20.193.28:0/1932840136 shutdown_connections 2026-02-24T09:17:25.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.566+0000 7f2a76f8c640 1 -- 10.20.193.28:0/1932840136 wait complete. 2026-02-24T09:17:25.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.567+0000 7f2a76f8c640 1 Processor -- start 2026-02-24T09:17:25.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.567+0000 7f2a76f8c640 1 -- start start 2026-02-24T09:17:25.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.568+0000 7f2a76f8c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a7010b7b0 0x7f2a700f3f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.568+0000 7f2a76f8c640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2a7010c1a0 0x7f2a70173dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.568+0000 7f2a76f8c640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f2a70113500 0x7f2a700f4610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.568+0000 7f2a76f8c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2a700f9820 con 0x7f2a7010b7b0 2026-02-24T09:17:25.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.568+0000 7f2a76f8c640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f2a700f9990 con 0x7f2a7010c1a0 2026-02-24T09:17:25.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.568+0000 7f2a76f8c640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2a700f9b50 con 0x7f2a70113500 2026-02-24T09:17:25.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.568+0000 7f2a75f8a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a7010b7b0 0x7f2a700f3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.568+0000 7f2a75f8a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a7010b7b0 0x7f2a700f3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40582/0 (socket says 10.20.193.28:40582) 2026-02-24T09:17:25.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.568+0000 7f2a75f8a640 1 -- 10.20.193.28:0/386847517 learned_addr learned my addr 10.20.193.28:0/386847517 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:25.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.568+0000 7f2a75789640 1 --2- 10.20.193.28:0/386847517 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2a7010c1a0 0x7f2a70173dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.568+0000 7f2a7678b640 1 --2- 10.20.193.28:0/386847517 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f2a70113500 0x7f2a700f4610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.568+0000 7f2a75f8a640 1 -- 10.20.193.28:0/386847517 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f2a70113500 msgr2=0x7f2a700f4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:25.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.568+0000 7f2a75f8a640 1 --2- 10.20.193.28:0/386847517 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f2a70113500 0x7f2a700f4610 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.568+0000 7f2a75f8a640 1 -- 10.20.193.28:0/386847517 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2a7010c1a0 msgr2=0x7f2a70173dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:25.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.568+0000 7f2a75f8a640 1 --2- 10.20.193.28:0/386847517 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2a7010c1a0 0x7f2a70173dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.568+0000 7f2a75f8a640 1 -- 10.20.193.28:0/386847517 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a60009570 con 0x7f2a7010b7b0 2026-02-24T09:17:25.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.568+0000 7f2a75f8a640 1 --2- 10.20.193.28:0/386847517 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a7010b7b0 0x7f2a700f3f10 secure :-1 s=READY pgs=336 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a600098a0 tx=0x7f2a600028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:25.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.569+0000 7f2a5effd640 1 -- 10.20.193.28:0/386847517 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a6003d070 con 0x7f2a7010b7b0 2026-02-24T09:17:25.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.569+0000 7f2a5effd640 1 -- 10.20.193.28:0/386847517 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2a60002a40 con 0x7f2a7010b7b0 2026-02-24T09:17:25.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.569+0000 7f2a5effd640 1 -- 10.20.193.28:0/386847517 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a60041720 con 0x7f2a7010b7b0 2026-02-24T09:17:25.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.569+0000 7f2a76f8c640 1 -- 10.20.193.28:0/386847517 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a700f9dd0 con 0x7f2a7010b7b0 2026-02-24T09:17:25.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.569+0000 7f2a76f8c640 1 -- 10.20.193.28:0/386847517 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a700fa290 con 0x7f2a7010b7b0 2026-02-24T09:17:25.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.572+0000 7f2a5effd640 1 -- 10.20.193.28:0/386847517 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f2a600386a0 con 0x7f2a7010b7b0 2026-02-24T09:17:25.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.573+0000 7f2a5effd640 1 --2- 10.20.193.28:0/386847517 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f2a4c0b5830 0x7f2a4c0d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.573+0000 7f2a5effd640 1 -- 10.20.193.28:0/386847517 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f2a6010b0f0 con 0x7f2a7010b7b0 2026-02-24T09:17:25.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.573+0000 7f2a75789640 1 --2- 10.20.193.28:0/386847517 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f2a4c0b5830 0x7f2a4c0d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.574+0000 7f2a7a20fe00 1 Processor -- start 2026-02-24T09:17:25.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.574+0000 7f2a7a20fe00 1 -- start start 2026-02-24T09:17:25.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.574+0000 7f2a75789640 1 --2- 10.20.193.28:0/386847517 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f2a4c0b5830 0x7f2a4c0d5ce0 secure :-1 s=READY pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a700fa8b0 tx=0x7f2a64005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:25.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.574+0000 7f2a7a20fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a376fc4390 0x55a376fc4760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.574+0000 7f2a7a20fe00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a376fc4ca0 0x55a377009400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.574+0000 7f2a7a20fe00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a377009940 0x55a377029d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.574+0000 7f2a7a20fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a376eda910 con 0x55a376fc4390 2026-02-24T09:17:25.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.574+0000 7f2a7a20fe00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55a376ed6640 con 0x55a377009940 2026-02-24T09:17:25.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.574+0000 7f2a7a20fe00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55a376ed07a0 con 0x55a376fc4ca0 2026-02-24T09:17:25.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.574+0000 7f2a75789640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a376fc4ca0 0x55a377009400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.574+0000 7f2a7678b640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a377009940 0x55a377029d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.574+0000 7f2a7678b640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a377009940 0x55a377029d20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:44436/0 (socket says 10.20.193.28:44436) 2026-02-24T09:17:25.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.574+0000 7f2a7678b640 1 -- 10.20.193.28:0/882715865 learned_addr learned my addr 10.20.193.28:0/882715865 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:25.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.574+0000 7f2a75789640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a376fc4ca0 0x55a377009400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:35490/0 (socket says 10.20.193.28:35490) 2026-02-24T09:17:25.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.575+0000 7f2a75f8a640 1 --2- 10.20.193.28:0/882715865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a376fc4390 0x55a376fc4760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.575+0000 7f2a7678b640 1 -- 10.20.193.28:0/882715865 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a376fc4ca0 msgr2=0x55a377009400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:25.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.575+0000 7f2a7678b640 1 --2- 10.20.193.28:0/882715865 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a376fc4ca0 0x55a377009400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.575+0000 7f2a7678b640 1 -- 10.20.193.28:0/882715865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a376fc4390 msgr2=0x55a376fc4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:25.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.575+0000 7f2a7678b640 1 --2- 10.20.193.28:0/882715865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a376fc4390 0x55a376fc4760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.575+0000 7f2a7678b640 1 -- 10.20.193.28:0/882715865 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a376e7bd00 con 0x55a377009940 2026-02-24T09:17:25.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.575+0000 7f2a75f8a640 1 --2- 10.20.193.28:0/882715865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a376fc4390 0x55a376fc4760 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:17:25.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.575+0000 7f2a7678b640 1 --2- 10.20.193.28:0/882715865 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a377009940 0x55a377029d20 secure :-1 s=READY pgs=104 gs=2 cs=0 l=1 c_cookie=5934432681897510437 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a6c005660 tx=0x7f2a6c003c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=525b57150bf84625 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:25.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.575+0000 7f2a3e4e6640 1 -- 10.20.193.28:0/882715865 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a6c00aea0 con 0x55a377009940 2026-02-24T09:17:25.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.575+0000 7f2a3e4e6640 1 -- 10.20.193.28:0/882715865 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2a6c003e90 con 0x55a377009940 2026-02-24T09:17:25.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.575+0000 7f2a3e4e6640 1 -- 10.20.193.28:0/882715865 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a6c010980 con 0x55a377009940 2026-02-24T09:17:25.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.576+0000 7f2a7a20fe00 1 -- 10.20.193.28:0/882715865 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a377009940 msgr2=0x55a377029d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:25.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.576+0000 7f2a7a20fe00 1 --2- 10.20.193.28:0/882715865 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a377009940 0x55a377029d20 secure :-1 s=READY pgs=104 gs=2 cs=0 l=1 c_cookie=5934432681897510437 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a6c005660 tx=0x7f2a6c003c30 comp rx=0 tx=0).stop 2026-02-24T09:17:25.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.576+0000 7f2a7a20fe00 1 -- 10.20.193.28:0/882715865 shutdown_connections 2026-02-24T09:17:25.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.576+0000 7f2a7a20fe00 1 --2- 10.20.193.28:0/882715865 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a377009940 0x55a377029d20 unknown :-1 s=CLOSED pgs=104 gs=2 cs=0 l=1 c_cookie=5934432681897510437 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.576+0000 7f2a7a20fe00 1 --2- 10.20.193.28:0/882715865 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a376fc4ca0 0x55a377009400 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.576+0000 7f2a7a20fe00 1 --2- 10.20.193.28:0/882715865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a376fc4390 0x55a376fc4760 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.576+0000 7f2a7a20fe00 1 -- 10.20.193.28:0/882715865 >> 10.20.193.28:0/882715865 conn(0x55a376ee38a0 msgr2=0x55a376fc2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:25.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.576+0000 7f2a7a20fe00 1 -- 10.20.193.28:0/882715865 shutdown_connections 2026-02-24T09:17:25.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.576+0000 7f2a7a20fe00 1 -- 10.20.193.28:0/882715865 wait complete. 2026-02-24T09:17:25.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.577+0000 7f2a7a20fe00 1 -- start start 2026-02-24T09:17:25.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.578+0000 7f2a7a20fe00 1 Processor -- start 2026-02-24T09:17:25.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.578+0000 7f2a7a20fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a376fc4390 0x55a377021240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.578+0000 7f2a7a20fe00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a376fc4ca0 0x55a377021780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.578+0000 7f2a7a20fe00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a377009940 0x55a377026770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.578+0000 7f2a7a20fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a377026cb0 con 0x55a376fc4390 2026-02-24T09:17:25.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.578+0000 7f2a7a20fe00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55a377026e20 con 0x55a376fc4ca0 2026-02-24T09:17:25.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.578+0000 7f2a7a20fe00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55a377026fe0 con 0x55a377009940 2026-02-24T09:17:25.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.578+0000 7f2a75f8a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a376fc4390 0x55a377021240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.578+0000 7f2a75f8a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a376fc4390 0x55a377021240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40610/0 (socket says 10.20.193.28:40610) 2026-02-24T09:17:25.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.578+0000 7f2a75f8a640 1 -- 10.20.193.28:0/2295191468 learned_addr learned my addr 10.20.193.28:0/2295191468 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:25.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.578+0000 7f2a7678b640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a377009940 0x55a377026770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.578+0000 7f2a75789640 1 --2- 10.20.193.28:0/2295191468 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a376fc4ca0 0x55a377021780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.579+0000 7f2a75f8a640 1 -- 10.20.193.28:0/2295191468 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a377009940 msgr2=0x55a377026770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:25.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.579+0000 7f2a75f8a640 1 --2- 10.20.193.28:0/2295191468 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a377009940 0x55a377026770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.579+0000 7f2a75f8a640 1 -- 10.20.193.28:0/2295191468 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a376fc4ca0 msgr2=0x55a377021780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:25.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.579+0000 7f2a75f8a640 1 --2- 10.20.193.28:0/2295191468 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a376fc4ca0 0x55a377021780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.579+0000 7f2a75f8a640 1 -- 10.20.193.28:0/2295191468 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a6c0052d0 con 0x55a376fc4390 2026-02-24T09:17:25.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.579+0000 7f2a7678b640 1 --2- 10.20.193.28:0/2295191468 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a377009940 0x55a377026770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:17:25.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.579+0000 7f2a75f8a640 1 --2- 10.20.193.28:0/2295191468 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a376fc4390 0x55a377021240 secure :-1 s=READY pgs=337 gs=1 cs=0 l=1 c_cookie=16610244771493309687 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a600d1760 tx=0x7f2a60108f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e683719d6525ecf7 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:25.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.579+0000 7f2a2b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:17:25.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.579+0000 7f2a2b7fe640 1 -- 10.20.193.28:0/2295191468 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a600d0cf0 con 0x55a376fc4390 2026-02-24T09:17:25.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.579+0000 7f2a2b7fe640 1 -- 10.20.193.28:0/2295191468 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2a60048e80 con 0x55a376fc4390 2026-02-24T09:17:25.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.579+0000 7f2a2b7fe640 1 -- 10.20.193.28:0/2295191468 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a600d30b0 con 0x55a376fc4390 2026-02-24T09:17:25.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.579+0000 7f2a7a20fe00 1 -- 10.20.193.28:0/2295191468 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a700fa290 con 0x55a376fc4390 2026-02-24T09:17:25.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.579+0000 7f2a2b7fe640 1 -- 10.20.193.28:0/2295191468 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f2a600cce40 con 0x55a376fc4390 2026-02-24T09:17:25.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.579+0000 7f2a2b7fe640 10 client.15354 inactive, discarding osd_map(92..92 src has 1..92) 2026-02-24T09:17:25.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.579+0000 7f2a7a20fe00 10 client.15354 _ll_register_callbacks cb 0x55a376e58510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:25.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.579+0000 7f2a7a20fe00 1 -- 10.20.193.28:0/2295191468 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a376b66600 con 0x55a376fc4390 2026-02-24T09:17:25.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.580+0000 7f2a2b7fe640 1 -- 10.20.193.28:0/2295191468 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f2a600cf7b0 con 0x55a376fc4390 2026-02-24T09:17:25.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.580+0000 7f2a7a20fe00 10 client.15354 fetch_fsmap learned FSMap version 22 2026-02-24T09:17:25.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.580+0000 7f2a7a20fe00 1 -- 10.20.193.28:0/2295191468 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=22}) -- 0x55a376e543b0 con 0x55a376fc4390 2026-02-24T09:17:25.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.580+0000 7f2a2b7fe640 1 -- 10.20.193.28:0/2295191468 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 22) ==== 8346+0+0 (secure 0 0 0) 0x7f2a600cd000 con 0x55a376fc4390 2026-02-24T09:17:25.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.580+0000 7f2a7a20fe00 10 client.15354 fetch_fsmap finished waiting for FSMap version 22 2026-02-24T09:17:25.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.580+0000 7f2a7a20fe00 10 client.15354 resolve_mds: resolved name 'b' to daemon mds.b 2026-02-24T09:17:25.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.580+0000 7f2a7a20fe00 20 client.15354 populate_metadata read hostname 'trial028' 2026-02-24T09:17:25.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.580+0000 7f2a7a20fe00 1 --2- 10.20.193.28:0/2295191468 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55a377007670 0x55a377008ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.580+0000 7f2a7a20fe00 4 client.15354 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:17:25.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.580+0000 7f2a7a20fe00 1 -- 10.20.193.28:0/2295191468 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a376ea32e0 con 0x55a377007670 2026-02-24T09:17:25.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.580+0000 7f2a75789640 1 --2- 10.20.193.28:0/2295191468 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55a377007670 0x55a377008ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.581+0000 7f2a75789640 1 --2- 10.20.193.28:0/2295191468 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55a377007670 0x55a377008ae0 crc :-1 s=READY pgs=16 gs=4 cs=0 l=0 c_cookie=9391366895577537105 s_cookie=9243868232154697837 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8254d66f16431a51 server_cookie=8048d12e5819506d in_seq=0 out_seq=0 2026-02-24T09:17:25.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.581+0000 7f2a2b7fe640 10 client.15354 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:17:25.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.582+0000 7f2a2b7fe640 1 -- 10.20.193.28:0/2295191468 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55a376ea32e0 con 0x55a377007670 2026-02-24T09:17:25.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.582+0000 7f2a2b7fe640 10 client.15354 handle_command_reply: tid=0 2026-02-24T09:17:25.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.582+0000 7f2a7a20fe00 1 client.15354 shutdown 2026-02-24T09:17:25.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.582+0000 7f2a7a20fe00 1 -- 10.20.193.28:0/2295191468 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a376fc4390 msgr2=0x55a377021240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:25.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.582+0000 7f2a7a20fe00 1 --2- 10.20.193.28:0/2295191468 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a376fc4390 0x55a377021240 secure :-1 s=READY pgs=337 gs=1 cs=0 l=1 c_cookie=16610244771493309687 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a600d1760 tx=0x7f2a60108f90 comp rx=0 tx=0).stop 2026-02-24T09:17:25.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.583+0000 7f2a7a20fe00 1 -- 10.20.193.28:0/2295191468 shutdown_connections 2026-02-24T09:17:25.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.583+0000 7f2a7a20fe00 1 --2- 10.20.193.28:0/2295191468 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55a377007670 0x55a377008ae0 crc :-1 s=READY pgs=16 gs=4 cs=0 l=0 c_cookie=9391366895577537105 s_cookie=9243868232154697837 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.583+0000 7f2a7a20fe00 1 --2- 10.20.193.28:0/2295191468 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a377009940 0x55a377026770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.583+0000 7f2a7a20fe00 1 --2- 10.20.193.28:0/2295191468 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a376fc4ca0 0x55a377021780 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.583+0000 7f2a7a20fe00 1 --2- 10.20.193.28:0/2295191468 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a376fc4390 0x55a377021240 unknown :-1 s=CLOSED pgs=337 gs=1 cs=0 l=1 c_cookie=16610244771493309687 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.583+0000 7f2a2b7fe640 0 client.15354 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:17:25.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.583+0000 7f2a7a20fe00 1 -- 10.20.193.28:0/2295191468 >> 10.20.193.28:0/2295191468 conn(0x55a376ee38a0 msgr2=0x55a376fc2480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:25.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.583+0000 7f2a7a20fe00 1 -- 10.20.193.28:0/2295191468 shutdown_connections 2026-02-24T09:17:25.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.583+0000 7f2a7a20fe00 1 -- 10.20.193.28:0/2295191468 wait complete. 2026-02-24T09:17:25.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.583+0000 7f2a7a20fe00 20 client.15354 trim_cache size 0 max 16384 2026-02-24T09:17:25.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.593+0000 7f2a7a20fe00 1 Processor -- start 2026-02-24T09:17:25.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.593+0000 7f2a7a20fe00 1 -- start start 2026-02-24T09:17:25.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.593+0000 7f2a7a20fe00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a376fc4390 0x55a37701e630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.593+0000 7f2a7a20fe00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a376fc4ca0 0x55a37701eb70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.593+0000 7f2a7a20fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a377009940 0x55a377021060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.593+0000 7f2a7a20fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a377026b70 con 0x55a377009940 2026-02-24T09:17:25.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.593+0000 7f2a7a20fe00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55a376ece3d0 con 0x55a376fc4390 2026-02-24T09:17:25.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.593+0000 7f2a7a20fe00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55a376b8e610 con 0x55a376fc4ca0 2026-02-24T09:17:25.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.593+0000 7f2a75789640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a376fc4ca0 0x55a37701eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.593+0000 7f2a75789640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a376fc4ca0 0x55a37701eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:35504/0 (socket says 10.20.193.28:35504) 2026-02-24T09:17:25.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.593+0000 7f2a75789640 1 -- 10.20.193.28:0/260657437 learned_addr learned my addr 10.20.193.28:0/260657437 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:25.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.593+0000 7f2a7678b640 1 --2- 10.20.193.28:0/260657437 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a377009940 0x55a377021060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.593+0000 7f2a75f8a640 1 --2- 10.20.193.28:0/260657437 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a376fc4390 0x55a37701e630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.594+0000 7f2a75789640 1 -- 10.20.193.28:0/260657437 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a376fc4390 msgr2=0x55a37701e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:25.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.594+0000 7f2a75789640 1 --2- 10.20.193.28:0/260657437 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a376fc4390 0x55a37701e630 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.594+0000 7f2a75789640 1 -- 10.20.193.28:0/260657437 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a377009940 msgr2=0x55a377021060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:25.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.594+0000 7f2a75789640 1 --2- 10.20.193.28:0/260657437 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a377009940 0x55a377021060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.594+0000 7f2a75789640 1 -- 10.20.193.28:0/260657437 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a376e660d0 con 0x55a376fc4ca0 2026-02-24T09:17:25.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.594+0000 7f2a75789640 1 --2- 10.20.193.28:0/260657437 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a376fc4ca0 0x55a37701eb70 secure :-1 s=READY pgs=105 gs=2 cs=0 l=1 c_cookie=8799352077472423025 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55a377027800 tx=0x7f2a64014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a1d9417ef56dc71 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:25.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.594+0000 7f2a3dce5640 1 -- 10.20.193.28:0/260657437 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a64021040 con 0x55a376fc4ca0 2026-02-24T09:17:25.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.594+0000 7f2a3dce5640 1 -- 10.20.193.28:0/260657437 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2a6402a170 con 0x55a376fc4ca0 2026-02-24T09:17:25.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.594+0000 7f2a3dce5640 1 -- 10.20.193.28:0/260657437 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a64026950 con 0x55a376fc4ca0 2026-02-24T09:17:25.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.594+0000 7f2a7a20fe00 1 -- 10.20.193.28:0/260657437 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a376fc4ca0 msgr2=0x55a37701eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:25.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.594+0000 7f2a7a20fe00 1 --2- 10.20.193.28:0/260657437 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a376fc4ca0 0x55a37701eb70 secure :-1 s=READY pgs=105 gs=2 cs=0 l=1 c_cookie=8799352077472423025 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55a377027800 tx=0x7f2a64014000 comp rx=0 tx=0).stop 2026-02-24T09:17:25.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.594+0000 7f2a7a20fe00 1 -- 10.20.193.28:0/260657437 shutdown_connections 2026-02-24T09:17:25.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.594+0000 7f2a7a20fe00 1 --2- 10.20.193.28:0/260657437 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a377009940 0x55a377021060 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.594+0000 7f2a7a20fe00 1 --2- 10.20.193.28:0/260657437 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a376fc4ca0 0x55a37701eb70 unknown :-1 s=CLOSED pgs=105 gs=2 cs=0 l=1 c_cookie=8799352077472423025 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.594+0000 7f2a7a20fe00 1 --2- 10.20.193.28:0/260657437 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a376fc4390 0x55a37701e630 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.594+0000 7f2a7a20fe00 1 -- 10.20.193.28:0/260657437 >> 10.20.193.28:0/260657437 conn(0x55a376ee38a0 msgr2=0x55a377013180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:25.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.594+0000 7f2a7a20fe00 1 -- 10.20.193.28:0/260657437 shutdown_connections 2026-02-24T09:17:25.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.594+0000 7f2a7a20fe00 1 -- 10.20.193.28:0/260657437 wait complete. 2026-02-24T09:17:25.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.595+0000 7f2a7a20fe00 1 -- start start 2026-02-24T09:17:25.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.595+0000 7f2a7a20fe00 1 Processor -- start 2026-02-24T09:17:25.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.596+0000 7f2a7a20fe00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a376fc4390 0x55a376fc3c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.596+0000 7f2a7a20fe00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a376fc4ca0 0x55a3770244a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.596+0000 7f2a7a20fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a377009940 0x55a377024a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.596+0000 7f2a7a20fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a377020df0 con 0x55a377009940 2026-02-24T09:17:25.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.596+0000 7f2a7a20fe00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55a377025150 con 0x55a376fc4ca0 2026-02-24T09:17:25.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.596+0000 7f2a7a20fe00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55a377025310 con 0x55a376fc4390 2026-02-24T09:17:25.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.596+0000 7f2a7678b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a377009940 0x55a377024a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.596+0000 7f2a75f8a640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a376fc4390 0x55a376fc3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.596+0000 7f2a7678b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a377009940 0x55a377024a20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40624/0 (socket says 10.20.193.28:40624) 2026-02-24T09:17:25.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.596+0000 7f2a7678b640 1 -- 10.20.193.28:0/2385560896 learned_addr learned my addr 10.20.193.28:0/2385560896 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:25.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.596+0000 7f2a75f8a640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a376fc4390 0x55a376fc3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:35516/0 (socket says 10.20.193.28:35516) 2026-02-24T09:17:25.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.596+0000 7f2a75789640 1 --2- 10.20.193.28:0/2385560896 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a376fc4ca0 0x55a3770244a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.596+0000 7f2a75f8a640 1 -- 10.20.193.28:0/2385560896 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a376fc4ca0 msgr2=0x55a3770244a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:25.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.596+0000 7f2a75f8a640 1 --2- 10.20.193.28:0/2385560896 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a376fc4ca0 0x55a3770244a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.596+0000 7f2a75f8a640 1 -- 10.20.193.28:0/2385560896 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a377009940 msgr2=0x55a377024a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:25.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.596+0000 7f2a75f8a640 1 --2- 10.20.193.28:0/2385560896 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a377009940 0x55a377024a20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.596+0000 7f2a75f8a640 1 -- 10.20.193.28:0/2385560896 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a376e60b50 con 0x55a376fc4390 2026-02-24T09:17:25.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.597+0000 7f2a75f8a640 1 --2- 10.20.193.28:0/2385560896 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a376fc4390 0x55a376fc3c20 secure :-1 s=READY pgs=106 gs=1 cs=0 l=1 c_cookie=16698574402911230923 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a600d1bf0 tx=0x7f2a6002fe20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7bd40f254f45bcb server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:25.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.597+0000 7f2a2b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.159:3300/0 2026-02-24T09:17:25.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.597+0000 7f2a2b7fe640 1 -- 10.20.193.28:0/2385560896 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a60048e80 con 0x55a376fc4390 2026-02-24T09:17:25.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.597+0000 7f2a2b7fe640 1 -- 10.20.193.28:0/2385560896 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x55a376b66600 con 0x55a376fc4390 2026-02-24T09:17:25.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.597+0000 7f2a2b7fe640 1 -- 10.20.193.28:0/2385560896 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a600d2e30 con 0x55a376fc4390 2026-02-24T09:17:25.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.597+0000 7f2a7a20fe00 1 -- 10.20.193.28:0/2385560896 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a640098a0 con 0x55a376fc4390 2026-02-24T09:17:25.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.597+0000 7f2a7a20fe00 10 client.25123 _ll_register_callbacks cb 0x55a376e58510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:25.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.597+0000 7f2a7a20fe00 1 -- 10.20.193.28:0/2385560896 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a376eddb90 con 0x55a376fc4390 2026-02-24T09:17:25.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.597+0000 7f2a2b7fe640 1 -- 10.20.193.28:0/2385560896 <== mon.1 v2:10.20.193.159:3300/0 4 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f2a600d3300 con 0x55a376fc4390 2026-02-24T09:17:25.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.597+0000 7f2a2b7fe640 1 -- 10.20.193.28:0/2385560896 <== mon.1 v2:10.20.193.159:3300/0 5 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f2a600d0cf0 con 0x55a376fc4390 2026-02-24T09:17:25.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.597+0000 7f2a7a20fe00 10 client.25123 fetch_fsmap learned FSMap version 22 2026-02-24T09:17:25.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.597+0000 7f2a7a20fe00 1 -- 10.20.193.28:0/2385560896 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({fsmap=22}) -- 0x55a376e546e0 con 0x55a376fc4390 2026-02-24T09:17:25.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.598+0000 7f2a2b7fe640 1 -- 10.20.193.28:0/2385560896 <== mon.1 v2:10.20.193.159:3300/0 6 ==== fsmap(e 22) ==== 8346+0+0 (secure 0 0 0) 0x7f2a600d07e0 con 0x55a376fc4390 2026-02-24T09:17:25.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.598+0000 7f2a7a20fe00 10 client.25123 fetch_fsmap finished waiting for FSMap version 22 2026-02-24T09:17:25.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.598+0000 7f2a7a20fe00 10 client.25123 resolve_mds: resolved name 'b' to daemon mds.b 2026-02-24T09:17:25.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.598+0000 7f2a7a20fe00 20 client.25123 populate_metadata read hostname 'trial028' 2026-02-24T09:17:25.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.598+0000 7f2a7a20fe00 1 --2- 10.20.193.28:0/2385560896 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55a376fe98c0 0x55a376fe85d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:25.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.598+0000 7f2a7a20fe00 4 client.25123 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-24T09:17:25.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.598+0000 7f2a7a20fe00 1 -- 10.20.193.28:0/2385560896 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "status"}) -- 0x55a376b63e50 con 0x55a376fe98c0 2026-02-24T09:17:25.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.598+0000 7f2a75789640 1 --2- 10.20.193.28:0/2385560896 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55a376fe98c0 0x55a376fe85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:25.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.599+0000 7f2a75789640 1 --2- 10.20.193.28:0/2385560896 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55a376fe98c0 0x55a376fe85d0 crc :-1 s=READY pgs=17 gs=4 cs=0 l=0 c_cookie=14829019543202384615 s_cookie=2708852712154206049 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdcb42b4ffe74ae7 server_cookie=2597c73088ce0f61 in_seq=0 out_seq=0 2026-02-24T09:17:25.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.599+0000 7f2a2b7fe640 10 client.25123 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:17:25.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.599+0000 7f2a2b7fe640 1 -- 10.20.193.28:0/2385560896 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1223 (crc 0 0 0) 0x55a376b63e50 con 0x55a376fe98c0 2026-02-24T09:17:25.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.599+0000 7f2a2b7fe640 10 client.25123 handle_command_reply: tid=0 2026-02-24T09:17:25.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.599+0000 7f2a7a20fe00 1 client.25123 shutdown 2026-02-24T09:17:25.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.599+0000 7f2a7a20fe00 1 -- 10.20.193.28:0/2385560896 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a376fc4390 msgr2=0x55a376fc3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:25.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.599+0000 7f2a7a20fe00 1 --2- 10.20.193.28:0/2385560896 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a376fc4390 0x55a376fc3c20 secure :-1 s=READY pgs=106 gs=1 cs=0 l=1 c_cookie=16698574402911230923 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a600d1bf0 tx=0x7f2a6002fe20 comp rx=0 tx=0).stop 2026-02-24T09:17:25.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.600+0000 7f2a7a20fe00 1 -- 10.20.193.28:0/2385560896 shutdown_connections 2026-02-24T09:17:25.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.600+0000 7f2a7a20fe00 1 --2- 10.20.193.28:0/2385560896 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55a376fe98c0 0x55a376fe85d0 crc :-1 s=READY pgs=17 gs=4 cs=0 l=0 c_cookie=14829019543202384615 s_cookie=2708852712154206049 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.600+0000 7f2a7a20fe00 1 --2- 10.20.193.28:0/2385560896 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a377009940 0x55a377024a20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.600+0000 7f2a7a20fe00 1 --2- 10.20.193.28:0/2385560896 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a376fc4ca0 0x55a3770244a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.600+0000 7f2a2b7fe640 0 client.25123 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:17:25.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.600+0000 7f2a7a20fe00 1 --2- 10.20.193.28:0/2385560896 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a376fc4390 0x55a376fc3c20 unknown :-1 s=CLOSED pgs=106 gs=1 cs=0 l=1 c_cookie=16698574402911230923 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.600+0000 7f2a7a20fe00 1 -- 10.20.193.28:0/2385560896 >> 10.20.193.28:0/2385560896 conn(0x55a376ee38a0 msgr2=0x55a377021060 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:25.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.600+0000 7f2a7a20fe00 1 -- 10.20.193.28:0/2385560896 shutdown_connections 2026-02-24T09:17:25.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.600+0000 7f2a7a20fe00 1 -- 10.20.193.28:0/2385560896 wait complete. 2026-02-24T09:17:25.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.600+0000 7f2a7a20fe00 20 client.25123 trim_cache size 0 max 16384 2026-02-24T09:17:25.605 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-24T09:17:25.605 INFO:teuthology.orchestra.run.trial028.stdout: "cluster_fsid": "e9ad50af-1160-11f1-800e-d404e6e7d460", 2026-02-24T09:17:25.606 INFO:teuthology.orchestra.run.trial028.stdout: "whoami": 0, 2026-02-24T09:17:25.606 INFO:teuthology.orchestra.run.trial028.stdout: "id": 24788, 2026-02-24T09:17:25.606 INFO:teuthology.orchestra.run.trial028.stdout: "want_state": "up:active", 2026-02-24T09:17:25.606 INFO:teuthology.orchestra.run.trial028.stdout: "state": "up:active", 2026-02-24T09:17:25.606 INFO:teuthology.orchestra.run.trial028.stdout: "fs_name": "cephfs", 2026-02-24T09:17:25.606 INFO:teuthology.orchestra.run.trial028.stdout: "rank_uptime": 25.121986251999999, 2026-02-24T09:17:25.606 INFO:teuthology.orchestra.run.trial028.stdout: "mdsmap_epoch": 22, 2026-02-24T09:17:25.606 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch": 92, 2026-02-24T09:17:25.606 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch_barrier": 92, 2026-02-24T09:17:25.606 INFO:teuthology.orchestra.run.trial028.stdout: "uptime": 31.451969335000001, 2026-02-24T09:17:25.606 INFO:teuthology.orchestra.run.trial028.stdout: "sysinfo": { 2026-02-24T09:17:25.606 INFO:teuthology.orchestra.run.trial028.stdout: "arch": "x86_64", 2026-02-24T09:17:25.606 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_release": "tentacle", 2026-02-24T09:17:25.606 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version": "ceph version 20.3.0-5537-g5bc9a1ff (5bc9a1ffc19df681248ece8c3c8c7191a571745b) tentacle (dev - RelWithDebInfo)", 2026-02-24T09:17:25.606 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version_short": "20.3.0-5537-g5bc9a1ff", 2026-02-24T09:17:25.607 INFO:teuthology.orchestra.run.trial028.stdout: "container_hostname": "trial074", 2026-02-24T09:17:25.607 INFO:teuthology.orchestra.run.trial028.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b", 2026-02-24T09:17:25.607 INFO:teuthology.orchestra.run.trial028.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-24T09:17:25.607 INFO:teuthology.orchestra.run.trial028.stdout: "distro": "centos", 2026-02-24T09:17:25.607 INFO:teuthology.orchestra.run.trial028.stdout: "distro_description": "CentOS Stream 9", 2026-02-24T09:17:25.607 INFO:teuthology.orchestra.run.trial028.stdout: "distro_version": "9", 2026-02-24T09:17:25.607 INFO:teuthology.orchestra.run.trial028.stdout: "hostname": "trial074", 2026-02-24T09:17:25.607 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Thu Feb 12 10:25:42 EST 2026", 2026-02-24T09:17:25.607 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_version": "6.19.0-g8dec4b357aab", 2026-02-24T09:17:25.607 INFO:teuthology.orchestra.run.trial028.stdout: "mem_swap_kb": "8388604", 2026-02-24T09:17:25.607 INFO:teuthology.orchestra.run.trial028.stdout: "mem_total_kb": "130448332", 2026-02-24T09:17:25.607 INFO:teuthology.orchestra.run.trial028.stdout: "os": "Linux" 2026-02-24T09:17:25.607 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:17:25.607 INFO:teuthology.orchestra.run.trial028.stdout: "endian": "little" 2026-02-24T09:17:25.607 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-24T09:17:25.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.600+0000 7f2a76f8c640 1 -- 10.20.193.28:0/386847517 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f2a4c0b5830 msgr2=0x7f2a4c0d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:25.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.600+0000 7f2a76f8c640 1 --2- 10.20.193.28:0/386847517 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f2a4c0b5830 0x7f2a4c0d5ce0 secure :-1 s=READY pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a700fa8b0 tx=0x7f2a64005f90 comp rx=0 tx=0).stop 2026-02-24T09:17:25.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.600+0000 7f2a76f8c640 1 -- 10.20.193.28:0/386847517 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a7010b7b0 msgr2=0x7f2a700f3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:25.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.600+0000 7f2a76f8c640 1 --2- 10.20.193.28:0/386847517 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a7010b7b0 0x7f2a700f3f10 secure :-1 s=READY pgs=336 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a600098a0 tx=0x7f2a600028d0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.600+0000 7f2a76f8c640 1 -- 10.20.193.28:0/386847517 shutdown_connections 2026-02-24T09:17:25.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.600+0000 7f2a76f8c640 1 --2- 10.20.193.28:0/386847517 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f2a4c0b5830 0x7f2a4c0d5ce0 unknown :-1 s=CLOSED pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.600+0000 7f2a76f8c640 1 --2- 10.20.193.28:0/386847517 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f2a70113500 0x7f2a700f4610 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.600+0000 7f2a76f8c640 1 --2- 10.20.193.28:0/386847517 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2a7010c1a0 0x7f2a70173dd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.600+0000 7f2a76f8c640 1 --2- 10.20.193.28:0/386847517 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a7010b7b0 0x7f2a700f3f10 unknown :-1 s=CLOSED pgs=336 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:25.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.600+0000 7f2a76f8c640 1 -- 10.20.193.28:0/386847517 >> 10.20.193.28:0/386847517 conn(0x7f2a700e9260 msgr2=0x7f2a7010f510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:25.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.601+0000 7f2a76f8c640 1 -- 10.20.193.28:0/386847517 shutdown_connections 2026-02-24T09:17:25.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:25.601+0000 7f2a76f8c640 1 -- 10.20.193.28:0/386847517 wait complete. 2026-02-24T09:17:25.697 INFO:tasks.cephadm:Setup complete, yielding 2026-02-24T09:17:25.697 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-02-24T09:17:25.716 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@trial028.front.sepia.ceph.com 2026-02-24T09:17:25.716 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- bash -c 'ceph orch status' 2026-02-24T09:17:25.900 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:26.031 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:25 trial028 ceph-mon[40371]: pgmap v193: 97 pgs: 97 active+clean; 645 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2026-02-24T09:17:26.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.077+0000 7f1068c1d640 1 -- 10.20.193.28:0/523530157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f106410b3b0 msgr2=0x7f106410b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:26.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.077+0000 7f1068c1d640 1 --2- 10.20.193.28:0/523530157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f106410b3b0 0x7f106410b780 secure :-1 s=READY pgs=338 gs=1 cs=0 l=1 c_cookie=17745895835325412615 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1050009950 tx=0x7f105002f190 comp rx=0 tx=0).stop 2026-02-24T09:17:26.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.077+0000 7f1068c1d640 1 -- 10.20.193.28:0/523530157 shutdown_connections 2026-02-24T09:17:26.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.077+0000 7f1068c1d640 1 --2- 10.20.193.28:0/523530157 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f10641559d0 0x7f1064175e60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:26.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.077+0000 7f1068c1d640 1 --2- 10.20.193.28:0/523530157 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f106410bcc0 0x7f1064155360 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:26.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.077+0000 7f1068c1d640 1 --2- 10.20.193.28:0/523530157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f106410b3b0 0x7f106410b780 unknown :-1 s=CLOSED pgs=338 gs=1 cs=0 l=1 c_cookie=17745895835325412615 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:26.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.077+0000 7f1068c1d640 1 -- 10.20.193.28:0/523530157 >> 10.20.193.28:0/523530157 conn(0x7f10640e8e40 msgr2=0x7f1064109250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:26.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.077+0000 7f1068c1d640 1 -- 10.20.193.28:0/523530157 shutdown_connections 2026-02-24T09:17:26.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.077+0000 7f1068c1d640 1 -- 10.20.193.28:0/523530157 wait complete. 2026-02-24T09:17:26.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.078+0000 7f1068c1d640 1 Processor -- start 2026-02-24T09:17:26.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.078+0000 7f1068c1d640 1 -- start start 2026-02-24T09:17:26.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.078+0000 7f1068c1d640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f106410b3b0 0x7f1064160370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:26.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.078+0000 7f1068c1d640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f106410bcc0 0x7f10641608b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:26.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.078+0000 7f1068c1d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f10641559d0 0x7f1064165c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:26.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.078+0000 7f1068c1d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1064166250 con 0x7f10641559d0 2026-02-24T09:17:26.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.078+0000 7f1068c1d640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f10641663c0 con 0x7f106410b3b0 2026-02-24T09:17:26.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.078+0000 7f1068c1d640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1064166580 con 0x7f106410bcc0 2026-02-24T09:17:26.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.078+0000 7f1063fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f10641559d0 0x7f1064165c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:26.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.078+0000 7f10637fe640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f106410b3b0 0x7f1064160370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:26.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.078+0000 7f10637fe640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f106410b3b0 0x7f1064160370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:44498/0 (socket says 10.20.193.28:44498) 2026-02-24T09:17:26.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.078+0000 7f10637fe640 1 -- 10.20.193.28:0/4269429211 learned_addr learned my addr 10.20.193.28:0/4269429211 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:26.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.078+0000 7f1062ffd640 1 --2- 10.20.193.28:0/4269429211 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f106410bcc0 0x7f10641608b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:26.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.079+0000 7f1063fff640 1 -- 10.20.193.28:0/4269429211 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f106410bcc0 msgr2=0x7f10641608b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:26.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.079+0000 7f1063fff640 1 --2- 10.20.193.28:0/4269429211 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f106410bcc0 0x7f10641608b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:26.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.079+0000 7f1063fff640 1 -- 10.20.193.28:0/4269429211 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f106410b3b0 msgr2=0x7f1064160370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:26.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.079+0000 7f1063fff640 1 --2- 10.20.193.28:0/4269429211 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f106410b3b0 0x7f1064160370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:26.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.079+0000 7f1063fff640 1 -- 10.20.193.28:0/4269429211 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1050009570 con 0x7f10641559d0 2026-02-24T09:17:26.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.079+0000 7f10637fe640 1 --2- 10.20.193.28:0/4269429211 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f106410b3b0 0x7f1064160370 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:17:26.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.079+0000 7f1063fff640 1 --2- 10.20.193.28:0/4269429211 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f10641559d0 0x7f1064165c30 secure :-1 s=READY pgs=339 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f105800e720 tx=0x7f105800ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:26.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.079+0000 7f1060ff9640 1 -- 10.20.193.28:0/4269429211 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1058005500 con 0x7f10641559d0 2026-02-24T09:17:26.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.079+0000 7f1068c1d640 1 -- 10.20.193.28:0/4269429211 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1064166860 con 0x7f10641559d0 2026-02-24T09:17:26.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.079+0000 7f1060ff9640 1 -- 10.20.193.28:0/4269429211 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f1058005660 con 0x7f10641559d0 2026-02-24T09:17:26.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.079+0000 7f1060ff9640 1 -- 10.20.193.28:0/4269429211 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1058011460 con 0x7f10641559d0 2026-02-24T09:17:26.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.079+0000 7f1068c1d640 1 -- 10.20.193.28:0/4269429211 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10641534e0 con 0x7f10641559d0 2026-02-24T09:17:26.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.080+0000 7f1068c1d640 1 -- 10.20.193.28:0/4269429211 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f106410c410 con 0x7f10641559d0 2026-02-24T09:17:26.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.082+0000 7f1060ff9640 1 -- 10.20.193.28:0/4269429211 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f105800c7e0 con 0x7f10641559d0 2026-02-24T09:17:26.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.084+0000 7f1060ff9640 1 --2- 10.20.193.28:0/4269429211 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f10380b5840 0x7f10380d5cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:26.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.084+0000 7f1060ff9640 1 -- 10.20.193.28:0/4269429211 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f10580e7b30 con 0x7f10641559d0 2026-02-24T09:17:26.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.084+0000 7f10637fe640 1 --2- 10.20.193.28:0/4269429211 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f10380b5840 0x7f10380d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:26.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.084+0000 7f1060ff9640 1 -- 10.20.193.28:0/4269429211 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f1058120930 con 0x7f10641559d0 2026-02-24T09:17:26.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.085+0000 7f10637fe640 1 --2- 10.20.193.28:0/4269429211 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f10380b5840 0x7f10380d5cf0 secure :-1 s=READY pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10500023b0 tx=0x7f105003a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:26.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.207+0000 7f1068c1d640 1 -- 10.20.193.28:0/4269429211 --> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f1064161480 con 0x7f10380b5840 2026-02-24T09:17:26.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.208+0000 7f1060ff9640 1 -- 10.20.193.28:0/4269429211 <== mgr.14223 v2:10.20.193.28:6800/906910473 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f1064161480 con 0x7f10380b5840 2026-02-24T09:17:26.209 INFO:teuthology.orchestra.run.trial028.stdout:Backend: cephadm 2026-02-24T09:17:26.209 INFO:teuthology.orchestra.run.trial028.stdout:Available: Yes 2026-02-24T09:17:26.209 INFO:teuthology.orchestra.run.trial028.stdout:Paused: No 2026-02-24T09:17:26.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.209+0000 7f1068c1d640 1 -- 10.20.193.28:0/4269429211 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f10380b5840 msgr2=0x7f10380d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:26.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.209+0000 7f1068c1d640 1 --2- 10.20.193.28:0/4269429211 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f10380b5840 0x7f10380d5cf0 secure :-1 s=READY pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10500023b0 tx=0x7f105003a040 comp rx=0 tx=0).stop 2026-02-24T09:17:26.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.209+0000 7f1068c1d640 1 -- 10.20.193.28:0/4269429211 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f10641559d0 msgr2=0x7f1064165c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:26.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.209+0000 7f1068c1d640 1 --2- 10.20.193.28:0/4269429211 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f10641559d0 0x7f1064165c30 secure :-1 s=READY pgs=339 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f105800e720 tx=0x7f105800ebf0 comp rx=0 tx=0).stop 2026-02-24T09:17:26.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.209+0000 7f1068c1d640 1 -- 10.20.193.28:0/4269429211 shutdown_connections 2026-02-24T09:17:26.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.209+0000 7f1068c1d640 1 --2- 10.20.193.28:0/4269429211 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f10380b5840 0x7f10380d5cf0 unknown :-1 s=CLOSED pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:26.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.209+0000 7f1068c1d640 1 --2- 10.20.193.28:0/4269429211 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f10641559d0 0x7f1064165c30 unknown :-1 s=CLOSED pgs=339 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:26.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.209+0000 7f1068c1d640 1 --2- 10.20.193.28:0/4269429211 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f106410bcc0 0x7f10641608b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:26.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.209+0000 7f1068c1d640 1 --2- 10.20.193.28:0/4269429211 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f106410b3b0 0x7f1064160370 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:26.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.209+0000 7f1068c1d640 1 -- 10.20.193.28:0/4269429211 >> 10.20.193.28:0/4269429211 conn(0x7f10640e8e40 msgr2=0x7f1064109220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:26.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.210+0000 7f1068c1d640 1 -- 10.20.193.28:0/4269429211 shutdown_connections 2026-02-24T09:17:26.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.210+0000 7f1068c1d640 1 -- 10.20.193.28:0/4269429211 wait complete. 2026-02-24T09:17:26.279 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:26 trial159 ceph-mon[44242]: pgmap v193: 97 pgs: 97 active+clean; 645 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2026-02-24T09:17:26.308 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- bash -c 'ceph orch ps' 2026-02-24T09:17:26.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:25 trial074 ceph-mon[44412]: pgmap v193: 97 pgs: 97 active+clean; 645 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2026-02-24T09:17:26.491 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:26.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.667+0000 7f02269eb640 1 -- 10.20.193.28:0/1458591524 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f022010cc10 msgr2=0x7f0220111c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:26.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.667+0000 7f02269eb640 1 --2- 10.20.193.28:0/1458591524 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f022010cc10 0x7f0220111c60 secure :-1 s=READY pgs=340 gs=1 cs=0 l=1 c_cookie=15270477455374343172 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0214009950 tx=0x7f021402f190 comp rx=0 tx=0).stop 2026-02-24T09:17:26.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.667+0000 7f02269eb640 1 -- 10.20.193.28:0/1458591524 shutdown_connections 2026-02-24T09:17:26.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.667+0000 7f02269eb640 1 --2- 10.20.193.28:0/1458591524 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f0220112410 0x7f0220172de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:26.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.667+0000 7f02269eb640 1 --2- 10.20.193.28:0/1458591524 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f022010cc10 0x7f0220111c60 unknown :-1 s=CLOSED pgs=340 gs=1 cs=0 l=1 c_cookie=15270477455374343172 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:26.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.667+0000 7f02269eb640 1 --2- 10.20.193.28:0/1458591524 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f022010c220 0x7f022010c5f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:26.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.667+0000 7f02269eb640 1 -- 10.20.193.28:0/1458591524 >> 10.20.193.28:0/1458591524 conn(0x7f02200e9b70 msgr2=0x7f0220109f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:26.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.667+0000 7f02269eb640 1 -- 10.20.193.28:0/1458591524 shutdown_connections 2026-02-24T09:17:26.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.667+0000 7f02269eb640 1 -- 10.20.193.28:0/1458591524 wait complete. 2026-02-24T09:17:26.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.667+0000 7f02269eb640 1 Processor -- start 2026-02-24T09:17:26.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.668+0000 7f02269eb640 1 -- start start 2026-02-24T09:17:26.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.668+0000 7f02269eb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f022010c220 0x7f02200f4240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:26.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.668+0000 7f02269eb640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f022010cc10 0x7f0220172ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:26.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.668+0000 7f02269eb640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f0220112410 0x7f02200f4940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:26.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.668+0000 7f02269eb640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f02200f9b50 con 0x7f022010c220 2026-02-24T09:17:26.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.668+0000 7f02269eb640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f02200f9cc0 con 0x7f0220112410 2026-02-24T09:17:26.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.668+0000 7f02269eb640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f02200f9e80 con 0x7f022010cc10 2026-02-24T09:17:26.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.668+0000 7f02259e9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f022010c220 0x7f02200f4240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:26.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.668+0000 7f02259e9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f022010c220 0x7f02200f4240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40656/0 (socket says 10.20.193.28:40656) 2026-02-24T09:17:26.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.668+0000 7f02259e9640 1 -- 10.20.193.28:0/1952776905 learned_addr learned my addr 10.20.193.28:0/1952776905 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:26.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.668+0000 7f02251e8640 1 --2- 10.20.193.28:0/1952776905 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f022010cc10 0x7f0220172ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:26.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.668+0000 7f02261ea640 1 --2- 10.20.193.28:0/1952776905 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f0220112410 0x7f02200f4940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:26.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.668+0000 7f02259e9640 1 -- 10.20.193.28:0/1952776905 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f022010cc10 msgr2=0x7f0220172ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:26.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.668+0000 7f02259e9640 1 --2- 10.20.193.28:0/1952776905 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f022010cc10 0x7f0220172ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:26.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.668+0000 7f02259e9640 1 -- 10.20.193.28:0/1952776905 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f0220112410 msgr2=0x7f02200f4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:26.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.668+0000 7f02259e9640 1 --2- 10.20.193.28:0/1952776905 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f0220112410 0x7f02200f4940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:26.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.668+0000 7f02259e9640 1 -- 10.20.193.28:0/1952776905 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0214009570 con 0x7f022010c220 2026-02-24T09:17:26.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.668+0000 7f02251e8640 1 --2- 10.20.193.28:0/1952776905 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f022010cc10 0x7f0220172ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:17:26.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.669+0000 7f02259e9640 1 --2- 10.20.193.28:0/1952776905 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f022010c220 0x7f02200f4240 secure :-1 s=READY pgs=341 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f021000d950 tx=0x7f021000de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:26.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.669+0000 7f020effd640 1 -- 10.20.193.28:0/1952776905 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0210004540 con 0x7f022010c220 2026-02-24T09:17:26.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.669+0000 7f020effd640 1 -- 10.20.193.28:0/1952776905 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f0210009ce0 con 0x7f022010c220 2026-02-24T09:17:26.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.669+0000 7f02269eb640 1 -- 10.20.193.28:0/1952776905 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02200fa160 con 0x7f022010c220 2026-02-24T09:17:26.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.669+0000 7f02269eb640 1 -- 10.20.193.28:0/1952776905 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02200fa680 con 0x7f022010c220 2026-02-24T09:17:26.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.669+0000 7f020effd640 1 -- 10.20.193.28:0/1952776905 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f02100106e0 con 0x7f022010c220 2026-02-24T09:17:26.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.670+0000 7f020cff9640 1 -- 10.20.193.28:0/1952776905 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02200fa9b0 con 0x7f022010c220 2026-02-24T09:17:26.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.673+0000 7f020effd640 1 -- 10.20.193.28:0/1952776905 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f02100097c0 con 0x7f022010c220 2026-02-24T09:17:26.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.674+0000 7f020effd640 1 --2- 10.20.193.28:0/1952776905 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f01fc0b5830 0x7f01fc0d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:26.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.674+0000 7f020effd640 1 -- 10.20.193.28:0/1952776905 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f02100e7030 con 0x7f022010c220 2026-02-24T09:17:26.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.674+0000 7f02251e8640 1 --2- 10.20.193.28:0/1952776905 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f01fc0b5830 0x7f01fc0d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:26.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.674+0000 7f020effd640 1 -- 10.20.193.28:0/1952776905 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f02100e7520 con 0x7f022010c220 2026-02-24T09:17:26.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.675+0000 7f02251e8640 1 --2- 10.20.193.28:0/1952776905 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f01fc0b5830 0x7f01fc0d5ce0 secure :-1 s=READY pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02140023d0 tx=0x7f0214031040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:26.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.793+0000 7f020cff9640 1 -- 10.20.193.28:0/1952776905 --> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f02200f53a0 con 0x7f01fc0b5830 2026-02-24T09:17:26.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.799+0000 7f020effd640 1 -- 10.20.193.28:0/1952776905 <== mgr.14223 v2:10.20.193.28:6800/906910473 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7f02200f53a0 con 0x7f01fc0b5830 2026-02-24T09:17:26.801 INFO:teuthology.orchestra.run.trial028.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-24T09:17:26.801 INFO:teuthology.orchestra.run.trial028.stdout:mds.a trial028 running (34s) 29s ago 33s 13.4M - 20.3.0-5537-g5bc9a1ff 5573ff5fc120 43cb11de53de 2026-02-24T09:17:26.801 INFO:teuthology.orchestra.run.trial028.stdout:mds.b trial074 running (32s) 29s ago 32s 13.5M - 20.3.0-5537-g5bc9a1ff 5573ff5fc120 5667a6cc81df 2026-02-24T09:17:26.801 INFO:teuthology.orchestra.run.trial028.stdout:mds.c trial159 running (39s) 29s ago 39s 13.7M - 20.3.0-5537-g5bc9a1ff 5573ff5fc120 eccb225062f0 2026-02-24T09:17:26.801 INFO:teuthology.orchestra.run.trial028.stdout:mds.d trial028 running (42s) 29s ago 42s 13.5M - 20.3.0-5537-g5bc9a1ff 5573ff5fc120 58d73f612dc1 2026-02-24T09:17:26.801 INFO:teuthology.orchestra.run.trial028.stdout:mds.e trial074 running (41s) 29s ago 41s 13.3M - 20.3.0-5537-g5bc9a1ff 5573ff5fc120 cc859768621f 2026-02-24T09:17:26.801 INFO:teuthology.orchestra.run.trial028.stdout:mds.f trial159 running (40s) 29s ago 40s 13.8M - 20.3.0-5537-g5bc9a1ff 5573ff5fc120 a30a19c3bc77 2026-02-24T09:17:26.801 INFO:teuthology.orchestra.run.trial028.stdout:mds.g trial028 running (35s) 29s ago 35s 13.6M - 20.3.0-5537-g5bc9a1ff 5573ff5fc120 9713d8f0c295 2026-02-24T09:17:26.801 INFO:teuthology.orchestra.run.trial028.stdout:mds.h trial074 running (37s) 29s ago 37s 13.3M - 20.3.0-5537-g5bc9a1ff 5573ff5fc120 29fc54210882 2026-02-24T09:17:26.802 INFO:teuthology.orchestra.run.trial028.stdout:mds.i trial159 running (36s) 29s ago 36s 13.8M - 20.3.0-5537-g5bc9a1ff 5573ff5fc120 ecfd3c16b347 2026-02-24T09:17:26.802 INFO:teuthology.orchestra.run.trial028.stdout:mds.j trial028 running (44s) 29s ago 43s 13.5M - 20.3.0-5537-g5bc9a1ff 5573ff5fc120 66f9feb3dffc 2026-02-24T09:17:26.802 INFO:teuthology.orchestra.run.trial028.stdout:mds.k trial074 running (45s) 29s ago 45s 13.9M - 20.3.0-5537-g5bc9a1ff 5573ff5fc120 770bcb83261f 2026-02-24T09:17:26.802 INFO:teuthology.orchestra.run.trial028.stdout:mds.l trial159 running (46s) 29s ago 46s 14.3M - 20.3.0-5537-g5bc9a1ff 5573ff5fc120 946a22caf596 2026-02-24T09:17:26.802 INFO:teuthology.orchestra.run.trial028.stdout:mgr.x trial028 *:9283,8765 running (4m) 29s ago 4m 563M - 20.3.0-5537-g5bc9a1ff 5573ff5fc120 1e11c7f0ee80 2026-02-24T09:17:26.802 INFO:teuthology.orchestra.run.trial028.stdout:mgr.y trial074 *:8443,8765 running (3m) 29s ago 3m 497M - 20.3.0-5537-g5bc9a1ff 5573ff5fc120 03163885a70e 2026-02-24T09:17:26.802 INFO:teuthology.orchestra.run.trial028.stdout:mgr.z trial159 *:8443,8765 running (3m) 29s ago 3m 496M - 20.3.0-5537-g5bc9a1ff 5573ff5fc120 be3c8d53ef6c 2026-02-24T09:17:26.802 INFO:teuthology.orchestra.run.trial028.stdout:mon.a trial028 running (4m) 29s ago 4m 57.1M 2048M 20.3.0-5537-g5bc9a1ff 5573ff5fc120 5f849c008983 2026-02-24T09:17:26.802 INFO:teuthology.orchestra.run.trial028.stdout:mon.b trial074 running (4m) 29s ago 4m 48.9M 2048M 20.3.0-5537-g5bc9a1ff 5573ff5fc120 53b93562cdbc 2026-02-24T09:17:26.802 INFO:teuthology.orchestra.run.trial028.stdout:mon.c trial159 running (4m) 29s ago 4m 48.8M 2048M 20.3.0-5537-g5bc9a1ff 5573ff5fc120 6c87cc974a4b 2026-02-24T09:17:26.802 INFO:teuthology.orchestra.run.trial028.stdout:osd.0 trial028 running (3m) 29s ago 3m 45.2M 20.5G 20.3.0-5537-g5bc9a1ff 5573ff5fc120 63613c52ffba 2026-02-24T09:17:26.802 INFO:teuthology.orchestra.run.trial028.stdout:osd.1 trial074 running (3m) 29s ago 3m 47.8M 20.5G 20.3.0-5537-g5bc9a1ff 5573ff5fc120 566bc4e692ec 2026-02-24T09:17:26.802 INFO:teuthology.orchestra.run.trial028.stdout:osd.2 trial159 running (2m) 29s ago 3m 46.3M 20.5G 20.3.0-5537-g5bc9a1ff 5573ff5fc120 3bf50f93b569 2026-02-24T09:17:26.803 INFO:teuthology.orchestra.run.trial028.stdout:osd.3 trial028 running (2m) 29s ago 2m 44.8M 20.5G 20.3.0-5537-g5bc9a1ff 5573ff5fc120 1194e7313aee 2026-02-24T09:17:26.803 INFO:teuthology.orchestra.run.trial028.stdout:osd.4 trial074 running (2m) 29s ago 2m 42.9M 20.5G 20.3.0-5537-g5bc9a1ff 5573ff5fc120 64083cadad93 2026-02-24T09:17:26.803 INFO:teuthology.orchestra.run.trial028.stdout:osd.5 trial159 running (2m) 29s ago 2m 46.6M 20.5G 20.3.0-5537-g5bc9a1ff 5573ff5fc120 6acdf2ab6e3b 2026-02-24T09:17:26.803 INFO:teuthology.orchestra.run.trial028.stdout:osd.6 trial028 running (2m) 29s ago 2m 41.8M 20.5G 20.3.0-5537-g5bc9a1ff 5573ff5fc120 a1f1a8c77620 2026-02-24T09:17:26.803 INFO:teuthology.orchestra.run.trial028.stdout:osd.7 trial074 running (110s) 29s ago 113s 45.3M 20.5G 20.3.0-5537-g5bc9a1ff 5573ff5fc120 011efe206520 2026-02-24T09:17:26.803 INFO:teuthology.orchestra.run.trial028.stdout:osd.8 trial159 running (96s) 29s ago 100s 44.6M 20.5G 20.3.0-5537-g5bc9a1ff 5573ff5fc120 ed054192455a 2026-02-24T09:17:26.803 INFO:teuthology.orchestra.run.trial028.stdout:osd.9 trial028 running (83s) 29s ago 86s 41.5M 20.5G 20.3.0-5537-g5bc9a1ff 5573ff5fc120 394049a480bc 2026-02-24T09:17:26.803 INFO:teuthology.orchestra.run.trial028.stdout:osd.10 trial074 running (70s) 29s ago 73s 45.9M 20.5G 20.3.0-5537-g5bc9a1ff 5573ff5fc120 6a1ec3feaa90 2026-02-24T09:17:26.803 INFO:teuthology.orchestra.run.trial028.stdout:osd.11 trial159 running (56s) 29s ago 59s 41.5M 20.5G 20.3.0-5537-g5bc9a1ff 5573ff5fc120 afba6e97fa15 2026-02-24T09:17:26.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.801+0000 7f020cff9640 1 -- 10.20.193.28:0/1952776905 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f01fc0b5830 msgr2=0x7f01fc0d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:26.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.801+0000 7f020cff9640 1 --2- 10.20.193.28:0/1952776905 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f01fc0b5830 0x7f01fc0d5ce0 secure :-1 s=READY pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02140023d0 tx=0x7f0214031040 comp rx=0 tx=0).stop 2026-02-24T09:17:26.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.801+0000 7f020cff9640 1 -- 10.20.193.28:0/1952776905 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f022010c220 msgr2=0x7f02200f4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:26.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.801+0000 7f020cff9640 1 --2- 10.20.193.28:0/1952776905 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f022010c220 0x7f02200f4240 secure :-1 s=READY pgs=341 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f021000d950 tx=0x7f021000de20 comp rx=0 tx=0).stop 2026-02-24T09:17:26.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.801+0000 7f020cff9640 1 -- 10.20.193.28:0/1952776905 shutdown_connections 2026-02-24T09:17:26.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.801+0000 7f020cff9640 1 --2- 10.20.193.28:0/1952776905 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f01fc0b5830 0x7f01fc0d5ce0 unknown :-1 s=CLOSED pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:26.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.801+0000 7f020cff9640 1 --2- 10.20.193.28:0/1952776905 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f0220112410 0x7f02200f4940 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:26.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.801+0000 7f020cff9640 1 --2- 10.20.193.28:0/1952776905 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f022010cc10 0x7f0220172ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:26.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.801+0000 7f020cff9640 1 --2- 10.20.193.28:0/1952776905 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f022010c220 0x7f02200f4240 unknown :-1 s=CLOSED pgs=341 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:26.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.801+0000 7f020cff9640 1 -- 10.20.193.28:0/1952776905 >> 10.20.193.28:0/1952776905 conn(0x7f02200e9b70 msgr2=0x7f022010fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:26.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.801+0000 7f020cff9640 1 -- 10.20.193.28:0/1952776905 shutdown_connections 2026-02-24T09:17:26.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:26.801+0000 7f020cff9640 1 -- 10.20.193.28:0/1952776905 wait complete. 2026-02-24T09:17:26.904 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- bash -c 'ceph orch ls' 2026-02-24T09:17:27.089 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:27.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:27 trial028 ceph-mon[40371]: from='client.15366 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:27.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.266+0000 7f38212da640 1 -- 10.20.193.28:0/3642669091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f381c10b2d0 msgr2=0x7f381c10b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:27.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.266+0000 7f38212da640 1 --2- 10.20.193.28:0/3642669091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f381c10b2d0 0x7f381c10b6a0 secure :-1 s=READY pgs=342 gs=1 cs=0 l=1 c_cookie=7006814357964502257 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3808009950 tx=0x7f380802f190 comp rx=0 tx=0).stop 2026-02-24T09:17:27.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.266+0000 7f38212da640 1 -- 10.20.193.28:0/3642669091 shutdown_connections 2026-02-24T09:17:27.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.266+0000 7f38212da640 1 --2- 10.20.193.28:0/3642669091 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f381c1112e0 0x7f381c111cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:27.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.266+0000 7f38212da640 1 --2- 10.20.193.28:0/3642669091 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f381c10bcc0 0x7f381c110b50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:27.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.266+0000 7f38212da640 1 --2- 10.20.193.28:0/3642669091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f381c10b2d0 0x7f381c10b6a0 unknown :-1 s=CLOSED pgs=342 gs=1 cs=0 l=1 c_cookie=7006814357964502257 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:27.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.266+0000 7f38212da640 1 -- 10.20.193.28:0/3642669091 >> 10.20.193.28:0/3642669091 conn(0x7f381c0e8e40 msgr2=0x7f381c109250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:27.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.266+0000 7f38212da640 1 -- 10.20.193.28:0/3642669091 shutdown_connections 2026-02-24T09:17:27.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.266+0000 7f38212da640 1 -- 10.20.193.28:0/3642669091 wait complete. 2026-02-24T09:17:27.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.267+0000 7f38212da640 1 Processor -- start 2026-02-24T09:17:27.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.267+0000 7f38212da640 1 -- start start 2026-02-24T09:17:27.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.267+0000 7f38212da640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f381c10b2d0 0x7f381c1235d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:27.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.267+0000 7f38212da640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f381c10bcc0 0x7f381c123b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:27.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.267+0000 7f38212da640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f381c1112e0 0x7f381c128ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:27.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.267+0000 7f38212da640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f381c129500 con 0x7f381c1112e0 2026-02-24T09:17:27.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.267+0000 7f38212da640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f381c129670 con 0x7f381c10bcc0 2026-02-24T09:17:27.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.267+0000 7f38212da640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f381c129830 con 0x7f381c10b2d0 2026-02-24T09:17:27.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.267+0000 7f381bfff640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f381c10b2d0 0x7f381c1235d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:27.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.267+0000 7f3820ad9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f381c1112e0 0x7f381c128ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:27.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.267+0000 7f381bfff640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f381c10b2d0 0x7f381c1235d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:47580/0 (socket says 10.20.193.28:47580) 2026-02-24T09:17:27.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.267+0000 7f381bfff640 1 -- 10.20.193.28:0/3433591399 learned_addr learned my addr 10.20.193.28:0/3433591399 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:27.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.267+0000 7f381b7fe640 1 --2- 10.20.193.28:0/3433591399 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f381c10bcc0 0x7f381c123b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:27.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.268+0000 7f381bfff640 1 -- 10.20.193.28:0/3433591399 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f381c10bcc0 msgr2=0x7f381c123b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:27.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.268+0000 7f381bfff640 1 --2- 10.20.193.28:0/3433591399 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f381c10bcc0 0x7f381c123b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:27.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.268+0000 7f381bfff640 1 -- 10.20.193.28:0/3433591399 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f381c1112e0 msgr2=0x7f381c128ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:27.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.268+0000 7f381bfff640 1 --2- 10.20.193.28:0/3433591399 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f381c1112e0 0x7f381c128ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:27.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.268+0000 7f381bfff640 1 -- 10.20.193.28:0/3433591399 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3808009570 con 0x7f381c10b2d0 2026-02-24T09:17:27.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.268+0000 7f3820ad9640 1 --2- 10.20.193.28:0/3433591399 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f381c1112e0 0x7f381c128ee0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:17:27.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.268+0000 7f381bfff640 1 --2- 10.20.193.28:0/3433591399 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f381c10b2d0 0x7f381c1235d0 secure :-1 s=READY pgs=107 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38080098a0 tx=0x7f38080028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:27.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.268+0000 7f38197fa640 1 -- 10.20.193.28:0/3433591399 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f380803d070 con 0x7f381c10b2d0 2026-02-24T09:17:27.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.268+0000 7f38212da640 1 -- 10.20.193.28:0/3433591399 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f381c129ab0 con 0x7f381c10b2d0 2026-02-24T09:17:27.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.268+0000 7f38197fa640 1 -- 10.20.193.28:0/3433591399 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3808002a40 con 0x7f381c10b2d0 2026-02-24T09:17:27.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.268+0000 7f38197fa640 1 -- 10.20.193.28:0/3433591399 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3808041720 con 0x7f381c10b2d0 2026-02-24T09:17:27.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.268+0000 7f38212da640 1 -- 10.20.193.28:0/3433591399 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f381c16a210 con 0x7f381c10b2d0 2026-02-24T09:17:27.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.269+0000 7f38212da640 1 -- 10.20.193.28:0/3433591399 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f381c10c3f0 con 0x7f381c10b2d0 2026-02-24T09:17:27.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.271+0000 7f38197fa640 1 -- 10.20.193.28:0/3433591399 <== mon.1 v2:10.20.193.159:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f38080386a0 con 0x7f381c10b2d0 2026-02-24T09:17:27.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.273+0000 7f38197fa640 1 --2- 10.20.193.28:0/3433591399 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f37f00b5840 0x7f37f00d5cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:27.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.273+0000 7f38197fa640 1 -- 10.20.193.28:0/3433591399 <== mon.1 v2:10.20.193.159:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f380810b330 con 0x7f381c10b2d0 2026-02-24T09:17:27.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.273+0000 7f381b7fe640 1 --2- 10.20.193.28:0/3433591399 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f37f00b5840 0x7f37f00d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:27.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.273+0000 7f38197fa640 1 -- 10.20.193.28:0/3433591399 <== mon.1 v2:10.20.193.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f380810b7b0 con 0x7f381c10b2d0 2026-02-24T09:17:27.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.273+0000 7f381b7fe640 1 --2- 10.20.193.28:0/3433591399 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f37f00b5840 0x7f37f00d5cf0 secure :-1 s=READY pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f381c129f70 tx=0x7f380c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:27.279 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:27 trial159 ceph-mon[44242]: from='client.15366 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:27.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:27 trial074 ceph-mon[44412]: from='client.15366 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:27.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.395+0000 7f38212da640 1 -- 10.20.193.28:0/3433591399 --> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f381c124730 con 0x7f37f00b5840 2026-02-24T09:17:27.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.398+0000 7f38197fa640 1 -- 10.20.193.28:0/3433591399 <== mgr.14223 v2:10.20.193.28:6800/906910473 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+940 (secure 0 0 0) 0x7f381c124730 con 0x7f37f00b5840 2026-02-24T09:17:27.399 INFO:teuthology.orchestra.run.trial028.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2026-02-24T09:17:27.399 INFO:teuthology.orchestra.run.trial028.stdout:mds.all 12/12 30s ago 50s trial028=a;trial028=d;trial028=g;trial028=j;trial074=b;trial074=e;trial074=h;trial074=k;trial159=c;trial159=f;trial159=i;trial159=l;count:12 2026-02-24T09:17:27.399 INFO:teuthology.orchestra.run.trial028.stdout:mgr 3/3 30s ago 3m trial028=x;trial074=y;trial159=z;count:3 2026-02-24T09:17:27.399 INFO:teuthology.orchestra.run.trial028.stdout:mon 3/3 30s ago 4m trial028:10.20.193.28=a;trial074:10.20.193.74=b;trial159:10.20.193.159=c;count:3 2026-02-24T09:17:27.399 INFO:teuthology.orchestra.run.trial028.stdout:osd.default 12 30s ago 68s trial159 2026-02-24T09:17:27.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.399+0000 7f38212da640 1 -- 10.20.193.28:0/3433591399 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f37f00b5840 msgr2=0x7f37f00d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:27.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.399+0000 7f38212da640 1 --2- 10.20.193.28:0/3433591399 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f37f00b5840 0x7f37f00d5cf0 secure :-1 s=READY pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f381c129f70 tx=0x7f380c005f90 comp rx=0 tx=0).stop 2026-02-24T09:17:27.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.399+0000 7f38212da640 1 -- 10.20.193.28:0/3433591399 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f381c10b2d0 msgr2=0x7f381c1235d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:27.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.399+0000 7f38212da640 1 --2- 10.20.193.28:0/3433591399 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f381c10b2d0 0x7f381c1235d0 secure :-1 s=READY pgs=107 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38080098a0 tx=0x7f38080028d0 comp rx=0 tx=0).stop 2026-02-24T09:17:27.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.399+0000 7f38212da640 1 -- 10.20.193.28:0/3433591399 shutdown_connections 2026-02-24T09:17:27.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.399+0000 7f38212da640 1 --2- 10.20.193.28:0/3433591399 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f37f00b5840 0x7f37f00d5cf0 unknown :-1 s=CLOSED pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:27.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.399+0000 7f38212da640 1 --2- 10.20.193.28:0/3433591399 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f381c1112e0 0x7f381c128ee0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:27.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.399+0000 7f38212da640 1 --2- 10.20.193.28:0/3433591399 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f381c10bcc0 0x7f381c123b10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:27.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.399+0000 7f38212da640 1 --2- 10.20.193.28:0/3433591399 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f381c10b2d0 0x7f381c1235d0 unknown :-1 s=CLOSED pgs=107 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:27.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.399+0000 7f38212da640 1 -- 10.20.193.28:0/3433591399 >> 10.20.193.28:0/3433591399 conn(0x7f381c0e8e40 msgr2=0x7f381c109220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:27.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.399+0000 7f38212da640 1 -- 10.20.193.28:0/3433591399 shutdown_connections 2026-02-24T09:17:27.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.400+0000 7f38212da640 1 -- 10.20.193.28:0/3433591399 wait complete. 2026-02-24T09:17:27.502 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- bash -c 'ceph orch host ls' 2026-02-24T09:17:27.685 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:27.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.858+0000 7f2c5106a640 1 -- 10.20.193.28:0/1858813065 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2c4c118a40 msgr2=0x7f2c4c11da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:27.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.858+0000 7f2c5106a640 1 --2- 10.20.193.28:0/1858813065 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2c4c118a40 0x7f2c4c11da90 secure :-1 s=READY pgs=343 gs=1 cs=0 l=1 c_cookie=6464663205438367323 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c34009950 tx=0x7f2c3402f190 comp rx=0 tx=0).stop 2026-02-24T09:17:27.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.858+0000 7f2c5106a640 1 -- 10.20.193.28:0/1858813065 shutdown_connections 2026-02-24T09:17:27.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.858+0000 7f2c5106a640 1 --2- 10.20.193.28:0/1858813065 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f2c4c11e240 0x7f2c4c17ec10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:27.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.858+0000 7f2c5106a640 1 --2- 10.20.193.28:0/1858813065 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2c4c118a40 0x7f2c4c11da90 unknown :-1 s=CLOSED pgs=343 gs=1 cs=0 l=1 c_cookie=6464663205438367323 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:27.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.858+0000 7f2c5106a640 1 --2- 10.20.193.28:0/1858813065 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2c4c118050 0x7f2c4c118420 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:27.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.858+0000 7f2c5106a640 1 -- 10.20.193.28:0/1858813065 >> 10.20.193.28:0/1858813065 conn(0x7f2c4c0f5960 msgr2=0x7f2c4c115d70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:27.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.858+0000 7f2c5106a640 1 -- 10.20.193.28:0/1858813065 shutdown_connections 2026-02-24T09:17:27.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.858+0000 7f2c5106a640 1 -- 10.20.193.28:0/1858813065 wait complete. 2026-02-24T09:17:27.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.859+0000 7f2c5106a640 1 Processor -- start 2026-02-24T09:17:27.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.859+0000 7f2c5106a640 1 -- start start 2026-02-24T09:17:27.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.859+0000 7f2c5106a640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f2c4c118050 0x7f2c4c0fe370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:27.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.859+0000 7f2c5106a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2c4c118a40 0x7f2c4c17eb10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:27.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.859+0000 7f2c5106a640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2c4c11e240 0x7f2c4c0fea70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:27.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.859+0000 7f2c5106a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4c103c80 con 0x7f2c4c118a40 2026-02-24T09:17:27.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.859+0000 7f2c5106a640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4c103df0 con 0x7f2c4c11e240 2026-02-24T09:17:27.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.859+0000 7f2c5106a640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4c103fb0 con 0x7f2c4c118050 2026-02-24T09:17:27.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.859+0000 7f2c4a575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2c4c118a40 0x7f2c4c17eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:27.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.859+0000 7f2c4a575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2c4c118a40 0x7f2c4c17eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43406/0 (socket says 10.20.193.28:43406) 2026-02-24T09:17:27.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.859+0000 7f2c4a575640 1 -- 10.20.193.28:0/3837449116 learned_addr learned my addr 10.20.193.28:0/3837449116 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:27.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.859+0000 7f2c4b577640 1 --2- 10.20.193.28:0/3837449116 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2c4c11e240 0x7f2c4c0fea70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:27.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.859+0000 7f2c4ad76640 1 --2- 10.20.193.28:0/3837449116 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f2c4c118050 0x7f2c4c0fe370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:27.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.860+0000 7f2c4a575640 1 -- 10.20.193.28:0/3837449116 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f2c4c118050 msgr2=0x7f2c4c0fe370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:27.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.860+0000 7f2c4a575640 1 --2- 10.20.193.28:0/3837449116 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f2c4c118050 0x7f2c4c0fe370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:27.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.860+0000 7f2c4a575640 1 -- 10.20.193.28:0/3837449116 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2c4c11e240 msgr2=0x7f2c4c0fea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:27.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.860+0000 7f2c4a575640 1 --2- 10.20.193.28:0/3837449116 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2c4c11e240 0x7f2c4c0fea70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:27.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.860+0000 7f2c4a575640 1 -- 10.20.193.28:0/3837449116 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c34009570 con 0x7f2c4c118a40 2026-02-24T09:17:27.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.860+0000 7f2c4a575640 1 --2- 10.20.193.28:0/3837449116 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2c4c118a40 0x7f2c4c17eb10 secure :-1 s=READY pgs=344 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c340098a0 tx=0x7f2c340028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:27.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.860+0000 7f2c2bfff640 1 -- 10.20.193.28:0/3837449116 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2c3403d070 con 0x7f2c4c118a40 2026-02-24T09:17:27.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.860+0000 7f2c2bfff640 1 -- 10.20.193.28:0/3837449116 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2c34002a70 con 0x7f2c4c118a40 2026-02-24T09:17:27.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.860+0000 7f2c2bfff640 1 -- 10.20.193.28:0/3837449116 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2c34041890 con 0x7f2c4c118a40 2026-02-24T09:17:27.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.860+0000 7f2c5106a640 1 -- 10.20.193.28:0/3837449116 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c4c104230 con 0x7f2c4c118a40 2026-02-24T09:17:27.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.860+0000 7f2c5106a640 1 -- 10.20.193.28:0/3837449116 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c4c104650 con 0x7f2c4c118a40 2026-02-24T09:17:27.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.861+0000 7f2c5106a640 1 -- 10.20.193.28:0/3837449116 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c10005300 con 0x7f2c4c118a40 2026-02-24T09:17:27.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.863+0000 7f2c2bfff640 1 -- 10.20.193.28:0/3837449116 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f2c34041a20 con 0x7f2c4c118a40 2026-02-24T09:17:27.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.864+0000 7f2c2bfff640 1 --2- 10.20.193.28:0/3837449116 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f2c200b5830 0x7f2c200d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:27.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.864+0000 7f2c2bfff640 1 -- 10.20.193.28:0/3837449116 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f2c3410b630 con 0x7f2c4c118a40 2026-02-24T09:17:27.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.864+0000 7f2c2bfff640 1 -- 10.20.193.28:0/3837449116 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f2c3410bab0 con 0x7f2c4c118a40 2026-02-24T09:17:27.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.865+0000 7f2c4ad76640 1 --2- 10.20.193.28:0/3837449116 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f2c200b5830 0x7f2c200d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:27.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.865+0000 7f2c4ad76640 1 --2- 10.20.193.28:0/3837449116 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f2c200b5830 0x7f2c200d5ce0 secure :-1 s=READY pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c40004740 tx=0x7f2c40004420 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:27.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.983+0000 7f2c5106a640 1 -- 10.20.193.28:0/3837449116 --> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f2c10002bb0 con 0x7f2c200b5830 2026-02-24T09:17:27.985 INFO:teuthology.orchestra.run.trial028.stdout:HOST ADDR LABELS STATUS 2026-02-24T09:17:27.985 INFO:teuthology.orchestra.run.trial028.stdout:trial028 10.20.193.28 2026-02-24T09:17:27.985 INFO:teuthology.orchestra.run.trial028.stdout:trial074 10.20.193.74 2026-02-24T09:17:27.985 INFO:teuthology.orchestra.run.trial028.stdout:trial159 10.20.193.159 2026-02-24T09:17:27.985 INFO:teuthology.orchestra.run.trial028.stdout:3 hosts in cluster 2026-02-24T09:17:27.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.984+0000 7f2c2bfff640 1 -- 10.20.193.28:0/3837449116 <== mgr.14223 v2:10.20.193.28:6800/906910473 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+187 (secure 0 0 0) 0x7f2c10002bb0 con 0x7f2c200b5830 2026-02-24T09:17:27.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.985+0000 7f2c5106a640 1 -- 10.20.193.28:0/3837449116 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f2c200b5830 msgr2=0x7f2c200d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:27.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.985+0000 7f2c5106a640 1 --2- 10.20.193.28:0/3837449116 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f2c200b5830 0x7f2c200d5ce0 secure :-1 s=READY pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c40004740 tx=0x7f2c40004420 comp rx=0 tx=0).stop 2026-02-24T09:17:27.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.985+0000 7f2c5106a640 1 -- 10.20.193.28:0/3837449116 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2c4c118a40 msgr2=0x7f2c4c17eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:27.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.985+0000 7f2c5106a640 1 --2- 10.20.193.28:0/3837449116 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2c4c118a40 0x7f2c4c17eb10 secure :-1 s=READY pgs=344 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c340098a0 tx=0x7f2c340028d0 comp rx=0 tx=0).stop 2026-02-24T09:17:27.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.985+0000 7f2c5106a640 1 -- 10.20.193.28:0/3837449116 shutdown_connections 2026-02-24T09:17:27.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.985+0000 7f2c5106a640 1 --2- 10.20.193.28:0/3837449116 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f2c200b5830 0x7f2c200d5ce0 unknown :-1 s=CLOSED pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:27.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.985+0000 7f2c5106a640 1 --2- 10.20.193.28:0/3837449116 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2c4c11e240 0x7f2c4c0fea70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:27.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.985+0000 7f2c5106a640 1 --2- 10.20.193.28:0/3837449116 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2c4c118a40 0x7f2c4c17eb10 unknown :-1 s=CLOSED pgs=344 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:27.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.985+0000 7f2c5106a640 1 --2- 10.20.193.28:0/3837449116 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f2c4c118050 0x7f2c4c0fe370 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:27.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.985+0000 7f2c5106a640 1 -- 10.20.193.28:0/3837449116 >> 10.20.193.28:0/3837449116 conn(0x7f2c4c0f5960 msgr2=0x7f2c4c11b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:27.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.985+0000 7f2c5106a640 1 -- 10.20.193.28:0/3837449116 shutdown_connections 2026-02-24T09:17:27.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:27.985+0000 7f2c5106a640 1 -- 10.20.193.28:0/3837449116 wait complete. 2026-02-24T09:17:28.085 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- bash -c 'ceph orch device ls' 2026-02-24T09:17:28.270 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:28.279 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:28 trial159 ceph-mon[44242]: from='client.15372 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:28.279 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:28 trial159 ceph-mon[44242]: pgmap v194: 97 pgs: 97 active+clean; 648 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2026-02-24T09:17:28.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:28 trial159 ceph-mon[44242]: from='client.25141 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:28.315 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:28 trial028 ceph-mon[40371]: from='client.15372 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:28.315 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:28 trial028 ceph-mon[40371]: pgmap v194: 97 pgs: 97 active+clean; 648 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2026-02-24T09:17:28.316 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:28 trial028 ceph-mon[40371]: from='client.25141 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:28.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:28 trial074 ceph-mon[44412]: from='client.15372 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:28.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:28 trial074 ceph-mon[44412]: pgmap v194: 97 pgs: 97 active+clean; 648 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2026-02-24T09:17:28.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:28 trial074 ceph-mon[44412]: from='client.25141 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:28.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.462+0000 7f5ef3b3c640 1 -- 10.20.193.28:0/3448616806 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5eec10c300 msgr2=0x7f5eec10c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:28.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.462+0000 7f5ef3b3c640 1 --2- 10.20.193.28:0/3448616806 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5eec10c300 0x7f5eec10c6d0 secure :-1 s=READY pgs=345 gs=1 cs=0 l=1 c_cookie=5870284513324476328 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5edc009950 tx=0x7f5edc02f190 comp rx=0 tx=0).stop 2026-02-24T09:17:28.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.462+0000 7f5ef3b3c640 1 -- 10.20.193.28:0/3448616806 shutdown_connections 2026-02-24T09:17:28.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.462+0000 7f5ef3b3c640 1 --2- 10.20.193.28:0/3448616806 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5eec1124f0 0x7f5eec172ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:28.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.462+0000 7f5ef3b3c640 1 --2- 10.20.193.28:0/3448616806 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5eec10ccf0 0x7f5eec111d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:28.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.462+0000 7f5ef3b3c640 1 --2- 10.20.193.28:0/3448616806 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5eec10c300 0x7f5eec10c6d0 unknown :-1 s=CLOSED pgs=345 gs=1 cs=0 l=1 c_cookie=5870284513324476328 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:28.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.462+0000 7f5ef3b3c640 1 -- 10.20.193.28:0/3448616806 >> 10.20.193.28:0/3448616806 conn(0x7f5eec0e9bf0 msgr2=0x7f5eec10a000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:28.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.462+0000 7f5ef3b3c640 1 -- 10.20.193.28:0/3448616806 shutdown_connections 2026-02-24T09:17:28.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.463+0000 7f5ef3b3c640 1 -- 10.20.193.28:0/3448616806 wait complete. 2026-02-24T09:17:28.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.463+0000 7f5ef3b3c640 1 Processor -- start 2026-02-24T09:17:28.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.463+0000 7f5ef3b3c640 1 -- start start 2026-02-24T09:17:28.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.464+0000 7f5ef3b3c640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5eec10c300 0x7f5eec0f4860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:28.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.464+0000 7f5ef3b3c640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5eec10ccf0 0x7f5eec172dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:28.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.464+0000 7f5ef3b3c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5eec1124f0 0x7f5eec0f4f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:28.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.464+0000 7f5ef3b3c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5eec0fa170 con 0x7f5eec1124f0 2026-02-24T09:17:28.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.464+0000 7f5ef3b3c640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f5eec0fa2e0 con 0x7f5eec10c300 2026-02-24T09:17:28.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.464+0000 7f5ef3b3c640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5eec0fa4a0 con 0x7f5eec10ccf0 2026-02-24T09:17:28.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.464+0000 7f5ef20b2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5eec1124f0 0x7f5eec0f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:28.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.464+0000 7f5ef18b1640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5eec10c300 0x7f5eec0f4860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:28.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.464+0000 7f5ef20b2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5eec1124f0 0x7f5eec0f4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43420/0 (socket says 10.20.193.28:43420) 2026-02-24T09:17:28.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.464+0000 7f5ef20b2640 1 -- 10.20.193.28:0/218018833 learned_addr learned my addr 10.20.193.28:0/218018833 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:28.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.464+0000 7f5ef10b0640 1 --2- 10.20.193.28:0/218018833 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5eec10ccf0 0x7f5eec172dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:28.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.464+0000 7f5ef20b2640 1 -- 10.20.193.28:0/218018833 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5eec10ccf0 msgr2=0x7f5eec172dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:28.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.464+0000 7f5ef20b2640 1 --2- 10.20.193.28:0/218018833 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5eec10ccf0 0x7f5eec172dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:28.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.464+0000 7f5ef20b2640 1 -- 10.20.193.28:0/218018833 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5eec10c300 msgr2=0x7f5eec0f4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:28.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.464+0000 7f5ef20b2640 1 --2- 10.20.193.28:0/218018833 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5eec10c300 0x7f5eec0f4860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:28.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.464+0000 7f5ef20b2640 1 -- 10.20.193.28:0/218018833 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5edc009570 con 0x7f5eec1124f0 2026-02-24T09:17:28.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.464+0000 7f5ef20b2640 1 --2- 10.20.193.28:0/218018833 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5eec1124f0 0x7f5eec0f4f60 secure :-1 s=READY pgs=346 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ee8006e90 tx=0x7f5ee800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:28.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.465+0000 7f5edaffd640 1 -- 10.20.193.28:0/218018833 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ee8005500 con 0x7f5eec1124f0 2026-02-24T09:17:28.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.465+0000 7f5edaffd640 1 -- 10.20.193.28:0/218018833 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f5ee8005df0 con 0x7f5eec1124f0 2026-02-24T09:17:28.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.465+0000 7f5edaffd640 1 -- 10.20.193.28:0/218018833 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ee8003a00 con 0x7f5eec1124f0 2026-02-24T09:17:28.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.465+0000 7f5ef3b3c640 1 -- 10.20.193.28:0/218018833 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eec0fa780 con 0x7f5eec1124f0 2026-02-24T09:17:28.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.465+0000 7f5ef3b3c640 1 -- 10.20.193.28:0/218018833 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eec0fac00 con 0x7f5eec1124f0 2026-02-24T09:17:28.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.466+0000 7f5ef3b3c640 1 -- 10.20.193.28:0/218018833 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5eb4005300 con 0x7f5eec1124f0 2026-02-24T09:17:28.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.468+0000 7f5edaffd640 1 -- 10.20.193.28:0/218018833 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f5ee8003b60 con 0x7f5eec1124f0 2026-02-24T09:17:28.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.470+0000 7f5edaffd640 1 --2- 10.20.193.28:0/218018833 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5ec80b5830 0x7f5ec80d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:28.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.470+0000 7f5edaffd640 1 -- 10.20.193.28:0/218018833 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f5ee80e7e40 con 0x7f5eec1124f0 2026-02-24T09:17:28.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.470+0000 7f5ef18b1640 1 --2- 10.20.193.28:0/218018833 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5ec80b5830 0x7f5ec80d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:28.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.470+0000 7f5edaffd640 1 -- 10.20.193.28:0/218018833 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f5ee80e8330 con 0x7f5eec1124f0 2026-02-24T09:17:28.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.470+0000 7f5ef18b1640 1 --2- 10.20.193.28:0/218018833 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5ec80b5830 0x7f5ec80d5ce0 secure :-1 s=READY pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5edc0098a0 tx=0x7f5edc03a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:28.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.591+0000 7f5ef3b3c640 1 -- 10.20.193.28:0/218018833 --> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f5eb4002bb0 con 0x7f5ec80b5830 2026-02-24T09:17:28.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.593+0000 7f5edaffd640 1 -- 10.20.193.28:0/218018833 <== mgr.14223 v2:10.20.193.28:6800/906910473 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+910 (secure 0 0 0) 0x7f5eb4002bb0 con 0x7f5ec80b5830 2026-02-24T09:17:28.594 INFO:teuthology.orchestra.run.trial028.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2026-02-24T09:17:28.594 INFO:teuthology.orchestra.run.trial028.stdout:trial028 /dev/nvme1n1 ssd MTFDKCC1T9TGP-1BK1JABYY_112510AB50DD 1788G No 67s ago Has a FileSystem, LVM detected 2026-02-24T09:17:28.594 INFO:teuthology.orchestra.run.trial028.stdout:trial028 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_112510AB50F4 1788G No 67s ago Has a FileSystem, LVM detected 2026-02-24T09:17:28.595 INFO:teuthology.orchestra.run.trial028.stdout:trial074 /dev/nvme0n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510AFFFDC 1788G No 54s ago Has a FileSystem, LVM detected 2026-02-24T09:17:28.595 INFO:teuthology.orchestra.run.trial028.stdout:trial074 /dev/nvme1n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B0020E 1788G No 54s ago Has a FileSystem, LVM detected 2026-02-24T09:17:28.595 INFO:teuthology.orchestra.run.trial028.stdout:trial159 /dev/nvme0n1 ssd MTFDKCC1T9TGP-1BK1JABYY_092510AB6994 1788G No 49s ago Has a FileSystem, LVM detected 2026-02-24T09:17:28.595 INFO:teuthology.orchestra.run.trial028.stdout:trial159 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_092510AB693F 1788G No 49s ago Has a FileSystem, LVM detected 2026-02-24T09:17:28.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.594+0000 7f5ef3b3c640 1 -- 10.20.193.28:0/218018833 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5ec80b5830 msgr2=0x7f5ec80d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:28.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.594+0000 7f5ef3b3c640 1 --2- 10.20.193.28:0/218018833 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5ec80b5830 0x7f5ec80d5ce0 secure :-1 s=READY pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5edc0098a0 tx=0x7f5edc03a040 comp rx=0 tx=0).stop 2026-02-24T09:17:28.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.594+0000 7f5ef3b3c640 1 -- 10.20.193.28:0/218018833 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5eec1124f0 msgr2=0x7f5eec0f4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:28.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.594+0000 7f5ef3b3c640 1 --2- 10.20.193.28:0/218018833 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5eec1124f0 0x7f5eec0f4f60 secure :-1 s=READY pgs=346 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ee8006e90 tx=0x7f5ee800edf0 comp rx=0 tx=0).stop 2026-02-24T09:17:28.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.594+0000 7f5ef3b3c640 1 -- 10.20.193.28:0/218018833 shutdown_connections 2026-02-24T09:17:28.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.594+0000 7f5ef3b3c640 1 --2- 10.20.193.28:0/218018833 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f5ec80b5830 0x7f5ec80d5ce0 unknown :-1 s=CLOSED pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:28.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.594+0000 7f5ef3b3c640 1 --2- 10.20.193.28:0/218018833 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5eec1124f0 0x7f5eec0f4f60 unknown :-1 s=CLOSED pgs=346 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:28.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.594+0000 7f5ef3b3c640 1 --2- 10.20.193.28:0/218018833 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5eec10ccf0 0x7f5eec172dc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:28.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.594+0000 7f5ef3b3c640 1 --2- 10.20.193.28:0/218018833 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5eec10c300 0x7f5eec0f4860 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:28.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.594+0000 7f5ef3b3c640 1 -- 10.20.193.28:0/218018833 >> 10.20.193.28:0/218018833 conn(0x7f5eec0e9bf0 msgr2=0x7f5eec10f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:28.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.594+0000 7f5ef3b3c640 1 -- 10.20.193.28:0/218018833 shutdown_connections 2026-02-24T09:17:28.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:28.594+0000 7f5ef3b3c640 1 -- 10.20.193.28:0/218018833 wait complete. 2026-02-24T09:17:28.728 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-02-24T09:17:28.741 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@trial028.front.sepia.ceph.com 2026-02-24T09:17:28.742 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- bash -c 'ceph fs dump' 2026-02-24T09:17:28.926 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:29.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.098+0000 7f07e173e640 1 -- 10.20.193.28:0/1166293608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f07dc10de30 msgr2=0x7f07dc112e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:29.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.098+0000 7f07e173e640 1 --2- 10.20.193.28:0/1166293608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f07dc10de30 0x7f07dc112e80 secure :-1 s=READY pgs=347 gs=1 cs=0 l=1 c_cookie=5273882923028768463 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07c4009950 tx=0x7f07c402f190 comp rx=0 tx=0).stop 2026-02-24T09:17:29.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.098+0000 7f07e173e640 1 -- 10.20.193.28:0/1166293608 shutdown_connections 2026-02-24T09:17:29.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.098+0000 7f07e173e640 1 --2- 10.20.193.28:0/1166293608 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f07dc113630 0x7f07dc174000 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:29.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.098+0000 7f07e173e640 1 --2- 10.20.193.28:0/1166293608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f07dc10de30 0x7f07dc112e80 unknown :-1 s=CLOSED pgs=347 gs=1 cs=0 l=1 c_cookie=5273882923028768463 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:29.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.098+0000 7f07e173e640 1 --2- 10.20.193.28:0/1166293608 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f07dc10d440 0x7f07dc10d810 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:29.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.098+0000 7f07e173e640 1 -- 10.20.193.28:0/1166293608 >> 10.20.193.28:0/1166293608 conn(0x7f07dc0ead50 msgr2=0x7f07dc10b160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:29.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.098+0000 7f07e173e640 1 -- 10.20.193.28:0/1166293608 shutdown_connections 2026-02-24T09:17:29.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.098+0000 7f07e173e640 1 -- 10.20.193.28:0/1166293608 wait complete. 2026-02-24T09:17:29.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.099+0000 7f07e173e640 1 Processor -- start 2026-02-24T09:17:29.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.099+0000 7f07e173e640 1 -- start start 2026-02-24T09:17:29.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.099+0000 7f07e173e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f07dc10d440 0x7f07dc0f5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:29.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.099+0000 7f07e173e640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f07dc10de30 0x7f07dc173f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:29.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.099+0000 7f07e173e640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f07dc113630 0x7f07dc0f6230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:29.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.099+0000 7f07e173e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f07dc0fb440 con 0x7f07dc10d440 2026-02-24T09:17:29.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.099+0000 7f07e173e640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f07dc0fb5b0 con 0x7f07dc10de30 2026-02-24T09:17:29.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.099+0000 7f07e173e640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f07dc0fb770 con 0x7f07dc113630 2026-02-24T09:17:29.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.100+0000 7f07da7fc640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f07dc10de30 0x7f07dc173f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:29.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.100+0000 7f07da7fc640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f07dc10de30 0x7f07dc173f00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:52090/0 (socket says 10.20.193.28:52090) 2026-02-24T09:17:29.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.100+0000 7f07da7fc640 1 -- 10.20.193.28:0/1912966753 learned_addr learned my addr 10.20.193.28:0/1912966753 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:29.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.100+0000 7f07daffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f07dc10d440 0x7f07dc0f5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:29.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.100+0000 7f07daffd640 1 -- 10.20.193.28:0/1912966753 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f07dc113630 msgr2=0x7f07dc0f6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:29.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.100+0000 7f07daffd640 1 --2- 10.20.193.28:0/1912966753 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f07dc113630 0x7f07dc0f6230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:29.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.100+0000 7f07daffd640 1 -- 10.20.193.28:0/1912966753 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f07dc10de30 msgr2=0x7f07dc173f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:29.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.100+0000 7f07daffd640 1 --2- 10.20.193.28:0/1912966753 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f07dc10de30 0x7f07dc173f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:29.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.100+0000 7f07daffd640 1 -- 10.20.193.28:0/1912966753 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c4009570 con 0x7f07dc10d440 2026-02-24T09:17:29.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.100+0000 7f07daffd640 1 --2- 10.20.193.28:0/1912966753 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f07dc10d440 0x7f07dc0f5b30 secure :-1 s=READY pgs=348 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07d000d720 tx=0x7f07d000dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:29.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.100+0000 7f07bbfff640 1 -- 10.20.193.28:0/1912966753 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f07d0004500 con 0x7f07dc10d440 2026-02-24T09:17:29.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.100+0000 7f07bbfff640 1 -- 10.20.193.28:0/1912966753 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f07d0004d10 con 0x7f07dc10d440 2026-02-24T09:17:29.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.100+0000 7f07bbfff640 1 -- 10.20.193.28:0/1912966753 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f07d00052a0 con 0x7f07dc10d440 2026-02-24T09:17:29.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.100+0000 7f07e173e640 1 -- 10.20.193.28:0/1912966753 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07dc0fba50 con 0x7f07dc10d440 2026-02-24T09:17:29.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.101+0000 7f07e173e640 1 -- 10.20.193.28:0/1912966753 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07dc0fbed0 con 0x7f07dc10d440 2026-02-24T09:17:29.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.101+0000 7f07e173e640 1 -- 10.20.193.28:0/1912966753 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07dc10e720 con 0x7f07dc10d440 2026-02-24T09:17:29.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.103+0000 7f07bbfff640 1 -- 10.20.193.28:0/1912966753 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f07d0005430 con 0x7f07dc10d440 2026-02-24T09:17:29.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.105+0000 7f07bbfff640 1 --2- 10.20.193.28:0/1912966753 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f07b00b5830 0x7f07b00d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:29.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.105+0000 7f07bbfff640 1 -- 10.20.193.28:0/1912966753 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f07d00e6ae0 con 0x7f07dc10d440 2026-02-24T09:17:29.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.105+0000 7f07da7fc640 1 --2- 10.20.193.28:0/1912966753 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f07b00b5830 0x7f07b00d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:29.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.105+0000 7f07bbfff640 1 -- 10.20.193.28:0/1912966753 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f07d011f930 con 0x7f07dc10d440 2026-02-24T09:17:29.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.106+0000 7f07da7fc640 1 --2- 10.20.193.28:0/1912966753 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f07b00b5830 0x7f07b00d5ce0 secure :-1 s=READY pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07dc0fc4d0 tx=0x7f07c403a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:29.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.246+0000 7f07e173e640 1 -- 10.20.193.28:0/1912966753 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f07dc0f6c90 con 0x7f07dc10d440 2026-02-24T09:17:29.247 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:29 trial028 ceph-mon[40371]: from='client.15384 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:29.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.247+0000 7f07bbfff640 1 -- 10.20.193.28:0/1912966753 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) ==== 76+0+3080 (secure 0 0 0) 0x7f07d00a9370 con 0x7f07dc10d440 2026-02-24T09:17:29.248 INFO:teuthology.orchestra.run.trial028.stdout:e22 2026-02-24T09:17:29.248 INFO:teuthology.orchestra.run.trial028.stdout:btime 2026-02-24T09:17:06:566638+0000 2026-02-24T09:17:29.249 INFO:teuthology.orchestra.run.trial028.stdout:enable_multiple, ever_enabled_multiple: 1,1 2026-02-24T09:17:29.249 INFO:teuthology.orchestra.run.trial028.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-24T09:17:29.249 INFO:teuthology.orchestra.run.trial028.stdout:legacy client fscid: 1 2026-02-24T09:17:29.249 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:17:29.249 INFO:teuthology.orchestra.run.trial028.stdout:Filesystem 'cephfs' (1) 2026-02-24T09:17:29.249 INFO:teuthology.orchestra.run.trial028.stdout:fs_name cephfs 2026-02-24T09:17:29.249 INFO:teuthology.orchestra.run.trial028.stdout:epoch 22 2026-02-24T09:17:29.249 INFO:teuthology.orchestra.run.trial028.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2026-02-24T09:17:29.250 INFO:teuthology.orchestra.run.trial028.stdout:created 2026-02-24T09:16:59.889500+0000 2026-02-24T09:17:29.250 INFO:teuthology.orchestra.run.trial028.stdout:modified 2026-02-24T09:17:05.859296+0000 2026-02-24T09:17:29.250 INFO:teuthology.orchestra.run.trial028.stdout:tableserver 0 2026-02-24T09:17:29.250 INFO:teuthology.orchestra.run.trial028.stdout:root 0 2026-02-24T09:17:29.250 INFO:teuthology.orchestra.run.trial028.stdout:session_timeout 300 2026-02-24T09:17:29.250 INFO:teuthology.orchestra.run.trial028.stdout:session_autoclose 300 2026-02-24T09:17:29.250 INFO:teuthology.orchestra.run.trial028.stdout:max_file_size 1099511627776 2026-02-24T09:17:29.250 INFO:teuthology.orchestra.run.trial028.stdout:max_xattr_size 65536 2026-02-24T09:17:29.250 INFO:teuthology.orchestra.run.trial028.stdout:required_client_features {} 2026-02-24T09:17:29.250 INFO:teuthology.orchestra.run.trial028.stdout:last_failure 0 2026-02-24T09:17:29.250 INFO:teuthology.orchestra.run.trial028.stdout:last_failure_osd_epoch 0 2026-02-24T09:17:29.250 INFO:teuthology.orchestra.run.trial028.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-24T09:17:29.251 INFO:teuthology.orchestra.run.trial028.stdout:max_mds 3 2026-02-24T09:17:29.251 INFO:teuthology.orchestra.run.trial028.stdout:in 0,1,2 2026-02-24T09:17:29.251 INFO:teuthology.orchestra.run.trial028.stdout:up {0=24788,1=24761,2=24760} 2026-02-24T09:17:29.251 INFO:teuthology.orchestra.run.trial028.stdout:failed 2026-02-24T09:17:29.251 INFO:teuthology.orchestra.run.trial028.stdout:damaged 2026-02-24T09:17:29.251 INFO:teuthology.orchestra.run.trial028.stdout:stopped 2026-02-24T09:17:29.251 INFO:teuthology.orchestra.run.trial028.stdout:data_pools [3] 2026-02-24T09:17:29.251 INFO:teuthology.orchestra.run.trial028.stdout:metadata_pool 2 2026-02-24T09:17:29.251 INFO:teuthology.orchestra.run.trial028.stdout:inline_data disabled 2026-02-24T09:17:29.251 INFO:teuthology.orchestra.run.trial028.stdout:balancer 2026-02-24T09:17:29.251 INFO:teuthology.orchestra.run.trial028.stdout:bal_rank_mask -1 2026-02-24T09:17:29.251 INFO:teuthology.orchestra.run.trial028.stdout:standby_count_wanted 0 2026-02-24T09:17:29.251 INFO:teuthology.orchestra.run.trial028.stdout:qdb_cluster leader: 24788 members: 24788,24761,24760 2026-02-24T09:17:29.252 INFO:teuthology.orchestra.run.trial028.stdout:[mds.b{0:24788} state up:active seq 3 addr [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] compat {c=[1],r=[1],i=[1fff]}] 2026-02-24T09:17:29.252 INFO:teuthology.orchestra.run.trial028.stdout:[mds.i{0:24745} state up:standby-replay seq 1 addr [v2:10.20.193.159:6838/533862317,v1:10.20.193.159:6839/533862317] compat {c=[1],r=[1],i=[1fff]}] 2026-02-24T09:17:29.252 INFO:teuthology.orchestra.run.trial028.stdout:[mds.h{1:24761} state up:active seq 5 addr [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] compat {c=[1],r=[1],i=[1fff]}] 2026-02-24T09:17:29.252 INFO:teuthology.orchestra.run.trial028.stdout:[mds.e{1:24734} state up:standby-replay seq 1 addr [v2:10.20.193.74:6834/2067708838,v1:10.20.193.74:6835/2067708838] compat {c=[1],r=[1],i=[1fff]}] 2026-02-24T09:17:29.252 INFO:teuthology.orchestra.run.trial028.stdout:[mds.a{2:24760} state up:active seq 5 addr [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] compat {c=[1],r=[1],i=[1fff]}] 2026-02-24T09:17:29.252 INFO:teuthology.orchestra.run.trial028.stdout:[mds.c{2:24727} state up:standby-replay seq 1 addr [v2:10.20.193.159:6836/2059577520,v1:10.20.193.159:6837/2059577520] compat {c=[1],r=[1],i=[1fff]}] 2026-02-24T09:17:29.252 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:17:29.252 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:17:29.252 INFO:teuthology.orchestra.run.trial028.stdout:Standby daemons: 2026-02-24T09:17:29.252 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:17:29.252 INFO:teuthology.orchestra.run.trial028.stdout:[mds.j{-1:14856} state up:standby seq 1 addr [v2:10.20.193.28:6834/3473030842,v1:10.20.193.28:6835/3473030842] compat {c=[1],r=[1],i=[1fff]}] 2026-02-24T09:17:29.252 INFO:teuthology.orchestra.run.trial028.stdout:[mds.d{-1:14862} state up:standby seq 1 addr [v2:10.20.193.28:6836/4120804601,v1:10.20.193.28:6837/4120804601] compat {c=[1],r=[1],i=[1fff]}] 2026-02-24T09:17:29.252 INFO:teuthology.orchestra.run.trial028.stdout:[mds.g{-1:14910} state up:standby seq 1 addr [v2:10.20.193.28:6838/1354296520,v1:10.20.193.28:6839/1354296520] compat {c=[1],r=[1],i=[1fff]}] 2026-02-24T09:17:29.253 INFO:teuthology.orchestra.run.trial028.stdout:[mds.l{-1:24691} state up:standby seq 1 addr [v2:10.20.193.159:6832/3049112106,v1:10.20.193.159:6833/3049112106] compat {c=[1],r=[1],i=[1fff]}] 2026-02-24T09:17:29.253 INFO:teuthology.orchestra.run.trial028.stdout:[mds.k{-1:24710} state up:standby seq 1 addr [v2:10.20.193.74:6832/1426135976,v1:10.20.193.74:6833/1426135976] compat {c=[1],r=[1],i=[1fff]}] 2026-02-24T09:17:29.253 INFO:teuthology.orchestra.run.trial028.stdout:[mds.f{-1:24721} state up:standby seq 1 addr [v2:10.20.193.159:6834/3999384392,v1:10.20.193.159:6835/3999384392] compat {c=[1],r=[1],i=[1fff]}] 2026-02-24T09:17:29.254 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 22 2026-02-24T09:17:29.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.248+0000 7f07e173e640 1 -- 10.20.193.28:0/1912966753 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f07b00b5830 msgr2=0x7f07b00d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:29.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.248+0000 7f07e173e640 1 --2- 10.20.193.28:0/1912966753 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f07b00b5830 0x7f07b00d5ce0 secure :-1 s=READY pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07dc0fc4d0 tx=0x7f07c403a040 comp rx=0 tx=0).stop 2026-02-24T09:17:29.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.248+0000 7f07e173e640 1 -- 10.20.193.28:0/1912966753 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f07dc10d440 msgr2=0x7f07dc0f5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:29.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.248+0000 7f07e173e640 1 --2- 10.20.193.28:0/1912966753 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f07dc10d440 0x7f07dc0f5b30 secure :-1 s=READY pgs=348 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07d000d720 tx=0x7f07d000dbf0 comp rx=0 tx=0).stop 2026-02-24T09:17:29.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.249+0000 7f07e173e640 1 -- 10.20.193.28:0/1912966753 shutdown_connections 2026-02-24T09:17:29.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.249+0000 7f07e173e640 1 --2- 10.20.193.28:0/1912966753 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f07b00b5830 0x7f07b00d5ce0 unknown :-1 s=CLOSED pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:29.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.249+0000 7f07e173e640 1 --2- 10.20.193.28:0/1912966753 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f07dc113630 0x7f07dc0f6230 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:29.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.249+0000 7f07e173e640 1 --2- 10.20.193.28:0/1912966753 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f07dc10de30 0x7f07dc173f00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:29.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.249+0000 7f07e173e640 1 --2- 10.20.193.28:0/1912966753 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f07dc10d440 0x7f07dc0f5b30 unknown :-1 s=CLOSED pgs=348 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:29.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.249+0000 7f07e173e640 1 -- 10.20.193.28:0/1912966753 >> 10.20.193.28:0/1912966753 conn(0x7f07dc0ead50 msgr2=0x7f07dc110c90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:29.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.249+0000 7f07e173e640 1 -- 10.20.193.28:0/1912966753 shutdown_connections 2026-02-24T09:17:29.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.250+0000 7f07e173e640 1 -- 10.20.193.28:0/1912966753 wait complete. 2026-02-24T09:17:29.279 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:29 trial159 ceph-mon[44242]: from='client.15384 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:29.351 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- bash -c 'ceph osd dump' 2026-02-24T09:17:29.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:29 trial074 ceph-mon[44412]: from='client.15384 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:29.534 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:29.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.705+0000 7fbc5b577640 1 -- 10.20.193.28:0/1374574171 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc5c10f600 msgr2=0x7fbc5c10f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:29.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.705+0000 7fbc5b577640 1 --2- 10.20.193.28:0/1374574171 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc5c10f600 0x7fbc5c10f9d0 secure :-1 s=READY pgs=349 gs=1 cs=0 l=1 c_cookie=18133003457399235100 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc50009950 tx=0x7fbc5002f190 comp rx=0 tx=0).stop 2026-02-24T09:17:29.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.705+0000 7fbc5b577640 1 -- 10.20.193.28:0/1374574171 shutdown_connections 2026-02-24T09:17:29.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.705+0000 7fbc5b577640 1 --2- 10.20.193.28:0/1374574171 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fbc5c1157f0 0x7fbc5c1761c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:29.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.705+0000 7fbc5b577640 1 --2- 10.20.193.28:0/1374574171 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fbc5c10fff0 0x7fbc5c115040 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:29.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.705+0000 7fbc5b577640 1 --2- 10.20.193.28:0/1374574171 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc5c10f600 0x7fbc5c10f9d0 unknown :-1 s=CLOSED pgs=349 gs=1 cs=0 l=1 c_cookie=18133003457399235100 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:29.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.705+0000 7fbc5b577640 1 -- 10.20.193.28:0/1374574171 >> 10.20.193.28:0/1374574171 conn(0x7fbc5c0ecef0 msgr2=0x7fbc5c10d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:29.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.706+0000 7fbc5b577640 1 -- 10.20.193.28:0/1374574171 shutdown_connections 2026-02-24T09:17:29.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.706+0000 7fbc5b577640 1 -- 10.20.193.28:0/1374574171 wait complete. 2026-02-24T09:17:29.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.707+0000 7fbc5b577640 1 Processor -- start 2026-02-24T09:17:29.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.707+0000 7fbc5b577640 1 -- start start 2026-02-24T09:17:29.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.707+0000 7fbc5b577640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fbc5c10f600 0x7fbc5c11df80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:29.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.707+0000 7fbc5b577640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fbc5c10fff0 0x7fbc5c11e4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:29.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.707+0000 7fbc5b577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc5c1157f0 0x7fbc5c123890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:29.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.707+0000 7fbc5b577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c123eb0 con 0x7fbc5c1157f0 2026-02-24T09:17:29.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.707+0000 7fbc5b577640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c124020 con 0x7fbc5c10fff0 2026-02-24T09:17:29.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.707+0000 7fbc5b577640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c1241e0 con 0x7fbc5c10f600 2026-02-24T09:17:29.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.707+0000 7fbc5ad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc5c1157f0 0x7fbc5c123890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:29.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.707+0000 7fbc59d74640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fbc5c10fff0 0x7fbc5c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:29.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.707+0000 7fbc5ad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc5c1157f0 0x7fbc5c123890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43444/0 (socket says 10.20.193.28:43444) 2026-02-24T09:17:29.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.707+0000 7fbc5ad76640 1 -- 10.20.193.28:0/2369728839 learned_addr learned my addr 10.20.193.28:0/2369728839 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:29.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.707+0000 7fbc59d74640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fbc5c10fff0 0x7fbc5c11e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:52106/0 (socket says 10.20.193.28:52106) 2026-02-24T09:17:29.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.707+0000 7fbc5a575640 1 --2- 10.20.193.28:0/2369728839 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fbc5c10f600 0x7fbc5c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:29.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.708+0000 7fbc5ad76640 1 -- 10.20.193.28:0/2369728839 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fbc5c10f600 msgr2=0x7fbc5c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:29.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.708+0000 7fbc5ad76640 1 --2- 10.20.193.28:0/2369728839 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fbc5c10f600 0x7fbc5c11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:29.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.708+0000 7fbc5ad76640 1 -- 10.20.193.28:0/2369728839 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fbc5c10fff0 msgr2=0x7fbc5c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:29.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.708+0000 7fbc5ad76640 1 --2- 10.20.193.28:0/2369728839 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fbc5c10fff0 0x7fbc5c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:29.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.708+0000 7fbc5ad76640 1 -- 10.20.193.28:0/2369728839 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc50009570 con 0x7fbc5c1157f0 2026-02-24T09:17:29.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.708+0000 7fbc5ad76640 1 --2- 10.20.193.28:0/2369728839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc5c1157f0 0x7fbc5c123890 secure :-1 s=READY pgs=350 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc4c006e90 tx=0x7fbc4c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:29.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.708+0000 7fbc437fe640 1 -- 10.20.193.28:0/2369728839 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbc4c005500 con 0x7fbc5c1157f0 2026-02-24T09:17:29.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.708+0000 7fbc437fe640 1 -- 10.20.193.28:0/2369728839 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fbc4c005df0 con 0x7fbc5c1157f0 2026-02-24T09:17:29.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.708+0000 7fbc5b577640 1 -- 10.20.193.28:0/2369728839 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc5c1244c0 con 0x7fbc5c1157f0 2026-02-24T09:17:29.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.708+0000 7fbc5b577640 1 -- 10.20.193.28:0/2369728839 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc5c164bc0 con 0x7fbc5c1157f0 2026-02-24T09:17:29.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.708+0000 7fbc437fe640 1 -- 10.20.193.28:0/2369728839 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbc4c003a00 con 0x7fbc5c1157f0 2026-02-24T09:17:29.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.709+0000 7fbc5b577640 1 -- 10.20.193.28:0/2369728839 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc20005300 con 0x7fbc5c1157f0 2026-02-24T09:17:29.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.711+0000 7fbc437fe640 1 -- 10.20.193.28:0/2369728839 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7fbc4c003b60 con 0x7fbc5c1157f0 2026-02-24T09:17:29.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.712+0000 7fbc437fe640 1 --2- 10.20.193.28:0/2369728839 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fbc340b5890 0x7fbc340d5d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:29.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.713+0000 7fbc437fe640 1 -- 10.20.193.28:0/2369728839 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7fbc4c0e7c60 con 0x7fbc5c1157f0 2026-02-24T09:17:29.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.713+0000 7fbc5a575640 1 --2- 10.20.193.28:0/2369728839 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fbc340b5890 0x7fbc340d5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:29.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.713+0000 7fbc437fe640 1 -- 10.20.193.28:0/2369728839 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fbc4c0e8150 con 0x7fbc5c1157f0 2026-02-24T09:17:29.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.713+0000 7fbc5a575640 1 --2- 10.20.193.28:0/2369728839 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fbc340b5890 0x7fbc340d5d40 secure :-1 s=READY pgs=209 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc500098a0 tx=0x7fbc5003a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:29.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.827+0000 7fbc5b577640 1 -- 10.20.193.28:0/2369728839 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fbc20005880 con 0x7fbc5c1157f0 2026-02-24T09:17:29.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.828+0000 7fbc437fe640 1 -- 10.20.193.28:0/2369728839 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v92) ==== 56+0+5446 (secure 0 0 0) 0x7fbc4c0aa5e0 con 0x7fbc5c1157f0 2026-02-24T09:17:29.829 INFO:teuthology.orchestra.run.trial028.stdout:epoch 92 2026-02-24T09:17:29.829 INFO:teuthology.orchestra.run.trial028.stdout:fsid e9ad50af-1160-11f1-800e-d404e6e7d460 2026-02-24T09:17:29.829 INFO:teuthology.orchestra.run.trial028.stdout:created 2026-02-24T09:12:33.966733+0000 2026-02-24T09:17:29.829 INFO:teuthology.orchestra.run.trial028.stdout:modified 2026-02-24T09:17:01.228853+0000 2026-02-24T09:17:29.829 INFO:teuthology.orchestra.run.trial028.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2026-02-24T09:17:29.830 INFO:teuthology.orchestra.run.trial028.stdout:crush_version 38 2026-02-24T09:17:29.830 INFO:teuthology.orchestra.run.trial028.stdout:full_ratio 0.95 2026-02-24T09:17:29.830 INFO:teuthology.orchestra.run.trial028.stdout:backfillfull_ratio 0.9 2026-02-24T09:17:29.830 INFO:teuthology.orchestra.run.trial028.stdout:nearfull_ratio 0.85 2026-02-24T09:17:29.830 INFO:teuthology.orchestra.run.trial028.stdout:require_min_compat_client luminous 2026-02-24T09:17:29.830 INFO:teuthology.orchestra.run.trial028.stdout:min_compat_client jewel 2026-02-24T09:17:29.830 INFO:teuthology.orchestra.run.trial028.stdout:require_osd_release tentacle 2026-02-24T09:17:29.830 INFO:teuthology.orchestra.run.trial028.stdout:stretch_mode_enabled false 2026-02-24T09:17:29.830 INFO:teuthology.orchestra.run.trial028.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 26 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2026-02-24T09:17:29.830 INFO:teuthology.orchestra.run.trial028.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 91 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2026-02-24T09:17:29.830 INFO:teuthology.orchestra.run.trial028.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 92 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2026-02-24T09:17:29.831 INFO:teuthology.orchestra.run.trial028.stdout:max_osd 12 2026-02-24T09:17:29.831 INFO:teuthology.orchestra.run.trial028.stdout:osd.0 up in weight 1 up_from 10 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:10.20.193.28:6802/2124354447,v1:10.20.193.28:6803/2124354447] [v2:10.20.193.28:6804/2124354447,v1:10.20.193.28:6805/2124354447] exists,up b7836f68-f25a-4aea-830a-3c2ce8ac79e6 2026-02-24T09:17:29.831 INFO:teuthology.orchestra.run.trial028.stdout:osd.1 up in weight 1 up_from 16 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:10.20.193.74:6800/267363486,v1:10.20.193.74:6801/267363486] [v2:10.20.193.74:6802/267363486,v1:10.20.193.74:6803/267363486] exists,up 04273ff8-91e3-4e70-8041-cc8c205b9a42 2026-02-24T09:17:29.831 INFO:teuthology.orchestra.run.trial028.stdout:osd.2 up in weight 1 up_from 22 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:10.20.193.159:6800/3320466721,v1:10.20.193.159:6801/3320466721] [v2:10.20.193.159:6802/3320466721,v1:10.20.193.159:6803/3320466721] exists,up dea96db1-588b-4d08-8e52-52c4c995bdc0 2026-02-24T09:17:29.831 INFO:teuthology.orchestra.run.trial028.stdout:osd.3 up in weight 1 up_from 30 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:10.20.193.28:6810/1790609615,v1:10.20.193.28:6811/1790609615] [v2:10.20.193.28:6812/1790609615,v1:10.20.193.28:6813/1790609615] exists,up c785c244-eb3f-4af5-83c6-cd492459f75e 2026-02-24T09:17:29.831 INFO:teuthology.orchestra.run.trial028.stdout:osd.4 up in weight 1 up_from 38 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:10.20.193.74:6808/610990618,v1:10.20.193.74:6809/610990618] [v2:10.20.193.74:6810/610990618,v1:10.20.193.74:6811/610990618] exists,up 041239c2-6187-4154-9557-b1b5846f9e0e 2026-02-24T09:17:29.831 INFO:teuthology.orchestra.run.trial028.stdout:osd.5 up in weight 1 up_from 45 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:10.20.193.159:6808/1653417923,v1:10.20.193.159:6809/1653417923] [v2:10.20.193.159:6810/1653417923,v1:10.20.193.159:6811/1653417923] exists,up ffeeb021-0924-4421-aecf-bac2e74364a9 2026-02-24T09:17:29.831 INFO:teuthology.orchestra.run.trial028.stdout:osd.6 up in weight 1 up_from 53 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:10.20.193.28:6818/1891043856,v1:10.20.193.28:6819/1891043856] [v2:10.20.193.28:6820/1891043856,v1:10.20.193.28:6821/1891043856] exists,up f3736156-4951-4901-9323-7930fb73b8dd 2026-02-24T09:17:29.831 INFO:teuthology.orchestra.run.trial028.stdout:osd.7 up in weight 1 up_from 58 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:10.20.193.74:6816/2328869739,v1:10.20.193.74:6817/2328869739] [v2:10.20.193.74:6818/2328869739,v1:10.20.193.74:6819/2328869739] exists,up 214b27ee-75f9-4a54-a59b-e8bfbb895903 2026-02-24T09:17:29.831 INFO:teuthology.orchestra.run.trial028.stdout:osd.8 up in weight 1 up_from 66 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:10.20.193.159:6816/3877834753,v1:10.20.193.159:6817/3877834753] [v2:10.20.193.159:6818/3877834753,v1:10.20.193.159:6819/3877834753] exists,up 76599c26-6778-4fa2-b85d-feea8baac7c3 2026-02-24T09:17:29.831 INFO:teuthology.orchestra.run.trial028.stdout:osd.9 up in weight 1 up_from 74 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:10.20.193.28:6826/4207785690,v1:10.20.193.28:6827/4207785690] [v2:10.20.193.28:6828/4207785690,v1:10.20.193.28:6829/4207785690] exists,up 52b52b35-2d65-4e53-b7d8-fd7385d5ae88 2026-02-24T09:17:29.831 INFO:teuthology.orchestra.run.trial028.stdout:osd.10 up in weight 1 up_from 79 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:10.20.193.74:6824/2590408209,v1:10.20.193.74:6825/2590408209] [v2:10.20.193.74:6826/2590408209,v1:10.20.193.74:6827/2590408209] exists,up 65c8e576-a1c7-4c03-bbf6-57c775f2860f 2026-02-24T09:17:29.832 INFO:teuthology.orchestra.run.trial028.stdout:osd.11 up in weight 1 up_from 87 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:10.20.193.159:6824/709820718,v1:10.20.193.159:6825/709820718] [v2:10.20.193.159:6826/709820718,v1:10.20.193.159:6827/709820718] exists,up e2305377-fadb-4cf0-8384-87387f116255 2026-02-24T09:17:29.832 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:0/3696280830 expires 2026-02-25T09:13:39.242729+0000 2026-02-24T09:17:29.832 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:6801/3539300247 expires 2026-02-25T09:13:39.242729+0000 2026-02-24T09:17:29.832 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:0/3799405177 expires 2026-02-25T09:12:46.171932+0000 2026-02-24T09:17:29.832 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:0/1189576634 expires 2026-02-25T09:12:46.171932+0000 2026-02-24T09:17:29.832 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:6800/1682009277 expires 2026-02-25T09:12:46.171932+0000 2026-02-24T09:17:29.832 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:6800/3539300247 expires 2026-02-25T09:13:39.242729+0000 2026-02-24T09:17:29.832 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:6801/1682009277 expires 2026-02-25T09:12:46.171932+0000 2026-02-24T09:17:29.832 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:0/673213915 expires 2026-02-25T09:12:59.028609+0000 2026-02-24T09:17:29.832 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:0/857248143 expires 2026-02-25T09:13:39.242729+0000 2026-02-24T09:17:29.832 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:0/1541006046 expires 2026-02-25T09:12:46.171932+0000 2026-02-24T09:17:29.832 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:0/264576041 expires 2026-02-25T09:12:59.028609+0000 2026-02-24T09:17:29.832 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:6800/2303472235 expires 2026-02-25T09:12:59.028609+0000 2026-02-24T09:17:29.833 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:6801/2303472235 expires 2026-02-25T09:12:59.028609+0000 2026-02-24T09:17:29.833 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:0/2622827224 expires 2026-02-25T09:12:59.028609+0000 2026-02-24T09:17:29.833 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:0/3614117448 expires 2026-02-25T09:13:39.242729+0000 2026-02-24T09:17:29.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.829+0000 7fbc5b577640 1 -- 10.20.193.28:0/2369728839 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fbc340b5890 msgr2=0x7fbc340d5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:29.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.829+0000 7fbc5b577640 1 --2- 10.20.193.28:0/2369728839 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fbc340b5890 0x7fbc340d5d40 secure :-1 s=READY pgs=209 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc500098a0 tx=0x7fbc5003a040 comp rx=0 tx=0).stop 2026-02-24T09:17:29.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.829+0000 7fbc5b577640 1 -- 10.20.193.28:0/2369728839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc5c1157f0 msgr2=0x7fbc5c123890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:29.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.829+0000 7fbc5b577640 1 --2- 10.20.193.28:0/2369728839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc5c1157f0 0x7fbc5c123890 secure :-1 s=READY pgs=350 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc4c006e90 tx=0x7fbc4c00edf0 comp rx=0 tx=0).stop 2026-02-24T09:17:29.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.829+0000 7fbc5b577640 1 -- 10.20.193.28:0/2369728839 shutdown_connections 2026-02-24T09:17:29.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.829+0000 7fbc5b577640 1 --2- 10.20.193.28:0/2369728839 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fbc340b5890 0x7fbc340d5d40 unknown :-1 s=CLOSED pgs=209 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:29.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.829+0000 7fbc5b577640 1 --2- 10.20.193.28:0/2369728839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc5c1157f0 0x7fbc5c123890 unknown :-1 s=CLOSED pgs=350 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:29.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.829+0000 7fbc5b577640 1 --2- 10.20.193.28:0/2369728839 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fbc5c10fff0 0x7fbc5c11e4c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:29.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.829+0000 7fbc5b577640 1 --2- 10.20.193.28:0/2369728839 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fbc5c10f600 0x7fbc5c11df80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:29.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.829+0000 7fbc5b577640 1 -- 10.20.193.28:0/2369728839 >> 10.20.193.28:0/2369728839 conn(0x7fbc5c0ecef0 msgr2=0x7fbc5c10d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:29.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.830+0000 7fbc5b577640 1 -- 10.20.193.28:0/2369728839 shutdown_connections 2026-02-24T09:17:29.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:29.830+0000 7fbc5b577640 1 -- 10.20.193.28:0/2369728839 wait complete. 2026-02-24T09:17:29.933 INFO:teuthology.run_tasks:Running task fs.ready... 2026-02-24T09:17:29.951 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:17:30.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:30 trial028 ceph-mon[40371]: from='client.15390 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:30.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:30 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/1912966753' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2026-02-24T09:17:30.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:30 trial028 ceph-mon[40371]: pgmap v195: 97 pgs: 97 active+clean; 648 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2026-02-24T09:17:30.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:30 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/2369728839' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2026-02-24T09:17:30.135 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:30.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:30 trial159 ceph-mon[44242]: from='client.15390 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:30.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:30 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/1912966753' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2026-02-24T09:17:30.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:30 trial159 ceph-mon[44242]: pgmap v195: 97 pgs: 97 active+clean; 648 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2026-02-24T09:17:30.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:30 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/2369728839' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2026-02-24T09:17:30.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.315+0000 7f880bb54640 1 -- 10.20.193.28:0/2419336843 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f880410b340 msgr2=0x7f880410b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:30.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.315+0000 7f880bb54640 1 --2- 10.20.193.28:0/2419336843 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f880410b340 0x7f880410b710 secure :-1 s=READY pgs=351 gs=1 cs=0 l=1 c_cookie=2361115413457677498 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f87f4009950 tx=0x7f87f402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:17:30.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.315+0000 7f880bb54640 1 -- 10.20.193.28:0/2419336843 shutdown_connections 2026-02-24T09:17:30.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.315+0000 7f880bb54640 1 --2- 10.20.193.28:0/2419336843 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f88041112a0 0x7f8804111c80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:30.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.315+0000 7f880bb54640 1 --2- 10.20.193.28:0/2419336843 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f880410bd30 0x7f8804110b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:30.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.315+0000 7f880bb54640 1 --2- 10.20.193.28:0/2419336843 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f880410b340 0x7f880410b710 unknown :-1 s=CLOSED pgs=351 gs=1 cs=0 l=1 c_cookie=2361115413457677498 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:30.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.315+0000 7f880bb54640 1 -- 10.20.193.28:0/2419336843 >> 10.20.193.28:0/2419336843 conn(0x7f88040e8ed0 msgr2=0x7f88041092e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:30.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.315+0000 7f880bb54640 1 -- 10.20.193.28:0/2419336843 shutdown_connections 2026-02-24T09:17:30.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.315+0000 7f880bb54640 1 -- 10.20.193.28:0/2419336843 wait complete. 2026-02-24T09:17:30.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.316+0000 7f880bb54640 1 Processor -- start 2026-02-24T09:17:30.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.316+0000 7f880bb54640 1 -- start start 2026-02-24T09:17:30.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.316+0000 7f880bb54640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f880410b340 0x7f8804123670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:30.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.316+0000 7f880bb54640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f880410bd30 0x7f8804123bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:30.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.317+0000 7f880bb54640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88041112a0 0x7f8804128f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:30.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.317+0000 7f880bb54640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8804129550 con 0x7f88041112a0 2026-02-24T09:17:30.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.317+0000 7f880bb54640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f88041296c0 con 0x7f880410bd30 2026-02-24T09:17:30.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.317+0000 7f880bb54640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8804129880 con 0x7f880410b340 2026-02-24T09:17:30.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.317+0000 7f88098c9640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f880410b340 0x7f8804123670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:30.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.317+0000 7f880a0ca640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88041112a0 0x7f8804128f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:30.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.317+0000 7f88098c9640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f880410b340 0x7f8804123670 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:47658/0 (socket says 10.20.193.28:47658) 2026-02-24T09:17:30.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.317+0000 7f88098c9640 1 -- 10.20.193.28:0/423647621 learned_addr learned my addr 10.20.193.28:0/423647621 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:30.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.317+0000 7f88090c8640 1 --2- 10.20.193.28:0/423647621 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f880410bd30 0x7f8804123bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:30.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.317+0000 7f88098c9640 1 -- 10.20.193.28:0/423647621 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f880410bd30 msgr2=0x7f8804123bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:30.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.317+0000 7f88098c9640 1 --2- 10.20.193.28:0/423647621 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f880410bd30 0x7f8804123bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:30.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.317+0000 7f88098c9640 1 -- 10.20.193.28:0/423647621 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88041112a0 msgr2=0x7f8804128f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:30.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.317+0000 7f88098c9640 1 --2- 10.20.193.28:0/423647621 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88041112a0 0x7f8804128f30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:30.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.317+0000 7f88098c9640 1 -- 10.20.193.28:0/423647621 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f4009570 con 0x7f880410b340 2026-02-24T09:17:30.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.317+0000 7f880a0ca640 1 --2- 10.20.193.28:0/423647621 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88041112a0 0x7f8804128f30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:17:30.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.318+0000 7f88098c9640 1 --2- 10.20.193.28:0/423647621 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f880410b340 0x7f8804123670 secure :-1 s=READY pgs=108 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f87f40098a0 tx=0x7f87f40028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:30.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.318+0000 7f87f2ffd640 1 -- 10.20.193.28:0/423647621 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f87f403d070 con 0x7f880410b340 2026-02-24T09:17:30.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.318+0000 7f880bb54640 1 -- 10.20.193.28:0/423647621 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8804129b00 con 0x7f880410b340 2026-02-24T09:17:30.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.318+0000 7f87f2ffd640 1 -- 10.20.193.28:0/423647621 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f87f4002a40 con 0x7f880410b340 2026-02-24T09:17:30.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.318+0000 7f87f2ffd640 1 -- 10.20.193.28:0/423647621 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f87f4041720 con 0x7f880410b340 2026-02-24T09:17:30.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.318+0000 7f880bb54640 1 -- 10.20.193.28:0/423647621 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f880416a260 con 0x7f880410b340 2026-02-24T09:17:30.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.319+0000 7f880bb54640 1 -- 10.20.193.28:0/423647621 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87cc005300 con 0x7f880410b340 2026-02-24T09:17:30.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.321+0000 7f87f2ffd640 1 -- 10.20.193.28:0/423647621 <== mon.1 v2:10.20.193.159:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f87f40386a0 con 0x7f880410b340 2026-02-24T09:17:30.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.322+0000 7f87f2ffd640 1 --2- 10.20.193.28:0/423647621 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f87e00b5840 0x7f87e00d5cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:30.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.322+0000 7f87f2ffd640 1 -- 10.20.193.28:0/423647621 <== mon.1 v2:10.20.193.159:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f87f410b0e0 con 0x7f880410b340 2026-02-24T09:17:30.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.322+0000 7f87f2ffd640 1 -- 10.20.193.28:0/423647621 <== mon.1 v2:10.20.193.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f87f410b560 con 0x7f880410b340 2026-02-24T09:17:30.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.322+0000 7f88090c8640 1 --2- 10.20.193.28:0/423647621 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f87e00b5840 0x7f87e00d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:30.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.323+0000 7f88090c8640 1 --2- 10.20.193.28:0/423647621 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f87e00b5840 0x7f87e00d5cf0 secure :-1 s=READY pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8804129fc0 tx=0x7f87f8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:30.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:30 trial074 ceph-mon[44412]: from='client.15390 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:30.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:30 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/1912966753' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2026-02-24T09:17:30.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:30 trial074 ceph-mon[44412]: pgmap v195: 97 pgs: 97 active+clean; 648 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2026-02-24T09:17:30.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:30 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/2369728839' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2026-02-24T09:17:30.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.462+0000 7f880bb54640 1 -- 10.20.193.28:0/423647621 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87cc005950 con 0x7f880410b340 2026-02-24T09:17:30.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.463+0000 7f87f2ffd640 1 -- 10.20.193.28:0/423647621 <== mon.1 v2:10.20.193.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11901 (secure 0 0 0) 0x7f87f40cda80 con 0x7f880410b340 2026-02-24T09:17:30.464 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:17:30.465 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 22 2026-02-24T09:17:30.465 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":22,"btime":"2026-02-24T09:17:06:566638+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14856,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/3473030842","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":3473030842},{"type":"v1","addr":"10.20.193.28:6835","nonce":3473030842}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14862,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/4120804601","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":4120804601},{"type":"v1","addr":"10.20.193.28:6837","nonce":4120804601}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14910,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/1354296520","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1354296520},{"type":"v1","addr":"10.20.193.28:6839","nonce":1354296520}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24691,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.159:6833/3049112106","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6832","nonce":3049112106},{"type":"v1","addr":"10.20.193.159:6833","nonce":3049112106}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24710,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.74:6833/1426135976","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6832","nonce":1426135976},{"type":"v1","addr":"10.20.193.74:6833","nonce":1426135976}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24721,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.159:6835/3999384392","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6834","nonce":3999384392},{"type":"v1","addr":"10.20.193.159:6835","nonce":3999384392}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:16:59.889500+0000","modified":"2026-02-24T09:17:05.859296+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24788,"mds_1":24761,"mds_2":24760},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24727":{"gid":24727,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.159:6837/2059577520","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6836","nonce":2059577520},{"type":"v1","addr":"10.20.193.159:6837","nonce":2059577520}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24734":{"gid":24734,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.74:6835/2067708838","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6834","nonce":2067708838},{"type":"v1","addr":"10.20.193.74:6835","nonce":2067708838}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24745":{"gid":24745,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.159:6839/533862317","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6838","nonce":533862317},{"type":"v1","addr":"10.20.193.159:6839","nonce":533862317}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24760":{"gid":24760,"name":"a","rank":2,"incarnation":20,"state":"up:active","state_seq":5,"addr":"10.20.193.28:6841/492586680","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":492586680},{"type":"v1","addr":"10.20.193.28:6841","nonce":492586680}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24761":{"gid":24761,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"10.20.193.74:6837/958749351","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6836","nonce":958749351},{"type":"v1","addr":"10.20.193.74:6837","nonce":958749351}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24788":{"gid":24788,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"10.20.193.74:6839/828566790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6838","nonce":828566790},{"type":"v1","addr":"10.20.193.74:6839","nonce":828566790}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24788,"qdb_cluster":[24788,24761,24760]},"id":1}]} 2026-02-24T09:17:30.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.464+0000 7f880bb54640 1 -- 10.20.193.28:0/423647621 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f87e00b5840 msgr2=0x7f87e00d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:30.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.464+0000 7f880bb54640 1 --2- 10.20.193.28:0/423647621 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f87e00b5840 0x7f87e00d5cf0 secure :-1 s=READY pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8804129fc0 tx=0x7f87f8005f90 comp rx=0 tx=0).stop 2026-02-24T09:17:30.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.464+0000 7f880bb54640 1 -- 10.20.193.28:0/423647621 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f880410b340 msgr2=0x7f8804123670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:30.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.464+0000 7f880bb54640 1 --2- 10.20.193.28:0/423647621 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f880410b340 0x7f8804123670 secure :-1 s=READY pgs=108 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f87f40098a0 tx=0x7f87f40028d0 comp rx=0 tx=0).stop 2026-02-24T09:17:30.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.464+0000 7f880bb54640 1 -- 10.20.193.28:0/423647621 shutdown_connections 2026-02-24T09:17:30.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.464+0000 7f880bb54640 1 --2- 10.20.193.28:0/423647621 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f87e00b5840 0x7f87e00d5cf0 unknown :-1 s=CLOSED pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:30.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.464+0000 7f880bb54640 1 --2- 10.20.193.28:0/423647621 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88041112a0 0x7f8804128f30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:30.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.464+0000 7f880bb54640 1 --2- 10.20.193.28:0/423647621 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f880410bd30 0x7f8804123bb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:30.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.464+0000 7f880bb54640 1 --2- 10.20.193.28:0/423647621 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f880410b340 0x7f8804123670 unknown :-1 s=CLOSED pgs=108 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:30.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.464+0000 7f880bb54640 1 -- 10.20.193.28:0/423647621 >> 10.20.193.28:0/423647621 conn(0x7f88040e8ed0 msgr2=0x7f88041092b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:30.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.464+0000 7f880bb54640 1 -- 10.20.193.28:0/423647621 shutdown_connections 2026-02-24T09:17:30.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.464+0000 7f880bb54640 1 -- 10.20.193.28:0/423647621 wait complete. 2026-02-24T09:17:30.563 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:17:30.746 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:30.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.927+0000 7f2687577640 1 -- 10.20.193.28:0/643154664 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2688114020 msgr2=0x7f26881143f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:30.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.927+0000 7f2687577640 1 --2- 10.20.193.28:0/643154664 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2688114020 0x7f26881143f0 secure :-1 s=READY pgs=352 gs=1 cs=0 l=1 c_cookie=13468838966103608120 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f267c009950 tx=0x7f267c02f190 comp rx=0 tx=0).stop 2026-02-24T09:17:30.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.927+0000 7f2687577640 1 -- 10.20.193.28:0/643154664 shutdown_connections 2026-02-24T09:17:30.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.927+0000 7f2687577640 1 --2- 10.20.193.28:0/643154664 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f26881199a0 0x7f268817a370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:30.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.927+0000 7f2687577640 1 --2- 10.20.193.28:0/643154664 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f2688114a10 0x7f26881191f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:30.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.927+0000 7f2687577640 1 --2- 10.20.193.28:0/643154664 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2688114020 0x7f26881143f0 unknown :-1 s=CLOSED pgs=352 gs=1 cs=0 l=1 c_cookie=13468838966103608120 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:30.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.927+0000 7f2687577640 1 -- 10.20.193.28:0/643154664 >> 10.20.193.28:0/643154664 conn(0x7f2688064810 msgr2=0x7f2688064c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:30.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.927+0000 7f2687577640 1 -- 10.20.193.28:0/643154664 shutdown_connections 2026-02-24T09:17:30.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.927+0000 7f2687577640 1 -- 10.20.193.28:0/643154664 wait complete. 2026-02-24T09:17:30.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.928+0000 7f2687577640 1 Processor -- start 2026-02-24T09:17:30.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.928+0000 7f2687577640 1 -- start start 2026-02-24T09:17:30.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.928+0000 7f2687577640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2688114020 0x7f2688105390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:30.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.928+0000 7f2687577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2688114a10 0x7f268817a270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:30.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.928+0000 7f2687577640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f26881199a0 0x7f2688105930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:30.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.928+0000 7f2687577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f26881060c0 con 0x7f2688114a10 2026-02-24T09:17:30.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.928+0000 7f2687577640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f268810a270 con 0x7f2688114020 2026-02-24T09:17:30.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.928+0000 7f2687577640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f268810a430 con 0x7f26881199a0 2026-02-24T09:17:30.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.928+0000 7f2685d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2688114a10 0x7f268817a270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:30.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.928+0000 7f2685d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2688114a10 0x7f268817a270 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43464/0 (socket says 10.20.193.28:43464) 2026-02-24T09:17:30.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.928+0000 7f2685d74640 1 -- 10.20.193.28:0/1244093987 learned_addr learned my addr 10.20.193.28:0/1244093987 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:30.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.928+0000 7f2686575640 1 --2- 10.20.193.28:0/1244093987 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2688114020 0x7f2688105390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:30.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.929+0000 7f2685d74640 1 -- 10.20.193.28:0/1244093987 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f26881199a0 msgr2=0x7f2688105930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:30.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.929+0000 7f2685d74640 1 --2- 10.20.193.28:0/1244093987 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f26881199a0 0x7f2688105930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:30.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.929+0000 7f2685d74640 1 -- 10.20.193.28:0/1244093987 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2688114020 msgr2=0x7f2688105390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:30.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.929+0000 7f2685d74640 1 --2- 10.20.193.28:0/1244093987 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2688114020 0x7f2688105390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:30.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.929+0000 7f2685d74640 1 -- 10.20.193.28:0/1244093987 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f267c009570 con 0x7f2688114a10 2026-02-24T09:17:30.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.929+0000 7f2685d74640 1 --2- 10.20.193.28:0/1244093987 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2688114a10 0x7f268817a270 secure :-1 s=READY pgs=353 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f267000b500 tx=0x7f267000b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:30.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.929+0000 7f266f7fe640 1 -- 10.20.193.28:0/1244093987 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26700044a0 con 0x7f2688114a10 2026-02-24T09:17:30.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.929+0000 7f2687577640 1 -- 10.20.193.28:0/1244093987 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f268810a710 con 0x7f2688114a10 2026-02-24T09:17:30.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.929+0000 7f266f7fe640 1 -- 10.20.193.28:0/1244093987 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2670002b60 con 0x7f2688114a10 2026-02-24T09:17:30.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.929+0000 7f2687577640 1 -- 10.20.193.28:0/1244093987 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f268810abe0 con 0x7f2688114a10 2026-02-24T09:17:30.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.929+0000 7f266f7fe640 1 -- 10.20.193.28:0/1244093987 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26700044a0 con 0x7f2688114a10 2026-02-24T09:17:30.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.930+0000 7f266d7fa640 1 -- 10.20.193.28:0/1244093987 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f264c005300 con 0x7f2688114a10 2026-02-24T09:17:30.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.932+0000 7f266f7fe640 1 -- 10.20.193.28:0/1244093987 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f2670002cd0 con 0x7f2688114a10 2026-02-24T09:17:30.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.934+0000 7f266f7fe640 1 --2- 10.20.193.28:0/1244093987 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f26600b5820 0x7f26600d5cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:30.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.934+0000 7f266f7fe640 1 -- 10.20.193.28:0/1244093987 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f26700e6410 con 0x7f2688114a10 2026-02-24T09:17:30.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.934+0000 7f2686575640 1 --2- 10.20.193.28:0/1244093987 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f26600b5820 0x7f26600d5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:30.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.934+0000 7f266f7fe640 1 -- 10.20.193.28:0/1244093987 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f26700e6890 con 0x7f2688114a10 2026-02-24T09:17:30.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:30.934+0000 7f2686575640 1 --2- 10.20.193.28:0/1244093987 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f26600b5820 0x7f26600d5cd0 secure :-1 s=READY pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f267c0023d0 tx=0x7f267c031040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:31.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.075+0000 7f266d7fa640 1 -- 10.20.193.28:0/1244093987 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f264c005950 con 0x7f2688114a10 2026-02-24T09:17:31.077 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:31 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/423647621' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:17:31.077 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:17:31.078 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":22,"btime":"2026-02-24T09:17:06:566638+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14856,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/3473030842","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":3473030842},{"type":"v1","addr":"10.20.193.28:6835","nonce":3473030842}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14862,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/4120804601","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":4120804601},{"type":"v1","addr":"10.20.193.28:6837","nonce":4120804601}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14910,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/1354296520","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1354296520},{"type":"v1","addr":"10.20.193.28:6839","nonce":1354296520}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24691,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.159:6833/3049112106","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6832","nonce":3049112106},{"type":"v1","addr":"10.20.193.159:6833","nonce":3049112106}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24710,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.74:6833/1426135976","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6832","nonce":1426135976},{"type":"v1","addr":"10.20.193.74:6833","nonce":1426135976}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24721,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.159:6835/3999384392","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6834","nonce":3999384392},{"type":"v1","addr":"10.20.193.159:6835","nonce":3999384392}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:16:59.889500+0000","modified":"2026-02-24T09:17:05.859296+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24788,"mds_1":24761,"mds_2":24760},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24727":{"gid":24727,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.159:6837/2059577520","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6836","nonce":2059577520},{"type":"v1","addr":"10.20.193.159:6837","nonce":2059577520}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24734":{"gid":24734,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.74:6835/2067708838","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6834","nonce":2067708838},{"type":"v1","addr":"10.20.193.74:6835","nonce":2067708838}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24745":{"gid":24745,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.159:6839/533862317","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6838","nonce":533862317},{"type":"v1","addr":"10.20.193.159:6839","nonce":533862317}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24760":{"gid":24760,"name":"a","rank":2,"incarnation":20,"state":"up:active","state_seq":5,"addr":"10.20.193.28:6841/492586680","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":492586680},{"type":"v1","addr":"10.20.193.28:6841","nonce":492586680}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24761":{"gid":24761,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"10.20.193.74:6837/958749351","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6836","nonce":958749351},{"type":"v1","addr":"10.20.193.74:6837","nonce":958749351}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24788":{"gid":24788,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"10.20.193.74:6839/828566790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6838","nonce":828566790},{"type":"v1","addr":"10.20.193.74:6839","nonce":828566790}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24788,"qdb_cluster":[24788,24761,24760]},"id":1}]} 2026-02-24T09:17:31.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.075+0000 7f266f7fe640 1 -- 10.20.193.28:0/1244093987 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11901 (secure 0 0 0) 0x7f26700a8db0 con 0x7f2688114a10 2026-02-24T09:17:31.079 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 22 2026-02-24T09:17:31.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.077+0000 7f266d7fa640 1 -- 10.20.193.28:0/1244093987 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f26600b5820 msgr2=0x7f26600d5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:31.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.077+0000 7f266d7fa640 1 --2- 10.20.193.28:0/1244093987 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f26600b5820 0x7f26600d5cd0 secure :-1 s=READY pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f267c0023d0 tx=0x7f267c031040 comp rx=0 tx=0).stop 2026-02-24T09:17:31.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.077+0000 7f266d7fa640 1 -- 10.20.193.28:0/1244093987 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2688114a10 msgr2=0x7f268817a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:31.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.077+0000 7f266d7fa640 1 --2- 10.20.193.28:0/1244093987 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2688114a10 0x7f268817a270 secure :-1 s=READY pgs=353 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f267000b500 tx=0x7f267000b9d0 comp rx=0 tx=0).stop 2026-02-24T09:17:31.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.078+0000 7f266d7fa640 1 -- 10.20.193.28:0/1244093987 shutdown_connections 2026-02-24T09:17:31.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.078+0000 7f266d7fa640 1 --2- 10.20.193.28:0/1244093987 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f26600b5820 0x7f26600d5cd0 unknown :-1 s=CLOSED pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:31.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.078+0000 7f266d7fa640 1 --2- 10.20.193.28:0/1244093987 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f26881199a0 0x7f2688105930 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:31.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.078+0000 7f266d7fa640 1 --2- 10.20.193.28:0/1244093987 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2688114a10 0x7f268817a270 unknown :-1 s=CLOSED pgs=353 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:31.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.078+0000 7f266d7fa640 1 --2- 10.20.193.28:0/1244093987 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2688114020 0x7f2688105390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:31.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.078+0000 7f266d7fa640 1 -- 10.20.193.28:0/1244093987 >> 10.20.193.28:0/1244093987 conn(0x7f2688064810 msgr2=0x7f2688065bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:31.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.078+0000 7f266d7fa640 1 -- 10.20.193.28:0/1244093987 shutdown_connections 2026-02-24T09:17:31.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.078+0000 7f266d7fa640 1 -- 10.20.193.28:0/1244093987 wait complete. 2026-02-24T09:17:31.180 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T09:17:31.279 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:31 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/423647621' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:17:31.364 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:31.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:31 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/423647621' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:17:31.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.544+0000 7fda13071640 1 -- 10.20.193.28:0/2790786038 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fda0c114a10 msgr2=0x7fda0c1191f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:31.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.544+0000 7fda13071640 1 --2- 10.20.193.28:0/2790786038 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fda0c114a10 0x7fda0c1191f0 secure :-1 s=READY pgs=354 gs=1 cs=0 l=1 c_cookie=17873402626749881341 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda00009950 tx=0x7fda0002f190 comp rx=0 tx=0).stop 2026-02-24T09:17:31.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.544+0000 7fda13071640 1 -- 10.20.193.28:0/2790786038 shutdown_connections 2026-02-24T09:17:31.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.544+0000 7fda13071640 1 --2- 10.20.193.28:0/2790786038 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fda0c1199a0 0x7fda0c17a370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.544+0000 7fda13071640 1 --2- 10.20.193.28:0/2790786038 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fda0c114a10 0x7fda0c1191f0 unknown :-1 s=CLOSED pgs=354 gs=1 cs=0 l=1 c_cookie=17873402626749881341 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.544+0000 7fda13071640 1 --2- 10.20.193.28:0/2790786038 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fda0c114020 0x7fda0c1143f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.544+0000 7fda13071640 1 -- 10.20.193.28:0/2790786038 >> 10.20.193.28:0/2790786038 conn(0x7fda0c064810 msgr2=0x7fda0c064c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.544+0000 7fda13071640 1 -- 10.20.193.28:0/2790786038 shutdown_connections 2026-02-24T09:17:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.544+0000 7fda13071640 1 -- 10.20.193.28:0/2790786038 wait complete. 2026-02-24T09:17:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.545+0000 7fda13071640 1 Processor -- start 2026-02-24T09:17:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.545+0000 7fda13071640 1 -- start start 2026-02-24T09:17:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.545+0000 7fda13071640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fda0c114020 0x7fda0c0fbda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.545+0000 7fda13071640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fda0c114a10 0x7fda0c17a270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:31.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.545+0000 7fda13071640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fda0c1199a0 0x7fda0c0fc4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:31.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.545+0000 7fda13071640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c1016b0 con 0x7fda0c114a10 2026-02-24T09:17:31.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.545+0000 7fda13071640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c101820 con 0x7fda0c114020 2026-02-24T09:17:31.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.545+0000 7fda13071640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c1019e0 con 0x7fda0c1199a0 2026-02-24T09:17:31.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.546+0000 7fda1206f640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fda0c114020 0x7fda0c0fbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:31.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.546+0000 7fda12870640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fda0c1199a0 0x7fda0c0fc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:31.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.546+0000 7fda1206f640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fda0c114020 0x7fda0c0fbda0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:52174/0 (socket says 10.20.193.28:52174) 2026-02-24T09:17:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.546+0000 7fda1206f640 1 -- 10.20.193.28:0/4051782632 learned_addr learned my addr 10.20.193.28:0/4051782632 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.546+0000 7fda1186e640 1 --2- 10.20.193.28:0/4051782632 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fda0c114a10 0x7fda0c17a270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.546+0000 7fda1186e640 1 -- 10.20.193.28:0/4051782632 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fda0c1199a0 msgr2=0x7fda0c0fc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.546+0000 7fda1186e640 1 --2- 10.20.193.28:0/4051782632 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fda0c1199a0 0x7fda0c0fc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.546+0000 7fda1186e640 1 -- 10.20.193.28:0/4051782632 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fda0c114020 msgr2=0x7fda0c0fbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.546+0000 7fda1186e640 1 --2- 10.20.193.28:0/4051782632 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fda0c114020 0x7fda0c0fbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.546+0000 7fda1186e640 1 -- 10.20.193.28:0/4051782632 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda00009570 con 0x7fda0c114a10 2026-02-24T09:17:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.546+0000 7fda1186e640 1 --2- 10.20.193.28:0/4051782632 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fda0c114a10 0x7fda0c17a270 secure :-1 s=READY pgs=355 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda00009950 tx=0x7fda000028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.546+0000 7fd9f37fe640 1 -- 10.20.193.28:0/4051782632 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fda0003d070 con 0x7fda0c114a10 2026-02-24T09:17:31.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.546+0000 7fd9f37fe640 1 -- 10.20.193.28:0/4051782632 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fda0002fe20 con 0x7fda0c114a10 2026-02-24T09:17:31.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.546+0000 7fd9f37fe640 1 -- 10.20.193.28:0/4051782632 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fda000418c0 con 0x7fda0c114a10 2026-02-24T09:17:31.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.546+0000 7fda13071640 1 -- 10.20.193.28:0/4051782632 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda0c101c60 con 0x7fda0c114a10 2026-02-24T09:17:31.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.547+0000 7fda13071640 1 -- 10.20.193.28:0/4051782632 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda0c102080 con 0x7fda0c114a10 2026-02-24T09:17:31.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.547+0000 7fd9f17fa640 1 -- 10.20.193.28:0/4051782632 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda0c067220 con 0x7fda0c114a10 2026-02-24T09:17:31.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.549+0000 7fd9f37fe640 1 -- 10.20.193.28:0/4051782632 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7fda00041a50 con 0x7fda0c114a10 2026-02-24T09:17:31.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.551+0000 7fd9f37fe640 1 --2- 10.20.193.28:0/4051782632 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fd9e80b5830 0x7fd9e80d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:31.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.551+0000 7fd9f37fe640 1 -- 10.20.193.28:0/4051782632 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7fda0010b740 con 0x7fda0c114a10 2026-02-24T09:17:31.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.551+0000 7fda1206f640 1 --2- 10.20.193.28:0/4051782632 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fd9e80b5830 0x7fd9e80d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:31.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.551+0000 7fd9f37fe640 1 -- 10.20.193.28:0/4051782632 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fda0010bc30 con 0x7fda0c114a10 2026-02-24T09:17:31.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.552+0000 7fda1206f640 1 --2- 10.20.193.28:0/4051782632 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fd9e80b5830 0x7fd9e80d5ce0 secure :-1 s=READY pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd9fc00b2a0 tx=0x7fd9fc00b480 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:31.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.666+0000 7fd9f17fa640 1 -- 10.20.193.28:0/4051782632 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fda0c1143f0 con 0x7fda0c114a10 2026-02-24T09:17:31.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.667+0000 7fd9f37fe640 1 -- 10.20.193.28:0/4051782632 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+22632 (secure 0 0 0) 0x7fda000ce1d0 con 0x7fda0c114a10 2026-02-24T09:17:31.668 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:17:31.668 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":92,"fsid":"e9ad50af-1160-11f1-800e-d404e6e7d460","created":"2026-02-24T09:12:33.966733+0000","modified":"2026-02-24T09:17:01.228853+0000","last_up_change":"2026-02-24T09:16:34.222008+0000","last_in_change":"2026-02-24T09:16:20.530109+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":38,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T09:14:33.468078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-24T09:16:57.259549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-24T09:16:58.835796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7836f68-f25a-4aea-830a-3c2ce8ac79e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6803","nonce":2124354447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6805","nonce":2124354447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6809","nonce":2124354447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6807","nonce":2124354447}]},"public_addr":"10.20.193.28:6803/2124354447","cluster_addr":"10.20.193.28:6805/2124354447","heartbeat_back_addr":"10.20.193.28:6809/2124354447","heartbeat_front_addr":"10.20.193.28:6807/2124354447","state":["exists","up"]},{"osd":1,"uuid":"04273ff8-91e3-4e70-8041-cc8c205b9a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6800","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6801","nonce":267363486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6802","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6803","nonce":267363486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6806","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6807","nonce":267363486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6804","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6805","nonce":267363486}]},"public_addr":"10.20.193.74:6801/267363486","cluster_addr":"10.20.193.74:6803/267363486","heartbeat_back_addr":"10.20.193.74:6807/267363486","heartbeat_front_addr":"10.20.193.74:6805/267363486","state":["exists","up"]},{"osd":2,"uuid":"dea96db1-588b-4d08-8e52-52c4c995bdc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6800","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6801","nonce":3320466721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6802","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6803","nonce":3320466721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6806","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6807","nonce":3320466721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6804","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6805","nonce":3320466721}]},"public_addr":"10.20.193.159:6801/3320466721","cluster_addr":"10.20.193.159:6803/3320466721","heartbeat_back_addr":"10.20.193.159:6807/3320466721","heartbeat_front_addr":"10.20.193.159:6805/3320466721","state":["exists","up"]},{"osd":3,"uuid":"c785c244-eb3f-4af5-83c6-cd492459f75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6811","nonce":1790609615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6813","nonce":1790609615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6817","nonce":1790609615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6815","nonce":1790609615}]},"public_addr":"10.20.193.28:6811/1790609615","cluster_addr":"10.20.193.28:6813/1790609615","heartbeat_back_addr":"10.20.193.28:6817/1790609615","heartbeat_front_addr":"10.20.193.28:6815/1790609615","state":["exists","up"]},{"osd":4,"uuid":"041239c2-6187-4154-9557-b1b5846f9e0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6808","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6809","nonce":610990618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6810","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6811","nonce":610990618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6814","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6815","nonce":610990618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6812","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6813","nonce":610990618}]},"public_addr":"10.20.193.74:6809/610990618","cluster_addr":"10.20.193.74:6811/610990618","heartbeat_back_addr":"10.20.193.74:6815/610990618","heartbeat_front_addr":"10.20.193.74:6813/610990618","state":["exists","up"]},{"osd":5,"uuid":"ffeeb021-0924-4421-aecf-bac2e74364a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6808","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6809","nonce":1653417923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6810","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6811","nonce":1653417923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6814","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6815","nonce":1653417923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6812","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6813","nonce":1653417923}]},"public_addr":"10.20.193.159:6809/1653417923","cluster_addr":"10.20.193.159:6811/1653417923","heartbeat_back_addr":"10.20.193.159:6815/1653417923","heartbeat_front_addr":"10.20.193.159:6813/1653417923","state":["exists","up"]},{"osd":6,"uuid":"f3736156-4951-4901-9323-7930fb73b8dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6819","nonce":1891043856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6821","nonce":1891043856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6825","nonce":1891043856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6823","nonce":1891043856}]},"public_addr":"10.20.193.28:6819/1891043856","cluster_addr":"10.20.193.28:6821/1891043856","heartbeat_back_addr":"10.20.193.28:6825/1891043856","heartbeat_front_addr":"10.20.193.28:6823/1891043856","state":["exists","up"]},{"osd":7,"uuid":"214b27ee-75f9-4a54-a59b-e8bfbb895903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6816","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6817","nonce":2328869739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6818","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6819","nonce":2328869739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6822","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6823","nonce":2328869739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6820","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6821","nonce":2328869739}]},"public_addr":"10.20.193.74:6817/2328869739","cluster_addr":"10.20.193.74:6819/2328869739","heartbeat_back_addr":"10.20.193.74:6823/2328869739","heartbeat_front_addr":"10.20.193.74:6821/2328869739","state":["exists","up"]},{"osd":8,"uuid":"76599c26-6778-4fa2-b85d-feea8baac7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6816","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6817","nonce":3877834753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6818","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6819","nonce":3877834753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6822","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6823","nonce":3877834753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6820","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6821","nonce":3877834753}]},"public_addr":"10.20.193.159:6817/3877834753","cluster_addr":"10.20.193.159:6819/3877834753","heartbeat_back_addr":"10.20.193.159:6823/3877834753","heartbeat_front_addr":"10.20.193.159:6821/3877834753","state":["exists","up"]},{"osd":9,"uuid":"52b52b35-2d65-4e53-b7d8-fd7385d5ae88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6827","nonce":4207785690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6829","nonce":4207785690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6833","nonce":4207785690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6831","nonce":4207785690}]},"public_addr":"10.20.193.28:6827/4207785690","cluster_addr":"10.20.193.28:6829/4207785690","heartbeat_back_addr":"10.20.193.28:6833/4207785690","heartbeat_front_addr":"10.20.193.28:6831/4207785690","state":["exists","up"]},{"osd":10,"uuid":"65c8e576-a1c7-4c03-bbf6-57c775f2860f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6824","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6825","nonce":2590408209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6826","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6827","nonce":2590408209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6830","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6831","nonce":2590408209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6828","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6829","nonce":2590408209}]},"public_addr":"10.20.193.74:6825/2590408209","cluster_addr":"10.20.193.74:6827/2590408209","heartbeat_back_addr":"10.20.193.74:6831/2590408209","heartbeat_front_addr":"10.20.193.74:6829/2590408209","state":["exists","up"]},{"osd":11,"uuid":"e2305377-fadb-4cf0-8384-87387f116255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":87,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6824","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6825","nonce":709820718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6826","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6827","nonce":709820718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6830","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6831","nonce":709820718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6828","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6829","nonce":709820718}]},"public_addr":"10.20.193.159:6825/709820718","cluster_addr":"10.20.193.159:6827/709820718","heartbeat_back_addr":"10.20.193.159:6831/709820718","heartbeat_front_addr":"10.20.193.159:6829/709820718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:02.414561+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:16.784172+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:30.639920+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:44.510387+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:58.186053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:11.714819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:25.188981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:38.602303+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:51.899864+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:16:05.444224+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:16:18.900719+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:16:32.290361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:0/3696280830":"2026-02-25T09:13:39.242729+0000","10.20.193.28:6801/3539300247":"2026-02-25T09:13:39.242729+0000","10.20.193.28:0/3799405177":"2026-02-25T09:12:46.171932+0000","10.20.193.28:0/1189576634":"2026-02-25T09:12:46.171932+0000","10.20.193.28:6800/1682009277":"2026-02-25T09:12:46.171932+0000","10.20.193.28:6800/3539300247":"2026-02-25T09:13:39.242729+0000","10.20.193.28:6801/1682009277":"2026-02-25T09:12:46.171932+0000","10.20.193.28:0/673213915":"2026-02-25T09:12:59.028609+0000","10.20.193.28:0/857248143":"2026-02-25T09:13:39.242729+0000","10.20.193.28:0/1541006046":"2026-02-25T09:12:46.171932+0000","10.20.193.28:0/264576041":"2026-02-25T09:12:59.028609+0000","10.20.193.28:6800/2303472235":"2026-02-25T09:12:59.028609+0000","10.20.193.28:6801/2303472235":"2026-02-25T09:12:59.028609+0000","10.20.193.28:0/2622827224":"2026-02-25T09:12:59.028609+0000","10.20.193.28:0/3614117448":"2026-02-25T09:13:39.242729+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T09:17:31.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.669+0000 7fd9f17fa640 1 -- 10.20.193.28:0/4051782632 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fd9e80b5830 msgr2=0x7fd9e80d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:31.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.669+0000 7fd9f17fa640 1 --2- 10.20.193.28:0/4051782632 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fd9e80b5830 0x7fd9e80d5ce0 secure :-1 s=READY pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd9fc00b2a0 tx=0x7fd9fc00b480 comp rx=0 tx=0).stop 2026-02-24T09:17:31.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.669+0000 7fd9f17fa640 1 -- 10.20.193.28:0/4051782632 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fda0c114a10 msgr2=0x7fda0c17a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:31.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.669+0000 7fd9f17fa640 1 --2- 10.20.193.28:0/4051782632 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fda0c114a10 0x7fda0c17a270 secure :-1 s=READY pgs=355 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda00009950 tx=0x7fda000028d0 comp rx=0 tx=0).stop 2026-02-24T09:17:31.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.669+0000 7fd9f17fa640 1 -- 10.20.193.28:0/4051782632 shutdown_connections 2026-02-24T09:17:31.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.669+0000 7fd9f17fa640 1 --2- 10.20.193.28:0/4051782632 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fd9e80b5830 0x7fd9e80d5ce0 unknown :-1 s=CLOSED pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:31.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.669+0000 7fd9f17fa640 1 --2- 10.20.193.28:0/4051782632 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fda0c1199a0 0x7fda0c0fc4a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:31.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.669+0000 7fd9f17fa640 1 --2- 10.20.193.28:0/4051782632 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fda0c114a10 0x7fda0c17a270 unknown :-1 s=CLOSED pgs=355 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:31.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.669+0000 7fd9f17fa640 1 --2- 10.20.193.28:0/4051782632 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fda0c114020 0x7fda0c0fbda0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:31.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.669+0000 7fd9f17fa640 1 -- 10.20.193.28:0/4051782632 >> 10.20.193.28:0/4051782632 conn(0x7fda0c064810 msgr2=0x7fda0c065bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:31.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.669+0000 7fd9f17fa640 1 -- 10.20.193.28:0/4051782632 shutdown_connections 2026-02-24T09:17:31.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:31.669+0000 7fd9f17fa640 1 -- 10.20.193.28:0/4051782632 wait complete. 2026-02-24T09:17:31.766 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2026-02-24T09:16:59.889500+0000', 'modified': '2026-02-24T09:17:05.859296+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24788, 'mds_1': 24761, 'mds_2': 24760}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24727': {'gid': 24727, 'name': 'c', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.159:6837/2059577520', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.159:6836', 'nonce': 2059577520}, {'type': 'v1', 'addr': '10.20.193.159:6837', 'nonce': 2059577520}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24734': {'gid': 24734, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.74:6835/2067708838', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.74:6834', 'nonce': 2067708838}, {'type': 'v1', 'addr': '10.20.193.74:6835', 'nonce': 2067708838}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24745': {'gid': 24745, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.159:6839/533862317', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.159:6838', 'nonce': 533862317}, {'type': 'v1', 'addr': '10.20.193.159:6839', 'nonce': 533862317}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24760': {'gid': 24760, 'name': 'a', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 5, 'addr': '10.20.193.28:6841/492586680', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.28:6840', 'nonce': 492586680}, {'type': 'v1', 'addr': '10.20.193.28:6841', 'nonce': 492586680}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24761': {'gid': 24761, 'name': 'h', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 5, 'addr': '10.20.193.74:6837/958749351', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.74:6836', 'nonce': 958749351}, {'type': 'v1', 'addr': '10.20.193.74:6837', 'nonce': 958749351}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24788': {'gid': 24788, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '10.20.193.74:6839/828566790', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.74:6838', 'nonce': 828566790}, {'type': 'v1', 'addr': '10.20.193.74:6839', 'nonce': 828566790}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24788, 'qdb_cluster': [24788, 24761, 24760]} 2026-02-24T09:17:31.766 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2026-02-24T09:17:31.766 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph tell mds.a status 2026-02-24T09:17:31.948 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:32.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.131+0000 7ff85caa4640 1 -- 10.20.193.28:0/921575382 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff85810fff0 msgr2=0x7ff858115040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:32.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.131+0000 7ff85caa4640 1 --2- 10.20.193.28:0/921575382 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff85810fff0 0x7ff858115040 secure :-1 s=READY pgs=356 gs=1 cs=0 l=1 c_cookie=440357088407180363 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff848009950 tx=0x7ff84802f190 comp rx=0 tx=0).stop 2026-02-24T09:17:32.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.131+0000 7ff85caa4640 1 -- 10.20.193.28:0/921575382 shutdown_connections 2026-02-24T09:17:32.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.131+0000 7ff85caa4640 1 --2- 10.20.193.28:0/921575382 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff8581157f0 0x7ff8581761c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.131+0000 7ff85caa4640 1 --2- 10.20.193.28:0/921575382 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff85810fff0 0x7ff858115040 unknown :-1 s=CLOSED pgs=356 gs=1 cs=0 l=1 c_cookie=440357088407180363 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.131+0000 7ff85caa4640 1 --2- 10.20.193.28:0/921575382 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff85810f600 0x7ff85810f9d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.131+0000 7ff85caa4640 1 -- 10.20.193.28:0/921575382 >> 10.20.193.28:0/921575382 conn(0x7ff8580ecef0 msgr2=0x7ff85810d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:32.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.131+0000 7ff85caa4640 1 -- 10.20.193.28:0/921575382 shutdown_connections 2026-02-24T09:17:32.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.132+0000 7ff85caa4640 1 -- 10.20.193.28:0/921575382 wait complete. 2026-02-24T09:17:32.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.132+0000 7ff85caa4640 1 Processor -- start 2026-02-24T09:17:32.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.132+0000 7ff85caa4640 1 -- start start 2026-02-24T09:17:32.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.132+0000 7ff85caa4640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff85810f600 0x7ff8580f5950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.132+0000 7ff85caa4640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff85810fff0 0x7ff8581760c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.132+0000 7ff85caa4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8581157f0 0x7ff8580f6050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.132+0000 7ff85caa4640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff8580fb260 con 0x7ff8581157f0 2026-02-24T09:17:32.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.132+0000 7ff85caa4640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7ff8580fb3d0 con 0x7ff85810f600 2026-02-24T09:17:32.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.132+0000 7ff85caa4640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff8580fb590 con 0x7ff85810fff0 2026-02-24T09:17:32.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.133+0000 7ff857fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8581157f0 0x7ff8580f6050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:32.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.133+0000 7ff857fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8581157f0 0x7ff8580f6050 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43500/0 (socket says 10.20.193.28:43500) 2026-02-24T09:17:32.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.133+0000 7ff857fff640 1 -- 10.20.193.28:0/378611813 learned_addr learned my addr 10.20.193.28:0/378611813 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:32.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.133+0000 7ff856ffd640 1 --2- 10.20.193.28:0/378611813 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff85810fff0 0x7ff8581760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:32.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.133+0000 7ff8577fe640 1 --2- 10.20.193.28:0/378611813 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff85810f600 0x7ff8580f5950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:32.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.133+0000 7ff857fff640 1 -- 10.20.193.28:0/378611813 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff85810fff0 msgr2=0x7ff8581760c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:32.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.133+0000 7ff857fff640 1 --2- 10.20.193.28:0/378611813 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff85810fff0 0x7ff8581760c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.133+0000 7ff857fff640 1 -- 10.20.193.28:0/378611813 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff85810f600 msgr2=0x7ff8580f5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:32.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.133+0000 7ff857fff640 1 --2- 10.20.193.28:0/378611813 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff85810f600 0x7ff8580f5950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.133+0000 7ff857fff640 1 -- 10.20.193.28:0/378611813 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff848009570 con 0x7ff8581157f0 2026-02-24T09:17:32.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.133+0000 7ff857fff640 1 --2- 10.20.193.28:0/378611813 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8581157f0 0x7ff8580f6050 secure :-1 s=READY pgs=357 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff84c006e90 tx=0x7ff84c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:32.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.133+0000 7ff854ff9640 1 -- 10.20.193.28:0/378611813 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff84c005500 con 0x7ff8581157f0 2026-02-24T09:17:32.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.133+0000 7ff854ff9640 1 -- 10.20.193.28:0/378611813 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff84c005df0 con 0x7ff8581157f0 2026-02-24T09:17:32.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.133+0000 7ff854ff9640 1 -- 10.20.193.28:0/378611813 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff84c003a00 con 0x7ff8581157f0 2026-02-24T09:17:32.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.133+0000 7ff85caa4640 1 -- 10.20.193.28:0/378611813 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8580fb870 con 0x7ff8581157f0 2026-02-24T09:17:32.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.133+0000 7ff85caa4640 1 -- 10.20.193.28:0/378611813 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8580fbcf0 con 0x7ff8581157f0 2026-02-24T09:17:32.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.136+0000 7ff854ff9640 1 -- 10.20.193.28:0/378611813 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7ff84c020060 con 0x7ff8581157f0 2026-02-24T09:17:32.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.137+0000 7ff854ff9640 1 --2- 10.20.193.28:0/378611813 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff82c0b5830 0x7ff82c0d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.137+0000 7ff854ff9640 1 -- 10.20.193.28:0/378611813 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7ff84c0e7540 con 0x7ff8581157f0 2026-02-24T09:17:32.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.138+0000 7ff8577fe640 1 --2- 10.20.193.28:0/378611813 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff82c0b5830 0x7ff82c0d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:32.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.138+0000 7ff8577fe640 1 --2- 10.20.193.28:0/378611813 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff82c0b5830 0x7ff82c0d5ce0 secure :-1 s=READY pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff844004740 tx=0x7ff844004340 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:32.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.139+0000 7ff85fd27e00 1 Processor -- start 2026-02-24T09:17:32.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.139+0000 7ff85fd27e00 1 -- start start 2026-02-24T09:17:32.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.139+0000 7ff85fd27e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564cee9d6390 0x564cee9d6760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.139+0000 7ff85fd27e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564cee9d6ca0 0x564ceea1b400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.139+0000 7ff85fd27e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564ceea1b940 0x564ceea3bd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.139+0000 7ff85fd27e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564cee8ec910 con 0x564cee9d6390 2026-02-24T09:17:32.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.139+0000 7ff85fd27e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x564cee8e8640 con 0x564cee9d6ca0 2026-02-24T09:17:32.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.139+0000 7ff85fd27e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x564cee8e27a0 con 0x564ceea1b940 2026-02-24T09:17:32.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.140+0000 7ff8577fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564cee9d6390 0x564cee9d6760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:32.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.140+0000 7ff8577fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564cee9d6390 0x564cee9d6760 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43502/0 (socket says 10.20.193.28:43502) 2026-02-24T09:17:32.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.140+0000 7ff8577fe640 1 -- 10.20.193.28:0/2103396614 learned_addr learned my addr 10.20.193.28:0/2103396614 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:32.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.140+0000 7ff857fff640 1 --2- 10.20.193.28:0/2103396614 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564ceea1b940 0x564ceea3bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:32.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.140+0000 7ff856ffd640 1 --2- 10.20.193.28:0/2103396614 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564cee9d6ca0 0x564ceea1b400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:32.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.140+0000 7ff8577fe640 1 -- 10.20.193.28:0/2103396614 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564ceea1b940 msgr2=0x564ceea3bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:32.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.140+0000 7ff8577fe640 1 --2- 10.20.193.28:0/2103396614 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564ceea1b940 0x564ceea3bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.140+0000 7ff8577fe640 1 -- 10.20.193.28:0/2103396614 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564cee9d6ca0 msgr2=0x564ceea1b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:32.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.140+0000 7ff8577fe640 1 --2- 10.20.193.28:0/2103396614 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564cee9d6ca0 0x564ceea1b400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.140+0000 7ff8577fe640 1 -- 10.20.193.28:0/2103396614 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cee88dd00 con 0x564cee9d6390 2026-02-24T09:17:32.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.140+0000 7ff856ffd640 1 --2- 10.20.193.28:0/2103396614 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564cee9d6ca0 0x564ceea1b400 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:32.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.140+0000 7ff8577fe640 1 --2- 10.20.193.28:0/2103396614 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564cee9d6390 0x564cee9d6760 secure :-1 s=READY pgs=358 gs=1 cs=0 l=1 c_cookie=6457975635622251719 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff84400fd70 tx=0x7ff844012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599f569ff1644cc7 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:32.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.140+0000 7ff81bfff640 1 -- 10.20.193.28:0/2103396614 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff84401e680 con 0x564cee9d6390 2026-02-24T09:17:32.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.140+0000 7ff81bfff640 1 -- 10.20.193.28:0/2103396614 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff844011e60 con 0x564cee9d6390 2026-02-24T09:17:32.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.140+0000 7ff81bfff640 1 -- 10.20.193.28:0/2103396614 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff844010a20 con 0x564cee9d6390 2026-02-24T09:17:32.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.141+0000 7ff85fd27e00 1 -- 10.20.193.28:0/2103396614 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564cee9d6390 msgr2=0x564cee9d6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:32.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.141+0000 7ff85fd27e00 1 --2- 10.20.193.28:0/2103396614 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564cee9d6390 0x564cee9d6760 secure :-1 s=READY pgs=358 gs=1 cs=0 l=1 c_cookie=6457975635622251719 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff84400fd70 tx=0x7ff844012000 comp rx=0 tx=0).stop 2026-02-24T09:17:32.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.141+0000 7ff85fd27e00 1 -- 10.20.193.28:0/2103396614 shutdown_connections 2026-02-24T09:17:32.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.141+0000 7ff85fd27e00 1 --2- 10.20.193.28:0/2103396614 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564ceea1b940 0x564ceea3bd20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.141+0000 7ff85fd27e00 1 --2- 10.20.193.28:0/2103396614 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564cee9d6ca0 0x564ceea1b400 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.141+0000 7ff85fd27e00 1 --2- 10.20.193.28:0/2103396614 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564cee9d6390 0x564cee9d6760 unknown :-1 s=CLOSED pgs=358 gs=1 cs=0 l=1 c_cookie=6457975635622251719 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.141+0000 7ff85fd27e00 1 -- 10.20.193.28:0/2103396614 >> 10.20.193.28:0/2103396614 conn(0x564cee8f58a0 msgr2=0x564cee9d4c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:32.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.141+0000 7ff85fd27e00 1 -- 10.20.193.28:0/2103396614 shutdown_connections 2026-02-24T09:17:32.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.141+0000 7ff85fd27e00 1 -- 10.20.193.28:0/2103396614 wait complete. 2026-02-24T09:17:32.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.142+0000 7ff85fd27e00 1 -- start start 2026-02-24T09:17:32.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.142+0000 7ff85fd27e00 1 Processor -- start 2026-02-24T09:17:32.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.143+0000 7ff85fd27e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564cee9d6390 0x564ceea331b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.143+0000 7ff85fd27e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564cee9d6ca0 0x564ceea336f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.143+0000 7ff85fd27e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564ceea1b940 0x564ceea386e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.143+0000 7ff85fd27e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564ceea38c20 con 0x564cee9d6ca0 2026-02-24T09:17:32.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.143+0000 7ff85fd27e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x564ceea38d90 con 0x564cee9d6390 2026-02-24T09:17:32.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.143+0000 7ff85fd27e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x564ceea38f50 con 0x564ceea1b940 2026-02-24T09:17:32.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.143+0000 7ff856ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564cee9d6ca0 0x564ceea336f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:32.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.143+0000 7ff856ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564cee9d6ca0 0x564ceea336f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43512/0 (socket says 10.20.193.28:43512) 2026-02-24T09:17:32.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.143+0000 7ff856ffd640 1 -- 10.20.193.28:0/3207310207 learned_addr learned my addr 10.20.193.28:0/3207310207 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:32.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.143+0000 7ff8577fe640 1 --2- 10.20.193.28:0/3207310207 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564cee9d6390 0x564ceea331b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:32.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.143+0000 7ff857fff640 1 --2- 10.20.193.28:0/3207310207 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564ceea1b940 0x564ceea386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:32.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.143+0000 7ff856ffd640 1 -- 10.20.193.28:0/3207310207 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564ceea1b940 msgr2=0x564ceea386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:32.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.143+0000 7ff856ffd640 1 --2- 10.20.193.28:0/3207310207 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564ceea1b940 0x564ceea386e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.143+0000 7ff856ffd640 1 -- 10.20.193.28:0/3207310207 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564cee9d6390 msgr2=0x564ceea331b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:32.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.144+0000 7ff856ffd640 1 --2- 10.20.193.28:0/3207310207 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564cee9d6390 0x564ceea331b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.144+0000 7ff856ffd640 1 -- 10.20.193.28:0/3207310207 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cee8663b0 con 0x564cee9d6ca0 2026-02-24T09:17:32.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.144+0000 7ff857fff640 1 --2- 10.20.193.28:0/3207310207 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564ceea1b940 0x564ceea386e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:32.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.144+0000 7ff856ffd640 1 --2- 10.20.193.28:0/3207310207 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564cee9d6ca0 0x564ceea336f0 secure :-1 s=READY pgs=359 gs=1 cs=0 l=1 c_cookie=10533927310187538759 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8480046f0 tx=0x7ff848004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92300713d583a947 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:32.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.144+0000 7ff8197fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:17:32.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.144+0000 7ff8197fa640 1 -- 10.20.193.28:0/3207310207 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff848005dd0 con 0x564cee9d6ca0 2026-02-24T09:17:32.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.144+0000 7ff8197fa640 1 -- 10.20.193.28:0/3207310207 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff84803e050 con 0x564cee9d6ca0 2026-02-24T09:17:32.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.144+0000 7ff8197fa640 1 -- 10.20.193.28:0/3207310207 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff848043410 con 0x564cee9d6ca0 2026-02-24T09:17:32.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.144+0000 7ff85fd27e00 1 -- 10.20.193.28:0/3207310207 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff84400f9e0 con 0x564cee9d6ca0 2026-02-24T09:17:32.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.144+0000 7ff8197fa640 1 -- 10.20.193.28:0/3207310207 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7ff8480435a0 con 0x564cee9d6ca0 2026-02-24T09:17:32.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.144+0000 7ff85fd27e00 10 client.15432 _ll_register_callbacks cb 0x564cee86a510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:32.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.144+0000 7ff85fd27e00 1 -- 10.20.193.28:0/3207310207 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564cee578600 con 0x564cee9d6ca0 2026-02-24T09:17:32.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.145+0000 7ff8197fa640 1 -- 10.20.193.28:0/3207310207 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7ff8480386a0 con 0x564cee9d6ca0 2026-02-24T09:17:32.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.145+0000 7ff85fd27e00 10 client.15432 fetch_fsmap learned FSMap version 22 2026-02-24T09:17:32.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.145+0000 7ff85fd27e00 1 -- 10.20.193.28:0/3207310207 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=22}) -- 0x564cee8780d0 con 0x564cee9d6ca0 2026-02-24T09:17:32.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.145+0000 7ff8197fa640 1 -- 10.20.193.28:0/3207310207 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 22) ==== 8346+0+0 (secure 0 0 0) 0x7ff848038800 con 0x564cee9d6ca0 2026-02-24T09:17:32.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.145+0000 7ff85fd27e00 10 client.15432 fetch_fsmap finished waiting for FSMap version 22 2026-02-24T09:17:32.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.145+0000 7ff85fd27e00 10 client.15432 resolve_mds: resolved name 'a' to daemon mds.a 2026-02-24T09:17:32.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.145+0000 7ff85fd27e00 20 client.15432 populate_metadata read hostname 'trial028' 2026-02-24T09:17:32.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.145+0000 7ff85fd27e00 1 --2- 10.20.193.28:0/3207310207 >> [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] conn(0x564ceea198a0 0x564ceea1ad10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.145+0000 7ff85fd27e00 4 client.15432 mds_command: new command op to 24760 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:17:32.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.145+0000 7ff85fd27e00 1 -- 10.20.193.28:0/3207310207 --> [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564cee8b52e0 con 0x564ceea198a0 2026-02-24T09:17:32.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.145+0000 7ff8577fe640 1 --2- 10.20.193.28:0/3207310207 >> [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] conn(0x564ceea198a0 0x564ceea1ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:32.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.146+0000 7ff8577fe640 1 --2- 10.20.193.28:0/3207310207 >> [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] conn(0x564ceea198a0 0x564ceea1ad10 crc :-1 s=READY pgs=19 gs=4 cs=0 l=0 c_cookie=8632102083576987357 s_cookie=4993990251075250957 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=77cb631c3483fedd server_cookie=454e37ac8f1aab0d in_seq=0 out_seq=0 2026-02-24T09:17:32.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.146+0000 7ff8197fa640 10 client.15432 ms_handle_connect on v2:10.20.193.28:6840/492586680 2026-02-24T09:17:32.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.146+0000 7ff8197fa640 1 -- 10.20.193.28:0/3207310207 <== mds.2 v2:10.20.193.28:6840/492586680 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x564cee8b52e0 con 0x564ceea198a0 2026-02-24T09:17:32.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.146+0000 7ff8197fa640 10 client.15432 handle_command_reply: tid=0 2026-02-24T09:17:32.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.146+0000 7ff85fd27e00 1 client.15432 shutdown 2026-02-24T09:17:32.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.146+0000 7ff85fd27e00 1 -- 10.20.193.28:0/3207310207 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564cee9d6ca0 msgr2=0x564ceea336f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:32.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.146+0000 7ff85fd27e00 1 --2- 10.20.193.28:0/3207310207 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564cee9d6ca0 0x564ceea336f0 secure :-1 s=READY pgs=359 gs=1 cs=0 l=1 c_cookie=10533927310187538759 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8480046f0 tx=0x7ff848004290 comp rx=0 tx=0).stop 2026-02-24T09:17:32.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.147+0000 7ff85fd27e00 1 -- 10.20.193.28:0/3207310207 shutdown_connections 2026-02-24T09:17:32.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.147+0000 7ff85fd27e00 1 --2- 10.20.193.28:0/3207310207 >> [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] conn(0x564ceea198a0 0x564ceea1ad10 crc :-1 s=READY pgs=19 gs=4 cs=0 l=0 c_cookie=8632102083576987357 s_cookie=4993990251075250957 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.147+0000 7ff85fd27e00 1 --2- 10.20.193.28:0/3207310207 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564ceea1b940 0x564ceea386e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.147+0000 7ff85fd27e00 1 --2- 10.20.193.28:0/3207310207 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564cee9d6ca0 0x564ceea336f0 unknown :-1 s=CLOSED pgs=359 gs=1 cs=0 l=1 c_cookie=10533927310187538759 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.147+0000 7ff85fd27e00 1 --2- 10.20.193.28:0/3207310207 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564cee9d6390 0x564ceea331b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.147+0000 7ff8197fa640 0 client.15432 ms_handle_reset on v2:10.20.193.28:6840/492586680 2026-02-24T09:17:32.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.147+0000 7ff85fd27e00 1 -- 10.20.193.28:0/3207310207 >> 10.20.193.28:0/3207310207 conn(0x564cee8f58a0 msgr2=0x564cee9d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:32.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.147+0000 7ff85fd27e00 1 -- 10.20.193.28:0/3207310207 shutdown_connections 2026-02-24T09:17:32.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.147+0000 7ff85fd27e00 1 -- 10.20.193.28:0/3207310207 wait complete. 2026-02-24T09:17:32.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.147+0000 7ff85fd27e00 20 client.15432 trim_cache size 0 max 16384 2026-02-24T09:17:32.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.156+0000 7ff85fd27e00 1 Processor -- start 2026-02-24T09:17:32.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.156+0000 7ff85fd27e00 1 -- start start 2026-02-24T09:17:32.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.156+0000 7ff85fd27e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564cee9d6390 0x564ceea1e430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.156+0000 7ff85fd27e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564cee9d6ca0 0x564ceea20790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.156+0000 7ff85fd27e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564ceea1b940 0x564ceea30580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.156+0000 7ff85fd27e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564cee8e03d0 con 0x564cee9d6390 2026-02-24T09:17:32.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.156+0000 7ff85fd27e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x564cee5a0610 con 0x564cee9d6ca0 2026-02-24T09:17:32.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.156+0000 7ff85fd27e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x564ceea2c470 con 0x564ceea1b940 2026-02-24T09:17:32.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.156+0000 7ff8577fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564cee9d6390 0x564ceea1e430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:32.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.156+0000 7ff8577fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564cee9d6390 0x564ceea1e430 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43528/0 (socket says 10.20.193.28:43528) 2026-02-24T09:17:32.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.156+0000 7ff8577fe640 1 -- 10.20.193.28:0/156417882 learned_addr learned my addr 10.20.193.28:0/156417882 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:32.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.157+0000 7ff8577fe640 1 -- 10.20.193.28:0/156417882 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564ceea1b940 msgr2=0x564ceea30580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:32.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.157+0000 7ff8577fe640 1 --2- 10.20.193.28:0/156417882 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564ceea1b940 0x564ceea30580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.157+0000 7ff8577fe640 1 -- 10.20.193.28:0/156417882 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564cee9d6ca0 msgr2=0x564ceea20790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:32.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.157+0000 7ff8577fe640 1 --2- 10.20.193.28:0/156417882 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564cee9d6ca0 0x564ceea20790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.157+0000 7ff8577fe640 1 -- 10.20.193.28:0/156417882 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cee872b50 con 0x564cee9d6390 2026-02-24T09:17:32.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.157+0000 7ff8577fe640 1 --2- 10.20.193.28:0/156417882 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564cee9d6390 0x564ceea1e430 secure :-1 s=READY pgs=360 gs=1 cs=0 l=1 c_cookie=7518321497222151124 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff844004280 tx=0x7ff844010570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68567191651bfbd4 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:32.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.157+0000 7ff81b7fe640 1 -- 10.20.193.28:0/156417882 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff844030040 con 0x564cee9d6390 2026-02-24T09:17:32.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.157+0000 7ff81b7fe640 1 -- 10.20.193.28:0/156417882 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff844010d80 con 0x564cee9d6390 2026-02-24T09:17:32.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.157+0000 7ff81b7fe640 1 -- 10.20.193.28:0/156417882 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff844036320 con 0x564cee9d6390 2026-02-24T09:17:32.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.157+0000 7ff85fd27e00 1 -- 10.20.193.28:0/156417882 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564cee9d6390 msgr2=0x564ceea1e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:32.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.157+0000 7ff85fd27e00 1 --2- 10.20.193.28:0/156417882 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564cee9d6390 0x564ceea1e430 secure :-1 s=READY pgs=360 gs=1 cs=0 l=1 c_cookie=7518321497222151124 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff844004280 tx=0x7ff844010570 comp rx=0 tx=0).stop 2026-02-24T09:17:32.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.157+0000 7ff85fd27e00 1 -- 10.20.193.28:0/156417882 shutdown_connections 2026-02-24T09:17:32.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.157+0000 7ff85fd27e00 1 --2- 10.20.193.28:0/156417882 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564ceea1b940 0x564ceea30580 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.157+0000 7ff85fd27e00 1 --2- 10.20.193.28:0/156417882 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564cee9d6ca0 0x564ceea20790 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.157+0000 7ff85fd27e00 1 --2- 10.20.193.28:0/156417882 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564cee9d6390 0x564ceea1e430 unknown :-1 s=CLOSED pgs=360 gs=1 cs=0 l=1 c_cookie=7518321497222151124 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.157+0000 7ff85fd27e00 1 -- 10.20.193.28:0/156417882 >> 10.20.193.28:0/156417882 conn(0x564cee8f58a0 msgr2=0x564ceea1dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:32.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.157+0000 7ff85fd27e00 1 -- 10.20.193.28:0/156417882 shutdown_connections 2026-02-24T09:17:32.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.157+0000 7ff85fd27e00 1 -- 10.20.193.28:0/156417882 wait complete. 2026-02-24T09:17:32.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.158+0000 7ff85fd27e00 1 -- start start 2026-02-24T09:17:32.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.158+0000 7ff85fd27e00 1 Processor -- start 2026-02-24T09:17:32.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.158+0000 7ff85fd27e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564cee9d6390 0x564ceea5ba70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.158+0000 7ff85fd27e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564cee9d6ca0 0x564ceea3c410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.158+0000 7ff85fd27e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564ceea1b940 0x564ceea3c950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.158+0000 7ff85fd27e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564ceea5c280 con 0x564cee9d6390 2026-02-24T09:17:32.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.158+0000 7ff85fd27e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x564ceea3ce90 con 0x564cee9d6ca0 2026-02-24T09:17:32.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.158+0000 7ff85fd27e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x564ceea3d020 con 0x564ceea1b940 2026-02-24T09:17:32.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.158+0000 7ff8577fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564cee9d6390 0x564ceea5ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:32.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.159+0000 7ff8577fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564cee9d6390 0x564ceea5ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43536/0 (socket says 10.20.193.28:43536) 2026-02-24T09:17:32.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.159+0000 7ff8577fe640 1 -- 10.20.193.28:0/3370736434 learned_addr learned my addr 10.20.193.28:0/3370736434 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:32.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.159+0000 7ff856ffd640 1 --2- 10.20.193.28:0/3370736434 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564cee9d6ca0 0x564ceea3c410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:32.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.159+0000 7ff8577fe640 1 -- 10.20.193.28:0/3370736434 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564ceea1b940 msgr2=0x564ceea3c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:32.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.159+0000 7ff8577fe640 1 --2- 10.20.193.28:0/3370736434 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564ceea1b940 0x564ceea3c950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.159+0000 7ff8577fe640 1 -- 10.20.193.28:0/3370736434 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564cee9d6ca0 msgr2=0x564ceea3c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:32.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.159+0000 7ff8577fe640 1 --2- 10.20.193.28:0/3370736434 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564cee9d6ca0 0x564ceea3c410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.159+0000 7ff8577fe640 1 -- 10.20.193.28:0/3370736434 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cee8666e0 con 0x564cee9d6390 2026-02-24T09:17:32.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.159+0000 7ff856ffd640 1 --2- 10.20.193.28:0/3370736434 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564cee9d6ca0 0x564ceea3c410 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:32.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.159+0000 7ff8577fe640 1 --2- 10.20.193.28:0/3370736434 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564cee9d6390 0x564ceea5ba70 secure :-1 s=READY pgs=361 gs=1 cs=0 l=1 c_cookie=1193808887266146456 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff844010540 tx=0x7ff844004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=109142db9f33f898 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:32.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.159+0000 7ff8197fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:17:32.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.159+0000 7ff8197fa640 1 -- 10.20.193.28:0/3370736434 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff844030040 con 0x564cee9d6390 2026-02-24T09:17:32.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.159+0000 7ff8197fa640 1 -- 10.20.193.28:0/3370736434 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff844036670 con 0x564cee9d6390 2026-02-24T09:17:32.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.159+0000 7ff8197fa640 1 -- 10.20.193.28:0/3370736434 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff84401ed10 con 0x564cee9d6390 2026-02-24T09:17:32.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.159+0000 7ff85fd27e00 1 -- 10.20.193.28:0/3370736434 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cee88dd00 con 0x564cee9d6390 2026-02-24T09:17:32.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.159+0000 7ff8197fa640 1 -- 10.20.193.28:0/3370736434 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7ff844040460 con 0x564cee9d6390 2026-02-24T09:17:32.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.159+0000 7ff85fd27e00 10 client.15438 _ll_register_callbacks cb 0x564cee86a510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:32.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.159+0000 7ff85fd27e00 1 -- 10.20.193.28:0/3370736434 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564cee8efb90 con 0x564cee9d6390 2026-02-24T09:17:32.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.160+0000 7ff8197fa640 1 -- 10.20.193.28:0/3370736434 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7ff84401e460 con 0x564cee9d6390 2026-02-24T09:17:32.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.160+0000 7ff85fd27e00 10 client.15438 fetch_fsmap learned FSMap version 22 2026-02-24T09:17:32.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.160+0000 7ff85fd27e00 1 -- 10.20.193.28:0/3370736434 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=22}) -- 0x564cee878330 con 0x564cee9d6390 2026-02-24T09:17:32.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.160+0000 7ff8197fa640 1 -- 10.20.193.28:0/3370736434 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 22) ==== 8346+0+0 (secure 0 0 0) 0x7ff84401e620 con 0x564cee9d6390 2026-02-24T09:17:32.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.160+0000 7ff85fd27e00 10 client.15438 fetch_fsmap finished waiting for FSMap version 22 2026-02-24T09:17:32.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.160+0000 7ff85fd27e00 10 client.15438 resolve_mds: resolved name 'a' to daemon mds.a 2026-02-24T09:17:32.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.160+0000 7ff85fd27e00 20 client.15438 populate_metadata read hostname 'trial028' 2026-02-24T09:17:32.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.160+0000 7ff85fd27e00 1 --2- 10.20.193.28:0/3370736434 >> [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] conn(0x564ceea040a0 0x564ceea02db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.160+0000 7ff85fd27e00 4 client.15438 mds_command: new command op to 24760 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-24T09:17:32.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.160+0000 7ff85fd27e00 1 -- 10.20.193.28:0/3370736434 --> [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] -- command(tid 0: {"prefix": "status"}) -- 0x564cee575e50 con 0x564ceea040a0 2026-02-24T09:17:32.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.160+0000 7ff856ffd640 1 --2- 10.20.193.28:0/3370736434 >> [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] conn(0x564ceea040a0 0x564ceea02db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:32.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.161+0000 7ff856ffd640 1 --2- 10.20.193.28:0/3370736434 >> [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] conn(0x564ceea040a0 0x564ceea02db0 crc :-1 s=READY pgs=20 gs=4 cs=0 l=0 c_cookie=8707483554287779175 s_cookie=4816877966576313164 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=78d732288ce0fd67 server_cookie=42d8fcfd5c2fe34c in_seq=0 out_seq=0 2026-02-24T09:17:32.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.161+0000 7ff8197fa640 10 client.15438 ms_handle_connect on v2:10.20.193.28:6840/492586680 2026-02-24T09:17:32.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.161+0000 7ff8197fa640 1 -- 10.20.193.28:0/3370736434 <== mds.2 v2:10.20.193.28:6840/492586680 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1217 (crc 0 0 0) 0x564cee575e50 con 0x564ceea040a0 2026-02-24T09:17:32.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.161+0000 7ff8197fa640 10 client.15438 handle_command_reply: tid=0 2026-02-24T09:17:32.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.161+0000 7ff85fd27e00 1 client.15438 shutdown 2026-02-24T09:17:32.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.161+0000 7ff85fd27e00 1 -- 10.20.193.28:0/3370736434 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564cee9d6390 msgr2=0x564ceea5ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:32.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.161+0000 7ff85fd27e00 1 --2- 10.20.193.28:0/3370736434 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564cee9d6390 0x564ceea5ba70 secure :-1 s=READY pgs=361 gs=1 cs=0 l=1 c_cookie=1193808887266146456 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff844010540 tx=0x7ff844004630 comp rx=0 tx=0).stop 2026-02-24T09:17:32.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.161+0000 7ff85fd27e00 1 -- 10.20.193.28:0/3370736434 shutdown_connections 2026-02-24T09:17:32.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.161+0000 7ff85fd27e00 1 --2- 10.20.193.28:0/3370736434 >> [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] conn(0x564ceea040a0 0x564ceea02db0 crc :-1 s=READY pgs=20 gs=4 cs=0 l=0 c_cookie=8707483554287779175 s_cookie=4816877966576313164 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.161+0000 7ff85fd27e00 1 --2- 10.20.193.28:0/3370736434 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564ceea1b940 0x564ceea3c950 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.161+0000 7ff85fd27e00 1 --2- 10.20.193.28:0/3370736434 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564cee9d6ca0 0x564ceea3c410 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.161+0000 7ff85fd27e00 1 --2- 10.20.193.28:0/3370736434 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564cee9d6390 0x564ceea5ba70 unknown :-1 s=CLOSED pgs=361 gs=1 cs=0 l=1 c_cookie=1193808887266146456 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.161+0000 7ff85fd27e00 1 -- 10.20.193.28:0/3370736434 >> 10.20.193.28:0/3370736434 conn(0x564cee8f58a0 msgr2=0x564ceea315e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:32.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.161+0000 7ff8197fa640 0 client.15438 ms_handle_reset on v2:10.20.193.28:6840/492586680 2026-02-24T09:17:32.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.162+0000 7ff85fd27e00 1 -- 10.20.193.28:0/3370736434 shutdown_connections 2026-02-24T09:17:32.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.162+0000 7ff85fd27e00 1 -- 10.20.193.28:0/3370736434 wait complete. 2026-02-24T09:17:32.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.162+0000 7ff85fd27e00 20 client.15438 trim_cache size 0 max 16384 2026-02-24T09:17:32.169 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-24T09:17:32.169 INFO:teuthology.orchestra.run.trial028.stdout: "cluster_fsid": "e9ad50af-1160-11f1-800e-d404e6e7d460", 2026-02-24T09:17:32.169 INFO:teuthology.orchestra.run.trial028.stdout: "whoami": 2, 2026-02-24T09:17:32.169 INFO:teuthology.orchestra.run.trial028.stdout: "id": 24760, 2026-02-24T09:17:32.169 INFO:teuthology.orchestra.run.trial028.stdout: "want_state": "up:active", 2026-02-24T09:17:32.169 INFO:teuthology.orchestra.run.trial028.stdout: "state": "up:active", 2026-02-24T09:17:32.169 INFO:teuthology.orchestra.run.trial028.stdout: "fs_name": "cephfs", 2026-02-24T09:17:32.170 INFO:teuthology.orchestra.run.trial028.stdout: "rank_uptime": 26.912612862, 2026-02-24T09:17:32.170 INFO:teuthology.orchestra.run.trial028.stdout: "mdsmap_epoch": 22, 2026-02-24T09:17:32.170 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch": 92, 2026-02-24T09:17:32.170 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch_barrier": 92, 2026-02-24T09:17:32.170 INFO:teuthology.orchestra.run.trial028.stdout: "uptime": 39.302985366000001, 2026-02-24T09:17:32.170 INFO:teuthology.orchestra.run.trial028.stdout: "sysinfo": { 2026-02-24T09:17:32.170 INFO:teuthology.orchestra.run.trial028.stdout: "arch": "x86_64", 2026-02-24T09:17:32.170 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_release": "tentacle", 2026-02-24T09:17:32.170 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version": "ceph version 20.3.0-5537-g5bc9a1ff (5bc9a1ffc19df681248ece8c3c8c7191a571745b) tentacle (dev - RelWithDebInfo)", 2026-02-24T09:17:32.171 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version_short": "20.3.0-5537-g5bc9a1ff", 2026-02-24T09:17:32.171 INFO:teuthology.orchestra.run.trial028.stdout: "container_hostname": "trial028", 2026-02-24T09:17:32.171 INFO:teuthology.orchestra.run.trial028.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b", 2026-02-24T09:17:32.171 INFO:teuthology.orchestra.run.trial028.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-24T09:17:32.171 INFO:teuthology.orchestra.run.trial028.stdout: "distro": "centos", 2026-02-24T09:17:32.171 INFO:teuthology.orchestra.run.trial028.stdout: "distro_description": "CentOS Stream 9", 2026-02-24T09:17:32.171 INFO:teuthology.orchestra.run.trial028.stdout: "distro_version": "9", 2026-02-24T09:17:32.171 INFO:teuthology.orchestra.run.trial028.stdout: "hostname": "trial028", 2026-02-24T09:17:32.171 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Thu Feb 12 10:25:42 EST 2026", 2026-02-24T09:17:32.171 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_version": "6.19.0-g8dec4b357aab", 2026-02-24T09:17:32.171 INFO:teuthology.orchestra.run.trial028.stdout: "mem_swap_kb": "8388604", 2026-02-24T09:17:32.172 INFO:teuthology.orchestra.run.trial028.stdout: "mem_total_kb": "130448336", 2026-02-24T09:17:32.172 INFO:teuthology.orchestra.run.trial028.stdout: "os": "Linux" 2026-02-24T09:17:32.172 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:17:32.172 INFO:teuthology.orchestra.run.trial028.stdout: "endian": "little" 2026-02-24T09:17:32.172 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-24T09:17:32.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.162+0000 7ff85caa4640 1 -- 10.20.193.28:0/378611813 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff82c0b5830 msgr2=0x7ff82c0d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:32.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.162+0000 7ff85caa4640 1 --2- 10.20.193.28:0/378611813 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff82c0b5830 0x7ff82c0d5ce0 secure :-1 s=READY pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff844004740 tx=0x7ff844004340 comp rx=0 tx=0).stop 2026-02-24T09:17:32.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.162+0000 7ff85caa4640 1 -- 10.20.193.28:0/378611813 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8581157f0 msgr2=0x7ff8580f6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:32.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.162+0000 7ff85caa4640 1 --2- 10.20.193.28:0/378611813 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8581157f0 0x7ff8580f6050 secure :-1 s=READY pgs=357 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff84c006e90 tx=0x7ff84c00edf0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.162+0000 7ff85caa4640 1 -- 10.20.193.28:0/378611813 shutdown_connections 2026-02-24T09:17:32.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.162+0000 7ff85caa4640 1 --2- 10.20.193.28:0/378611813 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff82c0b5830 0x7ff82c0d5ce0 unknown :-1 s=CLOSED pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.162+0000 7ff85caa4640 1 --2- 10.20.193.28:0/378611813 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8581157f0 0x7ff8580f6050 unknown :-1 s=CLOSED pgs=357 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.162+0000 7ff85caa4640 1 --2- 10.20.193.28:0/378611813 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff85810fff0 0x7ff8581760c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.162+0000 7ff85caa4640 1 --2- 10.20.193.28:0/378611813 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff85810f600 0x7ff8580f5950 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.162+0000 7ff85caa4640 1 -- 10.20.193.28:0/378611813 >> 10.20.193.28:0/378611813 conn(0x7ff8580ecef0 msgr2=0x7ff858111e00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:32.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.162+0000 7ff85caa4640 1 -- 10.20.193.28:0/378611813 shutdown_connections 2026-02-24T09:17:32.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.163+0000 7ff85caa4640 1 -- 10.20.193.28:0/378611813 wait complete. 2026-02-24T09:17:32.260 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:32 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/1244093987' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:17:32.261 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:32 trial028 ceph-mon[40371]: pgmap v196: 97 pgs: 97 active+clean; 648 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2026-02-24T09:17:32.261 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:32 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/4051782632' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:17:32.263 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph tell mds.h status 2026-02-24T09:17:32.279 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:32 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/1244093987' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:17:32.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:32 trial159 ceph-mon[44242]: pgmap v196: 97 pgs: 97 active+clean; 648 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2026-02-24T09:17:32.280 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:32 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/4051782632' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:17:32.373 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:32 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/1244093987' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:17:32.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:32 trial074 ceph-mon[44412]: pgmap v196: 97 pgs: 97 active+clean; 648 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2026-02-24T09:17:32.374 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:32 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/4051782632' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:17:32.446 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:32.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.612+0000 7f21bcc3b640 1 -- 10.20.193.28:0/3201799925 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f21b80618c0 msgr2=0x7f21b8155640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:32.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.612+0000 7f21bcc3b640 1 --2- 10.20.193.28:0/3201799925 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f21b80618c0 0x7f21b8155640 secure :-1 s=READY pgs=105 gs=1 cs=0 l=1 c_cookie=8831657126506427262 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21a0009950 tx=0x7f21a002f190 comp rx=0 tx=0).stop 2026-02-24T09:17:32.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.612+0000 7f21bcc3b640 1 -- 10.20.193.28:0/3201799925 shutdown_connections 2026-02-24T09:17:32.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.612+0000 7f21bcc3b640 1 --2- 10.20.193.28:0/3201799925 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f21b8155b80 0x7f21b8175f60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.612+0000 7f21bcc3b640 1 --2- 10.20.193.28:0/3201799925 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f21b80618c0 0x7f21b8155640 unknown :-1 s=CLOSED pgs=105 gs=1 cs=0 l=1 c_cookie=8831657126506427262 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.612+0000 7f21bcc3b640 1 --2- 10.20.193.28:0/3201799925 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f21b8060fb0 0x7f21b8061380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.612+0000 7f21bcc3b640 1 -- 10.20.193.28:0/3201799925 >> 10.20.193.28:0/3201799925 conn(0x7f21b80ead50 msgr2=0x7f21b810b160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:32.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.613+0000 7f21bcc3b640 1 -- 10.20.193.28:0/3201799925 shutdown_connections 2026-02-24T09:17:32.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.613+0000 7f21bcc3b640 1 -- 10.20.193.28:0/3201799925 wait complete. 2026-02-24T09:17:32.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.613+0000 7f21bcc3b640 1 Processor -- start 2026-02-24T09:17:32.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.613+0000 7f21bcc3b640 1 -- start start 2026-02-24T09:17:32.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.613+0000 7f21bcc3b640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f21b8060fb0 0x7f21b81623b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.614+0000 7f21bcc3b640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f21b80618c0 0x7f21b81628f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.614+0000 7f21bcc3b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f21b8155b80 0x7f21b8167cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.614+0000 7f21bcc3b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f21b81682e0 con 0x7f21b8155b80 2026-02-24T09:17:32.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.614+0000 7f21bcc3b640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f21b8168450 con 0x7f21b80618c0 2026-02-24T09:17:32.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.614+0000 7f21bcc3b640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f21b8168610 con 0x7f21b8060fb0 2026-02-24T09:17:32.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.614+0000 7f21b5d74640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f21b80618c0 0x7f21b81628f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:32.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.614+0000 7f21b5d74640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f21b80618c0 0x7f21b81628f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:52238/0 (socket says 10.20.193.28:52238) 2026-02-24T09:17:32.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.614+0000 7f21b5d74640 1 -- 10.20.193.28:0/1908717077 learned_addr learned my addr 10.20.193.28:0/1908717077 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:32.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.614+0000 7f21b6d76640 1 --2- 10.20.193.28:0/1908717077 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f21b8155b80 0x7f21b8167cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:32.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.614+0000 7f21b6575640 1 --2- 10.20.193.28:0/1908717077 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f21b8060fb0 0x7f21b81623b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:32.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.614+0000 7f21b5d74640 1 -- 10.20.193.28:0/1908717077 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f21b8060fb0 msgr2=0x7f21b81623b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:32.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.614+0000 7f21b5d74640 1 --2- 10.20.193.28:0/1908717077 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f21b8060fb0 0x7f21b81623b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.614+0000 7f21b5d74640 1 -- 10.20.193.28:0/1908717077 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f21b8155b80 msgr2=0x7f21b8167cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:32.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.614+0000 7f21b5d74640 1 --2- 10.20.193.28:0/1908717077 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f21b8155b80 0x7f21b8167cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.614+0000 7f21b5d74640 1 -- 10.20.193.28:0/1908717077 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21ac0094b0 con 0x7f21b80618c0 2026-02-24T09:17:32.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.615+0000 7f21b5d74640 1 --2- 10.20.193.28:0/1908717077 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f21b80618c0 0x7f21b81628f0 secure :-1 s=READY pgs=106 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21a00098a0 tx=0x7f21a0005dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:32.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.615+0000 7f219f7fe640 1 -- 10.20.193.28:0/1908717077 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f21a003d070 con 0x7f21b80618c0 2026-02-24T09:17:32.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.615+0000 7f21bcc3b640 1 -- 10.20.193.28:0/1908717077 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21a0009570 con 0x7f21b80618c0 2026-02-24T09:17:32.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.615+0000 7f21bcc3b640 1 -- 10.20.193.28:0/1908717077 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21b8151600 con 0x7f21b80618c0 2026-02-24T09:17:32.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.615+0000 7f219f7fe640 1 -- 10.20.193.28:0/1908717077 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f21a00386a0 con 0x7f21b80618c0 2026-02-24T09:17:32.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.615+0000 7f219f7fe640 1 -- 10.20.193.28:0/1908717077 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f21a0041690 con 0x7f21b80618c0 2026-02-24T09:17:32.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.618+0000 7f219f7fe640 1 -- 10.20.193.28:0/1908717077 <== mon.2 v2:10.20.193.74:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f21a0038810 con 0x7f21b80618c0 2026-02-24T09:17:32.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.620+0000 7f219f7fe640 1 --2- 10.20.193.28:0/1908717077 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f21900b5840 0x7f21900d5cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.620+0000 7f219f7fe640 1 -- 10.20.193.28:0/1908717077 <== mon.2 v2:10.20.193.74:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f21a010b060 con 0x7f21b80618c0 2026-02-24T09:17:32.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.620+0000 7f21b6575640 1 --2- 10.20.193.28:0/1908717077 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f21900b5840 0x7f21900d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:32.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.620+0000 7f21bec35e00 1 Processor -- start 2026-02-24T09:17:32.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.620+0000 7f21bec35e00 1 -- start start 2026-02-24T09:17:32.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.620+0000 7f21b6575640 1 --2- 10.20.193.28:0/1908717077 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f21900b5840 0x7f21900d5cf0 secure :-1 s=READY pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21ac004740 tx=0x7f21ac005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:32.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.621+0000 7f21bec35e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a166a390 0x55a4a166a760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.621+0000 7f21bec35e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a4a166aca0 0x55a4a16af400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.621+0000 7f21bec35e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a4a16af940 0x55a4a16cfd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.621+0000 7f21bec35e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a4a1580910 con 0x55a4a166a390 2026-02-24T09:17:32.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.621+0000 7f21bec35e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55a4a157c640 con 0x55a4a166aca0 2026-02-24T09:17:32.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.621+0000 7f21bec35e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55a4a15767a0 con 0x55a4a16af940 2026-02-24T09:17:32.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.621+0000 7f21b6575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a166a390 0x55a4a166a760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:32.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.621+0000 7f21b6575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a166a390 0x55a4a166a760 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43572/0 (socket says 10.20.193.28:43572) 2026-02-24T09:17:32.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.621+0000 7f21b6575640 1 -- 10.20.193.28:0/3816588262 learned_addr learned my addr 10.20.193.28:0/3816588262 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:32.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.621+0000 7f21b5d74640 1 --2- 10.20.193.28:0/3816588262 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a4a166aca0 0x55a4a16af400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:32.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.621+0000 7f21b6d76640 1 --2- 10.20.193.28:0/3816588262 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a4a16af940 0x55a4a16cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:32.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.621+0000 7f21b6575640 1 -- 10.20.193.28:0/3816588262 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a4a16af940 msgr2=0x55a4a16cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:32.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.621+0000 7f21b6575640 1 --2- 10.20.193.28:0/3816588262 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a4a16af940 0x55a4a16cfd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.621+0000 7f21b6575640 1 -- 10.20.193.28:0/3816588262 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a4a166aca0 msgr2=0x55a4a16af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:32.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.621+0000 7f21b6575640 1 --2- 10.20.193.28:0/3816588262 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a4a166aca0 0x55a4a16af400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.621+0000 7f21b6575640 1 -- 10.20.193.28:0/3816588262 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4a1521d00 con 0x55a4a166a390 2026-02-24T09:17:32.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.621+0000 7f21b6575640 1 --2- 10.20.193.28:0/3816588262 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a166a390 0x55a4a166a760 secure :-1 s=READY pgs=362 gs=1 cs=0 l=1 c_cookie=15173074877209493527 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21ac009e00 tx=0x7f21ac014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2919735de79c017 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:32.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.621+0000 7f219cff9640 1 -- 10.20.193.28:0/3816588262 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f21ac012bc0 con 0x55a4a166a390 2026-02-24T09:17:32.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.622+0000 7f219cff9640 1 -- 10.20.193.28:0/3816588262 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f21ac016070 con 0x55a4a166a390 2026-02-24T09:17:32.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.622+0000 7f219cff9640 1 -- 10.20.193.28:0/3816588262 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f21ac01b710 con 0x55a4a166a390 2026-02-24T09:17:32.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.622+0000 7f21bec35e00 1 -- 10.20.193.28:0/3816588262 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a166a390 msgr2=0x55a4a166a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:32.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.622+0000 7f21bec35e00 1 --2- 10.20.193.28:0/3816588262 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a166a390 0x55a4a166a760 secure :-1 s=READY pgs=362 gs=1 cs=0 l=1 c_cookie=15173074877209493527 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21ac009e00 tx=0x7f21ac014000 comp rx=0 tx=0).stop 2026-02-24T09:17:32.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.622+0000 7f21bec35e00 1 -- 10.20.193.28:0/3816588262 shutdown_connections 2026-02-24T09:17:32.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.622+0000 7f21bec35e00 1 --2- 10.20.193.28:0/3816588262 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a4a16af940 0x55a4a16cfd20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.622+0000 7f21bec35e00 1 --2- 10.20.193.28:0/3816588262 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a4a166aca0 0x55a4a16af400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.622+0000 7f21bec35e00 1 --2- 10.20.193.28:0/3816588262 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a166a390 0x55a4a166a760 unknown :-1 s=CLOSED pgs=362 gs=1 cs=0 l=1 c_cookie=15173074877209493527 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.622+0000 7f21bec35e00 1 -- 10.20.193.28:0/3816588262 >> 10.20.193.28:0/3816588262 conn(0x55a4a15898a0 msgr2=0x55a4a1668c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:32.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.622+0000 7f21bec35e00 1 -- 10.20.193.28:0/3816588262 shutdown_connections 2026-02-24T09:17:32.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.622+0000 7f21bec35e00 1 -- 10.20.193.28:0/3816588262 wait complete. 2026-02-24T09:17:32.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.623+0000 7f21bec35e00 1 -- start start 2026-02-24T09:17:32.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.624+0000 7f21bec35e00 1 Processor -- start 2026-02-24T09:17:32.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.624+0000 7f21bec35e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a4a166a390 0x55a4a16c7200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.624+0000 7f21bec35e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a166aca0 0x55a4a16c7740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.624+0000 7f21bec35e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a4a16af940 0x55a4a16cc730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.624+0000 7f21bec35e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a4a16ccc70 con 0x55a4a166aca0 2026-02-24T09:17:32.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.624+0000 7f21bec35e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55a4a16ccde0 con 0x55a4a16af940 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.624+0000 7f21bec35e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55a4a16ccfa0 con 0x55a4a166a390 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.624+0000 7f21b5d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a166aca0 0x55a4a16c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.625+0000 7f21b5d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a166aca0 0x55a4a16c7740 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43574/0 (socket says 10.20.193.28:43574) 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.625+0000 7f21b5d74640 1 -- 10.20.193.28:0/2053169701 learned_addr learned my addr 10.20.193.28:0/2053169701 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.625+0000 7f21b6575640 1 --2- 10.20.193.28:0/2053169701 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a4a166a390 0x55a4a16c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.625+0000 7f21b6d76640 1 --2- 10.20.193.28:0/2053169701 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a4a16af940 0x55a4a16cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.625+0000 7f21b5d74640 1 -- 10.20.193.28:0/2053169701 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a4a166a390 msgr2=0x55a4a16c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.625+0000 7f21b5d74640 1 --2- 10.20.193.28:0/2053169701 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a4a166a390 0x55a4a16c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.625+0000 7f21b5d74640 1 -- 10.20.193.28:0/2053169701 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a4a16af940 msgr2=0x55a4a16cc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.625+0000 7f21b5d74640 1 --2- 10.20.193.28:0/2053169701 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a4a16af940 0x55a4a16cc730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.625+0000 7f21b5d74640 1 -- 10.20.193.28:0/2053169701 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4a14fa3b0 con 0x55a4a166aca0 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.625+0000 7f21b5d74640 1 --2- 10.20.193.28:0/2053169701 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a166aca0 0x55a4a16c7740 secure :-1 s=READY pgs=363 gs=1 cs=0 l=1 c_cookie=2927557325864288606 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21a0108ba0 tx=0x7f21a002fdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a0c5e083bbc15e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.625+0000 7f2167fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.625+0000 7f2167fff640 1 -- 10.20.193.28:0/2053169701 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f21a0038c10 con 0x55a4a166aca0 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.625+0000 7f2167fff640 1 -- 10.20.193.28:0/2053169701 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f21a00d1df0 con 0x55a4a166aca0 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.625+0000 7f2167fff640 1 -- 10.20.193.28:0/2053169701 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f21a00cf650 con 0x55a4a166aca0 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.625+0000 7f21bec35e00 1 -- 10.20.193.28:0/2053169701 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21ac002e20 con 0x55a4a166aca0 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.625+0000 7f2167fff640 1 -- 10.20.193.28:0/2053169701 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f21a00d2de0 con 0x55a4a166aca0 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.625+0000 7f2167fff640 10 client.15450 inactive, discarding osd_map(92..92 src has 1..92) 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.625+0000 7f21bec35e00 10 client.15450 _ll_register_callbacks cb 0x55a4a14fe510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.625+0000 7f21bec35e00 1 -- 10.20.193.28:0/2053169701 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a4a120c600 con 0x55a4a166aca0 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.626+0000 7f2167fff640 1 -- 10.20.193.28:0/2053169701 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f21a00d2320 con 0x55a4a166aca0 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.626+0000 7f21bec35e00 10 client.15450 fetch_fsmap learned FSMap version 22 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.626+0000 7f21bec35e00 1 -- 10.20.193.28:0/2053169701 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=22}) -- 0x55a4a150c0d0 con 0x55a4a166aca0 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.626+0000 7f2167fff640 1 -- 10.20.193.28:0/2053169701 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 22) ==== 8346+0+0 (secure 0 0 0) 0x7f21a00d06e0 con 0x55a4a166aca0 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.626+0000 7f21bec35e00 10 client.15450 fetch_fsmap finished waiting for FSMap version 22 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.626+0000 7f21bec35e00 10 client.15450 resolve_mds: resolved name 'h' to daemon mds.h 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.626+0000 7f21bec35e00 20 client.15450 populate_metadata read hostname 'trial028' 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.626+0000 7f21bec35e00 1 --2- 10.20.193.28:0/2053169701 >> [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] conn(0x55a4a16ad5a0 0x55a4a16aea10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.626+0000 7f21bec35e00 4 client.15450 mds_command: new command op to 24761 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.626+0000 7f21bec35e00 1 -- 10.20.193.28:0/2053169701 --> [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a4a15492e0 con 0x55a4a16ad5a0 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.626+0000 7f21b6575640 1 --2- 10.20.193.28:0/2053169701 >> [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] conn(0x55a4a16ad5a0 0x55a4a16aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.627+0000 7f21b6575640 1 --2- 10.20.193.28:0/2053169701 >> [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] conn(0x55a4a16ad5a0 0x55a4a16aea10 crc :-1 s=READY pgs=19 gs=4 cs=0 l=0 c_cookie=16811144557731514498 s_cookie=7954834117433116078 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e94d2ee7ef540882 server_cookie=6e653f7bb8c245ae in_seq=0 out_seq=0 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.627+0000 7f2167fff640 10 client.15450 ms_handle_connect on v2:10.20.193.74:6836/958749351 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.627+0000 7f2167fff640 1 -- 10.20.193.28:0/2053169701 <== mds.1 v2:10.20.193.74:6836/958749351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55a4a15492e0 con 0x55a4a16ad5a0 2026-02-24T09:17:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.627+0000 7f2167fff640 10 client.15450 handle_command_reply: tid=0 2026-02-24T09:17:32.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.627+0000 7f21bec35e00 1 client.15450 shutdown 2026-02-24T09:17:32.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.627+0000 7f21bec35e00 1 -- 10.20.193.28:0/2053169701 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a166aca0 msgr2=0x55a4a16c7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:32.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.627+0000 7f21bec35e00 1 --2- 10.20.193.28:0/2053169701 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a166aca0 0x55a4a16c7740 secure :-1 s=READY pgs=363 gs=1 cs=0 l=1 c_cookie=2927557325864288606 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21a0108ba0 tx=0x7f21a002fdb0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.628+0000 7f21bec35e00 1 -- 10.20.193.28:0/2053169701 shutdown_connections 2026-02-24T09:17:32.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.628+0000 7f21bec35e00 1 --2- 10.20.193.28:0/2053169701 >> [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] conn(0x55a4a16ad5a0 0x55a4a16aea10 crc :-1 s=READY pgs=19 gs=4 cs=0 l=0 c_cookie=16811144557731514498 s_cookie=7954834117433116078 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.628+0000 7f21bec35e00 1 --2- 10.20.193.28:0/2053169701 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a4a16af940 0x55a4a16cc730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.628+0000 7f21bec35e00 1 --2- 10.20.193.28:0/2053169701 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a166aca0 0x55a4a16c7740 unknown :-1 s=CLOSED pgs=363 gs=1 cs=0 l=1 c_cookie=2927557325864288606 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.628+0000 7f21bec35e00 1 --2- 10.20.193.28:0/2053169701 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a4a166a390 0x55a4a16c7200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.628+0000 7f21bec35e00 1 -- 10.20.193.28:0/2053169701 >> 10.20.193.28:0/2053169701 conn(0x55a4a15898a0 msgr2=0x55a4a1668480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:32.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.628+0000 7f2167fff640 0 client.15450 ms_handle_reset on v2:10.20.193.74:6836/958749351 2026-02-24T09:17:32.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.628+0000 7f21bec35e00 1 -- 10.20.193.28:0/2053169701 shutdown_connections 2026-02-24T09:17:32.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.628+0000 7f21bec35e00 1 -- 10.20.193.28:0/2053169701 wait complete. 2026-02-24T09:17:32.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.628+0000 7f21bec35e00 20 client.15450 trim_cache size 0 max 16384 2026-02-24T09:17:32.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.637+0000 7f21bec35e00 1 Processor -- start 2026-02-24T09:17:32.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.637+0000 7f21bec35e00 1 -- start start 2026-02-24T09:17:32.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.638+0000 7f21bec35e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a4a166a390 0x55a4a16b9140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.638+0000 7f21bec35e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a4a166aca0 0x55a4a16ef710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.638+0000 7f21bec35e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a16af940 0x55a4a16efc50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.638+0000 7f21bec35e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a4a15743d0 con 0x55a4a16af940 2026-02-24T09:17:32.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.638+0000 7f21bec35e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55a4a1234610 con 0x55a4a166a390 2026-02-24T09:17:32.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.638+0000 7f21bec35e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55a4a16af4f0 con 0x55a4a166aca0 2026-02-24T09:17:32.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.638+0000 7f21b6575640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a4a166a390 0x55a4a16b9140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:32.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.638+0000 7f21b6575640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a4a166a390 0x55a4a16b9140 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:52250/0 (socket says 10.20.193.28:52250) 2026-02-24T09:17:32.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.638+0000 7f21b6575640 1 -- 10.20.193.28:0/1459644386 learned_addr learned my addr 10.20.193.28:0/1459644386 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:32.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.638+0000 7f21b5d74640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a4a166aca0 0x55a4a16ef710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:32.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.638+0000 7f21b6d76640 1 --2- 10.20.193.28:0/1459644386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a16af940 0x55a4a16efc50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:32.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.638+0000 7f21b6575640 1 -- 10.20.193.28:0/1459644386 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a4a166aca0 msgr2=0x55a4a16ef710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:32.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.638+0000 7f21b6575640 1 --2- 10.20.193.28:0/1459644386 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a4a166aca0 0x55a4a16ef710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.638+0000 7f21b6575640 1 -- 10.20.193.28:0/1459644386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a16af940 msgr2=0x55a4a16efc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:32.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.638+0000 7f21b6575640 1 --2- 10.20.193.28:0/1459644386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a16af940 0x55a4a16efc50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.638+0000 7f21b6575640 1 -- 10.20.193.28:0/1459644386 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4a1506b50 con 0x55a4a166a390 2026-02-24T09:17:32.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.638+0000 7f21b6d76640 1 --2- 10.20.193.28:0/1459644386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a16af940 0x55a4a16efc50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:17:32.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.638+0000 7f21b6575640 1 --2- 10.20.193.28:0/1459644386 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a4a166a390 0x55a4a16b9140 secure :-1 s=READY pgs=107 gs=1 cs=0 l=1 c_cookie=15208580021896220127 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21ac002c40 tx=0x7f21ac020040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d30fbaf38f3a0ddf server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:32.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.639+0000 7f21824e6640 1 -- 10.20.193.28:0/1459644386 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f21ac01ed70 con 0x55a4a166a390 2026-02-24T09:17:32.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.639+0000 7f21824e6640 1 -- 10.20.193.28:0/1459644386 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f21ac016040 con 0x55a4a166a390 2026-02-24T09:17:32.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.639+0000 7f21824e6640 1 -- 10.20.193.28:0/1459644386 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f21ac035820 con 0x55a4a166a390 2026-02-24T09:17:32.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.639+0000 7f21bec35e00 1 -- 10.20.193.28:0/1459644386 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a4a166a390 msgr2=0x55a4a16b9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:32.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.639+0000 7f21bec35e00 1 --2- 10.20.193.28:0/1459644386 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a4a166a390 0x55a4a16b9140 secure :-1 s=READY pgs=107 gs=1 cs=0 l=1 c_cookie=15208580021896220127 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21ac002c40 tx=0x7f21ac020040 comp rx=0 tx=0).stop 2026-02-24T09:17:32.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.639+0000 7f21bec35e00 1 -- 10.20.193.28:0/1459644386 shutdown_connections 2026-02-24T09:17:32.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.639+0000 7f21bec35e00 1 --2- 10.20.193.28:0/1459644386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a16af940 0x55a4a16efc50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.639+0000 7f21bec35e00 1 --2- 10.20.193.28:0/1459644386 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a4a166aca0 0x55a4a16ef710 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.639+0000 7f21bec35e00 1 --2- 10.20.193.28:0/1459644386 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a4a166a390 0x55a4a16b9140 unknown :-1 s=CLOSED pgs=107 gs=1 cs=0 l=1 c_cookie=15208580021896220127 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.639+0000 7f21bec35e00 1 -- 10.20.193.28:0/1459644386 >> 10.20.193.28:0/1459644386 conn(0x55a4a15898a0 msgr2=0x55a4a16c4800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:32.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.639+0000 7f21bec35e00 1 -- 10.20.193.28:0/1459644386 shutdown_connections 2026-02-24T09:17:32.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.639+0000 7f21bec35e00 1 -- 10.20.193.28:0/1459644386 wait complete. 2026-02-24T09:17:32.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.640+0000 7f21bec35e00 1 -- start start 2026-02-24T09:17:32.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.640+0000 7f21bec35e00 1 Processor -- start 2026-02-24T09:17:32.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.640+0000 7f21bec35e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a4a166a390 0x55a4a16d5580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.640+0000 7f21bec35e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a166aca0 0x55a4a16d5ac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.640+0000 7f21bec35e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a4a16af940 0x55a4a16d4330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.640+0000 7f21bec35e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a4a16cd990 con 0x55a4a166aca0 2026-02-24T09:17:32.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.640+0000 7f21bec35e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55a4a16ad100 con 0x55a4a166a390 2026-02-24T09:17:32.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.640+0000 7f21bec35e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55a4a16d4870 con 0x55a4a16af940 2026-02-24T09:17:32.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.640+0000 7f21b5d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a166aca0 0x55a4a16d5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:32.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.641+0000 7f21b5d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a166aca0 0x55a4a16d5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43598/0 (socket says 10.20.193.28:43598) 2026-02-24T09:17:32.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.641+0000 7f21b5d74640 1 -- 10.20.193.28:0/867650643 learned_addr learned my addr 10.20.193.28:0/867650643 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:32.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.641+0000 7f21b6575640 1 --2- 10.20.193.28:0/867650643 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a4a166a390 0x55a4a16d5580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:32.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.641+0000 7f21b6d76640 1 --2- 10.20.193.28:0/867650643 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a4a16af940 0x55a4a16d4330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:32.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.641+0000 7f21b5d74640 1 -- 10.20.193.28:0/867650643 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a4a16af940 msgr2=0x55a4a16d4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:32.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.641+0000 7f21b5d74640 1 --2- 10.20.193.28:0/867650643 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a4a16af940 0x55a4a16d4330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.641+0000 7f21b5d74640 1 -- 10.20.193.28:0/867650643 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a4a166a390 msgr2=0x55a4a16d5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:32.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.641+0000 7f21b5d74640 1 --2- 10.20.193.28:0/867650643 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a4a166a390 0x55a4a16d5580 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.641+0000 7f21b5d74640 1 -- 10.20.193.28:0/867650643 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4a14fa6e0 con 0x55a4a166aca0 2026-02-24T09:17:32.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.641+0000 7f21b5d74640 1 --2- 10.20.193.28:0/867650643 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a166aca0 0x55a4a16d5ac0 secure :-1 s=READY pgs=364 gs=2 cs=0 l=1 c_cookie=14400160286038796114 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21a00cd9c0 tx=0x7f21a0038f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7d7a57c1e07a752 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:32.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.641+0000 7f2167fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:17:32.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.641+0000 7f2167fff640 1 -- 10.20.193.28:0/867650643 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f21a00d1df0 con 0x55a4a166aca0 2026-02-24T09:17:32.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.641+0000 7f2167fff640 1 -- 10.20.193.28:0/867650643 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x55a4a120c600 con 0x55a4a166aca0 2026-02-24T09:17:32.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.641+0000 7f2167fff640 1 -- 10.20.193.28:0/867650643 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f21a00d16d0 con 0x55a4a166aca0 2026-02-24T09:17:32.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.641+0000 7f21bec35e00 1 -- 10.20.193.28:0/867650643 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4a1521d00 con 0x55a4a166aca0 2026-02-24T09:17:32.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.641+0000 7f2167fff640 1 -- 10.20.193.28:0/867650643 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f21a00d06e0 con 0x55a4a166aca0 2026-02-24T09:17:32.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.641+0000 7f2167fff640 10 client.15456 inactive, discarding osd_map(92..92 src has 1..92) 2026-02-24T09:17:32.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.641+0000 7f21bec35e00 10 client.15456 _ll_register_callbacks cb 0x55a4a14fe510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:32.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.641+0000 7f21bec35e00 1 -- 10.20.193.28:0/867650643 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a4a1583b90 con 0x55a4a166aca0 2026-02-24T09:17:32.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.641+0000 7f2167fff640 1 -- 10.20.193.28:0/867650643 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f21a00d7110 con 0x55a4a166aca0 2026-02-24T09:17:32.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.641+0000 7f21bec35e00 10 client.15456 fetch_fsmap learned FSMap version 22 2026-02-24T09:17:32.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.641+0000 7f21bec35e00 1 -- 10.20.193.28:0/867650643 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=22}) -- 0x55a4a150c330 con 0x55a4a166aca0 2026-02-24T09:17:32.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.642+0000 7f2167fff640 1 -- 10.20.193.28:0/867650643 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 22) ==== 8346+0+0 (secure 0 0 0) 0x7f21a00cbbe0 con 0x55a4a166aca0 2026-02-24T09:17:32.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.642+0000 7f21bec35e00 10 client.15456 fetch_fsmap finished waiting for FSMap version 22 2026-02-24T09:17:32.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.642+0000 7f21bec35e00 10 client.15456 resolve_mds: resolved name 'h' to daemon mds.h 2026-02-24T09:17:32.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.642+0000 7f21bec35e00 20 client.15456 populate_metadata read hostname 'trial028' 2026-02-24T09:17:32.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.642+0000 7f21bec35e00 1 --2- 10.20.193.28:0/867650643 >> [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] conn(0x55a4a1761920 0x55a4a1760630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:32.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.642+0000 7f21bec35e00 4 client.15456 mds_command: new command op to 24761 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-24T09:17:32.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.642+0000 7f21bec35e00 1 -- 10.20.193.28:0/867650643 --> [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] -- command(tid 0: {"prefix": "status"}) -- 0x55a4a1209e50 con 0x55a4a1761920 2026-02-24T09:17:32.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.642+0000 7f21b6575640 1 --2- 10.20.193.28:0/867650643 >> [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] conn(0x55a4a1761920 0x55a4a1760630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:32.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.642+0000 7f21b6575640 1 --2- 10.20.193.28:0/867650643 >> [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] conn(0x55a4a1761920 0x55a4a1760630 crc :-1 s=READY pgs=20 gs=4 cs=0 l=0 c_cookie=14378706638399490331 s_cookie=10446050118460073275 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c78b6d81875a491b server_cookie=90f7d33cb8bd653b in_seq=0 out_seq=0 2026-02-24T09:17:32.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.642+0000 7f2167fff640 10 client.15456 ms_handle_connect on v2:10.20.193.74:6836/958749351 2026-02-24T09:17:32.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.643+0000 7f2167fff640 1 -- 10.20.193.28:0/867650643 <== mds.1 v2:10.20.193.74:6836/958749351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1217 (crc 0 0 0) 0x55a4a1209e50 con 0x55a4a1761920 2026-02-24T09:17:32.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.643+0000 7f2167fff640 10 client.15456 handle_command_reply: tid=0 2026-02-24T09:17:32.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.643+0000 7f21bec35e00 1 client.15456 shutdown 2026-02-24T09:17:32.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.643+0000 7f21bec35e00 1 -- 10.20.193.28:0/867650643 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a166aca0 msgr2=0x55a4a16d5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:32.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.643+0000 7f21bec35e00 1 --2- 10.20.193.28:0/867650643 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a166aca0 0x55a4a16d5ac0 secure :-1 s=READY pgs=364 gs=2 cs=0 l=1 c_cookie=14400160286038796114 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21a00cd9c0 tx=0x7f21a0038f10 comp rx=0 tx=0).stop 2026-02-24T09:17:32.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.643+0000 7f21bec35e00 1 -- 10.20.193.28:0/867650643 shutdown_connections 2026-02-24T09:17:32.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.643+0000 7f21bec35e00 1 --2- 10.20.193.28:0/867650643 >> [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] conn(0x55a4a1761920 0x55a4a1760630 crc :-1 s=READY pgs=20 gs=4 cs=0 l=0 c_cookie=14378706638399490331 s_cookie=10446050118460073275 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.643+0000 7f21bec35e00 1 --2- 10.20.193.28:0/867650643 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a4a16af940 0x55a4a16d4330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.643+0000 7f21bec35e00 1 --2- 10.20.193.28:0/867650643 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4a166aca0 0x55a4a16d5ac0 unknown :-1 s=CLOSED pgs=364 gs=2 cs=0 l=1 c_cookie=14400160286038796114 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.643+0000 7f21bec35e00 1 --2- 10.20.193.28:0/867650643 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a4a166a390 0x55a4a16d5580 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.643+0000 7f2167fff640 0 client.15456 ms_handle_reset on v2:10.20.193.74:6836/958749351 2026-02-24T09:17:32.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.643+0000 7f21bec35e00 1 -- 10.20.193.28:0/867650643 >> 10.20.193.28:0/867650643 conn(0x55a4a15898a0 msgr2=0x55a4a16b9140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:32.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.643+0000 7f21bec35e00 1 -- 10.20.193.28:0/867650643 shutdown_connections 2026-02-24T09:17:32.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.643+0000 7f21bec35e00 1 -- 10.20.193.28:0/867650643 wait complete. 2026-02-24T09:17:32.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.643+0000 7f21bec35e00 20 client.15456 trim_cache size 0 max 16384 2026-02-24T09:17:32.649 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-24T09:17:32.650 INFO:teuthology.orchestra.run.trial028.stdout: "cluster_fsid": "e9ad50af-1160-11f1-800e-d404e6e7d460", 2026-02-24T09:17:32.650 INFO:teuthology.orchestra.run.trial028.stdout: "whoami": 1, 2026-02-24T09:17:32.650 INFO:teuthology.orchestra.run.trial028.stdout: "id": 24761, 2026-02-24T09:17:32.650 INFO:teuthology.orchestra.run.trial028.stdout: "want_state": "up:active", 2026-02-24T09:17:32.650 INFO:teuthology.orchestra.run.trial028.stdout: "state": "up:active", 2026-02-24T09:17:32.650 INFO:teuthology.orchestra.run.trial028.stdout: "fs_name": "cephfs", 2026-02-24T09:17:32.650 INFO:teuthology.orchestra.run.trial028.stdout: "rank_uptime": 28.400407674, 2026-02-24T09:17:32.650 INFO:teuthology.orchestra.run.trial028.stdout: "mdsmap_epoch": 22, 2026-02-24T09:17:32.650 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch": 92, 2026-02-24T09:17:32.650 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch_barrier": 92, 2026-02-24T09:17:32.650 INFO:teuthology.orchestra.run.trial028.stdout: "uptime": 43.560180133999999, 2026-02-24T09:17:32.650 INFO:teuthology.orchestra.run.trial028.stdout: "sysinfo": { 2026-02-24T09:17:32.650 INFO:teuthology.orchestra.run.trial028.stdout: "arch": "x86_64", 2026-02-24T09:17:32.650 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_release": "tentacle", 2026-02-24T09:17:32.651 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version": "ceph version 20.3.0-5537-g5bc9a1ff (5bc9a1ffc19df681248ece8c3c8c7191a571745b) tentacle (dev - RelWithDebInfo)", 2026-02-24T09:17:32.651 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version_short": "20.3.0-5537-g5bc9a1ff", 2026-02-24T09:17:32.651 INFO:teuthology.orchestra.run.trial028.stdout: "container_hostname": "trial074", 2026-02-24T09:17:32.651 INFO:teuthology.orchestra.run.trial028.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b", 2026-02-24T09:17:32.651 INFO:teuthology.orchestra.run.trial028.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-24T09:17:32.651 INFO:teuthology.orchestra.run.trial028.stdout: "distro": "centos", 2026-02-24T09:17:32.651 INFO:teuthology.orchestra.run.trial028.stdout: "distro_description": "CentOS Stream 9", 2026-02-24T09:17:32.651 INFO:teuthology.orchestra.run.trial028.stdout: "distro_version": "9", 2026-02-24T09:17:32.651 INFO:teuthology.orchestra.run.trial028.stdout: "hostname": "trial074", 2026-02-24T09:17:32.651 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Thu Feb 12 10:25:42 EST 2026", 2026-02-24T09:17:32.651 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_version": "6.19.0-g8dec4b357aab", 2026-02-24T09:17:32.651 INFO:teuthology.orchestra.run.trial028.stdout: "mem_swap_kb": "8388604", 2026-02-24T09:17:32.651 INFO:teuthology.orchestra.run.trial028.stdout: "mem_total_kb": "130448332", 2026-02-24T09:17:32.651 INFO:teuthology.orchestra.run.trial028.stdout: "os": "Linux" 2026-02-24T09:17:32.651 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:17:32.652 INFO:teuthology.orchestra.run.trial028.stdout: "endian": "little" 2026-02-24T09:17:32.652 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-24T09:17:32.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.644+0000 7f21bcc3b640 1 -- 10.20.193.28:0/1908717077 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f21900b5840 msgr2=0x7f21900d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:32.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.644+0000 7f21bcc3b640 1 --2- 10.20.193.28:0/1908717077 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f21900b5840 0x7f21900d5cf0 secure :-1 s=READY pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21ac004740 tx=0x7f21ac005f90 comp rx=0 tx=0).stop 2026-02-24T09:17:32.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.644+0000 7f21bcc3b640 1 -- 10.20.193.28:0/1908717077 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f21b80618c0 msgr2=0x7f21b81628f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:32.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.644+0000 7f21bcc3b640 1 --2- 10.20.193.28:0/1908717077 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f21b80618c0 0x7f21b81628f0 secure :-1 s=READY pgs=106 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21a00098a0 tx=0x7f21a0005dd0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.644+0000 7f21bcc3b640 1 -- 10.20.193.28:0/1908717077 shutdown_connections 2026-02-24T09:17:32.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.644+0000 7f21bcc3b640 1 --2- 10.20.193.28:0/1908717077 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f21900b5840 0x7f21900d5cf0 unknown :-1 s=CLOSED pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.644+0000 7f21bcc3b640 1 --2- 10.20.193.28:0/1908717077 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f21b8155b80 0x7f21b8167cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.644+0000 7f21bcc3b640 1 --2- 10.20.193.28:0/1908717077 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f21b80618c0 0x7f21b81628f0 unknown :-1 s=CLOSED pgs=106 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.644+0000 7f21bcc3b640 1 --2- 10.20.193.28:0/1908717077 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f21b8060fb0 0x7f21b81623b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:32.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.644+0000 7f21bcc3b640 1 -- 10.20.193.28:0/1908717077 >> 10.20.193.28:0/1908717077 conn(0x7f21b80ead50 msgr2=0x7f21b810b130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:32.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.644+0000 7f21bcc3b640 1 -- 10.20.193.28:0/1908717077 shutdown_connections 2026-02-24T09:17:32.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:32.644+0000 7f21bcc3b640 1 -- 10.20.193.28:0/1908717077 wait complete. 2026-02-24T09:17:32.776 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph tell mds.b status 2026-02-24T09:17:32.961 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:33.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.135+0000 7f26cb755640 1 -- 10.20.193.28:0/3038193297 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f26c410f6c0 msgr2=0x7f26c410fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:33.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.135+0000 7f26cb755640 1 --2- 10.20.193.28:0/3038193297 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f26c410f6c0 0x7f26c410fa90 secure :-1 s=READY pgs=365 gs=1 cs=0 l=1 c_cookie=11981538203496948290 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26b4009950 tx=0x7f26b402f190 comp rx=0 tx=0).stop 2026-02-24T09:17:33.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.135+0000 7f26cb755640 1 -- 10.20.193.28:0/3038193297 shutdown_connections 2026-02-24T09:17:33.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.135+0000 7f26cb755640 1 --2- 10.20.193.28:0/3038193297 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f26c41158b0 0x7f26c4176280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.135+0000 7f26cb755640 1 --2- 10.20.193.28:0/3038193297 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f26c41100b0 0x7f26c4115100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.135+0000 7f26cb755640 1 --2- 10.20.193.28:0/3038193297 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f26c410f6c0 0x7f26c410fa90 unknown :-1 s=CLOSED pgs=365 gs=1 cs=0 l=1 c_cookie=11981538203496948290 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.135+0000 7f26cb755640 1 -- 10.20.193.28:0/3038193297 >> 10.20.193.28:0/3038193297 conn(0x7f26c40ecfd0 msgr2=0x7f26c410d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:33.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.135+0000 7f26cb755640 1 -- 10.20.193.28:0/3038193297 shutdown_connections 2026-02-24T09:17:33.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.135+0000 7f26cb755640 1 -- 10.20.193.28:0/3038193297 wait complete. 2026-02-24T09:17:33.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.136+0000 7f26cb755640 1 Processor -- start 2026-02-24T09:17:33.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.136+0000 7f26cb755640 1 -- start start 2026-02-24T09:17:33.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.136+0000 7f26cb755640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f26c410f6c0 0x7f26c411e080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:33.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.136+0000 7f26cb755640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f26c41100b0 0x7f26c411e5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:33.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.136+0000 7f26cb755640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f26c41158b0 0x7f26c4123990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:33.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.136+0000 7f26cb755640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f26c4123fb0 con 0x7f26c410f6c0 2026-02-24T09:17:33.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.136+0000 7f26cb755640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f26c4124120 con 0x7f26c41158b0 2026-02-24T09:17:33.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.136+0000 7f26cb755640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f26c41242e0 con 0x7f26c41100b0 2026-02-24T09:17:33.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.137+0000 7f26c94ca640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f26c410f6c0 0x7f26c411e080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:33.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.137+0000 7f26c94ca640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f26c410f6c0 0x7f26c411e080 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43618/0 (socket says 10.20.193.28:43618) 2026-02-24T09:17:33.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.137+0000 7f26c94ca640 1 -- 10.20.193.28:0/103195157 learned_addr learned my addr 10.20.193.28:0/103195157 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:33.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.137+0000 7f26c8cc9640 1 --2- 10.20.193.28:0/103195157 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f26c41100b0 0x7f26c411e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:33.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.137+0000 7f26c9ccb640 1 --2- 10.20.193.28:0/103195157 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f26c41158b0 0x7f26c4123990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:33.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.137+0000 7f26c94ca640 1 -- 10.20.193.28:0/103195157 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f26c41100b0 msgr2=0x7f26c411e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:33.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.137+0000 7f26c94ca640 1 --2- 10.20.193.28:0/103195157 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f26c41100b0 0x7f26c411e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.137+0000 7f26c94ca640 1 -- 10.20.193.28:0/103195157 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f26c41158b0 msgr2=0x7f26c4123990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:33.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.137+0000 7f26c94ca640 1 --2- 10.20.193.28:0/103195157 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f26c41158b0 0x7f26c4123990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.137+0000 7f26c94ca640 1 -- 10.20.193.28:0/103195157 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b4009570 con 0x7f26c410f6c0 2026-02-24T09:17:33.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.137+0000 7f26c94ca640 1 --2- 10.20.193.28:0/103195157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f26c410f6c0 0x7f26c411e080 secure :-1 s=READY pgs=366 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26b40098a0 tx=0x7f26b40028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:33.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.137+0000 7f26b27fc640 1 -- 10.20.193.28:0/103195157 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26b403d070 con 0x7f26c410f6c0 2026-02-24T09:17:33.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.137+0000 7f26b27fc640 1 -- 10.20.193.28:0/103195157 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f26b4002a40 con 0x7f26c410f6c0 2026-02-24T09:17:33.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.137+0000 7f26cb755640 1 -- 10.20.193.28:0/103195157 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26c4124560 con 0x7f26c410f6c0 2026-02-24T09:17:33.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.137+0000 7f26b27fc640 1 -- 10.20.193.28:0/103195157 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26b4041720 con 0x7f26c410f6c0 2026-02-24T09:17:33.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.137+0000 7f26cb755640 1 -- 10.20.193.28:0/103195157 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26c4164cc0 con 0x7f26c410f6c0 2026-02-24T09:17:33.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.140+0000 7f26b27fc640 1 -- 10.20.193.28:0/103195157 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f26b40386a0 con 0x7f26c410f6c0 2026-02-24T09:17:33.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.142+0000 7f26b27fc640 1 --2- 10.20.193.28:0/103195157 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f26a00b5840 0x7f26a00d5cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:33.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.142+0000 7f26b27fc640 1 -- 10.20.193.28:0/103195157 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f26b410b120 con 0x7f26c410f6c0 2026-02-24T09:17:33.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.142+0000 7f26c8cc9640 1 --2- 10.20.193.28:0/103195157 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f26a00b5840 0x7f26a00d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:33.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.143+0000 7f26c8cc9640 1 --2- 10.20.193.28:0/103195157 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f26a00b5840 0x7f26a00d5cf0 secure :-1 s=READY pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26c4124a20 tx=0x7f26b8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:33.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.143+0000 7f26cd74fe00 1 Processor -- start 2026-02-24T09:17:33.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.143+0000 7f26cd74fe00 1 -- start start 2026-02-24T09:17:33.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.143+0000 7f26cd74fe00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a535f61da0 0x55a535f62170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:33.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.143+0000 7f26cd74fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a535f626b0 0x55a535fa6e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:33.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.143+0000 7f26cd74fe00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a535fa7350 0x55a535fc7730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:33.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.143+0000 7f26cd74fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a535e6f910 con 0x55a535f626b0 2026-02-24T09:17:33.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.143+0000 7f26cd74fe00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55a535e6b640 con 0x55a535f61da0 2026-02-24T09:17:33.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.143+0000 7f26cd74fe00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55a535e657a0 con 0x55a535fa7350 2026-02-24T09:17:33.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.143+0000 7f26c8cc9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a535f626b0 0x55a535fa6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:33.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.143+0000 7f26c94ca640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a535f61da0 0x55a535f62170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:33.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.143+0000 7f26c8cc9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a535f626b0 0x55a535fa6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43622/0 (socket says 10.20.193.28:43622) 2026-02-24T09:17:33.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.143+0000 7f26c8cc9640 1 -- 10.20.193.28:0/1321783532 learned_addr learned my addr 10.20.193.28:0/1321783532 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:33.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.143+0000 7f26c8cc9640 1 -- 10.20.193.28:0/1321783532 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a535fa7350 msgr2=0x55a535fc7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:33.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.143+0000 7f26c8cc9640 1 --2- 10.20.193.28:0/1321783532 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a535fa7350 0x55a535fc7730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.143+0000 7f26c8cc9640 1 -- 10.20.193.28:0/1321783532 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a535f61da0 msgr2=0x55a535f62170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:33.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.143+0000 7f26c8cc9640 1 --2- 10.20.193.28:0/1321783532 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a535f61da0 0x55a535f62170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.143+0000 7f26c8cc9640 1 -- 10.20.193.28:0/1321783532 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a535e10d00 con 0x55a535f626b0 2026-02-24T09:17:33.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.144+0000 7f26c8cc9640 1 --2- 10.20.193.28:0/1321783532 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a535f626b0 0x55a535fa6e10 secure :-1 s=READY pgs=367 gs=1 cs=0 l=1 c_cookie=17314885740493002510 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26b8009cc0 tx=0x7f26b8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f04ad4d7c08fd70e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:33.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.144+0000 7f2691ce5640 1 -- 10.20.193.28:0/1321783532 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26b8011e60 con 0x55a535f626b0 2026-02-24T09:17:33.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.144+0000 7f2691ce5640 1 -- 10.20.193.28:0/1321783532 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f26b80198c0 con 0x55a535f626b0 2026-02-24T09:17:33.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.144+0000 7f2691ce5640 1 -- 10.20.193.28:0/1321783532 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26b801bae0 con 0x55a535f626b0 2026-02-24T09:17:33.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.144+0000 7f26cd74fe00 1 -- 10.20.193.28:0/1321783532 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a535f626b0 msgr2=0x55a535fa6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:33.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.144+0000 7f26cd74fe00 1 --2- 10.20.193.28:0/1321783532 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a535f626b0 0x55a535fa6e10 secure :-1 s=READY pgs=367 gs=1 cs=0 l=1 c_cookie=17314885740493002510 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26b8009cc0 tx=0x7f26b8014000 comp rx=0 tx=0).stop 2026-02-24T09:17:33.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.144+0000 7f26cd74fe00 1 -- 10.20.193.28:0/1321783532 shutdown_connections 2026-02-24T09:17:33.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.144+0000 7f26cd74fe00 1 --2- 10.20.193.28:0/1321783532 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a535fa7350 0x55a535fc7730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.144+0000 7f26cd74fe00 1 --2- 10.20.193.28:0/1321783532 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a535f626b0 0x55a535fa6e10 unknown :-1 s=CLOSED pgs=367 gs=1 cs=0 l=1 c_cookie=17314885740493002510 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.144+0000 7f26cd74fe00 1 --2- 10.20.193.28:0/1321783532 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a535f61da0 0x55a535f62170 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.144+0000 7f26cd74fe00 1 -- 10.20.193.28:0/1321783532 >> 10.20.193.28:0/1321783532 conn(0x55a535e788a0 msgr2=0x55a535f57c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:33.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.144+0000 7f26cd74fe00 1 -- 10.20.193.28:0/1321783532 shutdown_connections 2026-02-24T09:17:33.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.144+0000 7f26cd74fe00 1 -- 10.20.193.28:0/1321783532 wait complete. 2026-02-24T09:17:33.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.146+0000 7f26cd74fe00 1 -- start start 2026-02-24T09:17:33.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.146+0000 7f26cd74fe00 1 Processor -- start 2026-02-24T09:17:33.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.146+0000 7f26cd74fe00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a535f61da0 0x55a535fbec20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:33.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.146+0000 7f26cd74fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a535f626b0 0x55a535fbf160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:33.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.146+0000 7f26cd74fe00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a535fa7350 0x55a535fc4150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:33.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.146+0000 7f26cd74fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a535fc4690 con 0x55a535f626b0 2026-02-24T09:17:33.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.146+0000 7f26cd74fe00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55a535fc4800 con 0x55a535fa7350 2026-02-24T09:17:33.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.146+0000 7f26cd74fe00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55a535fc49c0 con 0x55a535f61da0 2026-02-24T09:17:33.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.146+0000 7f26c8cc9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a535f626b0 0x55a535fbf160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:33.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.147+0000 7f26c94ca640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a535f61da0 0x55a535fbec20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:33.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.147+0000 7f26c9ccb640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a535fa7350 0x55a535fc4150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:33.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.147+0000 7f26c9ccb640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a535fa7350 0x55a535fc4150 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:52298/0 (socket says 10.20.193.28:52298) 2026-02-24T09:17:33.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.147+0000 7f26c9ccb640 1 -- 10.20.193.28:0/1746642284 learned_addr learned my addr 10.20.193.28:0/1746642284 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:33.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.147+0000 7f26c94ca640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a535f61da0 0x55a535fbec20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:47828/0 (socket says 10.20.193.28:47828) 2026-02-24T09:17:33.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.147+0000 7f26c8cc9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a535f626b0 0x55a535fbf160 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43632/0 (socket says 10.20.193.28:43632) 2026-02-24T09:17:33.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.147+0000 7f26c94ca640 1 -- 10.20.193.28:0/1746642284 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a535fa7350 msgr2=0x55a535fc4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:33.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.147+0000 7f26c94ca640 1 --2- 10.20.193.28:0/1746642284 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a535fa7350 0x55a535fc4150 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.147+0000 7f26c94ca640 1 -- 10.20.193.28:0/1746642284 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a535f626b0 msgr2=0x55a535fbf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:33.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.147+0000 7f26c94ca640 1 --2- 10.20.193.28:0/1746642284 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a535f626b0 0x55a535fbf160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.147+0000 7f26c94ca640 1 -- 10.20.193.28:0/1746642284 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a535de93b0 con 0x55a535f61da0 2026-02-24T09:17:33.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.147+0000 7f26c94ca640 1 --2- 10.20.193.28:0/1746642284 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a535f61da0 0x55a535fbec20 secure :-1 s=READY pgs=109 gs=2 cs=0 l=1 c_cookie=9034376058230968756 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26b4032040 tx=0x7f26b40d35b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d608d28a62691b4 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:33.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.147+0000 7f267effd640 10 client.0 ms_handle_connect on v2:10.20.193.159:3300/0 2026-02-24T09:17:33.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.147+0000 7f267effd640 1 -- 10.20.193.28:0/1746642284 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26b40f6040 con 0x55a535f61da0 2026-02-24T09:17:33.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.147+0000 7f267effd640 1 -- 10.20.193.28:0/1746642284 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f26b40d0e50 con 0x55a535f61da0 2026-02-24T09:17:33.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.147+0000 7f267effd640 1 -- 10.20.193.28:0/1746642284 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26b40d2380 con 0x55a535f61da0 2026-02-24T09:17:33.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.147+0000 7f26cd74fe00 1 -- 10.20.193.28:0/1746642284 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26b8009930 con 0x55a535f61da0 2026-02-24T09:17:33.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.148+0000 7f267effd640 1 -- 10.20.193.28:0/1746642284 <== mon.1 v2:10.20.193.159:3300/0 4 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f26b40dc5b0 con 0x55a535f61da0 2026-02-24T09:17:33.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.148+0000 7f26cd74fe00 10 client.25210 _ll_register_callbacks cb 0x55a535ded510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:33.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.148+0000 7f26cd74fe00 1 -- 10.20.193.28:0/1746642284 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a535afb600 con 0x55a535f61da0 2026-02-24T09:17:33.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.148+0000 7f267effd640 1 -- 10.20.193.28:0/1746642284 <== mon.1 v2:10.20.193.159:3300/0 5 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f26b40d0c70 con 0x55a535f61da0 2026-02-24T09:17:33.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.148+0000 7f26cd74fe00 10 client.25210 fetch_fsmap learned FSMap version 22 2026-02-24T09:17:33.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.148+0000 7f26cd74fe00 1 -- 10.20.193.28:0/1746642284 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({fsmap=22}) -- 0x55a535dfb0d0 con 0x55a535f61da0 2026-02-24T09:17:33.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.148+0000 7f267effd640 1 -- 10.20.193.28:0/1746642284 <== mon.1 v2:10.20.193.159:3300/0 6 ==== fsmap(e 22) ==== 8346+0+0 (secure 0 0 0) 0x7f26b40cf450 con 0x55a535f61da0 2026-02-24T09:17:33.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.148+0000 7f26cd74fe00 10 client.25210 fetch_fsmap finished waiting for FSMap version 22 2026-02-24T09:17:33.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.148+0000 7f26cd74fe00 10 client.25210 resolve_mds: resolved name 'b' to daemon mds.b 2026-02-24T09:17:33.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.148+0000 7f26cd74fe00 20 client.25210 populate_metadata read hostname 'trial028' 2026-02-24T09:17:33.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.148+0000 7f26cd74fe00 1 --2- 10.20.193.28:0/1746642284 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55a535fa4ec0 0x55a535fa6330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:33.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.148+0000 7f26cd74fe00 4 client.25210 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:17:33.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.148+0000 7f26cd74fe00 1 -- 10.20.193.28:0/1746642284 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a535e382e0 con 0x55a535fa4ec0 2026-02-24T09:17:33.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.149+0000 7f26c8cc9640 1 --2- 10.20.193.28:0/1746642284 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55a535fa4ec0 0x55a535fa6330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:33.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.149+0000 7f26c8cc9640 1 --2- 10.20.193.28:0/1746642284 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55a535fa4ec0 0x55a535fa6330 crc :-1 s=READY pgs=18 gs=4 cs=0 l=0 c_cookie=6884078391269207702 s_cookie=16737454387510074561 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f8928d2cd8b2e96 server_cookie=e84762162bd75cc1 in_seq=0 out_seq=0 2026-02-24T09:17:33.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.149+0000 7f267effd640 10 client.25210 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:17:33.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.150+0000 7f267effd640 1 -- 10.20.193.28:0/1746642284 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55a535e382e0 con 0x55a535fa4ec0 2026-02-24T09:17:33.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.150+0000 7f267effd640 10 client.25210 handle_command_reply: tid=0 2026-02-24T09:17:33.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.150+0000 7f26cd74fe00 1 client.25210 shutdown 2026-02-24T09:17:33.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.150+0000 7f26cd74fe00 1 -- 10.20.193.28:0/1746642284 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a535f61da0 msgr2=0x55a535fbec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:33.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.150+0000 7f26cd74fe00 1 --2- 10.20.193.28:0/1746642284 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a535f61da0 0x55a535fbec20 secure :-1 s=READY pgs=109 gs=2 cs=0 l=1 c_cookie=9034376058230968756 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26b4032040 tx=0x7f26b40d35b0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.150+0000 7f26cd74fe00 1 -- 10.20.193.28:0/1746642284 shutdown_connections 2026-02-24T09:17:33.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.150+0000 7f26cd74fe00 1 --2- 10.20.193.28:0/1746642284 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55a535fa4ec0 0x55a535fa6330 crc :-1 s=READY pgs=18 gs=4 cs=0 l=0 c_cookie=6884078391269207702 s_cookie=16737454387510074561 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.150+0000 7f26cd74fe00 1 --2- 10.20.193.28:0/1746642284 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a535fa7350 0x55a535fc4150 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.150+0000 7f26cd74fe00 1 --2- 10.20.193.28:0/1746642284 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a535f626b0 0x55a535fbf160 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.150+0000 7f26cd74fe00 1 --2- 10.20.193.28:0/1746642284 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a535f61da0 0x55a535fbec20 unknown :-1 s=CLOSED pgs=109 gs=2 cs=0 l=1 c_cookie=9034376058230968756 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.150+0000 7f267effd640 0 client.25210 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:17:33.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.150+0000 7f26cd74fe00 1 -- 10.20.193.28:0/1746642284 >> 10.20.193.28:0/1746642284 conn(0x55a535e788a0 msgr2=0x55a535f57480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:33.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.150+0000 7f26cd74fe00 1 -- 10.20.193.28:0/1746642284 shutdown_connections 2026-02-24T09:17:33.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.150+0000 7f26cd74fe00 1 -- 10.20.193.28:0/1746642284 wait complete. 2026-02-24T09:17:33.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.150+0000 7f26cd74fe00 20 client.25210 trim_cache size 0 max 16384 2026-02-24T09:17:33.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.159+0000 7f26cd74fe00 1 Processor -- start 2026-02-24T09:17:33.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.160+0000 7f26cd74fe00 1 -- start start 2026-02-24T09:17:33.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.160+0000 7f26cd74fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a535e788a0 0x55a535fa9e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:33.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.160+0000 7f26cd74fe00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a535f61da0 0x55a535fbc060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:33.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.160+0000 7f26cd74fe00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a535f626b0 0x55a535fbc5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:33.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.160+0000 7f26cd74fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a535e633d0 con 0x55a535e788a0 2026-02-24T09:17:33.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.160+0000 7f26cd74fe00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55a535b23610 con 0x55a535f626b0 2026-02-24T09:17:33.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.160+0000 7f26cd74fe00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55a535fa6e10 con 0x55a535f61da0 2026-02-24T09:17:33.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.160+0000 7f26c94ca640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a535e788a0 0x55a535fa9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:33.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.160+0000 7f26c8cc9640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a535f61da0 0x55a535fbc060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:33.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.160+0000 7f26c94ca640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a535e788a0 0x55a535fa9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43642/0 (socket says 10.20.193.28:43642) 2026-02-24T09:17:33.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.160+0000 7f26c94ca640 1 -- 10.20.193.28:0/3113057125 learned_addr learned my addr 10.20.193.28:0/3113057125 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:33.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.160+0000 7f26c9ccb640 1 --2- 10.20.193.28:0/3113057125 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a535f626b0 0x55a535fbc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:33.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.160+0000 7f26c94ca640 1 -- 10.20.193.28:0/3113057125 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a535f61da0 msgr2=0x55a535fbc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:33.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.160+0000 7f26c94ca640 1 --2- 10.20.193.28:0/3113057125 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a535f61da0 0x55a535fbc060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.160+0000 7f26c94ca640 1 -- 10.20.193.28:0/3113057125 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a535f626b0 msgr2=0x55a535fbc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:33.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.160+0000 7f26c94ca640 1 --2- 10.20.193.28:0/3113057125 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a535f626b0 0x55a535fbc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.160+0000 7f26c94ca640 1 -- 10.20.193.28:0/3113057125 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a535df5b50 con 0x55a535e788a0 2026-02-24T09:17:33.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.160+0000 7f26c94ca640 1 --2- 10.20.193.28:0/3113057125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a535e788a0 0x55a535fa9e40 secure :-1 s=READY pgs=368 gs=1 cs=0 l=1 c_cookie=1737873441221034308 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26b40ce6e0 tx=0x7f26b40ef000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=181e2aafe890c144 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:33.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.161+0000 7f26914e4640 1 -- 10.20.193.28:0/3113057125 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26b40d0c70 con 0x55a535e788a0 2026-02-24T09:17:33.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.161+0000 7f26914e4640 1 -- 10.20.193.28:0/3113057125 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f26b40f0060 con 0x55a535e788a0 2026-02-24T09:17:33.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.161+0000 7f26914e4640 1 -- 10.20.193.28:0/3113057125 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26b40d8460 con 0x55a535e788a0 2026-02-24T09:17:33.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.161+0000 7f26cd74fe00 1 -- 10.20.193.28:0/3113057125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a535e788a0 msgr2=0x55a535fa9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:33.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.161+0000 7f26cd74fe00 1 --2- 10.20.193.28:0/3113057125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a535e788a0 0x55a535fa9e40 secure :-1 s=READY pgs=368 gs=1 cs=0 l=1 c_cookie=1737873441221034308 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26b40ce6e0 tx=0x7f26b40ef000 comp rx=0 tx=0).stop 2026-02-24T09:17:33.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.161+0000 7f26cd74fe00 1 -- 10.20.193.28:0/3113057125 shutdown_connections 2026-02-24T09:17:33.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.161+0000 7f26cd74fe00 1 --2- 10.20.193.28:0/3113057125 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a535f626b0 0x55a535fbc5a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.161+0000 7f26cd74fe00 1 --2- 10.20.193.28:0/3113057125 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a535f61da0 0x55a535fbc060 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.161+0000 7f26cd74fe00 1 --2- 10.20.193.28:0/3113057125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a535e788a0 0x55a535fa9e40 unknown :-1 s=CLOSED pgs=368 gs=1 cs=0 l=1 c_cookie=1737873441221034308 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.161+0000 7f26cd74fe00 1 -- 10.20.193.28:0/3113057125 >> 10.20.193.28:0/3113057125 conn(0x55a535fa42a0 msgr2=0x55a535fa9730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:33.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.161+0000 7f26cd74fe00 1 -- 10.20.193.28:0/3113057125 shutdown_connections 2026-02-24T09:17:33.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.161+0000 7f26cd74fe00 1 -- 10.20.193.28:0/3113057125 wait complete. 2026-02-24T09:17:33.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.161+0000 7f26cd74fe00 1 -- start start 2026-02-24T09:17:33.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.162+0000 7f26cd74fe00 1 Processor -- start 2026-02-24T09:17:33.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.162+0000 7f26cd74fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a535e788a0 0x55a535fc1e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:33.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.162+0000 7f26cd74fe00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a535f61da0 0x55a535fc23c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:33.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.162+0000 7f26cd74fe00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a535f626b0 0x55a535fcad30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:33.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.162+0000 7f26cd74fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a535fc5a00 con 0x55a535e788a0 2026-02-24T09:17:33.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.162+0000 7f26cd74fe00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55a535fb6a70 con 0x55a535f626b0 2026-02-24T09:17:33.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.162+0000 7f26cd74fe00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55a535fcb270 con 0x55a535f61da0 2026-02-24T09:17:33.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.162+0000 7f26c94ca640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a535e788a0 0x55a535fc1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:33.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.162+0000 7f26c94ca640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a535e788a0 0x55a535fc1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43652/0 (socket says 10.20.193.28:43652) 2026-02-24T09:17:33.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.162+0000 7f26c94ca640 1 -- 10.20.193.28:0/4085214520 learned_addr learned my addr 10.20.193.28:0/4085214520 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:33.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.162+0000 7f26c9ccb640 1 --2- 10.20.193.28:0/4085214520 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a535f626b0 0x55a535fcad30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:33.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.162+0000 7f26c8cc9640 1 --2- 10.20.193.28:0/4085214520 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a535f61da0 0x55a535fc23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:33.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.162+0000 7f26c94ca640 1 -- 10.20.193.28:0/4085214520 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a535f61da0 msgr2=0x55a535fc23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:33.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.162+0000 7f26c94ca640 1 --2- 10.20.193.28:0/4085214520 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a535f61da0 0x55a535fc23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.162+0000 7f26c94ca640 1 -- 10.20.193.28:0/4085214520 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a535f626b0 msgr2=0x55a535fcad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:33.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.162+0000 7f26c94ca640 1 --2- 10.20.193.28:0/4085214520 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a535f626b0 0x55a535fcad30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.162+0000 7f26c94ca640 1 -- 10.20.193.28:0/4085214520 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a535de96e0 con 0x55a535e788a0 2026-02-24T09:17:33.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.163+0000 7f26c94ca640 1 --2- 10.20.193.28:0/4085214520 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a535e788a0 0x55a535fc1e80 secure :-1 s=READY pgs=369 gs=1 cs=0 l=1 c_cookie=15804972596985043104 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26b40ce6e0 tx=0x7f26b40d35b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db568ad6b01398a0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:33.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.163+0000 7f267effd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:17:33.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.163+0000 7f267effd640 1 -- 10.20.193.28:0/4085214520 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26b40d0c70 con 0x55a535e788a0 2026-02-24T09:17:33.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.163+0000 7f267effd640 1 -- 10.20.193.28:0/4085214520 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x55a535afb600 con 0x55a535e788a0 2026-02-24T09:17:33.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.163+0000 7f267effd640 1 -- 10.20.193.28:0/4085214520 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26b40d86e0 con 0x55a535e788a0 2026-02-24T09:17:33.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.163+0000 7f26cd74fe00 1 -- 10.20.193.28:0/4085214520 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26b8009930 con 0x55a535e788a0 2026-02-24T09:17:33.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.163+0000 7f26cd74fe00 10 client.15474 _ll_register_callbacks cb 0x55a535ded510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:33.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.163+0000 7f26cd74fe00 1 -- 10.20.193.28:0/4085214520 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a535e72b90 con 0x55a535e788a0 2026-02-24T09:17:33.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.163+0000 7f267effd640 1 -- 10.20.193.28:0/4085214520 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f26b40dc5b0 con 0x55a535e788a0 2026-02-24T09:17:33.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.163+0000 7f267effd640 1 -- 10.20.193.28:0/4085214520 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f26b40d2e60 con 0x55a535e788a0 2026-02-24T09:17:33.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.163+0000 7f26cd74fe00 10 client.15474 fetch_fsmap learned FSMap version 22 2026-02-24T09:17:33.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.163+0000 7f26cd74fe00 1 -- 10.20.193.28:0/4085214520 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=22}) -- 0x55a535dfb330 con 0x55a535e788a0 2026-02-24T09:17:33.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.163+0000 7f267effd640 1 -- 10.20.193.28:0/4085214520 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 22) ==== 8346+0+0 (secure 0 0 0) 0x7f26b40ccdc0 con 0x55a535e788a0 2026-02-24T09:17:33.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.163+0000 7f26cd74fe00 10 client.15474 fetch_fsmap finished waiting for FSMap version 22 2026-02-24T09:17:33.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.163+0000 7f26cd74fe00 10 client.15474 resolve_mds: resolved name 'b' to daemon mds.b 2026-02-24T09:17:33.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.163+0000 7f26cd74fe00 20 client.15474 populate_metadata read hostname 'trial028' 2026-02-24T09:17:33.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.163+0000 7f26cd74fe00 1 --2- 10.20.193.28:0/4085214520 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55a535fa7350 0x55a535f86310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:33.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.163+0000 7f26cd74fe00 4 client.15474 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-24T09:17:33.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.163+0000 7f26cd74fe00 1 -- 10.20.193.28:0/4085214520 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "status"}) -- 0x55a535af8e50 con 0x55a535fa7350 2026-02-24T09:17:33.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.164+0000 7f26c8cc9640 1 --2- 10.20.193.28:0/4085214520 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55a535fa7350 0x55a535f86310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:33.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.164+0000 7f26c8cc9640 1 --2- 10.20.193.28:0/4085214520 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55a535fa7350 0x55a535f86310 crc :-1 s=READY pgs=19 gs=4 cs=0 l=0 c_cookie=13869243874475722399 s_cookie=18129236546181896593 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c07973d24963469f server_cookie=fb97fc9600339991 in_seq=0 out_seq=0 2026-02-24T09:17:33.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.164+0000 7f267effd640 10 client.15474 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:17:33.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.164+0000 7f267effd640 1 -- 10.20.193.28:0/4085214520 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1217 (crc 0 0 0) 0x55a535af8e50 con 0x55a535fa7350 2026-02-24T09:17:33.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.164+0000 7f267effd640 10 client.15474 handle_command_reply: tid=0 2026-02-24T09:17:33.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.165+0000 7f26cd74fe00 1 client.15474 shutdown 2026-02-24T09:17:33.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.165+0000 7f26cd74fe00 1 -- 10.20.193.28:0/4085214520 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a535e788a0 msgr2=0x55a535fc1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:33.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.165+0000 7f26cd74fe00 1 --2- 10.20.193.28:0/4085214520 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a535e788a0 0x55a535fc1e80 secure :-1 s=READY pgs=369 gs=1 cs=0 l=1 c_cookie=15804972596985043104 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26b40ce6e0 tx=0x7f26b40d35b0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.165+0000 7f26cd74fe00 1 -- 10.20.193.28:0/4085214520 shutdown_connections 2026-02-24T09:17:33.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.165+0000 7f26cd74fe00 1 --2- 10.20.193.28:0/4085214520 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55a535fa7350 0x55a535f86310 crc :-1 s=READY pgs=19 gs=4 cs=0 l=0 c_cookie=13869243874475722399 s_cookie=18129236546181896593 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.165+0000 7f26cd74fe00 1 --2- 10.20.193.28:0/4085214520 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a535f626b0 0x55a535fcad30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.165+0000 7f26cd74fe00 1 --2- 10.20.193.28:0/4085214520 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a535f61da0 0x55a535fc23c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.165+0000 7f26cd74fe00 1 --2- 10.20.193.28:0/4085214520 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a535e788a0 0x55a535fc1e80 unknown :-1 s=CLOSED pgs=369 gs=1 cs=0 l=1 c_cookie=15804972596985043104 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.165+0000 7f26cd74fe00 1 -- 10.20.193.28:0/4085214520 >> 10.20.193.28:0/4085214520 conn(0x55a535fa42a0 msgr2=0x55a535fbd070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:33.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.165+0000 7f267effd640 0 client.15474 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:17:33.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.165+0000 7f26cd74fe00 1 -- 10.20.193.28:0/4085214520 shutdown_connections 2026-02-24T09:17:33.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.165+0000 7f26cd74fe00 1 -- 10.20.193.28:0/4085214520 wait complete. 2026-02-24T09:17:33.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.165+0000 7f26cd74fe00 20 client.15474 trim_cache size 0 max 16384 2026-02-24T09:17:33.172 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-24T09:17:33.173 INFO:teuthology.orchestra.run.trial028.stdout: "cluster_fsid": "e9ad50af-1160-11f1-800e-d404e6e7d460", 2026-02-24T09:17:33.173 INFO:teuthology.orchestra.run.trial028.stdout: "whoami": 0, 2026-02-24T09:17:33.173 INFO:teuthology.orchestra.run.trial028.stdout: "id": 24788, 2026-02-24T09:17:33.173 INFO:teuthology.orchestra.run.trial028.stdout: "want_state": "up:active", 2026-02-24T09:17:33.173 INFO:teuthology.orchestra.run.trial028.stdout: "state": "up:active", 2026-02-24T09:17:33.173 INFO:teuthology.orchestra.run.trial028.stdout: "fs_name": "cephfs", 2026-02-24T09:17:33.173 INFO:teuthology.orchestra.run.trial028.stdout: "rank_uptime": 32.687111068, 2026-02-24T09:17:33.173 INFO:teuthology.orchestra.run.trial028.stdout: "mdsmap_epoch": 22, 2026-02-24T09:17:33.173 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch": 92, 2026-02-24T09:17:33.173 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch_barrier": 92, 2026-02-24T09:17:33.173 INFO:teuthology.orchestra.run.trial028.stdout: "uptime": 39.017094491999998, 2026-02-24T09:17:33.174 INFO:teuthology.orchestra.run.trial028.stdout: "sysinfo": { 2026-02-24T09:17:33.174 INFO:teuthology.orchestra.run.trial028.stdout: "arch": "x86_64", 2026-02-24T09:17:33.174 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_release": "tentacle", 2026-02-24T09:17:33.174 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version": "ceph version 20.3.0-5537-g5bc9a1ff (5bc9a1ffc19df681248ece8c3c8c7191a571745b) tentacle (dev - RelWithDebInfo)", 2026-02-24T09:17:33.174 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version_short": "20.3.0-5537-g5bc9a1ff", 2026-02-24T09:17:33.174 INFO:teuthology.orchestra.run.trial028.stdout: "container_hostname": "trial074", 2026-02-24T09:17:33.174 INFO:teuthology.orchestra.run.trial028.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b", 2026-02-24T09:17:33.174 INFO:teuthology.orchestra.run.trial028.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-24T09:17:33.174 INFO:teuthology.orchestra.run.trial028.stdout: "distro": "centos", 2026-02-24T09:17:33.174 INFO:teuthology.orchestra.run.trial028.stdout: "distro_description": "CentOS Stream 9", 2026-02-24T09:17:33.174 INFO:teuthology.orchestra.run.trial028.stdout: "distro_version": "9", 2026-02-24T09:17:33.174 INFO:teuthology.orchestra.run.trial028.stdout: "hostname": "trial074", 2026-02-24T09:17:33.175 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Thu Feb 12 10:25:42 EST 2026", 2026-02-24T09:17:33.175 INFO:teuthology.orchestra.run.trial028.stdout: "kernel_version": "6.19.0-g8dec4b357aab", 2026-02-24T09:17:33.175 INFO:teuthology.orchestra.run.trial028.stdout: "mem_swap_kb": "8388604", 2026-02-24T09:17:33.175 INFO:teuthology.orchestra.run.trial028.stdout: "mem_total_kb": "130448332", 2026-02-24T09:17:33.175 INFO:teuthology.orchestra.run.trial028.stdout: "os": "Linux" 2026-02-24T09:17:33.175 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:17:33.175 INFO:teuthology.orchestra.run.trial028.stdout: "endian": "little" 2026-02-24T09:17:33.175 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-24T09:17:33.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.165+0000 7f26cb755640 1 -- 10.20.193.28:0/103195157 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f26a00b5840 msgr2=0x7f26a00d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:33.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.165+0000 7f26cb755640 1 --2- 10.20.193.28:0/103195157 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f26a00b5840 0x7f26a00d5cf0 secure :-1 s=READY pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26c4124a20 tx=0x7f26b8005f90 comp rx=0 tx=0).stop 2026-02-24T09:17:33.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.165+0000 7f26cb755640 1 -- 10.20.193.28:0/103195157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f26c410f6c0 msgr2=0x7f26c411e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:33.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.165+0000 7f26cb755640 1 --2- 10.20.193.28:0/103195157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f26c410f6c0 0x7f26c411e080 secure :-1 s=READY pgs=366 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26b40098a0 tx=0x7f26b40028d0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.166+0000 7f26cb755640 1 -- 10.20.193.28:0/103195157 shutdown_connections 2026-02-24T09:17:33.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.166+0000 7f26cb755640 1 --2- 10.20.193.28:0/103195157 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f26a00b5840 0x7f26a00d5cf0 unknown :-1 s=CLOSED pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.166+0000 7f26cb755640 1 --2- 10.20.193.28:0/103195157 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f26c41158b0 0x7f26c4123990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.166+0000 7f26cb755640 1 --2- 10.20.193.28:0/103195157 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f26c41100b0 0x7f26c411e5c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.166+0000 7f26cb755640 1 --2- 10.20.193.28:0/103195157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f26c410f6c0 0x7f26c411e080 unknown :-1 s=CLOSED pgs=366 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.166+0000 7f26cb755640 1 -- 10.20.193.28:0/103195157 >> 10.20.193.28:0/103195157 conn(0x7f26c40ecfd0 msgr2=0x7f26c410d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:33.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.166+0000 7f26cb755640 1 -- 10.20.193.28:0/103195157 shutdown_connections 2026-02-24T09:17:33.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.166+0000 7f26cb755640 1 -- 10.20.193.28:0/103195157 wait complete. 2026-02-24T09:17:33.267 INFO:teuthology.run_tasks:Running task ceph-fuse... 2026-02-24T09:17:33.300 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2026-02-24T09:17:33.300 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2026-02-24T09:17:33.300 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2026-02-24T09:17:33.300 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2026-02-24T09:17:33.300 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2026-02-24T09:17:33.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-24T09:17:33.300 DEBUG:teuthology.orchestra.run.trial028:> ip netns list 2026-02-24T09:17:33.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-24T09:17:33.338 DEBUG:teuthology.orchestra.run.trial028:> sudo ip link delete ceph-brx 2026-02-24T09:17:33.439 INFO:teuthology.orchestra.run.trial028.stderr:Cannot find device "ceph-brx" 2026-02-24T09:17:33.441 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T09:17:33.442 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2026-02-24T09:17:33.442 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2026-02-24T09:17:33.442 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph fs ls 2026-02-24T09:17:33.625 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:17:33.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.808+0000 7fabecdaf640 1 -- 10.20.193.28:0/3666241149 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fabe811ac80 msgr2=0x7fabe811b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:33.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.808+0000 7fabecdaf640 1 --2- 10.20.193.28:0/3666241149 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fabe811ac80 0x7fabe811b0b0 secure :-1 s=READY pgs=370 gs=1 cs=0 l=1 c_cookie=5492612202929054178 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fabd0009950 tx=0x7fabd002f190 comp rx=0 tx=0).stop 2026-02-24T09:17:33.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.808+0000 7fabecdaf640 1 -- 10.20.193.28:0/3666241149 shutdown_connections 2026-02-24T09:17:33.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.808+0000 7fabecdaf640 1 --2- 10.20.193.28:0/3666241149 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fabe81187a0 0x7fabe8118c20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.808+0000 7fabecdaf640 1 --2- 10.20.193.28:0/3666241149 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fabe811ac80 0x7fabe811b0b0 unknown :-1 s=CLOSED pgs=370 gs=1 cs=0 l=1 c_cookie=5492612202929054178 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.808+0000 7fabecdaf640 1 --2- 10.20.193.28:0/3666241149 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fabe811baa0 0x7fabe811a740 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.808+0000 7fabecdaf640 1 -- 10.20.193.28:0/3666241149 >> 10.20.193.28:0/3666241149 conn(0x7fabe8057f50 msgr2=0x7fabe8058350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:33.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.808+0000 7fabecdaf640 1 -- 10.20.193.28:0/3666241149 shutdown_connections 2026-02-24T09:17:33.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.808+0000 7fabecdaf640 1 -- 10.20.193.28:0/3666241149 wait complete. 2026-02-24T09:17:33.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.809+0000 7fabecdaf640 1 Processor -- start 2026-02-24T09:17:33.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.809+0000 7fabecdaf640 1 -- start start 2026-02-24T09:17:33.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.809+0000 7fabecdaf640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fabe81187a0 0x7fabe80fffd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:33.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.809+0000 7fabecdaf640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fabe811ac80 0x7fabe8100510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:33.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.809+0000 7fabecdaf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fabe811baa0 0x7fabe8105890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:33.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.809+0000 7fabecdaf640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fabe8105eb0 con 0x7fabe811baa0 2026-02-24T09:17:33.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.809+0000 7fabecdaf640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fabe8106020 con 0x7fabe81187a0 2026-02-24T09:17:33.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.809+0000 7fabecdaf640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fabe81061e0 con 0x7fabe811ac80 2026-02-24T09:17:33.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.809+0000 7fabe6d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fabe811baa0 0x7fabe8105890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:33.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.809+0000 7fabe6d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fabe811baa0 0x7fabe8105890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43670/0 (socket says 10.20.193.28:43670) 2026-02-24T09:17:33.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.809+0000 7fabe6575640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fabe81187a0 0x7fabe80fffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:33.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.809+0000 7fabe6d76640 1 -- 10.20.193.28:0/694013628 learned_addr learned my addr 10.20.193.28:0/694013628 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:33.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.809+0000 7fabe5d74640 1 --2- 10.20.193.28:0/694013628 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fabe811ac80 0x7fabe8100510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:33.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.810+0000 7fabe6d76640 1 -- 10.20.193.28:0/694013628 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fabe811ac80 msgr2=0x7fabe8100510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:33.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.810+0000 7fabe6d76640 1 --2- 10.20.193.28:0/694013628 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fabe811ac80 0x7fabe8100510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.810+0000 7fabe6d76640 1 -- 10.20.193.28:0/694013628 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fabe81187a0 msgr2=0x7fabe80fffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:33.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.810+0000 7fabe6d76640 1 --2- 10.20.193.28:0/694013628 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fabe81187a0 0x7fabe80fffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.810+0000 7fabe6d76640 1 -- 10.20.193.28:0/694013628 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd800a590 con 0x7fabe811baa0 2026-02-24T09:17:33.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.810+0000 7fabe6d76640 1 --2- 10.20.193.28:0/694013628 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fabe811baa0 0x7fabe8105890 secure :-1 s=READY pgs=371 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fabd8005790 tx=0x7fabd8003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:33.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.810+0000 7fabcf7fe640 1 -- 10.20.193.28:0/694013628 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fabd800fd60 con 0x7fabe811baa0 2026-02-24T09:17:33.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.810+0000 7fabcf7fe640 1 -- 10.20.193.28:0/694013628 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fabd8003e80 con 0x7fabe811baa0 2026-02-24T09:17:33.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.810+0000 7fabcf7fe640 1 -- 10.20.193.28:0/694013628 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fabd8019950 con 0x7fabe811baa0 2026-02-24T09:17:33.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.810+0000 7fabecdaf640 1 -- 10.20.193.28:0/694013628 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabd0009570 con 0x7fabe811baa0 2026-02-24T09:17:33.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.810+0000 7fabecdaf640 1 -- 10.20.193.28:0/694013628 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabe817bf70 con 0x7fabe811baa0 2026-02-24T09:17:33.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.811+0000 7fabcd7fa640 1 -- 10.20.193.28:0/694013628 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabe805a3b0 con 0x7fabe811baa0 2026-02-24T09:17:33.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.813+0000 7fabcf7fe640 1 -- 10.20.193.28:0/694013628 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7fabd8017020 con 0x7fabe811baa0 2026-02-24T09:17:33.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.815+0000 7fabcf7fe640 1 --2- 10.20.193.28:0/694013628 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fabc00b5910 0x7fabc00d5dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:33.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.815+0000 7fabcf7fe640 1 -- 10.20.193.28:0/694013628 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7fabd80e7f80 con 0x7fabe811baa0 2026-02-24T09:17:33.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.815+0000 7fabe6575640 1 --2- 10.20.193.28:0/694013628 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fabc00b5910 0x7fabc00d5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:33.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.815+0000 7fabcf7fe640 1 -- 10.20.193.28:0/694013628 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fabd80e8400 con 0x7fabe811baa0 2026-02-24T09:17:33.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.815+0000 7fabe6575640 1 --2- 10.20.193.28:0/694013628 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fabc00b5910 0x7fabc00d5dc0 secure :-1 s=READY pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fabdc004740 tx=0x7fabdc005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:33.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.957+0000 7fabcd7fa640 1 -- 10.20.193.28:0/694013628 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fabe8118c20 con 0x7fabe811baa0 2026-02-24T09:17:33.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.958+0000 7fabcf7fe640 1 -- 10.20.193.28:0/694013628 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) ==== 53+0+73 (secure 0 0 0) 0x7fabd80aa8a0 con 0x7fabe811baa0 2026-02-24T09:17:33.959 INFO:teuthology.orchestra.run.trial028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2026-02-24T09:17:33.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.959+0000 7fabcd7fa640 1 -- 10.20.193.28:0/694013628 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fabc00b5910 msgr2=0x7fabc00d5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:33.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.959+0000 7fabcd7fa640 1 --2- 10.20.193.28:0/694013628 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fabc00b5910 0x7fabc00d5dc0 secure :-1 s=READY pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fabdc004740 tx=0x7fabdc005f90 comp rx=0 tx=0).stop 2026-02-24T09:17:33.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.959+0000 7fabcd7fa640 1 -- 10.20.193.28:0/694013628 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fabe811baa0 msgr2=0x7fabe8105890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:33.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.959+0000 7fabcd7fa640 1 --2- 10.20.193.28:0/694013628 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fabe811baa0 0x7fabe8105890 secure :-1 s=READY pgs=371 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fabd8005790 tx=0x7fabd8003c20 comp rx=0 tx=0).stop 2026-02-24T09:17:33.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.959+0000 7fabcd7fa640 1 -- 10.20.193.28:0/694013628 shutdown_connections 2026-02-24T09:17:33.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.959+0000 7fabcd7fa640 1 --2- 10.20.193.28:0/694013628 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fabc00b5910 0x7fabc00d5dc0 unknown :-1 s=CLOSED pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.959+0000 7fabcd7fa640 1 --2- 10.20.193.28:0/694013628 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fabe811baa0 0x7fabe8105890 unknown :-1 s=CLOSED pgs=371 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.959+0000 7fabcd7fa640 1 --2- 10.20.193.28:0/694013628 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fabe811ac80 0x7fabe8100510 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.959+0000 7fabcd7fa640 1 --2- 10.20.193.28:0/694013628 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fabe81187a0 0x7fabe80fffd0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:33.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.959+0000 7fabcd7fa640 1 -- 10.20.193.28:0/694013628 >> 10.20.193.28:0/694013628 conn(0x7fabe8057f50 msgr2=0x7fabe80f5730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:33.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.959+0000 7fabcd7fa640 1 -- 10.20.193.28:0/694013628 shutdown_connections 2026-02-24T09:17:33.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:33.959+0000 7fabcd7fa640 1 -- 10.20.193.28:0/694013628 wait complete. 2026-02-24T09:17:34.060 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2026-02-24T09:17:34.060 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2026-02-24T09:17:34.060 INFO:tasks.cephfs.mount:self.client_remote.hostname = trial028.front.sepia.ceph.com 2026-02-24T09:17:34.060 INFO:tasks.cephfs.mount:self.client.name = client.0 2026-02-24T09:17:34.060 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2026-02-24T09:17:34.060 INFO:tasks.cephfs.mount:self.cephfs_name = None 2026-02-24T09:17:34.060 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2026-02-24T09:17:34.060 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2026-02-24T09:17:34.060 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2026-02-24T09:17:34.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-24T09:17:34.061 DEBUG:teuthology.orchestra.run.trial028:> ip addr 2026-02-24T09:17:34.101 INFO:teuthology.orchestra.run.trial028.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2026-02-24T09:17:34.101 INFO:teuthology.orchestra.run.trial028.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2026-02-24T09:17:34.101 INFO:teuthology.orchestra.run.trial028.stdout: inet 127.0.0.1/8 scope host lo 2026-02-24T09:17:34.101 INFO:teuthology.orchestra.run.trial028.stdout: valid_lft forever preferred_lft forever 2026-02-24T09:17:34.102 INFO:teuthology.orchestra.run.trial028.stdout: inet6 ::1/128 scope host 2026-02-24T09:17:34.102 INFO:teuthology.orchestra.run.trial028.stdout: valid_lft forever preferred_lft forever 2026-02-24T09:17:34.102 INFO:teuthology.orchestra.run.trial028.stdout:2: enp1s0f0np0: mtu 1500 qdisc fq_codel state UP group default qlen 1000 2026-02-24T09:17:34.102 INFO:teuthology.orchestra.run.trial028.stdout: link/ether 90:5a:08:77:63:0c brd ff:ff:ff:ff:ff:ff 2026-02-24T09:17:34.102 INFO:teuthology.orchestra.run.trial028.stdout: inet 10.20.193.28/20 brd 10.20.207.255 scope global dynamic noprefixroute enp1s0f0np0 2026-02-24T09:17:34.102 INFO:teuthology.orchestra.run.trial028.stdout: valid_lft 660sec preferred_lft 660sec 2026-02-24T09:17:34.102 INFO:teuthology.orchestra.run.trial028.stdout: inet6 fe80::925a:8ff:fe77:630c/64 scope link proto kernel_ll 2026-02-24T09:17:34.102 INFO:teuthology.orchestra.run.trial028.stdout: valid_lft forever preferred_lft forever 2026-02-24T09:17:34.102 INFO:teuthology.orchestra.run.trial028.stdout:3: enp1s0f1np1: mtu 1500 qdisc fq_codel state DOWN group default qlen 1000 2026-02-24T09:17:34.102 INFO:teuthology.orchestra.run.trial028.stdout: link/ether 90:5a:08:77:63:0d brd ff:ff:ff:ff:ff:ff 2026-02-24T09:17:34.103 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.159.254/20 2026-02-24T09:17:34.103 DEBUG:teuthology.orchestra.run.trial028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-24T09:17:34.103 DEBUG:teuthology.orchestra.run.trial028:> set -e 2026-02-24T09:17:34.104 DEBUG:teuthology.orchestra.run.trial028:> sudo ip link add name ceph-brx type bridge 2026-02-24T09:17:34.104 DEBUG:teuthology.orchestra.run.trial028:> sudo ip addr flush dev ceph-brx 2026-02-24T09:17:34.104 DEBUG:teuthology.orchestra.run.trial028:> sudo ip link set ceph-brx up 2026-02-24T09:17:34.104 DEBUG:teuthology.orchestra.run.trial028:> sudo ip addr add 192.168.159.254/20 brd 192.168.159.255 dev ceph-brx 2026-02-24T09:17:34.104 DEBUG:teuthology.orchestra.run.trial028:> ') 2026-02-24T09:17:34.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-24T09:17:34.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-24T09:17:34.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-24T09:17:34.368 DEBUG:teuthology.orchestra.run.trial028:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2026-02-24T09:17:34.423 INFO:teuthology.orchestra.run.trial028.stdout:1 2026-02-24T09:17:34.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-24T09:17:34.427 DEBUG:teuthology.orchestra.run.trial028:> ip r 2026-02-24T09:17:34.465 INFO:teuthology.orchestra.run.trial028.stdout:default via 10.20.192.1 dev enp1s0f0np0 proto dhcp src 10.20.193.28 metric 100 2026-02-24T09:17:34.465 INFO:teuthology.orchestra.run.trial028.stdout:10.20.192.0/20 dev enp1s0f0np0 proto kernel scope link src 10.20.193.28 metric 100 2026-02-24T09:17:34.465 INFO:teuthology.orchestra.run.trial028.stdout:192.168.144.0/20 dev ceph-brx proto kernel scope link src 192.168.159.254 2026-02-24T09:17:34.466 DEBUG:teuthology.orchestra.run.trial028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-24T09:17:34.466 DEBUG:teuthology.orchestra.run.trial028:> set -e 2026-02-24T09:17:34.466 DEBUG:teuthology.orchestra.run.trial028:> sudo iptables -A FORWARD -o enp1s0f0np0 -i ceph-brx -j ACCEPT 2026-02-24T09:17:34.466 DEBUG:teuthology.orchestra.run.trial028:> sudo iptables -A FORWARD -i enp1s0f0np0 -o ceph-brx -j ACCEPT 2026-02-24T09:17:34.466 DEBUG:teuthology.orchestra.run.trial028:> sudo iptables -t nat -A POSTROUTING -s 192.168.159.254/20 -o enp1s0f0np0 -j MASQUERADE 2026-02-24T09:17:34.466 DEBUG:teuthology.orchestra.run.trial028:> ') 2026-02-24T09:17:34.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-24T09:17:34.586 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:34 trial028 ceph-mon[40371]: pgmap v197: 97 pgs: 97 active+clean; 648 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 341 B/s wr, 6 op/s 2026-02-24T09:17:34.586 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:34 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/694013628' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2026-02-24T09:17:34.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:34 trial074 ceph-mon[44412]: pgmap v197: 97 pgs: 97 active+clean; 648 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 341 B/s wr, 6 op/s 2026-02-24T09:17:34.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:34 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/694013628' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2026-02-24T09:17:34.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-24T09:17:34.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-24T09:17:34.768 DEBUG:teuthology.orchestra.run.trial028:> ip netns list 2026-02-24T09:17:34.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:34 trial159 ceph-mon[44242]: pgmap v197: 97 pgs: 97 active+clean; 648 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 341 B/s wr, 6 op/s 2026-02-24T09:17:34.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:34 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/694013628' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2026-02-24T09:17:34.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-24T09:17:34.809 DEBUG:teuthology.orchestra.run.trial028:> ip netns list-id 2026-02-24T09:17:34.885 DEBUG:teuthology.orchestra.run.trial028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-24T09:17:34.886 DEBUG:teuthology.orchestra.run.trial028:> set -e 2026-02-24T09:17:34.886 DEBUG:teuthology.orchestra.run.trial028:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2026-02-24T09:17:34.886 DEBUG:teuthology.orchestra.run.trial028:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2026-02-24T09:17:34.886 DEBUG:teuthology.orchestra.run.trial028:> ') 2026-02-24T09:17:34.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-24T09:17:35.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-24T09:17:35.041 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.144.1/20 2026-02-24T09:17:35.041 DEBUG:teuthology.orchestra.run.trial028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-24T09:17:35.041 DEBUG:teuthology.orchestra.run.trial028:> set -e 2026-02-24T09:17:35.042 DEBUG:teuthology.orchestra.run.trial028:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2026-02-24T09:17:35.042 DEBUG:teuthology.orchestra.run.trial028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.144.1/20 brd 192.168.159.255 dev veth0 2026-02-24T09:17:35.042 DEBUG:teuthology.orchestra.run.trial028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2026-02-24T09:17:35.042 DEBUG:teuthology.orchestra.run.trial028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2026-02-24T09:17:35.042 DEBUG:teuthology.orchestra.run.trial028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.159.254 2026-02-24T09:17:35.042 DEBUG:teuthology.orchestra.run.trial028:> ') 2026-02-24T09:17:35.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-24T09:17:35.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-24T09:17:35.235 DEBUG:teuthology.orchestra.run.trial028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-24T09:17:35.235 DEBUG:teuthology.orchestra.run.trial028:> set -e 2026-02-24T09:17:35.235 DEBUG:teuthology.orchestra.run.trial028:> sudo ip link set brx.0 up 2026-02-24T09:17:35.235 DEBUG:teuthology.orchestra.run.trial028:> sudo ip link set dev brx.0 master ceph-brx 2026-02-24T09:17:35.235 DEBUG:teuthology.orchestra.run.trial028:> ') 2026-02-24T09:17:35.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-24T09:17:35.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-24T09:17:35.387 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2026-02-24T09:17:35.387 INFO:teuthology.orchestra.run:Running command with timeout 60 2026-02-24T09:17:35.388 DEBUG:teuthology.orchestra.run.trial028:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2026-02-24T09:17:35.427 INFO:teuthology.orchestra.run.trial028.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2026-02-24T09:17:35.427 INFO:teuthology.orchestra.run:Running command with timeout 60 2026-02-24T09:17:35.427 DEBUG:teuthology.orchestra.run.trial028:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2026-02-24T09:17:35.504 DEBUG:teuthology.orchestra.run.trial028:> sudo modprobe fuse 2026-02-24T09:17:35.602 DEBUG:teuthology.orchestra.run.trial028:> cat /proc/self/mounts | awk '{print $2}' 2026-02-24T09:17:35.640 INFO:teuthology.orchestra.run.trial028.stdout:/proc 2026-02-24T09:17:35.641 INFO:teuthology.orchestra.run.trial028.stdout:/sys 2026-02-24T09:17:35.641 INFO:teuthology.orchestra.run.trial028.stdout:/dev 2026-02-24T09:17:35.641 INFO:teuthology.orchestra.run.trial028.stdout:/sys/kernel/security 2026-02-24T09:17:35.641 INFO:teuthology.orchestra.run.trial028.stdout:/dev/shm 2026-02-24T09:17:35.641 INFO:teuthology.orchestra.run.trial028.stdout:/dev/pts 2026-02-24T09:17:35.641 INFO:teuthology.orchestra.run.trial028.stdout:/run 2026-02-24T09:17:35.641 INFO:teuthology.orchestra.run.trial028.stdout:/sys/fs/cgroup 2026-02-24T09:17:35.641 INFO:teuthology.orchestra.run.trial028.stdout:/sys/fs/pstore 2026-02-24T09:17:35.641 INFO:teuthology.orchestra.run.trial028.stdout:/sys/firmware/efi/efivars 2026-02-24T09:17:35.641 INFO:teuthology.orchestra.run.trial028.stdout:/sys/fs/bpf 2026-02-24T09:17:35.641 INFO:teuthology.orchestra.run.trial028.stdout:/sys/kernel/config 2026-02-24T09:17:35.641 INFO:teuthology.orchestra.run.trial028.stdout:/ 2026-02-24T09:17:35.641 INFO:teuthology.orchestra.run.trial028.stdout:/sys/fs/selinux 2026-02-24T09:17:35.641 INFO:teuthology.orchestra.run.trial028.stdout:/proc/sys/fs/binfmt_misc 2026-02-24T09:17:35.641 INFO:teuthology.orchestra.run.trial028.stdout:/dev/hugepages 2026-02-24T09:17:35.641 INFO:teuthology.orchestra.run.trial028.stdout:/dev/mqueue 2026-02-24T09:17:35.641 INFO:teuthology.orchestra.run.trial028.stdout:/sys/kernel/debug 2026-02-24T09:17:35.641 INFO:teuthology.orchestra.run.trial028.stdout:/sys/kernel/tracing 2026-02-24T09:17:35.641 INFO:teuthology.orchestra.run.trial028.stdout:/sys/fs/fuse/connections 2026-02-24T09:17:35.641 INFO:teuthology.orchestra.run.trial028.stdout:/run/credentials/systemd-sysctl.service 2026-02-24T09:17:35.641 INFO:teuthology.orchestra.run.trial028.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2026-02-24T09:17:35.641 INFO:teuthology.orchestra.run.trial028.stdout:/boot/efi 2026-02-24T09:17:35.641 INFO:teuthology.orchestra.run.trial028.stdout:/run/credentials/systemd-tmpfiles-setup.service 2026-02-24T09:17:35.641 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/nfs/rpc_pipefs 2026-02-24T09:17:35.641 INFO:teuthology.orchestra.run.trial028.stdout:/run/user/1000 2026-02-24T09:17:35.641 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/ceph 2026-02-24T09:17:35.641 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay 2026-02-24T09:17:35.641 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/c269a122eb5546e5e8929baaddc54076de45a803f15696704e2019f56627f467/merged 2026-02-24T09:17:35.641 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/56a73b483cb6feb6482ca1bc33a229e64381e2f8a4976791f828aa67ce3e42f8/merged 2026-02-24T09:17:35.641 INFO:teuthology.orchestra.run.trial028.stdout:/run/user/0 2026-02-24T09:17:35.641 INFO:teuthology.orchestra.run.trial028.stdout:/proc/sys/fs/binfmt_misc 2026-02-24T09:17:35.641 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/4ee96072bb680b0c875edca8b994cd7de0e6151c0dbed0820b46c9be72dff538/merged 2026-02-24T09:17:35.642 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/acc76589964340bb3280fa5bc293c65603ce460e6e99b9f7218df4c138f1bcc7/merged 2026-02-24T09:17:35.642 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/7be4716c15c661d5254bb62e7c7010d16d5a3def68306a6a7781499fe0968d3f/merged 2026-02-24T09:17:35.642 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/da2489ea0e4fc084b8d28a462aa61f86d65bd93bb3462e45bc6e30320e861d13/merged 2026-02-24T09:17:35.642 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/94c317f52d833b5635335b867d5886e251490b9fd4f74a9d605f78f510ee1d33/merged 2026-02-24T09:17:35.642 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/c98e70decea8f7982e1527045c67e2944a111a3b3e7d0395204ba4d679d636eb/merged 2026-02-24T09:17:35.642 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/d5aab891eb19fea944eef79b0c60da6eff7c632fb51455e5137c3a40a565cd48/merged 2026-02-24T09:17:35.642 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/14933b7a245feccca494e0061c9fc50b4882e78e89862969dc8d1e562fa254b9/merged 2026-02-24T09:17:35.642 INFO:teuthology.orchestra.run.trial028.stdout:/run/netns 2026-02-24T09:17:35.642 INFO:teuthology.orchestra.run.trial028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2026-02-24T09:17:35.642 INFO:teuthology.orchestra.run.trial028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2026-02-24T09:17:35.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-24T09:17:35.643 DEBUG:teuthology.orchestra.run.trial028:> ls /sys/fs/fuse/connections 2026-02-24T09:17:35.722 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2026-02-24T09:17:35.722 DEBUG:teuthology.orchestra.run.trial028:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/df987db1-0b17-4685-b91f-d18b9920239e --client_fs=cephfs) 2026-02-24T09:17:35.766 DEBUG:teuthology.orchestra.run.trial028:> sudo modprobe fuse 2026-02-24T09:17:35.822 DEBUG:teuthology.orchestra.run.trial028:> cat /proc/self/mounts | awk '{print $2}' 2026-02-24T09:17:35.862 INFO:teuthology.orchestra.run.trial028.stdout:/proc 2026-02-24T09:17:35.862 INFO:teuthology.orchestra.run.trial028.stdout:/sys 2026-02-24T09:17:35.863 INFO:teuthology.orchestra.run.trial028.stdout:/dev 2026-02-24T09:17:35.863 INFO:teuthology.orchestra.run.trial028.stdout:/sys/kernel/security 2026-02-24T09:17:35.863 INFO:teuthology.orchestra.run.trial028.stdout:/dev/shm 2026-02-24T09:17:35.863 INFO:teuthology.orchestra.run.trial028.stdout:/dev/pts 2026-02-24T09:17:35.863 INFO:teuthology.orchestra.run.trial028.stdout:/run 2026-02-24T09:17:35.863 INFO:teuthology.orchestra.run.trial028.stdout:/sys/fs/cgroup 2026-02-24T09:17:35.863 INFO:teuthology.orchestra.run.trial028.stdout:/sys/fs/pstore 2026-02-24T09:17:35.863 INFO:teuthology.orchestra.run.trial028.stdout:/sys/firmware/efi/efivars 2026-02-24T09:17:35.863 INFO:teuthology.orchestra.run.trial028.stdout:/sys/fs/bpf 2026-02-24T09:17:35.863 INFO:teuthology.orchestra.run.trial028.stdout:/sys/kernel/config 2026-02-24T09:17:35.863 INFO:teuthology.orchestra.run.trial028.stdout:/ 2026-02-24T09:17:35.863 INFO:teuthology.orchestra.run.trial028.stdout:/sys/fs/selinux 2026-02-24T09:17:35.864 INFO:teuthology.orchestra.run.trial028.stdout:/proc/sys/fs/binfmt_misc 2026-02-24T09:17:35.864 INFO:teuthology.orchestra.run.trial028.stdout:/dev/hugepages 2026-02-24T09:17:35.864 INFO:teuthology.orchestra.run.trial028.stdout:/dev/mqueue 2026-02-24T09:17:35.864 INFO:teuthology.orchestra.run.trial028.stdout:/sys/kernel/debug 2026-02-24T09:17:35.864 INFO:teuthology.orchestra.run.trial028.stdout:/sys/kernel/tracing 2026-02-24T09:17:35.864 INFO:teuthology.orchestra.run.trial028.stdout:/sys/fs/fuse/connections 2026-02-24T09:17:35.864 INFO:teuthology.orchestra.run.trial028.stdout:/run/credentials/systemd-sysctl.service 2026-02-24T09:17:35.864 INFO:teuthology.orchestra.run.trial028.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2026-02-24T09:17:35.864 INFO:teuthology.orchestra.run.trial028.stdout:/boot/efi 2026-02-24T09:17:35.864 INFO:teuthology.orchestra.run.trial028.stdout:/run/credentials/systemd-tmpfiles-setup.service 2026-02-24T09:17:35.864 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/nfs/rpc_pipefs 2026-02-24T09:17:35.864 INFO:teuthology.orchestra.run.trial028.stdout:/run/user/1000 2026-02-24T09:17:35.865 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/ceph 2026-02-24T09:17:35.865 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay 2026-02-24T09:17:35.865 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/c269a122eb5546e5e8929baaddc54076de45a803f15696704e2019f56627f467/merged 2026-02-24T09:17:35.865 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/56a73b483cb6feb6482ca1bc33a229e64381e2f8a4976791f828aa67ce3e42f8/merged 2026-02-24T09:17:35.865 INFO:teuthology.orchestra.run.trial028.stdout:/run/user/0 2026-02-24T09:17:35.865 INFO:teuthology.orchestra.run.trial028.stdout:/proc/sys/fs/binfmt_misc 2026-02-24T09:17:35.865 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/4ee96072bb680b0c875edca8b994cd7de0e6151c0dbed0820b46c9be72dff538/merged 2026-02-24T09:17:35.865 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/acc76589964340bb3280fa5bc293c65603ce460e6e99b9f7218df4c138f1bcc7/merged 2026-02-24T09:17:35.865 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/7be4716c15c661d5254bb62e7c7010d16d5a3def68306a6a7781499fe0968d3f/merged 2026-02-24T09:17:35.865 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/da2489ea0e4fc084b8d28a462aa61f86d65bd93bb3462e45bc6e30320e861d13/merged 2026-02-24T09:17:35.865 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/94c317f52d833b5635335b867d5886e251490b9fd4f74a9d605f78f510ee1d33/merged 2026-02-24T09:17:35.865 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/c98e70decea8f7982e1527045c67e2944a111a3b3e7d0395204ba4d679d636eb/merged 2026-02-24T09:17:35.866 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/d5aab891eb19fea944eef79b0c60da6eff7c632fb51455e5137c3a40a565cd48/merged 2026-02-24T09:17:35.866 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/14933b7a245feccca494e0061c9fc50b4882e78e89862969dc8d1e562fa254b9/merged 2026-02-24T09:17:35.866 INFO:teuthology.orchestra.run.trial028.stdout:/run/netns 2026-02-24T09:17:35.866 INFO:teuthology.orchestra.run.trial028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2026-02-24T09:17:35.866 INFO:teuthology.orchestra.run.trial028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2026-02-24T09:17:35.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-24T09:17:35.867 DEBUG:teuthology.orchestra.run.trial028:> ls /sys/fs/fuse/connections 2026-02-24T09:17:35.907 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.trial028.stderr:2026-02-24T09:17:35.907+0000 7f0b0a00b400 -1 init, newargv = 0x134fa8e0 newargc=13 2026-02-24T09:17:35.907 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.trial028.stderr:2026-02-24T09:17:35.907+0000 7f0b0a00b400 -1 init, args.argv = 0x133bfaf0 args.argc=4 2026-02-24T09:17:35.907 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.trial028.stderr:ceph-fuse[118839]: starting ceph client 2026-02-24T09:17:35.927 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.trial028.stderr:ceph-fuse[118839]: starting fuse 2026-02-24T09:17:35.947 INFO:teuthology.orchestra.run.trial028.stdout:44 2026-02-24T09:17:35.947 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2026-02-24T09:17:35.947 DEBUG:teuthology.orchestra.run.trial028:> sudo stdin-killer -- python3 -c ' 2026-02-24T09:17:35.947 DEBUG:teuthology.orchestra.run.trial028:> import glob 2026-02-24T09:17:35.947 DEBUG:teuthology.orchestra.run.trial028:> import re 2026-02-24T09:17:35.948 DEBUG:teuthology.orchestra.run.trial028:> import os 2026-02-24T09:17:35.948 DEBUG:teuthology.orchestra.run.trial028:> import subprocess 2026-02-24T09:17:35.948 DEBUG:teuthology.orchestra.run.trial028:> 2026-02-24T09:17:35.948 DEBUG:teuthology.orchestra.run.trial028:> def _find_admin_socket(client_name): 2026-02-24T09:17:35.948 DEBUG:teuthology.orchestra.run.trial028:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2026-02-24T09:17:35.948 DEBUG:teuthology.orchestra.run.trial028:> files = glob.glob(asok_path) 2026-02-24T09:17:35.948 DEBUG:teuthology.orchestra.run.trial028:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2026-02-24T09:17:35.948 DEBUG:teuthology.orchestra.run.trial028:> 2026-02-24T09:17:35.948 DEBUG:teuthology.orchestra.run.trial028:> # Given a non-glob path, it better be there 2026-02-24T09:17:35.948 DEBUG:teuthology.orchestra.run.trial028:> if "*" not in asok_path: 2026-02-24T09:17:35.948 DEBUG:teuthology.orchestra.run.trial028:> assert(len(files) == 1) 2026-02-24T09:17:35.948 DEBUG:teuthology.orchestra.run.trial028:> return files[0] 2026-02-24T09:17:35.949 DEBUG:teuthology.orchestra.run.trial028:> 2026-02-24T09:17:35.949 DEBUG:teuthology.orchestra.run.trial028:> for f in files: 2026-02-24T09:17:35.949 DEBUG:teuthology.orchestra.run.trial028:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2026-02-24T09:17:35.949 DEBUG:teuthology.orchestra.run.trial028:> if os.path.exists("/proc/{0}".format(pid)): 2026-02-24T09:17:35.949 DEBUG:teuthology.orchestra.run.trial028:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2026-02-24T09:17:35.949 DEBUG:teuthology.orchestra.run.trial028:> contents = proc_f.read() 2026-02-24T09:17:35.949 DEBUG:teuthology.orchestra.run.trial028:> if mountpoint in contents: 2026-02-24T09:17:35.949 DEBUG:teuthology.orchestra.run.trial028:> return f 2026-02-24T09:17:35.949 DEBUG:teuthology.orchestra.run.trial028:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2026-02-24T09:17:35.949 DEBUG:teuthology.orchestra.run.trial028:> 2026-02-24T09:17:35.949 DEBUG:teuthology.orchestra.run.trial028:> print(_find_admin_socket("client.0")) 2026-02-24T09:17:35.949 DEBUG:teuthology.orchestra.run.trial028:> ' 2026-02-24T09:17:36.085 INFO:teuthology.orchestra.run.trial028.stdout:/var/run/ceph/ceph-client.0.118839.asok 2026-02-24T09:17:36.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-24T09:17:36.095 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.118839.asok 2026-02-24T09:17:36.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-24T09:17:36.095 DEBUG:teuthology.orchestra.run.trial028:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.118839.asok status 2026-02-24T09:17:36.242 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-24T09:17:36.242 INFO:teuthology.orchestra.run.trial028.stdout: "metadata": { 2026-02-24T09:17:36.242 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_sha1": "5bc9a1ffc19df681248ece8c3c8c7191a571745b", 2026-02-24T09:17:36.243 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version": "ceph version 20.3.0-5537-g5bc9a1ff (5bc9a1ffc19df681248ece8c3c8c7191a571745b) tentacle (dev - RelWithDebInfo)", 2026-02-24T09:17:36.243 INFO:teuthology.orchestra.run.trial028.stdout: "entity_id": "0", 2026-02-24T09:17:36.243 INFO:teuthology.orchestra.run.trial028.stdout: "hostname": "trial028", 2026-02-24T09:17:36.243 INFO:teuthology.orchestra.run.trial028.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2026-02-24T09:17:36.243 INFO:teuthology.orchestra.run.trial028.stdout: "pid": "118839", 2026-02-24T09:17:36.243 INFO:teuthology.orchestra.run.trial028.stdout: "root": "/volumes/qa/sv_0/df987db1-0b17-4685-b91f-d18b9920239e" 2026-02-24T09:17:36.244 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:17:36.244 INFO:teuthology.orchestra.run.trial028.stdout: "dentry_count": 0, 2026-02-24T09:17:36.244 INFO:teuthology.orchestra.run.trial028.stdout: "dentry_pinned_count": 0, 2026-02-24T09:17:36.244 INFO:teuthology.orchestra.run.trial028.stdout: "id": 15486, 2026-02-24T09:17:36.244 INFO:teuthology.orchestra.run.trial028.stdout: "inst": { 2026-02-24T09:17:36.244 INFO:teuthology.orchestra.run.trial028.stdout: "name": { 2026-02-24T09:17:36.245 INFO:teuthology.orchestra.run.trial028.stdout: "type": "client", 2026-02-24T09:17:36.245 INFO:teuthology.orchestra.run.trial028.stdout: "num": 15486 2026-02-24T09:17:36.245 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:17:36.245 INFO:teuthology.orchestra.run.trial028.stdout: "addr": { 2026-02-24T09:17:36.245 INFO:teuthology.orchestra.run.trial028.stdout: "type": "v1", 2026-02-24T09:17:36.245 INFO:teuthology.orchestra.run.trial028.stdout: "addr": "192.168.144.1:0", 2026-02-24T09:17:36.245 INFO:teuthology.orchestra.run.trial028.stdout: "nonce": 3073018192 2026-02-24T09:17:36.245 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:17:36.245 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:17:36.245 INFO:teuthology.orchestra.run.trial028.stdout: "addr": { 2026-02-24T09:17:36.245 INFO:teuthology.orchestra.run.trial028.stdout: "type": "v1", 2026-02-24T09:17:36.245 INFO:teuthology.orchestra.run.trial028.stdout: "addr": "192.168.144.1:0", 2026-02-24T09:17:36.246 INFO:teuthology.orchestra.run.trial028.stdout: "nonce": 3073018192 2026-02-24T09:17:36.246 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:17:36.246 INFO:teuthology.orchestra.run.trial028.stdout: "inst_str": "client.15486 192.168.144.1:0/3073018192", 2026-02-24T09:17:36.246 INFO:teuthology.orchestra.run.trial028.stdout: "addr_str": "192.168.144.1:0/3073018192", 2026-02-24T09:17:36.246 INFO:teuthology.orchestra.run.trial028.stdout: "inode_count": 5, 2026-02-24T09:17:36.246 INFO:teuthology.orchestra.run.trial028.stdout: "mds_epoch": 22, 2026-02-24T09:17:36.246 INFO:teuthology.orchestra.run.trial028.stdout: "osd_epoch": 92, 2026-02-24T09:17:36.246 INFO:teuthology.orchestra.run.trial028.stdout: "osd_epoch_barrier": 92, 2026-02-24T09:17:36.246 INFO:teuthology.orchestra.run.trial028.stdout: "blocklisted": false, 2026-02-24T09:17:36.246 INFO:teuthology.orchestra.run.trial028.stdout: "fs_name": "cephfs" 2026-02-24T09:17:36.246 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-24T09:17:36.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-24T09:17:36.250 DEBUG:teuthology.orchestra.run.trial028:> stat --file-system '--printf=%T 2026-02-24T09:17:36.250 DEBUG:teuthology.orchestra.run.trial028:> ' -- /home/ubuntu/cephtest/mnt.0 2026-02-24T09:17:36.290 INFO:teuthology.orchestra.run.trial028.stdout:fuseblk 2026-02-24T09:17:36.290 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2026-02-24T09:17:36.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-24T09:17:36.291 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2026-02-24T09:17:36.390 INFO:teuthology.run_tasks:Running task exec... 2026-02-24T09:17:36.407 INFO:teuthology.task.exec:Executing custom commands... 2026-02-24T09:17:36.407 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@trial028.front.sepia.ceph.com 2026-02-24T09:17:36.407 DEBUG:teuthology.orchestra.run.trial028:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2026-02-24T09:17:36.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.521+0000 7f839bfff640 1 -- 10.20.193.28:0/309890618 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f839c10dbc0 msgr2=0x7f839c112c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:36.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.521+0000 7f839bfff640 1 --2- 10.20.193.28:0/309890618 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f839c10dbc0 0x7f839c112c10 secure :-1 s=READY pgs=373 gs=1 cs=0 l=1 c_cookie=2141327512471515944 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8384009950 tx=0x7f838402f190 comp rx=0 tx=0).stop 2026-02-24T09:17:36.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.521+0000 7f839bfff640 1 -- 10.20.193.28:0/309890618 shutdown_connections 2026-02-24T09:17:36.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.521+0000 7f839bfff640 1 --2- 10.20.193.28:0/309890618 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f839c1133c0 0x7f839c173d90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:36.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.521+0000 7f839bfff640 1 --2- 10.20.193.28:0/309890618 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f839c10dbc0 0x7f839c112c10 unknown :-1 s=CLOSED pgs=373 gs=1 cs=0 l=1 c_cookie=2141327512471515944 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:36.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.521+0000 7f839bfff640 1 --2- 10.20.193.28:0/309890618 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f839c10d1d0 0x7f839c10d5a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:36.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.521+0000 7f839bfff640 1 -- 10.20.193.28:0/309890618 >> 10.20.193.28:0/309890618 conn(0x7f839c0eaa80 msgr2=0x7f839c10ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:36.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.521+0000 7f839bfff640 1 -- 10.20.193.28:0/309890618 shutdown_connections 2026-02-24T09:17:36.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.521+0000 7f839bfff640 1 -- 10.20.193.28:0/309890618 wait complete. 2026-02-24T09:17:36.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.522+0000 7f839bfff640 1 Processor -- start 2026-02-24T09:17:36.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.522+0000 7f839bfff640 1 -- start start 2026-02-24T09:17:36.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.522+0000 7f839bfff640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f839c10d1d0 0x7f839c0f5780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:36.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.522+0000 7f839bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f839c10dbc0 0x7f839c173c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:36.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.522+0000 7f839bfff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f839c1133c0 0x7f839c0f5e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:36.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.522+0000 7f839bfff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f839c0fb090 con 0x7f839c10dbc0 2026-02-24T09:17:36.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.522+0000 7f839bfff640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f839c0fb200 con 0x7f839c1133c0 2026-02-24T09:17:36.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.522+0000 7f839bfff640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f839c0fb370 con 0x7f839c10d1d0 2026-02-24T09:17:36.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.522+0000 7f839a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f839c10dbc0 0x7f839c173c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:36.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.522+0000 7f839a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f839c10dbc0 0x7f839c173c90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43688/0 (socket says 10.20.193.28:43688) 2026-02-24T09:17:36.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.522+0000 7f839a7fc640 1 -- 10.20.193.28:0/984964995 learned_addr learned my addr 10.20.193.28:0/984964995 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:36.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.523+0000 7f839a7fc640 1 -- 10.20.193.28:0/984964995 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f839c10d1d0 msgr2=0x7f839c0f5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:36.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.523+0000 7f839a7fc640 1 --2- 10.20.193.28:0/984964995 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f839c10d1d0 0x7f839c0f5780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:36.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.523+0000 7f839a7fc640 1 -- 10.20.193.28:0/984964995 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f839c1133c0 msgr2=0x7f839c0f5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:36.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.523+0000 7f839a7fc640 1 --2- 10.20.193.28:0/984964995 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f839c1133c0 0x7f839c0f5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:36.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.523+0000 7f839a7fc640 1 -- 10.20.193.28:0/984964995 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8384009570 con 0x7f839c10dbc0 2026-02-24T09:17:36.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.523+0000 7f839a7fc640 1 --2- 10.20.193.28:0/984964995 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f839c10dbc0 0x7f839c173c90 secure :-1 s=READY pgs=374 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f83840098a0 tx=0x7f83840028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:36.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.523+0000 7f837bfff640 1 -- 10.20.193.28:0/984964995 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f838403d070 con 0x7f839c10dbc0 2026-02-24T09:17:36.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.523+0000 7f837bfff640 1 -- 10.20.193.28:0/984964995 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f838402fe20 con 0x7f839c10dbc0 2026-02-24T09:17:36.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.523+0000 7f837bfff640 1 -- 10.20.193.28:0/984964995 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8384041890 con 0x7f839c10dbc0 2026-02-24T09:17:36.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.523+0000 7f839bfff640 1 -- 10.20.193.28:0/984964995 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f839c0fb5f0 con 0x7f839c10dbc0 2026-02-24T09:17:36.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.523+0000 7f839bfff640 1 -- 10.20.193.28:0/984964995 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f839c0fba10 con 0x7f839c10dbc0 2026-02-24T09:17:36.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.523+0000 7f839bfff640 1 -- 10.20.193.28:0/984964995 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f839c10e4b0 con 0x7f839c10dbc0 2026-02-24T09:17:36.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.526+0000 7f837bfff640 1 -- 10.20.193.28:0/984964995 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f8384041a20 con 0x7f839c10dbc0 2026-02-24T09:17:36.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.527+0000 7f837bfff640 1 --2- 10.20.193.28:0/984964995 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f83700b5840 0x7f83700d5cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:36.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.527+0000 7f837bfff640 1 -- 10.20.193.28:0/984964995 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f838410b860 con 0x7f839c10dbc0 2026-02-24T09:17:36.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.527+0000 7f839affd640 1 --2- 10.20.193.28:0/984964995 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f83700b5840 0x7f83700d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:36.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.527+0000 7f837bfff640 1 -- 10.20.193.28:0/984964995 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f8384144930 con 0x7f839c10dbc0 2026-02-24T09:17:36.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.528+0000 7f839affd640 1 --2- 10.20.193.28:0/984964995 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f83700b5840 0x7f83700d5cf0 secure :-1 s=READY pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8390005970 tx=0x7f8390005900 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:36.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:36 trial028 ceph-mon[40371]: pgmap v198: 97 pgs: 97 active+clean; 648 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2026-02-24T09:17:36.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:36 trial074 ceph-mon[44412]: pgmap v198: 97 pgs: 97 active+clean; 648 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2026-02-24T09:17:36.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:36.672+0000 7f839bfff640 1 -- 10.20.193.28:0/984964995 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f839c062910 con 0x7f839c10dbc0 2026-02-24T09:17:36.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:36 trial159 ceph-mon[44242]: pgmap v198: 97 pgs: 97 active+clean; 648 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2026-02-24T09:17:37.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.345+0000 7f837bfff640 1 -- 10.20.193.28:0/984964995 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v23) ==== 118+0+0 (secure 0 0 0) 0x7f83840ce240 con 0x7f839c10dbc0 2026-02-24T09:17:37.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.347+0000 7f839bfff640 1 -- 10.20.193.28:0/984964995 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f83700b5840 msgr2=0x7f83700d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:37.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.347+0000 7f839bfff640 1 --2- 10.20.193.28:0/984964995 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f83700b5840 0x7f83700d5cf0 secure :-1 s=READY pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8390005970 tx=0x7f8390005900 comp rx=0 tx=0).stop 2026-02-24T09:17:37.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.347+0000 7f839bfff640 1 -- 10.20.193.28:0/984964995 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f839c10dbc0 msgr2=0x7f839c173c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:37.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.347+0000 7f839bfff640 1 --2- 10.20.193.28:0/984964995 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f839c10dbc0 0x7f839c173c90 secure :-1 s=READY pgs=374 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f83840098a0 tx=0x7f83840028d0 comp rx=0 tx=0).stop 2026-02-24T09:17:37.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.347+0000 7f839bfff640 1 -- 10.20.193.28:0/984964995 shutdown_connections 2026-02-24T09:17:37.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.347+0000 7f839bfff640 1 --2- 10.20.193.28:0/984964995 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f83700b5840 0x7f83700d5cf0 unknown :-1 s=CLOSED pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:37.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.347+0000 7f839bfff640 1 --2- 10.20.193.28:0/984964995 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f839c1133c0 0x7f839c0f5e10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:37.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.347+0000 7f839bfff640 1 --2- 10.20.193.28:0/984964995 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f839c10dbc0 0x7f839c173c90 unknown :-1 s=CLOSED pgs=374 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:37.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.347+0000 7f839bfff640 1 --2- 10.20.193.28:0/984964995 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f839c10d1d0 0x7f839c0f5780 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:37.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.347+0000 7f839bfff640 1 -- 10.20.193.28:0/984964995 >> 10.20.193.28:0/984964995 conn(0x7f839c0eaa80 msgr2=0x7f839c10f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:37.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.347+0000 7f839bfff640 1 -- 10.20.193.28:0/984964995 shutdown_connections 2026-02-24T09:17:37.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.347+0000 7f839bfff640 1 -- 10.20.193.28:0/984964995 wait complete. 2026-02-24T09:17:37.362 DEBUG:teuthology.orchestra.run.trial028:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.20' 2026-02-24T09:17:37.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.476+0000 7f3c89bd2640 1 -- 10.20.193.28:0/938401654 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3c841155b0 msgr2=0x7f3c84175f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:37.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.476+0000 7f3c89bd2640 1 --2- 10.20.193.28:0/938401654 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3c841155b0 0x7f3c84175f80 secure :-1 s=READY pgs=375 gs=1 cs=0 l=1 c_cookie=8561769337038973822 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c8000aa30 tx=0x7f3c80030270 comp rx=0 tx=0).stop 2026-02-24T09:17:37.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.476+0000 7f3c89bd2640 1 -- 10.20.193.28:0/938401654 shutdown_connections 2026-02-24T09:17:37.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.476+0000 7f3c89bd2640 1 --2- 10.20.193.28:0/938401654 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3c841155b0 0x7f3c84175f80 unknown :-1 s=CLOSED pgs=375 gs=1 cs=0 l=1 c_cookie=8561769337038973822 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:37.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.476+0000 7f3c89bd2640 1 --2- 10.20.193.28:0/938401654 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3c8410fdb0 0x7f3c84114e00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:37.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.476+0000 7f3c89bd2640 1 --2- 10.20.193.28:0/938401654 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3c8410f3c0 0x7f3c8410f790 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:37.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.476+0000 7f3c89bd2640 1 -- 10.20.193.28:0/938401654 >> 10.20.193.28:0/938401654 conn(0x7f3c840ecc70 msgr2=0x7f3c8410d080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:37.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.476+0000 7f3c89bd2640 1 -- 10.20.193.28:0/938401654 shutdown_connections 2026-02-24T09:17:37.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.476+0000 7f3c89bd2640 1 -- 10.20.193.28:0/938401654 wait complete. 2026-02-24T09:17:37.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.477+0000 7f3c89bd2640 1 Processor -- start 2026-02-24T09:17:37.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.477+0000 7f3c89bd2640 1 -- start start 2026-02-24T09:17:37.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.477+0000 7f3c89bd2640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3c8410f3c0 0x7f3c840f4d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:37.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.477+0000 7f3c89bd2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3c8410fdb0 0x7f3c84175e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:37.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.477+0000 7f3c89bd2640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3c841155b0 0x7f3c840f5430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:37.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.477+0000 7f3c89bd2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3c840fa640 con 0x7f3c8410fdb0 2026-02-24T09:17:37.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.477+0000 7f3c89bd2640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f3c840fa7b0 con 0x7f3c8410f3c0 2026-02-24T09:17:37.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.477+0000 7f3c89bd2640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3c840fa970 con 0x7f3c841155b0 2026-02-24T09:17:37.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.477+0000 7f3c7bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3c8410fdb0 0x7f3c84175e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:37.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.477+0000 7f3c7bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3c8410fdb0 0x7f3c84175e80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45914/0 (socket says 10.20.193.28:45914) 2026-02-24T09:17:37.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.477+0000 7f3c7bfff640 1 -- 10.20.193.28:0/2783467169 learned_addr learned my addr 10.20.193.28:0/2783467169 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:37.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.477+0000 7f3c88bd0640 1 --2- 10.20.193.28:0/2783467169 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3c8410f3c0 0x7f3c840f4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:37.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.477+0000 7f3c893d1640 1 --2- 10.20.193.28:0/2783467169 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3c841155b0 0x7f3c840f5430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:37.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.477+0000 7f3c7bfff640 1 -- 10.20.193.28:0/2783467169 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3c841155b0 msgr2=0x7f3c840f5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:37.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.477+0000 7f3c7bfff640 1 --2- 10.20.193.28:0/2783467169 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3c841155b0 0x7f3c840f5430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:37.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.477+0000 7f3c7bfff640 1 -- 10.20.193.28:0/2783467169 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3c8410f3c0 msgr2=0x7f3c840f4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:37.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.477+0000 7f3c7bfff640 1 --2- 10.20.193.28:0/2783467169 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3c8410f3c0 0x7f3c840f4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:37.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.477+0000 7f3c7bfff640 1 -- 10.20.193.28:0/2783467169 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c8000a650 con 0x7f3c8410fdb0 2026-02-24T09:17:37.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.478+0000 7f3c7bfff640 1 --2- 10.20.193.28:0/2783467169 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3c8410fdb0 0x7f3c84175e80 secure :-1 s=READY pgs=376 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c6c005db0 tx=0x7f3c6c00ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:37.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.478+0000 7f3c79ffb640 1 -- 10.20.193.28:0/2783467169 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3c6c004500 con 0x7f3c8410fdb0 2026-02-24T09:17:37.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.478+0000 7f3c79ffb640 1 -- 10.20.193.28:0/2783467169 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3c6c004d10 con 0x7f3c8410fdb0 2026-02-24T09:17:37.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.478+0000 7f3c79ffb640 1 -- 10.20.193.28:0/2783467169 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3c6c005280 con 0x7f3c8410fdb0 2026-02-24T09:17:37.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.478+0000 7f3c89bd2640 1 -- 10.20.193.28:0/2783467169 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c840fac50 con 0x7f3c8410fdb0 2026-02-24T09:17:37.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.478+0000 7f3c89bd2640 1 -- 10.20.193.28:0/2783467169 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c840fb0d0 con 0x7f3c8410fdb0 2026-02-24T09:17:37.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.478+0000 7f3c89bd2640 1 -- 10.20.193.28:0/2783467169 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c841106a0 con 0x7f3c8410fdb0 2026-02-24T09:17:37.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.481+0000 7f3c79ffb640 1 -- 10.20.193.28:0/2783467169 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f3c6c005410 con 0x7f3c8410fdb0 2026-02-24T09:17:37.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.482+0000 7f3c79ffb640 1 --2- 10.20.193.28:0/2783467169 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3c600b5830 0x7f3c600d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:37.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.483+0000 7f3c79ffb640 1 -- 10.20.193.28:0/2783467169 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f3c6c0e7140 con 0x7f3c8410fdb0 2026-02-24T09:17:37.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.483+0000 7f3c79ffb640 1 -- 10.20.193.28:0/2783467169 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f3c6c0e75c0 con 0x7f3c8410fdb0 2026-02-24T09:17:37.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.483+0000 7f3c88bd0640 1 --2- 10.20.193.28:0/2783467169 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3c600b5830 0x7f3c600d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:37.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.483+0000 7f3c88bd0640 1 --2- 10.20.193.28:0/2783467169 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3c600b5830 0x7f3c600d5ce0 secure :-1 s=READY pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c74004740 tx=0x7f3c7400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:37.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:37 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/984964995' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2026-02-24T09:17:37.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.617+0000 7f3c89bd2640 1 -- 10.20.193.28:0/2783467169 --> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.20", "target": ["mon-mgr", ""]}) -- 0x7f3c840f5e90 con 0x7f3c600b5830 2026-02-24T09:17:37.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.620+0000 7f3c79ffb640 1 -- 10.20.193.28:0/2783467169 <== mgr.14223 v2:10.20.193.28:6800/906910473 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f3c840f5e90 con 0x7f3c600b5830 2026-02-24T09:17:37.622 INFO:teuthology.orchestra.run.trial028.stdout:{} 2026-02-24T09:17:37.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.621+0000 7f3c89bd2640 1 -- 10.20.193.28:0/2783467169 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3c600b5830 msgr2=0x7f3c600d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:37.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.621+0000 7f3c89bd2640 1 --2- 10.20.193.28:0/2783467169 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3c600b5830 0x7f3c600d5ce0 secure :-1 s=READY pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c74004740 tx=0x7f3c7400b410 comp rx=0 tx=0).stop 2026-02-24T09:17:37.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.621+0000 7f3c89bd2640 1 -- 10.20.193.28:0/2783467169 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3c8410fdb0 msgr2=0x7f3c84175e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:37.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.621+0000 7f3c89bd2640 1 --2- 10.20.193.28:0/2783467169 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3c8410fdb0 0x7f3c84175e80 secure :-1 s=READY pgs=376 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c6c005db0 tx=0x7f3c6c00ddf0 comp rx=0 tx=0).stop 2026-02-24T09:17:37.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.621+0000 7f3c89bd2640 1 -- 10.20.193.28:0/2783467169 shutdown_connections 2026-02-24T09:17:37.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.621+0000 7f3c89bd2640 1 --2- 10.20.193.28:0/2783467169 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3c600b5830 0x7f3c600d5ce0 unknown :-1 s=CLOSED pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:37.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.621+0000 7f3c89bd2640 1 --2- 10.20.193.28:0/2783467169 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3c841155b0 0x7f3c840f5430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:37.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.621+0000 7f3c89bd2640 1 --2- 10.20.193.28:0/2783467169 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3c8410fdb0 0x7f3c84175e80 unknown :-1 s=CLOSED pgs=376 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:37.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.621+0000 7f3c89bd2640 1 --2- 10.20.193.28:0/2783467169 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3c8410f3c0 0x7f3c840f4d30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:37.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.621+0000 7f3c89bd2640 1 -- 10.20.193.28:0/2783467169 >> 10.20.193.28:0/2783467169 conn(0x7f3c840ecc70 msgr2=0x7f3c8410da10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:37.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.621+0000 7f3c89bd2640 1 -- 10.20.193.28:0/2783467169 shutdown_connections 2026-02-24T09:17:37.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.621+0000 7f3c89bd2640 1 -- 10.20.193.28:0/2783467169 wait complete. 2026-02-24T09:17:37.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:37 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/984964995' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2026-02-24T09:17:37.634 INFO:teuthology.run_tasks:Running task check-counter... 2026-02-24T09:17:37.654 INFO:teuthology.run_tasks:Running task exec... 2026-02-24T09:17:37.675 INFO:teuthology.task.exec:Executing custom commands... 2026-02-24T09:17:37.675 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@trial028.front.sepia.ceph.com 2026-02-24T09:17:37.676 DEBUG:teuthology.orchestra.run.trial028:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2026-02-24T09:17:37.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:37 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/984964995' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2026-02-24T09:17:37.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.789+0000 7f90e5283640 1 -- 10.20.193.28:0/2668883947 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90e0114340 msgr2=0x7f90e0119390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:37.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.789+0000 7f90e5283640 1 --2- 10.20.193.28:0/2668883947 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90e0114340 0x7f90e0119390 secure :-1 s=READY pgs=377 gs=2 cs=0 l=1 c_cookie=6457123198202385669 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90d0009950 tx=0x7f90d002f190 comp rx=0 tx=0).stop 2026-02-24T09:17:37.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.789+0000 7f90e5283640 1 -- 10.20.193.28:0/2668883947 shutdown_connections 2026-02-24T09:17:37.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.789+0000 7f90e5283640 1 --2- 10.20.193.28:0/2668883947 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f90e0119b40 0x7f90e017a510 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:37.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.789+0000 7f90e5283640 1 --2- 10.20.193.28:0/2668883947 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90e0114340 0x7f90e0119390 unknown :-1 s=CLOSED pgs=377 gs=2 cs=0 l=1 c_cookie=6457123198202385669 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:37.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.789+0000 7f90e5283640 1 --2- 10.20.193.28:0/2668883947 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f90e0113950 0x7f90e0113d20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:37.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.789+0000 7f90e5283640 1 -- 10.20.193.28:0/2668883947 >> 10.20.193.28:0/2668883947 conn(0x7f90e00619a0 msgr2=0x7f90e0061da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:37.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.789+0000 7f90e5283640 1 -- 10.20.193.28:0/2668883947 shutdown_connections 2026-02-24T09:17:37.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.789+0000 7f90e5283640 1 -- 10.20.193.28:0/2668883947 wait complete. 2026-02-24T09:17:37.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.790+0000 7f90e5283640 1 Processor -- start 2026-02-24T09:17:37.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.790+0000 7f90e5283640 1 -- start start 2026-02-24T09:17:37.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.790+0000 7f90e5283640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f90e0113950 0x7f90e00fb5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:37.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.790+0000 7f90e5283640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f90e0114340 0x7f90e017a410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:37.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.790+0000 7f90e5283640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90e0119b40 0x7f90e00fbce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:37.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.790+0000 7f90e5283640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f90e0100ef0 con 0x7f90e0119b40 2026-02-24T09:17:37.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.790+0000 7f90e5283640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f90e0101060 con 0x7f90e0114340 2026-02-24T09:17:37.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.790+0000 7f90e5283640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f90e0101220 con 0x7f90e0113950 2026-02-24T09:17:37.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.790+0000 7f90e4a82640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90e0119b40 0x7f90e00fbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:37.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.790+0000 7f90dffff640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f90e0113950 0x7f90e00fb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:37.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.790+0000 7f90dffff640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f90e0113950 0x7f90e00fb5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:60340/0 (socket says 10.20.193.28:60340) 2026-02-24T09:17:37.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.790+0000 7f90dffff640 1 -- 10.20.193.28:0/874607859 learned_addr learned my addr 10.20.193.28:0/874607859 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:37.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.790+0000 7f90e4a82640 1 --2- 10.20.193.28:0/874607859 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90e0119b40 0x7f90e00fbce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45924/0 (socket says 10.20.193.28:45924) 2026-02-24T09:17:37.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.790+0000 7f90df7fe640 1 --2- 10.20.193.28:0/874607859 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f90e0114340 0x7f90e017a410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:37.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.791+0000 7f90e4a82640 1 -- 10.20.193.28:0/874607859 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f90e0113950 msgr2=0x7f90e00fb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:37.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.791+0000 7f90e4a82640 1 --2- 10.20.193.28:0/874607859 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f90e0113950 0x7f90e00fb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:37.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.791+0000 7f90e4a82640 1 -- 10.20.193.28:0/874607859 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f90e0114340 msgr2=0x7f90e017a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:37.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.791+0000 7f90e4a82640 1 --2- 10.20.193.28:0/874607859 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f90e0114340 0x7f90e017a410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:37.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.791+0000 7f90e4a82640 1 -- 10.20.193.28:0/874607859 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90d0009570 con 0x7f90e0119b40 2026-02-24T09:17:37.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.791+0000 7f90e4a82640 1 --2- 10.20.193.28:0/874607859 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90e0119b40 0x7f90e00fbce0 secure :-1 s=READY pgs=378 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90d400f940 tx=0x7f90d400fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:37.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.791+0000 7f90dd7fa640 1 -- 10.20.193.28:0/874607859 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f90d400dce0 con 0x7f90e0119b40 2026-02-24T09:17:37.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.791+0000 7f90dd7fa640 1 -- 10.20.193.28:0/874607859 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f90d400de40 con 0x7f90e0119b40 2026-02-24T09:17:37.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.791+0000 7f90e5283640 1 -- 10.20.193.28:0/874607859 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90e0101500 con 0x7f90e0119b40 2026-02-24T09:17:37.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.791+0000 7f90dd7fa640 1 -- 10.20.193.28:0/874607859 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f90d40116b0 con 0x7f90e0119b40 2026-02-24T09:17:37.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.791+0000 7f90e5283640 1 -- 10.20.193.28:0/874607859 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90e01019d0 con 0x7f90e0119b40 2026-02-24T09:17:37.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.792+0000 7f90e5283640 1 -- 10.20.193.28:0/874607859 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90e0064e20 con 0x7f90e0119b40 2026-02-24T09:17:37.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.794+0000 7f90dd7fa640 1 -- 10.20.193.28:0/874607859 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f90d4020060 con 0x7f90e0119b40 2026-02-24T09:17:37.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.795+0000 7f90dd7fa640 1 --2- 10.20.193.28:0/874607859 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f90b40b57b0 0x7f90b40d5c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:37.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.795+0000 7f90dd7fa640 1 -- 10.20.193.28:0/874607859 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f90d4015070 con 0x7f90e0119b40 2026-02-24T09:17:37.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.795+0000 7f90dd7fa640 1 -- 10.20.193.28:0/874607859 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f90d40e81b0 con 0x7f90e0119b40 2026-02-24T09:17:37.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.795+0000 7f90dffff640 1 --2- 10.20.193.28:0/874607859 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f90b40b57b0 0x7f90b40d5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:37.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.796+0000 7f90dffff640 1 --2- 10.20.193.28:0/874607859 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f90b40b57b0 0x7f90b40d5c60 secure :-1 s=READY pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90cc0095b0 tx=0x7f90cc005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:37.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:37.930+0000 7f90e5283640 1 -- 10.20.193.28:0/874607859 --> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f90e0113dc0 con 0x7f90b40b57b0 2026-02-24T09:17:38.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.016+0000 7f90dd7fa640 1 -- 10.20.193.28:0/874607859 <== mgr.14223 v2:10.20.193.28:6800/906910473 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f90e0113dc0 con 0x7f90b40b57b0 2026-02-24T09:17:38.019 INFO:teuthology.orchestra.run.trial028.stdout:Schedule set for path / 2026-02-24T09:17:38.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.019+0000 7f90e5283640 1 -- 10.20.193.28:0/874607859 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f90b40b57b0 msgr2=0x7f90b40d5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:38.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.019+0000 7f90e5283640 1 --2- 10.20.193.28:0/874607859 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f90b40b57b0 0x7f90b40d5c60 secure :-1 s=READY pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90cc0095b0 tx=0x7f90cc005f90 comp rx=0 tx=0).stop 2026-02-24T09:17:38.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.019+0000 7f90e5283640 1 -- 10.20.193.28:0/874607859 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90e0119b40 msgr2=0x7f90e00fbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:38.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.019+0000 7f90e5283640 1 --2- 10.20.193.28:0/874607859 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90e0119b40 0x7f90e00fbce0 secure :-1 s=READY pgs=378 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90d400f940 tx=0x7f90d400fe10 comp rx=0 tx=0).stop 2026-02-24T09:17:38.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.019+0000 7f90e5283640 1 -- 10.20.193.28:0/874607859 shutdown_connections 2026-02-24T09:17:38.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.019+0000 7f90e5283640 1 --2- 10.20.193.28:0/874607859 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f90b40b57b0 0x7f90b40d5c60 unknown :-1 s=CLOSED pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:38.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.019+0000 7f90e5283640 1 --2- 10.20.193.28:0/874607859 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90e0119b40 0x7f90e00fbce0 unknown :-1 s=CLOSED pgs=378 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:38.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.019+0000 7f90e5283640 1 --2- 10.20.193.28:0/874607859 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f90e0114340 0x7f90e017a410 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:38.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.019+0000 7f90e5283640 1 --2- 10.20.193.28:0/874607859 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f90e0113950 0x7f90e00fb5e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:38.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.019+0000 7f90e5283640 1 -- 10.20.193.28:0/874607859 >> 10.20.193.28:0/874607859 conn(0x7f90e00619a0 msgr2=0x7f90e0118770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:38.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.019+0000 7f90e5283640 1 -- 10.20.193.28:0/874607859 shutdown_connections 2026-02-24T09:17:38.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.019+0000 7f90e5283640 1 -- 10.20.193.28:0/874607859 wait complete. 2026-02-24T09:17:38.034 DEBUG:teuthology.orchestra.run.trial028:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2026-02-24T09:17:38.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.146+0000 7fc598e83640 1 -- 10.20.193.28:0/2127896543 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc594114340 msgr2=0x7fc594119390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:38.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.146+0000 7fc598e83640 1 --2- 10.20.193.28:0/2127896543 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc594114340 0x7fc594119390 secure :-1 s=READY pgs=381 gs=1 cs=0 l=1 c_cookie=18199935108684593219 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc584009950 tx=0x7fc58402f190 comp rx=0 tx=0).stop 2026-02-24T09:17:38.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.146+0000 7fc598e83640 1 -- 10.20.193.28:0/2127896543 shutdown_connections 2026-02-24T09:17:38.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.146+0000 7fc598e83640 1 --2- 10.20.193.28:0/2127896543 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc594119b40 0x7fc59417a510 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:38.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.146+0000 7fc598e83640 1 --2- 10.20.193.28:0/2127896543 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc594114340 0x7fc594119390 unknown :-1 s=CLOSED pgs=381 gs=1 cs=0 l=1 c_cookie=18199935108684593219 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:38.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.146+0000 7fc598e83640 1 --2- 10.20.193.28:0/2127896543 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc594113950 0x7fc594113d20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:38.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.146+0000 7fc598e83640 1 -- 10.20.193.28:0/2127896543 >> 10.20.193.28:0/2127896543 conn(0x7fc5940619a0 msgr2=0x7fc594061da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:38.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.146+0000 7fc598e83640 1 -- 10.20.193.28:0/2127896543 shutdown_connections 2026-02-24T09:17:38.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.146+0000 7fc598e83640 1 -- 10.20.193.28:0/2127896543 wait complete. 2026-02-24T09:17:38.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.147+0000 7fc598e83640 1 Processor -- start 2026-02-24T09:17:38.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.147+0000 7fc598e83640 1 -- start start 2026-02-24T09:17:38.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.147+0000 7fc598e83640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc594113950 0x7fc5940fb530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:38.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.147+0000 7fc598e83640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc594114340 0x7fc59417a410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:38.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.147+0000 7fc598e83640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc594119b40 0x7fc5940fbc30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:38.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.147+0000 7fc598e83640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc594100e40 con 0x7fc594113950 2026-02-24T09:17:38.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.147+0000 7fc598e83640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fc594100fb0 con 0x7fc594114340 2026-02-24T09:17:38.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.147+0000 7fc598e83640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc594101170 con 0x7fc594119b40 2026-02-24T09:17:38.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.148+0000 7fc5937fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc594113950 0x7fc5940fb530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:38.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.148+0000 7fc5937fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc594113950 0x7fc5940fb530 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45964/0 (socket says 10.20.193.28:45964) 2026-02-24T09:17:38.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.148+0000 7fc5937fe640 1 -- 10.20.193.28:0/3039031152 learned_addr learned my addr 10.20.193.28:0/3039031152 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:38.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.148+0000 7fc592ffd640 1 --2- 10.20.193.28:0/3039031152 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc594114340 0x7fc59417a410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:38.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.148+0000 7fc593fff640 1 --2- 10.20.193.28:0/3039031152 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc594119b40 0x7fc5940fbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:38.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.148+0000 7fc5937fe640 1 -- 10.20.193.28:0/3039031152 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc594119b40 msgr2=0x7fc5940fbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:38.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.148+0000 7fc5937fe640 1 --2- 10.20.193.28:0/3039031152 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc594119b40 0x7fc5940fbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:38.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.148+0000 7fc5937fe640 1 -- 10.20.193.28:0/3039031152 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc594114340 msgr2=0x7fc59417a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:38.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.148+0000 7fc5937fe640 1 --2- 10.20.193.28:0/3039031152 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc594114340 0x7fc59417a410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:38.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.148+0000 7fc5937fe640 1 -- 10.20.193.28:0/3039031152 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc584009570 con 0x7fc594113950 2026-02-24T09:17:38.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.148+0000 7fc592ffd640 1 --2- 10.20.193.28:0/3039031152 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc594114340 0x7fc59417a410 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:17:38.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.148+0000 7fc5937fe640 1 --2- 10.20.193.28:0/3039031152 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc594113950 0x7fc5940fb530 secure :-1 s=READY pgs=382 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc580009480 tx=0x7fc58000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:38.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.148+0000 7fc590ff9640 1 -- 10.20.193.28:0/3039031152 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc58000cd40 con 0x7fc594113950 2026-02-24T09:17:38.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.148+0000 7fc590ff9640 1 -- 10.20.193.28:0/3039031152 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc580004d10 con 0x7fc594113950 2026-02-24T09:17:38.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.148+0000 7fc590ff9640 1 -- 10.20.193.28:0/3039031152 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc5800106b0 con 0x7fc594113950 2026-02-24T09:17:38.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.148+0000 7fc598e83640 1 -- 10.20.193.28:0/3039031152 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc594101450 con 0x7fc594113950 2026-02-24T09:17:38.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.148+0000 7fc598e83640 1 -- 10.20.193.28:0/3039031152 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5941018d0 con 0x7fc594113950 2026-02-24T09:17:38.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.149+0000 7fc598e83640 1 -- 10.20.193.28:0/3039031152 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc558005300 con 0x7fc594113950 2026-02-24T09:17:38.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.151+0000 7fc590ff9640 1 -- 10.20.193.28:0/3039031152 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7fc58001f060 con 0x7fc594113950 2026-02-24T09:17:38.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.153+0000 7fc590ff9640 1 --2- 10.20.193.28:0/3039031152 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc5680b5830 0x7fc5680d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:38.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.153+0000 7fc590ff9640 1 -- 10.20.193.28:0/3039031152 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7fc580014070 con 0x7fc594113950 2026-02-24T09:17:38.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.153+0000 7fc592ffd640 1 --2- 10.20.193.28:0/3039031152 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc5680b5830 0x7fc5680d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:38.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.153+0000 7fc590ff9640 1 -- 10.20.193.28:0/3039031152 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fc5800e7350 con 0x7fc594113950 2026-02-24T09:17:38.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.154+0000 7fc592ffd640 1 --2- 10.20.193.28:0/3039031152 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc5680b5830 0x7fc5680d5ce0 secure :-1 s=READY pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc5840023d0 tx=0x7fc584031040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:38.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.287+0000 7fc598e83640 1 -- 10.20.193.28:0/3039031152 --> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7fc558002bb0 con 0x7fc5680b5830 2026-02-24T09:17:38.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.320+0000 7fc590ff9640 1 -- 10.20.193.28:0/3039031152 <== mgr.14223 v2:10.20.193.28:6800/906910473 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7fc558002bb0 con 0x7fc5680b5830 2026-02-24T09:17:38.322 INFO:teuthology.orchestra.run.trial028.stdout:Retention added to path / 2026-02-24T09:17:38.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.322+0000 7fc598e83640 1 -- 10.20.193.28:0/3039031152 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc5680b5830 msgr2=0x7fc5680d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:38.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.322+0000 7fc598e83640 1 --2- 10.20.193.28:0/3039031152 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc5680b5830 0x7fc5680d5ce0 secure :-1 s=READY pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc5840023d0 tx=0x7fc584031040 comp rx=0 tx=0).stop 2026-02-24T09:17:38.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.322+0000 7fc598e83640 1 -- 10.20.193.28:0/3039031152 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc594113950 msgr2=0x7fc5940fb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:38.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.322+0000 7fc598e83640 1 --2- 10.20.193.28:0/3039031152 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc594113950 0x7fc5940fb530 secure :-1 s=READY pgs=382 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc580009480 tx=0x7fc58000ee60 comp rx=0 tx=0).stop 2026-02-24T09:17:38.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.322+0000 7fc598e83640 1 -- 10.20.193.28:0/3039031152 shutdown_connections 2026-02-24T09:17:38.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.322+0000 7fc598e83640 1 --2- 10.20.193.28:0/3039031152 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc5680b5830 0x7fc5680d5ce0 unknown :-1 s=CLOSED pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:38.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.322+0000 7fc598e83640 1 --2- 10.20.193.28:0/3039031152 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc594119b40 0x7fc5940fbc30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:38.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.322+0000 7fc598e83640 1 --2- 10.20.193.28:0/3039031152 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc594114340 0x7fc59417a410 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:38.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.322+0000 7fc598e83640 1 --2- 10.20.193.28:0/3039031152 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc594113950 0x7fc5940fb530 unknown :-1 s=CLOSED pgs=382 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:38.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.322+0000 7fc598e83640 1 -- 10.20.193.28:0/3039031152 >> 10.20.193.28:0/3039031152 conn(0x7fc5940619a0 msgr2=0x7fc5941185d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:38.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.322+0000 7fc598e83640 1 -- 10.20.193.28:0/3039031152 shutdown_connections 2026-02-24T09:17:38.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.323+0000 7fc598e83640 1 -- 10.20.193.28:0/3039031152 wait complete. 2026-02-24T09:17:38.336 DEBUG:teuthology.orchestra.run.trial028:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2026-02-24T09:17:38.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.449+0000 7fee73483640 1 -- 10.20.193.28:0/517699576 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee6c10fdb0 msgr2=0x7fee6c114e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:38.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.449+0000 7fee73483640 1 --2- 10.20.193.28:0/517699576 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee6c10fdb0 0x7fee6c114e00 secure :-1 s=READY pgs=383 gs=3 cs=0 l=1 c_cookie=4757438959404445784 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee60009950 tx=0x7fee6002f190 comp rx=0 tx=0).stop 2026-02-24T09:17:38.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.449+0000 7fee73483640 1 -- 10.20.193.28:0/517699576 shutdown_connections 2026-02-24T09:17:38.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.449+0000 7fee73483640 1 --2- 10.20.193.28:0/517699576 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fee6c1155b0 0x7fee6c175f80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:38.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.449+0000 7fee73483640 1 --2- 10.20.193.28:0/517699576 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee6c10fdb0 0x7fee6c114e00 unknown :-1 s=CLOSED pgs=383 gs=3 cs=0 l=1 c_cookie=4757438959404445784 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:38.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.449+0000 7fee73483640 1 --2- 10.20.193.28:0/517699576 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fee6c10f3c0 0x7fee6c10f790 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:38.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.449+0000 7fee73483640 1 -- 10.20.193.28:0/517699576 >> 10.20.193.28:0/517699576 conn(0x7fee6c0ecc70 msgr2=0x7fee6c10d080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:38.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.449+0000 7fee73483640 1 -- 10.20.193.28:0/517699576 shutdown_connections 2026-02-24T09:17:38.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.449+0000 7fee73483640 1 -- 10.20.193.28:0/517699576 wait complete. 2026-02-24T09:17:38.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.450+0000 7fee73483640 1 Processor -- start 2026-02-24T09:17:38.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.450+0000 7fee73483640 1 -- start start 2026-02-24T09:17:38.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.450+0000 7fee73483640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fee6c10f3c0 0x7fee6c0f4d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:38.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.450+0000 7fee73483640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fee6c10fdb0 0x7fee6c175e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:38.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.450+0000 7fee73483640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee6c1155b0 0x7fee6c0f5490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:38.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.450+0000 7fee73483640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fee6c0fa6a0 con 0x7fee6c1155b0 2026-02-24T09:17:38.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.450+0000 7fee73483640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fee6c0fa810 con 0x7fee6c10f3c0 2026-02-24T09:17:38.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.450+0000 7fee73483640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fee6c0fa9d0 con 0x7fee6c10fdb0 2026-02-24T09:17:38.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.450+0000 7fee72c82640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee6c1155b0 0x7fee6c0f5490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:38.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.450+0000 7fee72c82640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee6c1155b0 0x7fee6c0f5490 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45986/0 (socket says 10.20.193.28:45986) 2026-02-24T09:17:38.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.450+0000 7fee72c82640 1 -- 10.20.193.28:0/2888875708 learned_addr learned my addr 10.20.193.28:0/2888875708 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:38.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.450+0000 7fee72481640 1 --2- 10.20.193.28:0/2888875708 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fee6c10f3c0 0x7fee6c0f4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:38.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.450+0000 7fee71c80640 1 --2- 10.20.193.28:0/2888875708 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fee6c10fdb0 0x7fee6c175e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:38.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.451+0000 7fee72c82640 1 -- 10.20.193.28:0/2888875708 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fee6c10fdb0 msgr2=0x7fee6c175e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:38.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.451+0000 7fee72c82640 1 --2- 10.20.193.28:0/2888875708 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fee6c10fdb0 0x7fee6c175e80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:38.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.451+0000 7fee72c82640 1 -- 10.20.193.28:0/2888875708 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fee6c10f3c0 msgr2=0x7fee6c0f4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:38.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.451+0000 7fee72c82640 1 --2- 10.20.193.28:0/2888875708 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fee6c10f3c0 0x7fee6c0f4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:38.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.451+0000 7fee72c82640 1 -- 10.20.193.28:0/2888875708 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee60009570 con 0x7fee6c1155b0 2026-02-24T09:17:38.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.451+0000 7fee72c82640 1 --2- 10.20.193.28:0/2888875708 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee6c1155b0 0x7fee6c0f5490 secure :-1 s=READY pgs=384 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee6800f8d0 tx=0x7fee6800fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:38.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.451+0000 7fee537fe640 1 -- 10.20.193.28:0/2888875708 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee6800dce0 con 0x7fee6c1155b0 2026-02-24T09:17:38.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.451+0000 7fee537fe640 1 -- 10.20.193.28:0/2888875708 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fee6800de40 con 0x7fee6c1155b0 2026-02-24T09:17:38.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.451+0000 7fee537fe640 1 -- 10.20.193.28:0/2888875708 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee680116b0 con 0x7fee6c1155b0 2026-02-24T09:17:38.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.451+0000 7fee73483640 1 -- 10.20.193.28:0/2888875708 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee6c0facb0 con 0x7fee6c1155b0 2026-02-24T09:17:38.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.451+0000 7fee73483640 1 -- 10.20.193.28:0/2888875708 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee6c0fb130 con 0x7fee6c1155b0 2026-02-24T09:17:38.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.452+0000 7fee73483640 1 -- 10.20.193.28:0/2888875708 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee6c1106a0 con 0x7fee6c1155b0 2026-02-24T09:17:38.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.454+0000 7fee537fe640 1 -- 10.20.193.28:0/2888875708 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7fee68020060 con 0x7fee6c1155b0 2026-02-24T09:17:38.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.455+0000 7fee537fe640 1 --2- 10.20.193.28:0/2888875708 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fee480b5830 0x7fee480d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:38.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.455+0000 7fee537fe640 1 -- 10.20.193.28:0/2888875708 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7fee68015070 con 0x7fee6c1155b0 2026-02-24T09:17:38.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.456+0000 7fee72481640 1 --2- 10.20.193.28:0/2888875708 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fee480b5830 0x7fee480d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:38.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.456+0000 7fee537fe640 1 -- 10.20.193.28:0/2888875708 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fee680e81a0 con 0x7fee6c1155b0 2026-02-24T09:17:38.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.456+0000 7fee72481640 1 --2- 10.20.193.28:0/2888875708 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fee480b5830 0x7fee480d5ce0 secure :-1 s=READY pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee5c004740 tx=0x7fee5c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:38.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.589+0000 7fee73483640 1 -- 10.20.193.28:0/2888875708 --> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fee6c0f5f80 con 0x7fee480b5830 2026-02-24T09:17:38.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.593+0000 7fee537fe640 1 -- 10.20.193.28:0/2888875708 <== mgr.14223 v2:10.20.193.28:6800/906910473 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7fee5c009900 con 0x7fee480b5830 2026-02-24T09:17:38.596 INFO:teuthology.orchestra.run.trial028.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2026-02-24T00:00:00", "created": "2026-02-24T09:17:37", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2026-02-24T09:17:38.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.595+0000 7fee73483640 1 -- 10.20.193.28:0/2888875708 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fee480b5830 msgr2=0x7fee480d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:38.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.595+0000 7fee73483640 1 --2- 10.20.193.28:0/2888875708 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fee480b5830 0x7fee480d5ce0 secure :-1 s=READY pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee5c004740 tx=0x7fee5c005f90 comp rx=0 tx=0).stop 2026-02-24T09:17:38.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.595+0000 7fee73483640 1 -- 10.20.193.28:0/2888875708 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee6c1155b0 msgr2=0x7fee6c0f5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:38.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.595+0000 7fee73483640 1 --2- 10.20.193.28:0/2888875708 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee6c1155b0 0x7fee6c0f5490 secure :-1 s=READY pgs=384 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee6800f8d0 tx=0x7fee6800fda0 comp rx=0 tx=0).stop 2026-02-24T09:17:38.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.595+0000 7fee73483640 1 -- 10.20.193.28:0/2888875708 shutdown_connections 2026-02-24T09:17:38.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.595+0000 7fee73483640 1 --2- 10.20.193.28:0/2888875708 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fee480b5830 0x7fee480d5ce0 unknown :-1 s=CLOSED pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:38.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.595+0000 7fee73483640 1 --2- 10.20.193.28:0/2888875708 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee6c1155b0 0x7fee6c0f5490 unknown :-1 s=CLOSED pgs=384 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:38.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.595+0000 7fee73483640 1 --2- 10.20.193.28:0/2888875708 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fee6c10fdb0 0x7fee6c175e80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:38.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.595+0000 7fee73483640 1 --2- 10.20.193.28:0/2888875708 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fee6c10f3c0 0x7fee6c0f4d90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:38.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.595+0000 7fee73483640 1 -- 10.20.193.28:0/2888875708 >> 10.20.193.28:0/2888875708 conn(0x7fee6c0ecc70 msgr2=0x7fee6c113e60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:38.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.595+0000 7fee73483640 1 -- 10.20.193.28:0/2888875708 shutdown_connections 2026-02-24T09:17:38.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.595+0000 7fee73483640 1 -- 10.20.193.28:0/2888875708 wait complete. 2026-02-24T09:17:38.607 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:38 trial028 ceph-mon[40371]: pgmap v199: 97 pgs: 97 active+clean; 650 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 852 B/s wr, 7 op/s 2026-02-24T09:17:38.607 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:38 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/984964995' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2026-02-24T09:17:38.607 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:38 trial028 ceph-mon[40371]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=a=up:active} 3 up:standby-replay 6 up:standby 2026-02-24T09:17:38.609 DEBUG:teuthology.orchestra.run.trial028:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2026-02-24T09:17:38.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:38 trial074 ceph-mon[44412]: pgmap v199: 97 pgs: 97 active+clean; 650 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 852 B/s wr, 7 op/s 2026-02-24T09:17:38.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:38 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/984964995' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2026-02-24T09:17:38.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:38 trial074 ceph-mon[44412]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=a=up:active} 3 up:standby-replay 6 up:standby 2026-02-24T09:17:38.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.721+0000 7f6d5955c640 1 -- 10.20.193.28:0/654624683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d54113950 msgr2=0x7f6d54113d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:38.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.721+0000 7f6d5955c640 1 --2- 10.20.193.28:0/654624683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d54113950 0x7f6d54113d20 secure :-1 s=READY pgs=385 gs=1 cs=0 l=1 c_cookie=127077441658883631 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d40009950 tx=0x7f6d4002f190 comp rx=0 tx=0).stop 2026-02-24T09:17:38.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.722+0000 7f6d5955c640 1 -- 10.20.193.28:0/654624683 shutdown_connections 2026-02-24T09:17:38.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.722+0000 7f6d5955c640 1 --2- 10.20.193.28:0/654624683 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f6d54119b40 0x7f6d5417a510 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:38.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.722+0000 7f6d5955c640 1 --2- 10.20.193.28:0/654624683 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f6d54114340 0x7f6d54119390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:38.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.722+0000 7f6d5955c640 1 --2- 10.20.193.28:0/654624683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d54113950 0x7f6d54113d20 unknown :-1 s=CLOSED pgs=385 gs=1 cs=0 l=1 c_cookie=127077441658883631 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:38.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.722+0000 7f6d5955c640 1 -- 10.20.193.28:0/654624683 >> 10.20.193.28:0/654624683 conn(0x7f6d540619a0 msgr2=0x7f6d54061da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:38.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.722+0000 7f6d5955c640 1 -- 10.20.193.28:0/654624683 shutdown_connections 2026-02-24T09:17:38.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.722+0000 7f6d5955c640 1 -- 10.20.193.28:0/654624683 wait complete. 2026-02-24T09:17:38.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.722+0000 7f6d5955c640 1 Processor -- start 2026-02-24T09:17:38.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.722+0000 7f6d5955c640 1 -- start start 2026-02-24T09:17:38.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.723+0000 7f6d5955c640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f6d54113950 0x7f6d54122360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:38.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.723+0000 7f6d5955c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d54114340 0x7f6d541228a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:38.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.723+0000 7f6d5955c640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f6d54119b40 0x7f6d54127c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:38.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.723+0000 7f6d5955c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6d54128240 con 0x7f6d54114340 2026-02-24T09:17:38.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.723+0000 7f6d5955c640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f6d541283b0 con 0x7f6d54119b40 2026-02-24T09:17:38.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.723+0000 7f6d5955c640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6d54128570 con 0x7f6d54113950 2026-02-24T09:17:38.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.723+0000 7f6d537fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d54114340 0x7f6d541228a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:38.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.723+0000 7f6d537fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d54114340 0x7f6d541228a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46004/0 (socket says 10.20.193.28:46004) 2026-02-24T09:17:38.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.723+0000 7f6d537fe640 1 -- 10.20.193.28:0/3730200319 learned_addr learned my addr 10.20.193.28:0/3730200319 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:38.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.723+0000 7f6d58d5b640 1 --2- 10.20.193.28:0/3730200319 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f6d54119b40 0x7f6d54127c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:38.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.723+0000 7f6d53fff640 1 --2- 10.20.193.28:0/3730200319 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f6d54113950 0x7f6d54122360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:38.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.723+0000 7f6d537fe640 1 -- 10.20.193.28:0/3730200319 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f6d54113950 msgr2=0x7f6d54122360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:38.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.723+0000 7f6d537fe640 1 --2- 10.20.193.28:0/3730200319 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f6d54113950 0x7f6d54122360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:38.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.723+0000 7f6d537fe640 1 -- 10.20.193.28:0/3730200319 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f6d54119b40 msgr2=0x7f6d54127c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:38.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.723+0000 7f6d537fe640 1 --2- 10.20.193.28:0/3730200319 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f6d54119b40 0x7f6d54127c20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:38.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.723+0000 7f6d537fe640 1 -- 10.20.193.28:0/3730200319 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d40009570 con 0x7f6d54114340 2026-02-24T09:17:38.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.723+0000 7f6d537fe640 1 --2- 10.20.193.28:0/3730200319 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d54114340 0x7f6d541228a0 secure :-1 s=READY pgs=386 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d44009480 tx=0x7f6d4400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:38.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.723+0000 7f6d517fa640 1 -- 10.20.193.28:0/3730200319 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6d4400cd40 con 0x7f6d54114340 2026-02-24T09:17:38.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.724+0000 7f6d517fa640 1 -- 10.20.193.28:0/3730200319 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6d44004d10 con 0x7f6d54114340 2026-02-24T09:17:38.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.724+0000 7f6d517fa640 1 -- 10.20.193.28:0/3730200319 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6d440106b0 con 0x7f6d54114340 2026-02-24T09:17:38.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.724+0000 7f6d5955c640 1 -- 10.20.193.28:0/3730200319 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d54128850 con 0x7f6d54114340 2026-02-24T09:17:38.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.724+0000 7f6d5955c640 1 -- 10.20.193.28:0/3730200319 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d54168f50 con 0x7f6d54114340 2026-02-24T09:17:38.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.724+0000 7f6d5955c640 1 -- 10.20.193.28:0/3730200319 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d54064e20 con 0x7f6d54114340 2026-02-24T09:17:38.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.726+0000 7f6d517fa640 1 -- 10.20.193.28:0/3730200319 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 20) ==== 157190+0+0 (secure 0 0 0) 0x7f6d4401f060 con 0x7f6d54114340 2026-02-24T09:17:38.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.728+0000 7f6d517fa640 1 --2- 10.20.193.28:0/3730200319 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f6d280b5840 0x7f6d280d5cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:38.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.728+0000 7f6d517fa640 1 -- 10.20.193.28:0/3730200319 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8192+0+0 (secure 0 0 0) 0x7f6d44014070 con 0x7f6d54114340 2026-02-24T09:17:38.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.728+0000 7f6d517fa640 1 -- 10.20.193.28:0/3730200319 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f6d440e70d0 con 0x7f6d54114340 2026-02-24T09:17:38.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.728+0000 7f6d53fff640 1 --2- 10.20.193.28:0/3730200319 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f6d280b5840 0x7f6d280d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:38.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.729+0000 7f6d53fff640 1 --2- 10.20.193.28:0/3730200319 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f6d280b5840 0x7f6d280d5cf0 secure :-1 s=READY pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d400098a0 tx=0x7f6d4003a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:38.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:38 trial159 ceph-mon[44242]: pgmap v199: 97 pgs: 97 active+clean; 650 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 852 B/s wr, 7 op/s 2026-02-24T09:17:38.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:38 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/984964995' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2026-02-24T09:17:38.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:38 trial159 ceph-mon[44242]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=a=up:active} 3 up:standby-replay 6 up:standby 2026-02-24T09:17:38.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.861+0000 7f6d5955c640 1 -- 10.20.193.28:0/3730200319 --> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f6d54128a40 con 0x7f6d280b5840 2026-02-24T09:17:38.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.866+0000 7f6d517fa640 1 -- 10.20.193.28:0/3730200319 <== mgr.14223 v2:10.20.193.28:6800/906910473 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f6d54128a40 con 0x7f6d280b5840 2026-02-24T09:17:38.868 INFO:teuthology.orchestra.run.trial028.stdout:/ 1m 6m3h 2026-02-24T09:17:38.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.867+0000 7f6d5955c640 1 -- 10.20.193.28:0/3730200319 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f6d280b5840 msgr2=0x7f6d280d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:38.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.867+0000 7f6d5955c640 1 --2- 10.20.193.28:0/3730200319 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f6d280b5840 0x7f6d280d5cf0 secure :-1 s=READY pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d400098a0 tx=0x7f6d4003a040 comp rx=0 tx=0).stop 2026-02-24T09:17:38.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.867+0000 7f6d5955c640 1 -- 10.20.193.28:0/3730200319 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d54114340 msgr2=0x7f6d541228a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:38.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.867+0000 7f6d5955c640 1 --2- 10.20.193.28:0/3730200319 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d54114340 0x7f6d541228a0 secure :-1 s=READY pgs=386 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d44009480 tx=0x7f6d4400ee60 comp rx=0 tx=0).stop 2026-02-24T09:17:38.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.867+0000 7f6d5955c640 1 -- 10.20.193.28:0/3730200319 shutdown_connections 2026-02-24T09:17:38.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.867+0000 7f6d5955c640 1 --2- 10.20.193.28:0/3730200319 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f6d280b5840 0x7f6d280d5cf0 unknown :-1 s=CLOSED pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:38.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.867+0000 7f6d5955c640 1 --2- 10.20.193.28:0/3730200319 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f6d54119b40 0x7f6d54127c20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:38.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.867+0000 7f6d5955c640 1 --2- 10.20.193.28:0/3730200319 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d54114340 0x7f6d541228a0 unknown :-1 s=CLOSED pgs=386 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:38.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.867+0000 7f6d5955c640 1 --2- 10.20.193.28:0/3730200319 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f6d54113950 0x7f6d54122360 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:38.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.867+0000 7f6d5955c640 1 -- 10.20.193.28:0/3730200319 >> 10.20.193.28:0/3730200319 conn(0x7f6d540619a0 msgr2=0x7f6d54062d40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:38.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.867+0000 7f6d5955c640 1 -- 10.20.193.28:0/3730200319 shutdown_connections 2026-02-24T09:17:38.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:17:38.867+0000 7f6d5955c640 1 -- 10.20.193.28:0/3730200319 wait complete. 2026-02-24T09:17:38.881 DEBUG:teuthology.orchestra.run.trial028:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2026-02-24T09:17:38.941 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2026-02-24T09:17:38.958 INFO:teuthology.run_tasks:Running task background_exec... 2026-02-24T09:17:38.974 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@trial028.front.sepia.ceph.com 2026-02-24T09:17:38.974 DEBUG:teuthology.orchestra.run.trial028:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2026-02-24T09:17:38.979 INFO:teuthology.run_tasks:Running task workunit... 2026-02-24T09:17:39.000 INFO:tasks.workunit:Pulling workunits from ref 5bc9a1ffc19df681248ece8c3c8c7191a571745b 2026-02-24T09:17:39.000 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-24T09:17:39.000 INFO:tasks.workunit:timeout=3h 2026-02-24T09:17:39.000 INFO:tasks.workunit:cleanup=True 2026-02-24T09:17:39.000 DEBUG:teuthology.orchestra.run.trial028:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-24T09:17:39.041 INFO:teuthology.orchestra.run.trial028.stdout: File: /home/ubuntu/cephtest/mnt.0 2026-02-24T09:17:39.041 INFO:teuthology.orchestra.run.trial028.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2026-02-24T09:17:39.041 INFO:teuthology.orchestra.run.trial028.stdout:Device: 2ch/44d Inode: 1 Links: 2 2026-02-24T09:17:39.041 INFO:teuthology.orchestra.run.trial028.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T09:17:39.041 INFO:teuthology.orchestra.run.trial028.stdout:Context: system_u:object_r:fusefs_t:s0 2026-02-24T09:17:39.041 INFO:teuthology.orchestra.run.trial028.stdout:Access: 2026-02-24 09:17:07.807294942 +0000 2026-02-24T09:17:39.041 INFO:teuthology.orchestra.run.trial028.stdout:Modify: 2026-02-24 09:17:35.924777810 +0000 2026-02-24T09:17:39.041 INFO:teuthology.orchestra.run.trial028.stdout:Change: 2026-02-24 09:17:36.387192178 +0000 2026-02-24T09:17:39.041 INFO:teuthology.orchestra.run.trial028.stdout: Birth: - 2026-02-24T09:17:39.042 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2026-02-24T09:17:39.042 DEBUG:teuthology.orchestra.run.trial028:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2026-02-24T09:17:39.149 DEBUG:teuthology.orchestra.run.trial028:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 5bc9a1ffc19df681248ece8c3c8c7191a571745b 2026-02-24T09:17:39.197 INFO:tasks.workunit.client.0.trial028.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-24T09:17:39.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:39 trial028 ceph-mon[40371]: from='client.15498 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.20", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:39.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:39 trial028 ceph-mon[40371]: from='client.15504 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:39.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:39 trial028 ceph-mon[40371]: from='client.15516 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:39.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:39 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4, 8, 11]} : dispatch 2026-02-24T09:17:39.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:39 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]} : dispatch 2026-02-24T09:17:39.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:39 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9, 5, 8]} : dispatch 2026-02-24T09:17:39.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:39 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]} : dispatch 2026-02-24T09:17:39.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:39 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 7]} : dispatch 2026-02-24T09:17:39.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:39 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2026-02-24T09:17:39.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:39 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]} : dispatch 2026-02-24T09:17:39.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:39 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]} : dispatch 2026-02-24T09:17:39.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:39 trial074 ceph-mon[44412]: from='client.15498 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.20", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:39.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:39 trial074 ceph-mon[44412]: from='client.15504 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:39.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:39 trial074 ceph-mon[44412]: from='client.15516 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:39.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:39 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4, 8, 11]} : dispatch 2026-02-24T09:17:39.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:39 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]} : dispatch 2026-02-24T09:17:39.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:39 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9, 5, 8]} : dispatch 2026-02-24T09:17:39.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:39 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]} : dispatch 2026-02-24T09:17:39.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:39 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 7]} : dispatch 2026-02-24T09:17:39.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:39 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2026-02-24T09:17:39.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:39 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]} : dispatch 2026-02-24T09:17:39.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:39 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]} : dispatch 2026-02-24T09:17:39.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:39 trial159 ceph-mon[44242]: from='client.15498 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.20", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:39.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:39 trial159 ceph-mon[44242]: from='client.15504 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:39.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:39 trial159 ceph-mon[44242]: from='client.15516 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:39.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:39 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4, 8, 11]} : dispatch 2026-02-24T09:17:39.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:39 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]} : dispatch 2026-02-24T09:17:39.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:39 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9, 5, 8]} : dispatch 2026-02-24T09:17:39.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:39 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]} : dispatch 2026-02-24T09:17:39.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:39 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 7]} : dispatch 2026-02-24T09:17:39.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:39 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2026-02-24T09:17:39.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:39 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]} : dispatch 2026-02-24T09:17:39.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:39 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]} : dispatch 2026-02-24T09:17:40.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:40 trial028 ceph-mon[40371]: from='client.15522 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:40.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:40 trial028 ceph-mon[40371]: from='client.15528 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:40.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:40 trial028 ceph-mon[40371]: pgmap v200: 97 pgs: 97 active+clean; 650 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 6 op/s 2026-02-24T09:17:40.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4, 8, 11]}]': finished 2026-02-24T09:17:40.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2026-02-24T09:17:40.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9, 5, 8]}]': finished 2026-02-24T09:17:40.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2026-02-24T09:17:40.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 7]}]': finished 2026-02-24T09:17:40.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2026-02-24T09:17:40.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2026-02-24T09:17:40.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]': finished 2026-02-24T09:17:40.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:40 trial028 ceph-mon[40371]: mgrmap e21: x(active, since 4m), standbys: y, z 2026-02-24T09:17:40.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:40 trial028 ceph-mon[40371]: osdmap e93: 12 total, 12 up, 12 in 2026-02-24T09:17:40.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:40 trial074 ceph-mon[44412]: from='client.15522 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:40.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:40 trial074 ceph-mon[44412]: from='client.15528 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:40.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:40 trial074 ceph-mon[44412]: pgmap v200: 97 pgs: 97 active+clean; 650 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 6 op/s 2026-02-24T09:17:40.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4, 8, 11]}]': finished 2026-02-24T09:17:40.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2026-02-24T09:17:40.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9, 5, 8]}]': finished 2026-02-24T09:17:40.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2026-02-24T09:17:40.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 7]}]': finished 2026-02-24T09:17:40.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2026-02-24T09:17:40.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2026-02-24T09:17:40.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]': finished 2026-02-24T09:17:40.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:40 trial074 ceph-mon[44412]: mgrmap e21: x(active, since 4m), standbys: y, z 2026-02-24T09:17:40.625 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:40 trial074 ceph-mon[44412]: osdmap e93: 12 total, 12 up, 12 in 2026-02-24T09:17:40.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:40 trial159 ceph-mon[44242]: from='client.15522 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:40.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:40 trial159 ceph-mon[44242]: from='client.15528 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:17:40.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:40 trial159 ceph-mon[44242]: pgmap v200: 97 pgs: 97 active+clean; 650 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 6 op/s 2026-02-24T09:17:40.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4, 8, 11]}]': finished 2026-02-24T09:17:40.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2026-02-24T09:17:40.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9, 5, 8]}]': finished 2026-02-24T09:17:40.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2026-02-24T09:17:40.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 7]}]': finished 2026-02-24T09:17:40.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2026-02-24T09:17:40.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2026-02-24T09:17:40.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]': finished 2026-02-24T09:17:40.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:40 trial159 ceph-mon[44242]: mgrmap e21: x(active, since 4m), standbys: y, z 2026-02-24T09:17:40.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:40 trial159 ceph-mon[44242]: osdmap e93: 12 total, 12 up, 12 in 2026-02-24T09:17:41.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:41 trial074 ceph-mon[44412]: osdmap e94: 12 total, 12 up, 12 in 2026-02-24T09:17:41.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:41 trial159 ceph-mon[44242]: osdmap e94: 12 total, 12 up, 12 in 2026-02-24T09:17:41.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:41 trial028 ceph-mon[40371]: osdmap e94: 12 total, 12 up, 12 in 2026-02-24T09:17:42.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:42 trial074 ceph-mon[44412]: pgmap v203: 97 pgs: 97 active+clean; 668 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 3.5 KiB/s wr, 8 op/s; 14 B/s, 0 objects/s recovering 2026-02-24T09:17:42.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:42 trial159 ceph-mon[44242]: pgmap v203: 97 pgs: 97 active+clean; 668 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 3.5 KiB/s wr, 8 op/s; 14 B/s, 0 objects/s recovering 2026-02-24T09:17:42.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:42 trial028 ceph-mon[40371]: pgmap v203: 97 pgs: 97 active+clean; 668 KiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 3.5 KiB/s wr, 8 op/s; 14 B/s, 0 objects/s recovering 2026-02-24T09:17:44.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:44 trial074 ceph-mon[44412]: pgmap v204: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 44 KiB/s rd, 265 KiB/s wr, 79 op/s; 14 B/s, 0 objects/s recovering 2026-02-24T09:17:44.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:44 trial159 ceph-mon[44242]: pgmap v204: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 44 KiB/s rd, 265 KiB/s wr, 79 op/s; 14 B/s, 0 objects/s recovering 2026-02-24T09:17:44.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:44 trial028 ceph-mon[40371]: pgmap v204: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 44 KiB/s rd, 265 KiB/s wr, 79 op/s; 14 B/s, 0 objects/s recovering 2026-02-24T09:17:46.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:46 trial074 ceph-mon[44412]: pgmap v205: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 42 KiB/s rd, 264 KiB/s wr, 76 op/s; 28 B/s, 1 objects/s recovering 2026-02-24T09:17:46.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:46 trial159 ceph-mon[44242]: pgmap v205: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 42 KiB/s rd, 264 KiB/s wr, 76 op/s; 28 B/s, 1 objects/s recovering 2026-02-24T09:17:46.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:46 trial028 ceph-mon[40371]: pgmap v205: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 42 KiB/s rd, 264 KiB/s wr, 76 op/s; 28 B/s, 1 objects/s recovering 2026-02-24T09:17:48.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:48 trial074 ceph-mon[44412]: pgmap v206: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 44 KiB/s rd, 264 KiB/s wr, 77 op/s; 28 B/s, 1 objects/s recovering 2026-02-24T09:17:48.662 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:48 trial028 ceph-mon[40371]: pgmap v206: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 44 KiB/s rd, 264 KiB/s wr, 77 op/s; 28 B/s, 1 objects/s recovering 2026-02-24T09:17:48.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:48 trial159 ceph-mon[44242]: pgmap v206: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 44 KiB/s rd, 264 KiB/s wr, 77 op/s; 28 B/s, 1 objects/s recovering 2026-02-24T09:17:50.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:50 trial074 ceph-mon[44412]: pgmap v207: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 35 KiB/s rd, 213 KiB/s wr, 63 op/s; 23 B/s, 0 objects/s recovering 2026-02-24T09:17:50.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:50 trial159 ceph-mon[44242]: pgmap v207: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 35 KiB/s rd, 213 KiB/s wr, 63 op/s; 23 B/s, 0 objects/s recovering 2026-02-24T09:17:50.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:50 trial028 ceph-mon[40371]: pgmap v207: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 35 KiB/s rd, 213 KiB/s wr, 63 op/s; 23 B/s, 0 objects/s recovering 2026-02-24T09:17:52.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.123+0000 7fc7709cc640 1 -- 10.20.193.28:0/3330654390 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc76c1558f0 msgr2=0x7fc76c175cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:52.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.123+0000 7fc7709cc640 1 --2- 10.20.193.28:0/3330654390 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc76c1558f0 0x7fc76c175cd0 secure :-1 s=READY pgs=387 gs=1 cs=0 l=1 c_cookie=11660210566870480954 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc75c00aa30 tx=0x7fc75c030270 comp rx=0 tx=0).stop 2026-02-24T09:17:52.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.123+0000 7fc7709cc640 1 -- 10.20.193.28:0/3330654390 shutdown_connections 2026-02-24T09:17:52.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.123+0000 7fc7709cc640 1 --2- 10.20.193.28:0/3330654390 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc76c1558f0 0x7fc76c175cd0 unknown :-1 s=CLOSED pgs=387 gs=1 cs=0 l=1 c_cookie=11660210566870480954 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:52.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.123+0000 7fc7709cc640 1 --2- 10.20.193.28:0/3330654390 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc76c0610f0 0x7fc76c1553b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:52.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.123+0000 7fc7709cc640 1 --2- 10.20.193.28:0/3330654390 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc76c0607e0 0x7fc76c060bb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:52.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.123+0000 7fc7709cc640 1 -- 10.20.193.28:0/3330654390 >> 10.20.193.28:0/3330654390 conn(0x7fc76c0eaa80 msgr2=0x7fc76c10ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:52.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.123+0000 7fc7709cc640 1 -- 10.20.193.28:0/3330654390 shutdown_connections 2026-02-24T09:17:52.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.123+0000 7fc7709cc640 1 -- 10.20.193.28:0/3330654390 wait complete. 2026-02-24T09:17:52.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.124+0000 7fc7709cc640 1 Processor -- start 2026-02-24T09:17:52.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.124+0000 7fc7709cc640 1 -- start start 2026-02-24T09:17:52.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.124+0000 7fc7709cc640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc76c0607e0 0x7fc76c162090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:52.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.124+0000 7fc7709cc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc76c0610f0 0x7fc76c1625d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:52.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.124+0000 7fc7709cc640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc76c1558f0 0x7fc76c1679a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:52.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.124+0000 7fc7709cc640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc76c167fc0 con 0x7fc76c0610f0 2026-02-24T09:17:52.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.124+0000 7fc7709cc640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fc76c168130 con 0x7fc76c0607e0 2026-02-24T09:17:52.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.124+0000 7fc7709cc640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc76c1682f0 con 0x7fc76c1558f0 2026-02-24T09:17:52.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.124+0000 7fc76a575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc76c0610f0 0x7fc76c1625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:52.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.124+0000 7fc76b577640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc76c1558f0 0x7fc76c1679a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:52.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.124+0000 7fc76b577640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc76c1558f0 0x7fc76c1679a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:40068/0 (socket says 10.20.193.28:40068) 2026-02-24T09:17:52.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.124+0000 7fc76b577640 1 -- 10.20.193.28:0/3073928018 learned_addr learned my addr 10.20.193.28:0/3073928018 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:52.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.124+0000 7fc76ad76640 1 --2- 10.20.193.28:0/3073928018 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc76c0607e0 0x7fc76c162090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:52.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.125+0000 7fc76b577640 1 -- 10.20.193.28:0/3073928018 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc76c0607e0 msgr2=0x7fc76c162090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:52.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.125+0000 7fc76b577640 1 --2- 10.20.193.28:0/3073928018 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc76c0607e0 0x7fc76c162090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:52.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.125+0000 7fc76b577640 1 -- 10.20.193.28:0/3073928018 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc76c0610f0 msgr2=0x7fc76c1625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:52.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.125+0000 7fc76b577640 1 --2- 10.20.193.28:0/3073928018 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc76c0610f0 0x7fc76c1625d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:52.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.125+0000 7fc76b577640 1 -- 10.20.193.28:0/3073928018 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc75c00a650 con 0x7fc76c1558f0 2026-02-24T09:17:52.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.125+0000 7fc76b577640 1 --2- 10.20.193.28:0/3073928018 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc76c1558f0 0x7fc76c1679a0 secure :-1 s=READY pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc75c00a330 tx=0x7fc75c0039b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:52.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.125+0000 7fc743fff640 1 -- 10.20.193.28:0/3073928018 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc75c03e070 con 0x7fc76c1558f0 2026-02-24T09:17:52.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.125+0000 7fc743fff640 1 -- 10.20.193.28:0/3073928018 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc75c003e00 con 0x7fc76c1558f0 2026-02-24T09:17:52.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.125+0000 7fc7709cc640 1 -- 10.20.193.28:0/3073928018 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc76c168570 con 0x7fc76c1558f0 2026-02-24T09:17:52.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.125+0000 7fc743fff640 1 -- 10.20.193.28:0/3073928018 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc75c042910 con 0x7fc76c1558f0 2026-02-24T09:17:52.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.125+0000 7fc7709cc640 1 -- 10.20.193.28:0/3073928018 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc76c151510 con 0x7fc76c1558f0 2026-02-24T09:17:52.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.130+0000 7fc743fff640 1 -- 10.20.193.28:0/3073928018 <== mon.1 v2:10.20.193.159:3300/0 4 ==== mgrmap(e 21) ==== 157247+0+0 (secure 0 0 0) 0x7fc75c0050c0 con 0x7fc76c1558f0 2026-02-24T09:17:52.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.132+0000 7fc743fff640 1 --2- 10.20.193.28:0/3073928018 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc73c0b58d0 0x7fc73c0d5d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:52.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.132+0000 7fc743fff640 1 -- 10.20.193.28:0/3073928018 <== mon.1 v2:10.20.193.159:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8440+0+0 (secure 0 0 0) 0x7fc75c10c8a0 con 0x7fc76c1558f0 2026-02-24T09:17:52.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.132+0000 7fc7733fee00 1 Processor -- start 2026-02-24T09:17:52.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.132+0000 7fc7733fee00 1 -- start start 2026-02-24T09:17:52.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.132+0000 7fc76ad76640 1 --2- 10.20.193.28:0/3073928018 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc73c0b58d0 0x7fc73c0d5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:52.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.133+0000 7fc7733fee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56110d739a60 0x56110d81b200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:52.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.133+0000 7fc7733fee00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x56110d81b740 0x56110d81bb90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:52.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.133+0000 7fc7733fee00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x56110d860270 0x56110d880650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:52.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.133+0000 7fc7733fee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56110d730f10 con 0x56110d739a60 2026-02-24T09:17:52.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.133+0000 7fc76ad76640 1 --2- 10.20.193.28:0/3073928018 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc73c0b58d0 0x7fc73c0d5d80 secure :-1 s=READY pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc760004740 tx=0x7fc76000b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:52.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.133+0000 7fc76ad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56110d739a60 0x56110d81b200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:52.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.133+0000 7fc7733fee00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x56110d72cc40 con 0x56110d860270 2026-02-24T09:17:52.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.133+0000 7fc7733fee00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x56110d726da0 con 0x56110d81b740 2026-02-24T09:17:52.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.133+0000 7fc76b577640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x56110d860270 0x56110d880650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:52.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.133+0000 7fc76b577640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x56110d860270 0x56110d880650 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:50884/0 (socket says 10.20.193.28:50884) 2026-02-24T09:17:52.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.133+0000 7fc76b577640 1 -- 10.20.193.28:0/3239647452 learned_addr learned my addr 10.20.193.28:0/3239647452 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:52.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.133+0000 7fc76b577640 1 -- 10.20.193.28:0/3239647452 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x56110d81b740 msgr2=0x56110d81bb90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:17:52.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.133+0000 7fc76b577640 1 --2- 10.20.193.28:0/3239647452 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x56110d81b740 0x56110d81bb90 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:52.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.133+0000 7fc76b577640 1 -- 10.20.193.28:0/3239647452 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56110d739a60 msgr2=0x56110d81b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:52.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.134+0000 7fc76b577640 1 --2- 10.20.193.28:0/3239647452 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56110d739a60 0x56110d81b200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:52.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.134+0000 7fc76b577640 1 -- 10.20.193.28:0/3239647452 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56110d6d2340 con 0x56110d860270 2026-02-24T09:17:52.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.134+0000 7fc76ad76640 1 --2- 10.20.193.28:0/3239647452 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56110d739a60 0x56110d81b200 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:17:52.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.134+0000 7fc76b577640 1 --2- 10.20.193.28:0/3239647452 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x56110d860270 0x56110d880650 secure :-1 s=READY pgs=108 gs=2 cs=0 l=1 c_cookie=15015012828710244418 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc75c10a170 tx=0x7fc75c006d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0600a9d61351042 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:52.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.134+0000 7fc742ffd640 1 -- 10.20.193.28:0/3239647452 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc75c0d2210 con 0x56110d860270 2026-02-24T09:17:52.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.134+0000 7fc742ffd640 1 -- 10.20.193.28:0/3239647452 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc75c0053a0 con 0x56110d860270 2026-02-24T09:17:52.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.134+0000 7fc742ffd640 1 -- 10.20.193.28:0/3239647452 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc75c0cec80 con 0x56110d860270 2026-02-24T09:17:52.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.134+0000 7fc7733fee00 1 -- 10.20.193.28:0/3239647452 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x56110d860270 msgr2=0x56110d880650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:52.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.134+0000 7fc7733fee00 1 --2- 10.20.193.28:0/3239647452 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x56110d860270 0x56110d880650 secure :-1 s=READY pgs=108 gs=2 cs=0 l=1 c_cookie=15015012828710244418 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc75c10a170 tx=0x7fc75c006d50 comp rx=0 tx=0).stop 2026-02-24T09:17:52.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.134+0000 7fc7733fee00 1 -- 10.20.193.28:0/3239647452 shutdown_connections 2026-02-24T09:17:52.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.134+0000 7fc7733fee00 1 --2- 10.20.193.28:0/3239647452 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x56110d860270 0x56110d880650 unknown :-1 s=CLOSED pgs=108 gs=2 cs=0 l=1 c_cookie=15015012828710244418 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:52.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.134+0000 7fc7733fee00 1 --2- 10.20.193.28:0/3239647452 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x56110d81b740 0x56110d81bb90 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:52.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.134+0000 7fc7733fee00 1 --2- 10.20.193.28:0/3239647452 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56110d739a60 0x56110d81b200 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:52.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.134+0000 7fc7733fee00 1 -- 10.20.193.28:0/3239647452 >> 10.20.193.28:0/3239647452 conn(0x56110d7b5490 msgr2=0x56110d819ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:52.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.135+0000 7fc7733fee00 1 -- 10.20.193.28:0/3239647452 shutdown_connections 2026-02-24T09:17:52.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.135+0000 7fc7733fee00 1 -- 10.20.193.28:0/3239647452 wait complete. 2026-02-24T09:17:52.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.136+0000 7fc7733fee00 1 -- start start 2026-02-24T09:17:52.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.136+0000 7fc7733fee00 1 Processor -- start 2026-02-24T09:17:52.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.137+0000 7fc7733fee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56110d739a60 0x56110d81c210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:52.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.137+0000 7fc7733fee00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x56110d81b740 0x56110d81c750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:52.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.137+0000 7fc7733fee00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x56110d860270 0x56110d841270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:52.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.137+0000 7fc7733fee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56110d81cf40 con 0x56110d739a60 2026-02-24T09:17:52.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.137+0000 7fc7733fee00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x56110d81d0b0 con 0x56110d860270 2026-02-24T09:17:52.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.137+0000 7fc7733fee00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x56110d841800 con 0x56110d81b740 2026-02-24T09:17:52.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.137+0000 7fc76b577640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x56110d860270 0x56110d841270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:52.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.137+0000 7fc76b577640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x56110d860270 0x56110d841270 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:50892/0 (socket says 10.20.193.28:50892) 2026-02-24T09:17:52.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.137+0000 7fc76b577640 1 -- 10.20.193.28:0/1550345469 learned_addr learned my addr 10.20.193.28:0/1550345469 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:52.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.137+0000 7fc76ad76640 1 --2- 10.20.193.28:0/1550345469 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56110d739a60 0x56110d81c210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:52.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.137+0000 7fc76b577640 1 -- 10.20.193.28:0/1550345469 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x56110d81b740 msgr2=0x56110d81c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:52.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.137+0000 7fc76b577640 1 --2- 10.20.193.28:0/1550345469 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x56110d81b740 0x56110d81c750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:52.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.137+0000 7fc76b577640 1 -- 10.20.193.28:0/1550345469 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56110d739a60 msgr2=0x56110d81c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:52.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.137+0000 7fc76b577640 1 --2- 10.20.193.28:0/1550345469 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56110d739a60 0x56110d81c210 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:52.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.137+0000 7fc76b577640 1 -- 10.20.193.28:0/1550345469 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56110d6aace0 con 0x56110d860270 2026-02-24T09:17:52.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.137+0000 7fc76ad76640 1 --2- 10.20.193.28:0/1550345469 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56110d739a60 0x56110d81c210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:17:52.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.138+0000 7fc76b577640 1 --2- 10.20.193.28:0/1550345469 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x56110d860270 0x56110d841270 secure :-1 s=READY pgs=109 gs=1 cs=0 l=1 c_cookie=9765452079198561808 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc75c0d29a0 tx=0x7fc75c005420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8785daed2bbae610 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:52.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.138+0000 7fc71bfff640 10 client.0 ms_handle_connect on v2:10.20.193.74:3300/0 2026-02-24T09:17:52.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.138+0000 7fc71bfff640 1 -- 10.20.193.28:0/1550345469 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc75c0dd8e0 con 0x56110d860270 2026-02-24T09:17:52.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.138+0000 7fc7733fee00 1 -- 10.20.193.28:0/1550345469 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc76c151510 con 0x56110d860270 2026-02-24T09:17:52.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.138+0000 7fc71bfff640 1 -- 10.20.193.28:0/1550345469 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc75c0d8730 con 0x56110d860270 2026-02-24T09:17:52.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.138+0000 7fc71bfff640 1 -- 10.20.193.28:0/1550345469 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc75c0d09f0 con 0x56110d860270 2026-02-24T09:17:52.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.138+0000 7fc7733fee00 10 client.25340 _ll_register_callbacks cb 0x56110d6b1980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:52.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.138+0000 7fc7733fee00 1 -- 10.20.193.28:0/1550345469 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56110d3c6520 con 0x56110d860270 2026-02-24T09:17:52.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.138+0000 7fc71bfff640 1 -- 10.20.193.28:0/1550345469 <== mon.2 v2:10.20.193.74:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 8440+0+0 (secure 0 0 0) 0x7fc75c0d0b50 con 0x56110d860270 2026-02-24T09:17:52.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.138+0000 7fc71bfff640 1 -- 10.20.193.28:0/1550345469 <== mon.2 v2:10.20.193.74:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fc75c0d4400 con 0x56110d860270 2026-02-24T09:17:52.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.138+0000 7fc7733fee00 10 client.25340 fetch_fsmap learned FSMap version 23 2026-02-24T09:17:52.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.138+0000 7fc7733fee00 1 -- 10.20.193.28:0/1550345469 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({fsmap=23}) -- 0x56110d6bc5b0 con 0x56110d860270 2026-02-24T09:17:52.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.138+0000 7fc71bfff640 1 -- 10.20.193.28:0/1550345469 <== mon.2 v2:10.20.193.74:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fc75c0d4560 con 0x56110d860270 2026-02-24T09:17:52.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.138+0000 7fc7733fee00 10 client.25340 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:17:52.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.138+0000 7fc7733fee00 10 client.25340 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:17:52.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.138+0000 7fc7733fee00 20 client.25340 populate_metadata read hostname 'trial028' 2026-02-24T09:17:52.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.138+0000 7fc7733fee00 1 --2- 10.20.193.28:0/1550345469 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x56110d845c80 0x56110d846120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:52.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.138+0000 7fc7733fee00 4 client.25340 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:17:52.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.138+0000 7fc7733fee00 1 -- 10.20.193.28:0/1550345469 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56110d6f89d0 con 0x56110d845c80 2026-02-24T09:17:52.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.139+0000 7fc76ad76640 1 --2- 10.20.193.28:0/1550345469 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x56110d845c80 0x56110d846120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:52.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.140+0000 7fc76ad76640 1 --2- 10.20.193.28:0/1550345469 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x56110d845c80 0x56110d846120 crc :-1 s=READY pgs=21 gs=4 cs=0 l=0 c_cookie=5106299830338034353 s_cookie=1001248639862629241 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46dd38a42fef9ab1 server_cookie=de5265546dae379 in_seq=0 out_seq=0 2026-02-24T09:17:52.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.140+0000 7fc71bfff640 10 client.25340 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:17:52.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.140+0000 7fc71bfff640 1 -- 10.20.193.28:0/1550345469 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x56110d6f89d0 con 0x56110d845c80 2026-02-24T09:17:52.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.140+0000 7fc71bfff640 10 client.25340 handle_command_reply: tid=0 2026-02-24T09:17:52.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.140+0000 7fc7733fee00 1 client.25340 shutdown 2026-02-24T09:17:52.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.140+0000 7fc7733fee00 1 -- 10.20.193.28:0/1550345469 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x56110d860270 msgr2=0x56110d841270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:52.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.140+0000 7fc7733fee00 1 --2- 10.20.193.28:0/1550345469 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x56110d860270 0x56110d841270 secure :-1 s=READY pgs=109 gs=1 cs=0 l=1 c_cookie=9765452079198561808 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc75c0d29a0 tx=0x7fc75c005420 comp rx=0 tx=0).stop 2026-02-24T09:17:52.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.141+0000 7fc7733fee00 1 -- 10.20.193.28:0/1550345469 shutdown_connections 2026-02-24T09:17:52.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.141+0000 7fc7733fee00 1 --2- 10.20.193.28:0/1550345469 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x56110d845c80 0x56110d846120 crc :-1 s=READY pgs=21 gs=4 cs=0 l=0 c_cookie=5106299830338034353 s_cookie=1001248639862629241 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:52.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.141+0000 7fc7733fee00 1 --2- 10.20.193.28:0/1550345469 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x56110d860270 0x56110d841270 unknown :-1 s=CLOSED pgs=109 gs=1 cs=0 l=1 c_cookie=9765452079198561808 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:52.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.141+0000 7fc7733fee00 1 --2- 10.20.193.28:0/1550345469 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x56110d81b740 0x56110d81c750 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:52.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.141+0000 7fc7733fee00 1 --2- 10.20.193.28:0/1550345469 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56110d739a60 0x56110d81c210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:52.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.141+0000 7fc71bfff640 0 client.25340 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:17:52.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.141+0000 7fc7733fee00 1 -- 10.20.193.28:0/1550345469 >> 10.20.193.28:0/1550345469 conn(0x56110d7b5490 msgr2=0x56110d8192f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:52.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.141+0000 7fc7733fee00 1 -- 10.20.193.28:0/1550345469 shutdown_connections 2026-02-24T09:17:52.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.141+0000 7fc7733fee00 1 -- 10.20.193.28:0/1550345469 wait complete. 2026-02-24T09:17:52.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.141+0000 7fc7733fee00 20 client.25340 trim_cache size 0 max 16384 2026-02-24T09:17:52.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.149+0000 7fc7733fee00 1 Processor -- start 2026-02-24T09:17:52.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.150+0000 7fc7733fee00 1 -- start start 2026-02-24T09:17:52.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.150+0000 7fc7733fee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56110d739a60 0x56110d81c870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:52.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.150+0000 7fc7733fee00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x56110d81b740 0x56110d81a3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:52.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.150+0000 7fc7733fee00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x56110d860270 0x56110d81a930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:52.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.150+0000 7fc7733fee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56110d7249d0 con 0x56110d739a60 2026-02-24T09:17:52.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.150+0000 7fc7733fee00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x56110d465f10 con 0x56110d860270 2026-02-24T09:17:52.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.150+0000 7fc7733fee00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x56110d730f10 con 0x56110d81b740 2026-02-24T09:17:52.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.150+0000 7fc76ad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56110d739a60 0x56110d81c870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:52.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.150+0000 7fc76ad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56110d739a60 0x56110d81c870 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42778/0 (socket says 10.20.193.28:42778) 2026-02-24T09:17:52.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.150+0000 7fc76ad76640 1 -- 10.20.193.28:0/2852110933 learned_addr learned my addr 10.20.193.28:0/2852110933 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:52.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.150+0000 7fc76b577640 1 --2- 10.20.193.28:0/2852110933 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x56110d860270 0x56110d81a930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:52.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.150+0000 7fc76a575640 1 --2- 10.20.193.28:0/2852110933 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x56110d81b740 0x56110d81a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:52.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.151+0000 7fc76ad76640 1 -- 10.20.193.28:0/2852110933 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x56110d81b740 msgr2=0x56110d81a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:52.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.151+0000 7fc76ad76640 1 --2- 10.20.193.28:0/2852110933 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x56110d81b740 0x56110d81a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:52.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.151+0000 7fc76ad76640 1 -- 10.20.193.28:0/2852110933 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x56110d860270 msgr2=0x56110d81a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:52.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.151+0000 7fc76ad76640 1 --2- 10.20.193.28:0/2852110933 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x56110d860270 0x56110d81a930 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:52.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.151+0000 7fc76ad76640 1 -- 10.20.193.28:0/2852110933 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56110d6b7030 con 0x56110d739a60 2026-02-24T09:17:52.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.151+0000 7fc76ad76640 1 --2- 10.20.193.28:0/2852110933 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56110d739a60 0x56110d81c870 secure :-1 s=READY pgs=388 gs=1 cs=0 l=1 c_cookie=3969212863950437121 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc760011500 tx=0x7fc760013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37157a11e9ad3b01 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:52.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.151+0000 7fc7427fc640 1 -- 10.20.193.28:0/2852110933 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc760023040 con 0x56110d739a60 2026-02-24T09:17:52.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.151+0000 7fc7427fc640 1 -- 10.20.193.28:0/2852110933 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc760015070 con 0x56110d739a60 2026-02-24T09:17:52.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.151+0000 7fc7427fc640 1 -- 10.20.193.28:0/2852110933 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc760023040 con 0x56110d739a60 2026-02-24T09:17:52.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.151+0000 7fc7733fee00 1 -- 10.20.193.28:0/2852110933 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56110d739a60 msgr2=0x56110d81c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:52.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.151+0000 7fc7733fee00 1 --2- 10.20.193.28:0/2852110933 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56110d739a60 0x56110d81c870 secure :-1 s=READY pgs=388 gs=1 cs=0 l=1 c_cookie=3969212863950437121 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc760011500 tx=0x7fc760013000 comp rx=0 tx=0).stop 2026-02-24T09:17:52.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.151+0000 7fc7733fee00 1 -- 10.20.193.28:0/2852110933 shutdown_connections 2026-02-24T09:17:52.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.151+0000 7fc7733fee00 1 --2- 10.20.193.28:0/2852110933 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x56110d860270 0x56110d81a930 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:52.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.151+0000 7fc7733fee00 1 --2- 10.20.193.28:0/2852110933 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x56110d81b740 0x56110d81a3f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:52.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.151+0000 7fc7733fee00 1 --2- 10.20.193.28:0/2852110933 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56110d739a60 0x56110d81c870 unknown :-1 s=CLOSED pgs=388 gs=1 cs=0 l=1 c_cookie=3969212863950437121 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:52.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.151+0000 7fc7733fee00 1 -- 10.20.193.28:0/2852110933 >> 10.20.193.28:0/2852110933 conn(0x56110d7b5490 msgr2=0x56110d81c160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:52.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.151+0000 7fc7733fee00 1 -- 10.20.193.28:0/2852110933 shutdown_connections 2026-02-24T09:17:52.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.151+0000 7fc7733fee00 1 -- 10.20.193.28:0/2852110933 wait complete. 2026-02-24T09:17:52.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.152+0000 7fc7733fee00 1 -- start start 2026-02-24T09:17:52.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.152+0000 7fc7733fee00 1 Processor -- start 2026-02-24T09:17:52.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.152+0000 7fc7733fee00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x56110d739a60 0x56110d8546f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:52.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.152+0000 7fc7733fee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56110d81b740 0x56110d854c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:52.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.152+0000 7fc7733fee00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x56110d860270 0x56110d913fe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:52.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.153+0000 7fc7733fee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56110d78a580 con 0x56110d81b740 2026-02-24T09:17:52.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.153+0000 7fc7733fee00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x56110d855470 con 0x56110d739a60 2026-02-24T09:17:52.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.153+0000 7fc7733fee00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x56110d914520 con 0x56110d860270 2026-02-24T09:17:52.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.153+0000 7fc76a575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56110d81b740 0x56110d854c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:52.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.153+0000 7fc76ad76640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x56110d739a60 0x56110d8546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:52.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.153+0000 7fc76a575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56110d81b740 0x56110d854c30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42788/0 (socket says 10.20.193.28:42788) 2026-02-24T09:17:52.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.153+0000 7fc76a575640 1 -- 10.20.193.28:0/4052231455 learned_addr learned my addr 10.20.193.28:0/4052231455 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:17:52.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.153+0000 7fc76ad76640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x56110d739a60 0x56110d8546f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:50912/0 (socket says 10.20.193.28:50912) 2026-02-24T09:17:52.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.153+0000 7fc76b577640 1 --2- 10.20.193.28:0/4052231455 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x56110d860270 0x56110d913fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:52.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.153+0000 7fc76a575640 1 -- 10.20.193.28:0/4052231455 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x56110d860270 msgr2=0x56110d913fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:52.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.153+0000 7fc76a575640 1 --2- 10.20.193.28:0/4052231455 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x56110d860270 0x56110d913fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:52.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.153+0000 7fc76a575640 1 -- 10.20.193.28:0/4052231455 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x56110d739a60 msgr2=0x56110d8546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:52.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.153+0000 7fc76a575640 1 --2- 10.20.193.28:0/4052231455 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x56110d739a60 0x56110d8546f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:52.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.153+0000 7fc76a575640 1 -- 10.20.193.28:0/4052231455 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56110d6ab010 con 0x56110d81b740 2026-02-24T09:17:52.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.153+0000 7fc76a575640 1 --2- 10.20.193.28:0/4052231455 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56110d81b740 0x56110d854c30 secure :-1 s=READY pgs=389 gs=1 cs=0 l=1 c_cookie=10176535478671366727 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc76c168a30 tx=0x7fc754002f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d3a5119aa5dda47 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:52.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.153+0000 7fc71bfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:17:52.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.153+0000 7fc71bfff640 1 -- 10.20.193.28:0/4052231455 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc754011ed0 con 0x56110d81b740 2026-02-24T09:17:52.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.153+0000 7fc7733fee00 1 -- 10.20.193.28:0/4052231455 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc76000bdf0 con 0x56110d81b740 2026-02-24T09:17:52.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.153+0000 7fc7733fee00 10 client.15546 _ll_register_callbacks cb 0x56110d6b1980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:52.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.153+0000 7fc7733fee00 1 -- 10.20.193.28:0/4052231455 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56110d757d30 con 0x56110d81b740 2026-02-24T09:17:52.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.153+0000 7fc71bfff640 1 -- 10.20.193.28:0/4052231455 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc75401b930 con 0x56110d81b740 2026-02-24T09:17:52.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.153+0000 7fc71bfff640 1 -- 10.20.193.28:0/4052231455 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc754012b50 con 0x56110d81b740 2026-02-24T09:17:52.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.154+0000 7fc71bfff640 1 -- 10.20.193.28:0/4052231455 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 8440+0+0 (secure 0 0 0) 0x7fc754012ce0 con 0x56110d81b740 2026-02-24T09:17:52.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.154+0000 7fc71bfff640 1 -- 10.20.193.28:0/4052231455 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fc7540243f0 con 0x56110d81b740 2026-02-24T09:17:52.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.154+0000 7fc7733fee00 10 client.15546 fetch_fsmap learned FSMap version 23 2026-02-24T09:17:52.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.154+0000 7fc7733fee00 1 -- 10.20.193.28:0/4052231455 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x56110d6bc810 con 0x56110d81b740 2026-02-24T09:17:52.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.154+0000 7fc71bfff640 1 -- 10.20.193.28:0/4052231455 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fc75401baa0 con 0x56110d81b740 2026-02-24T09:17:52.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.154+0000 7fc7733fee00 10 client.15546 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:17:52.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.154+0000 7fc7733fee00 10 client.15546 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:17:52.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.154+0000 7fc7733fee00 20 client.15546 populate_metadata read hostname 'trial028' 2026-02-24T09:17:52.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.154+0000 7fc7733fee00 1 --2- 10.20.193.28:0/4052231455 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x56110d916240 0x56110d9366f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:52.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.154+0000 7fc7733fee00 4 client.15546 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-24T09:17:52.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.154+0000 7fc7733fee00 1 -- 10.20.193.28:0/4052231455 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56110d40a640 con 0x56110d916240 2026-02-24T09:17:52.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.154+0000 7fc76ad76640 1 --2- 10.20.193.28:0/4052231455 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x56110d916240 0x56110d9366f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:52.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.155+0000 7fc76ad76640 1 --2- 10.20.193.28:0/4052231455 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x56110d916240 0x56110d9366f0 crc :-1 s=READY pgs=22 gs=4 cs=0 l=0 c_cookie=2595921193137678452 s_cookie=13735202144682351396 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2406909245e12874 server_cookie=be9d3d940ff99b24 in_seq=0 out_seq=0 2026-02-24T09:17:52.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.155+0000 7fc71bfff640 10 client.15546 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:17:52.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.161+0000 7fc71bfff640 1 -- 10.20.193.28:0/4052231455 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56110d40a640 con 0x56110d916240 2026-02-24T09:17:52.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.161+0000 7fc71bfff640 10 client.15546 handle_command_reply: tid=0 2026-02-24T09:17:52.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.161+0000 7fc7733fee00 1 client.15546 shutdown 2026-02-24T09:17:52.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.161+0000 7fc7733fee00 1 -- 10.20.193.28:0/4052231455 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56110d81b740 msgr2=0x56110d854c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:52.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.161+0000 7fc7733fee00 1 --2- 10.20.193.28:0/4052231455 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56110d81b740 0x56110d854c30 secure :-1 s=READY pgs=389 gs=1 cs=0 l=1 c_cookie=10176535478671366727 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc76c168a30 tx=0x7fc754002f00 comp rx=0 tx=0).stop 2026-02-24T09:17:52.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.161+0000 7fc7733fee00 1 -- 10.20.193.28:0/4052231455 shutdown_connections 2026-02-24T09:17:52.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.161+0000 7fc7733fee00 1 --2- 10.20.193.28:0/4052231455 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x56110d916240 0x56110d9366f0 crc :-1 s=READY pgs=22 gs=4 cs=0 l=0 c_cookie=2595921193137678452 s_cookie=13735202144682351396 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:52.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.161+0000 7fc7733fee00 1 --2- 10.20.193.28:0/4052231455 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x56110d860270 0x56110d913fe0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:52.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.161+0000 7fc7733fee00 1 --2- 10.20.193.28:0/4052231455 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56110d81b740 0x56110d854c30 unknown :-1 s=CLOSED pgs=389 gs=1 cs=0 l=1 c_cookie=10176535478671366727 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:52.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.161+0000 7fc7733fee00 1 --2- 10.20.193.28:0/4052231455 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x56110d739a60 0x56110d8546f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:52.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.161+0000 7fc71bfff640 0 client.15546 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:17:52.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.161+0000 7fc7733fee00 1 -- 10.20.193.28:0/4052231455 >> 10.20.193.28:0/4052231455 conn(0x56110d7b5490 msgr2=0x56110d85f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:52.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.161+0000 7fc7733fee00 1 -- 10.20.193.28:0/4052231455 shutdown_connections 2026-02-24T09:17:52.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.161+0000 7fc7733fee00 1 -- 10.20.193.28:0/4052231455 wait complete. 2026-02-24T09:17:52.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.161+0000 7fc7733fee00 20 client.15546 trim_cache size 0 max 16384 2026-02-24T09:17:52.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-24T09:17:52.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-24T09:17:52.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-24T09:17:52.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-24T09:17:52.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.162+0000 7fc7709cc640 1 -- 10.20.193.28:0/3073928018 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc73c0b58d0 msgr2=0x7fc73c0d5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:52.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.162+0000 7fc7709cc640 1 --2- 10.20.193.28:0/3073928018 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc73c0b58d0 0x7fc73c0d5d80 secure :-1 s=READY pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc760004740 tx=0x7fc76000b410 comp rx=0 tx=0).stop 2026-02-24T09:17:52.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.162+0000 7fc7709cc640 1 -- 10.20.193.28:0/3073928018 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc76c1558f0 msgr2=0x7fc76c1679a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:52.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.162+0000 7fc7709cc640 1 --2- 10.20.193.28:0/3073928018 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc76c1558f0 0x7fc76c1679a0 secure :-1 s=READY pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc75c00a330 tx=0x7fc75c0039b0 comp rx=0 tx=0).stop 2026-02-24T09:17:52.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.162+0000 7fc7709cc640 1 -- 10.20.193.28:0/3073928018 shutdown_connections 2026-02-24T09:17:52.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.162+0000 7fc7709cc640 1 --2- 10.20.193.28:0/3073928018 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc73c0b58d0 0x7fc73c0d5d80 unknown :-1 s=CLOSED pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:52.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.162+0000 7fc7709cc640 1 --2- 10.20.193.28:0/3073928018 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc76c1558f0 0x7fc76c1679a0 unknown :-1 s=CLOSED pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:52.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.162+0000 7fc7709cc640 1 --2- 10.20.193.28:0/3073928018 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc76c0610f0 0x7fc76c1625d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:52.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.162+0000 7fc7709cc640 1 --2- 10.20.193.28:0/3073928018 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc76c0607e0 0x7fc76c162090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:52.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.162+0000 7fc7709cc640 1 -- 10.20.193.28:0/3073928018 >> 10.20.193.28:0/3073928018 conn(0x7fc76c0eaa80 msgr2=0x7fc76c10ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:52.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.162+0000 7fc7709cc640 1 -- 10.20.193.28:0/3073928018 shutdown_connections 2026-02-24T09:17:52.167 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:17:52.162+0000 7fc7709cc640 1 -- 10.20.193.28:0/3073928018 wait complete. 2026-02-24T09:17:52.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:52 trial159 ceph-mon[44242]: pgmap v208: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 33 KiB/s rd, 193 KiB/s wr, 58 op/s; 20 B/s, 0 objects/s recovering 2026-02-24T09:17:52.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:52 trial028 ceph-mon[40371]: pgmap v208: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 33 KiB/s rd, 193 KiB/s wr, 58 op/s; 20 B/s, 0 objects/s recovering 2026-02-24T09:17:52.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:52 trial074 ceph-mon[44412]: pgmap v208: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 33 KiB/s rd, 193 KiB/s wr, 58 op/s; 20 B/s, 0 objects/s recovering 2026-02-24T09:17:54.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:54 trial159 ceph-mon[44242]: pgmap v209: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 28 KiB/s rd, 175 KiB/s wr, 55 op/s; 9 B/s, 0 objects/s recovering 2026-02-24T09:17:54.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:54 trial028 ceph-mon[40371]: pgmap v209: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 28 KiB/s rd, 175 KiB/s wr, 55 op/s; 9 B/s, 0 objects/s recovering 2026-02-24T09:17:54.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:54 trial074 ceph-mon[44412]: pgmap v209: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 28 KiB/s rd, 175 KiB/s wr, 55 op/s; 9 B/s, 0 objects/s recovering 2026-02-24T09:17:56.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:56 trial159 ceph-mon[44242]: pgmap v210: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 1.7 KiB/s wr, 8 op/s; 9 B/s, 0 objects/s recovering 2026-02-24T09:17:56.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:56 trial028 ceph-mon[40371]: pgmap v210: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 1.7 KiB/s wr, 8 op/s; 9 B/s, 0 objects/s recovering 2026-02-24T09:17:56.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:56 trial074 ceph-mon[44412]: pgmap v210: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 1.7 KiB/s wr, 8 op/s; 9 B/s, 0 objects/s recovering 2026-02-24T09:17:58.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:58 trial159 ceph-mon[44242]: pgmap v211: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 2.3 KiB/s wr, 11 op/s 2026-02-24T09:17:58.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:58 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:17:58.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:58 trial028 ceph-mon[40371]: pgmap v211: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 2.3 KiB/s wr, 11 op/s 2026-02-24T09:17:58.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:58 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:17:58.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:58 trial074 ceph-mon[44412]: pgmap v211: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 2.3 KiB/s wr, 11 op/s 2026-02-24T09:17:58.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:58 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:17:59.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:59 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:17:59.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:59 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:17:59.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:59 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:17:59.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:59 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:17:59.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:59 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:17:59.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:59 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:17:59.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:59 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:17:59.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:59 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:17:59.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:59 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:17:59.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:17:59 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:17:59.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:59 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:17:59.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:59 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:17:59.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:59 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:17:59.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:59 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:17:59.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:59 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:17:59.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:59 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:17:59.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:59 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:17:59.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:59 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:17:59.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:59 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:17:59.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:17:59 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:17:59.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:59 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:17:59.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:59 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:17:59.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:59 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:17:59.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:59 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:17:59.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:59 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:17:59.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:59 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:17:59.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:59 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:17:59.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:59 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:17:59.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:59 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:17:59.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:17:59 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:18:00.610 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:18:00 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: 2026-02-24T09:18:00.330+0000 7fd64887e640 -1 client.15552 error registering admin socket command: (17) File exists 2026-02-24T09:18:00.610 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:18:00 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: 2026-02-24T09:18:00.330+0000 7fd64887e640 -1 client.15552 error registering admin socket command: (17) File exists 2026-02-24T09:18:00.610 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:18:00 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: 2026-02-24T09:18:00.330+0000 7fd64887e640 -1 client.15552 error registering admin socket command: (17) File exists 2026-02-24T09:18:00.610 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:18:00 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: 2026-02-24T09:18:00.330+0000 7fd64887e640 -1 client.15552 error registering admin socket command: (17) File exists 2026-02-24T09:18:00.610 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:18:00 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: 2026-02-24T09:18:00.330+0000 7fd64887e640 -1 client.15552 error registering admin socket command: (17) File exists 2026-02-24T09:18:00.610 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:18:00 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: 2026-02-24T09:18:00.330+0000 7fd64887e640 -1 client.15552 error registering admin socket command: (17) File exists 2026-02-24T09:18:00.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:00 trial028 ceph-mon[40371]: pgmap v212: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2026-02-24T09:18:00.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:00 trial159 ceph-mon[44242]: pgmap v212: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2026-02-24T09:18:00.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:00 trial074 ceph-mon[44412]: pgmap v212: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2026-02-24T09:18:02.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:02 trial159 ceph-mon[44242]: pgmap v213: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2026-02-24T09:18:02.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:02 trial159 ceph-mon[44242]: mgrmap e22: x(active, since 4m), standbys: y, z 2026-02-24T09:18:02.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:02 trial028 ceph-mon[40371]: pgmap v213: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2026-02-24T09:18:02.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:02 trial028 ceph-mon[40371]: mgrmap e22: x(active, since 4m), standbys: y, z 2026-02-24T09:18:02.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:02 trial074 ceph-mon[44412]: pgmap v213: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2026-02-24T09:18:02.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:02 trial074 ceph-mon[44412]: mgrmap e22: x(active, since 4m), standbys: y, z 2026-02-24T09:18:04.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:04 trial159 ceph-mon[44242]: pgmap v214: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 24 KiB/s wr, 25 op/s 2026-02-24T09:18:04.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:04 trial028 ceph-mon[40371]: pgmap v214: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 24 KiB/s wr, 25 op/s 2026-02-24T09:18:04.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:04 trial074 ceph-mon[44412]: pgmap v214: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 24 KiB/s wr, 25 op/s 2026-02-24T09:18:05.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.236+0000 7f2ebab7e640 1 -- 10.20.193.28:0/4051523960 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2eb4066a30 msgr2=0x7f2eb4062a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:05.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.236+0000 7f2ebab7e640 1 --2- 10.20.193.28:0/4051523960 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2eb4066a30 0x7f2eb4062a50 secure :-1 s=READY pgs=110 gs=1 cs=0 l=1 c_cookie=7958132540689096758 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ea4009950 tx=0x7f2ea402f190 comp rx=0 tx=0).stop 2026-02-24T09:18:05.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.237+0000 7f2ebab7e640 1 -- 10.20.193.28:0/4051523960 shutdown_connections 2026-02-24T09:18:05.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.237+0000 7f2ebab7e640 1 --2- 10.20.193.28:0/4051523960 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2eb4159bd0 0x7f2eb417a060 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:05.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.237+0000 7f2ebab7e640 1 --2- 10.20.193.28:0/4051523960 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f2eb4063070 0x7f2eb4063480 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:05.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.237+0000 7f2ebab7e640 1 --2- 10.20.193.28:0/4051523960 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2eb4066a30 0x7f2eb4062a50 unknown :-1 s=CLOSED pgs=110 gs=1 cs=0 l=1 c_cookie=7958132540689096758 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:05.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.237+0000 7f2ebab7e640 1 -- 10.20.193.28:0/4051523960 >> 10.20.193.28:0/4051523960 conn(0x7f2eb40ecc70 msgr2=0x7f2eb410d080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:05.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.237+0000 7f2ebab7e640 1 -- 10.20.193.28:0/4051523960 shutdown_connections 2026-02-24T09:18:05.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.237+0000 7f2ebab7e640 1 -- 10.20.193.28:0/4051523960 wait complete. 2026-02-24T09:18:05.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.237+0000 7f2ebab7e640 1 Processor -- start 2026-02-24T09:18:05.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.237+0000 7f2ebab7e640 1 -- start start 2026-02-24T09:18:05.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.238+0000 7f2ebab7e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2eb4063070 0x7f2eb4163630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:05.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.238+0000 7f2ebab7e640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f2eb4066a30 0x7f2eb4163b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:05.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.238+0000 7f2ebab7e640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2eb4159bd0 0x7f2eb4168f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:05.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.238+0000 7f2ebab7e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb4169560 con 0x7f2eb4063070 2026-02-24T09:18:05.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.238+0000 7f2ebab7e640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb41696d0 con 0x7f2eb4159bd0 2026-02-24T09:18:05.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.238+0000 7f2ebab7e640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb4169890 con 0x7f2eb4066a30 2026-02-24T09:18:05.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.238+0000 7f2eb9b7c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2eb4063070 0x7f2eb4163630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:05.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.238+0000 7f2eb9b7c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2eb4063070 0x7f2eb4163630 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46950/0 (socket says 10.20.193.28:46950) 2026-02-24T09:18:05.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.238+0000 7f2eb9b7c640 1 -- 10.20.193.28:0/2334339976 learned_addr learned my addr 10.20.193.28:0/2334339976 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:18:05.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.238+0000 7f2eb937b640 1 --2- 10.20.193.28:0/2334339976 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f2eb4066a30 0x7f2eb4163b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:05.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.238+0000 7f2eb9b7c640 1 -- 10.20.193.28:0/2334339976 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f2eb4066a30 msgr2=0x7f2eb4163b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:05.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.238+0000 7f2eb9b7c640 1 --2- 10.20.193.28:0/2334339976 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f2eb4066a30 0x7f2eb4163b70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:05.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.238+0000 7f2eba37d640 1 --2- 10.20.193.28:0/2334339976 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2eb4159bd0 0x7f2eb4168f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:05.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.238+0000 7f2eb9b7c640 1 -- 10.20.193.28:0/2334339976 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2eb4159bd0 msgr2=0x7f2eb4168f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:05.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.238+0000 7f2eb9b7c640 1 --2- 10.20.193.28:0/2334339976 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2eb4159bd0 0x7f2eb4168f40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:05.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.238+0000 7f2eb9b7c640 1 -- 10.20.193.28:0/2334339976 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb000a590 con 0x7f2eb4063070 2026-02-24T09:18:05.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.238+0000 7f2eba37d640 1 --2- 10.20.193.28:0/2334339976 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2eb4159bd0 0x7f2eb4168f40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:18:05.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.238+0000 7f2eb9b7c640 1 --2- 10.20.193.28:0/2334339976 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2eb4063070 0x7f2eb4163630 secure :-1 s=READY pgs=392 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ea40098a0 tx=0x7f2ea40028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:05.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.239+0000 7f2ea2ffd640 1 -- 10.20.193.28:0/2334339976 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2ea403d070 con 0x7f2eb4063070 2026-02-24T09:18:05.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.239+0000 7f2ea2ffd640 1 -- 10.20.193.28:0/2334339976 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2ea4002a40 con 0x7f2eb4063070 2026-02-24T09:18:05.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.239+0000 7f2ea2ffd640 1 -- 10.20.193.28:0/2334339976 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2ea4041720 con 0x7f2eb4063070 2026-02-24T09:18:05.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.239+0000 7f2ebab7e640 1 -- 10.20.193.28:0/2334339976 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ea4009570 con 0x7f2eb4063070 2026-02-24T09:18:05.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.239+0000 7f2ebab7e640 1 -- 10.20.193.28:0/2334339976 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eb4169da0 con 0x7f2eb4063070 2026-02-24T09:18:05.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.244+0000 7f2ebe3f1e00 1 Processor -- start 2026-02-24T09:18:05.247 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.245+0000 7f2ebe3f1e00 1 -- start start 2026-02-24T09:18:05.247 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.245+0000 7f2ebe3f1e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560f92e51a60 0x560f92f33200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:05.248 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.245+0000 7f2ebe3f1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f92f33740 0x560f92f33b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:05.248 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.245+0000 7f2ebe3f1e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560f92f78270 0x560f92f98650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:05.248 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.245+0000 7f2ebe3f1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560f92e48f10 con 0x560f92f33740 2026-02-24T09:18:05.248 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.245+0000 7f2ebe3f1e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x560f92e44c40 con 0x560f92f78270 2026-02-24T09:18:05.248 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.245+0000 7f2ebe3f1e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x560f92e3eda0 con 0x560f92e51a60 2026-02-24T09:18:05.248 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.245+0000 7f2eba37d640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560f92e51a60 0x560f92f33200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:05.248 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.245+0000 7f2eba37d640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560f92e51a60 0x560f92f33200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:55604/0 (socket says 10.20.193.28:55604) 2026-02-24T09:18:05.248 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.245+0000 7f2eba37d640 1 -- 10.20.193.28:0/3002452866 learned_addr learned my addr 10.20.193.28:0/3002452866 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:18:05.248 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.245+0000 7f2eb937b640 1 --2- 10.20.193.28:0/3002452866 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560f92f78270 0x560f92f98650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:05.248 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.245+0000 7f2eba37d640 1 -- 10.20.193.28:0/3002452866 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560f92f78270 msgr2=0x560f92f98650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:05.248 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.245+0000 7f2eba37d640 1 --2- 10.20.193.28:0/3002452866 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560f92f78270 0x560f92f98650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:05.248 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.245+0000 7f2eba37d640 1 -- 10.20.193.28:0/3002452866 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f92f33740 msgr2=0x560f92f33b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T09:18:05.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.245+0000 7f2eba37d640 1 --2- 10.20.193.28:0/3002452866 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f92f33740 0x560f92f33b90 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:05.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.245+0000 7f2eba37d640 1 -- 10.20.193.28:0/3002452866 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f92dea340 con 0x560f92e51a60 2026-02-24T09:18:05.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.246+0000 7f2eba37d640 1 --2- 10.20.193.28:0/3002452866 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560f92e51a60 0x560f92f33200 secure :-1 s=READY pgs=112 gs=1 cs=0 l=1 c_cookie=10282173115478847806 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2eb0005680 tx=0x7f2eb000ab90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8eb19df8a330313e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:05.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.246+0000 7f2e81bfe640 1 -- 10.20.193.28:0/3002452866 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2eb0003e80 con 0x560f92e51a60 2026-02-24T09:18:05.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.246+0000 7f2e81bfe640 1 -- 10.20.193.28:0/3002452866 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2eb0013910 con 0x560f92e51a60 2026-02-24T09:18:05.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.246+0000 7f2e81bfe640 1 -- 10.20.193.28:0/3002452866 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2eb00129c0 con 0x560f92e51a60 2026-02-24T09:18:05.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.246+0000 7f2ea2ffd640 1 -- 10.20.193.28:0/2334339976 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 22) ==== 157304+0+0 (secure 0 0 0) 0x7f2ea40386a0 con 0x7f2eb4063070 2026-02-24T09:18:05.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.246+0000 7f2ebe3f1e00 1 -- 10.20.193.28:0/3002452866 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560f92e51a60 msgr2=0x560f92f33200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:05.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.246+0000 7f2ebe3f1e00 1 --2- 10.20.193.28:0/3002452866 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560f92e51a60 0x560f92f33200 secure :-1 s=READY pgs=112 gs=1 cs=0 l=1 c_cookie=10282173115478847806 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2eb0005680 tx=0x7f2eb000ab90 comp rx=0 tx=0).stop 2026-02-24T09:18:05.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.247+0000 7f2ebe3f1e00 1 -- 10.20.193.28:0/3002452866 shutdown_connections 2026-02-24T09:18:05.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.247+0000 7f2ebe3f1e00 1 --2- 10.20.193.28:0/3002452866 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560f92f78270 0x560f92f98650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:05.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.247+0000 7f2ebe3f1e00 1 --2- 10.20.193.28:0/3002452866 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f92f33740 0x560f92f33b90 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:05.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.247+0000 7f2ebe3f1e00 1 --2- 10.20.193.28:0/3002452866 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560f92e51a60 0x560f92f33200 unknown :-1 s=CLOSED pgs=112 gs=1 cs=0 l=1 c_cookie=10282173115478847806 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:05.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.247+0000 7f2ebe3f1e00 1 -- 10.20.193.28:0/3002452866 >> 10.20.193.28:0/3002452866 conn(0x560f92ecd490 msgr2=0x560f92f31ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:05.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.247+0000 7f2ebe3f1e00 1 -- 10.20.193.28:0/3002452866 shutdown_connections 2026-02-24T09:18:05.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.247+0000 7f2ebe3f1e00 1 -- 10.20.193.28:0/3002452866 wait complete. 2026-02-24T09:18:05.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.248+0000 7f2ea2ffd640 1 --2- 10.20.193.28:0/2334339976 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f2e900b58c0 0x7f2e900d5d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:05.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.248+0000 7f2eba37d640 1 --2- 10.20.193.28:0/2334339976 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f2e900b58c0 0x7f2e900d5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:05.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.248+0000 7f2ea2ffd640 1 -- 10.20.193.28:0/2334339976 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8440+0+0 (secure 0 0 0) 0x7f2ea410b540 con 0x7f2eb4063070 2026-02-24T09:18:05.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.248+0000 7f2ebe3f1e00 1 -- start start 2026-02-24T09:18:05.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.249+0000 7f2ebe3f1e00 1 Processor -- start 2026-02-24T09:18:05.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.249+0000 7f2eba37d640 1 --2- 10.20.193.28:0/2334339976 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f2e900b58c0 0x7f2e900d5d70 secure :-1 s=READY pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2eb00034b0 tx=0x7f2eb000af90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:05.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.249+0000 7f2ebe3f1e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560f92e51a60 0x560f92f8f850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:05.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.249+0000 7f2ebe3f1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f92f33740 0x560f92f8fd90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:05.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.249+0000 7f2ebe3f1e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560f92f78270 0x560f92f91b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:05.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.249+0000 7f2ebe3f1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560f92f92090 con 0x560f92f33740 2026-02-24T09:18:05.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.249+0000 7f2ebe3f1e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x560f92f92200 con 0x560f92e51a60 2026-02-24T09:18:05.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.249+0000 7f2ebe3f1e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x560f92f923c0 con 0x560f92f78270 2026-02-24T09:18:05.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.249+0000 7f2eb937b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f92f33740 0x560f92f8fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:05.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.249+0000 7f2eb937b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f92f33740 0x560f92f8fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46966/0 (socket says 10.20.193.28:46966) 2026-02-24T09:18:05.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.249+0000 7f2eb937b640 1 -- 10.20.193.28:0/4032270738 learned_addr learned my addr 10.20.193.28:0/4032270738 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:18:05.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.249+0000 7f2eba37d640 1 --2- 10.20.193.28:0/4032270738 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560f92f78270 0x560f92f91b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:05.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.249+0000 7f2eb9b7c640 1 --2- 10.20.193.28:0/4032270738 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560f92e51a60 0x560f92f8f850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:05.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.251+0000 7f2eb937b640 1 -- 10.20.193.28:0/4032270738 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560f92f78270 msgr2=0x560f92f91b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:05.256 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.251+0000 7f2eb937b640 1 --2- 10.20.193.28:0/4032270738 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560f92f78270 0x560f92f91b20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:05.257 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.251+0000 7f2eb937b640 1 -- 10.20.193.28:0/4032270738 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560f92e51a60 msgr2=0x560f92f8f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:05.257 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.251+0000 7f2eb937b640 1 --2- 10.20.193.28:0/4032270738 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560f92e51a60 0x560f92f8f850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:05.257 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.251+0000 7f2eb937b640 1 -- 10.20.193.28:0/4032270738 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f92dc2ce0 con 0x560f92f33740 2026-02-24T09:18:05.257 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.251+0000 7f2eb9b7c640 1 --2- 10.20.193.28:0/4032270738 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560f92e51a60 0x560f92f8f850 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:18:05.257 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.251+0000 7f2eb937b640 1 --2- 10.20.193.28:0/4032270738 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f92f33740 0x560f92f8fd90 secure :-1 s=READY pgs=393 gs=3 cs=0 l=1 c_cookie=11527977953736347931 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ea8002c50 tx=0x7f2ea8009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ffb9adefefd511b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:05.257 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.251+0000 7f2e6affd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:18:05.257 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.251+0000 7f2e6affd640 1 -- 10.20.193.28:0/4032270738 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2ea8004850 con 0x560f92f33740 2026-02-24T09:18:05.257 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.251+0000 7f2e6affd640 1 -- 10.20.193.28:0/4032270738 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2ea8004e70 con 0x560f92f33740 2026-02-24T09:18:05.257 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.251+0000 7f2ebe3f1e00 1 -- 10.20.193.28:0/4032270738 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eb00052f0 con 0x560f92f33740 2026-02-24T09:18:05.257 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.251+0000 7f2e6affd640 1 -- 10.20.193.28:0/4032270738 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2ea8010a80 con 0x560f92f33740 2026-02-24T09:18:05.257 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.251+0000 7f2e6affd640 1 -- 10.20.193.28:0/4032270738 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 8440+0+0 (secure 0 0 0) 0x7f2ea8010c10 con 0x560f92f33740 2026-02-24T09:18:05.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.251+0000 7f2e6affd640 10 client.15561 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-24T09:18:05.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.251+0000 7f2ebe3f1e00 10 client.15561 _ll_register_callbacks cb 0x560f92dc9980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:05.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.251+0000 7f2ebe3f1e00 1 -- 10.20.193.28:0/4032270738 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560f92ade520 con 0x560f92f33740 2026-02-24T09:18:05.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.251+0000 7f2e6affd640 1 -- 10.20.193.28:0/4032270738 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f2ea8010e10 con 0x560f92f33740 2026-02-24T09:18:05.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.252+0000 7f2ebe3f1e00 10 client.15561 fetch_fsmap learned FSMap version 23 2026-02-24T09:18:05.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.252+0000 7f2ebe3f1e00 1 -- 10.20.193.28:0/4032270738 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x560f92dd45b0 con 0x560f92f33740 2026-02-24T09:18:05.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.252+0000 7f2e6affd640 1 -- 10.20.193.28:0/4032270738 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f2ea80049b0 con 0x560f92f33740 2026-02-24T09:18:05.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.252+0000 7f2ebe3f1e00 10 client.15561 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:18:05.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.252+0000 7f2ebe3f1e00 10 client.15561 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:18:05.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.252+0000 7f2ebe3f1e00 20 client.15561 populate_metadata read hostname 'trial028' 2026-02-24T09:18:05.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.252+0000 7f2ebe3f1e00 1 --2- 10.20.193.28:0/4032270738 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x560f92f757d0 0x560f92f75c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:05.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.252+0000 7f2ebe3f1e00 4 client.15561 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:18:05.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.252+0000 7f2ebe3f1e00 1 -- 10.20.193.28:0/4032270738 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f92e109d0 con 0x560f92f757d0 2026-02-24T09:18:05.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.252+0000 7f2eb9b7c640 1 --2- 10.20.193.28:0/4032270738 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x560f92f757d0 0x560f92f75c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:05.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.253+0000 7f2eb9b7c640 1 --2- 10.20.193.28:0/4032270738 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x560f92f757d0 0x560f92f75c70 crc :-1 s=READY pgs=26 gs=4 cs=0 l=0 c_cookie=4338512525349204127 s_cookie=11140663877411475385 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c357e27c705b09f server_cookie=9a9b96c54f230fb9 in_seq=0 out_seq=0 2026-02-24T09:18:05.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.253+0000 7f2e6affd640 10 client.15561 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:18:05.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.253+0000 7f2e6affd640 1 -- 10.20.193.28:0/4032270738 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x560f92e109d0 con 0x560f92f757d0 2026-02-24T09:18:05.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.253+0000 7f2e6affd640 10 client.15561 handle_command_reply: tid=0 2026-02-24T09:18:05.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.254+0000 7f2ebe3f1e00 1 client.15561 shutdown 2026-02-24T09:18:05.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.254+0000 7f2ebe3f1e00 1 -- 10.20.193.28:0/4032270738 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f92f33740 msgr2=0x560f92f8fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:05.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.254+0000 7f2ebe3f1e00 1 --2- 10.20.193.28:0/4032270738 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f92f33740 0x560f92f8fd90 secure :-1 s=READY pgs=393 gs=3 cs=0 l=1 c_cookie=11527977953736347931 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ea8002c50 tx=0x7f2ea8009920 comp rx=0 tx=0).stop 2026-02-24T09:18:05.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.254+0000 7f2ebe3f1e00 1 -- 10.20.193.28:0/4032270738 shutdown_connections 2026-02-24T09:18:05.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.254+0000 7f2ebe3f1e00 1 --2- 10.20.193.28:0/4032270738 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x560f92f757d0 0x560f92f75c70 crc :-1 s=READY pgs=26 gs=4 cs=0 l=0 c_cookie=4338512525349204127 s_cookie=11140663877411475385 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:05.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.254+0000 7f2ebe3f1e00 1 --2- 10.20.193.28:0/4032270738 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560f92f78270 0x560f92f91b20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:05.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.254+0000 7f2ebe3f1e00 1 --2- 10.20.193.28:0/4032270738 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f92f33740 0x560f92f8fd90 unknown :-1 s=CLOSED pgs=393 gs=3 cs=0 l=1 c_cookie=11527977953736347931 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:05.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.254+0000 7f2ebe3f1e00 1 --2- 10.20.193.28:0/4032270738 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560f92e51a60 0x560f92f8f850 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:05.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.254+0000 7f2e6affd640 0 client.15561 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:18:05.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.254+0000 7f2ebe3f1e00 1 -- 10.20.193.28:0/4032270738 >> 10.20.193.28:0/4032270738 conn(0x560f92ecd490 msgr2=0x560f92f312f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:05.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.254+0000 7f2ebe3f1e00 1 -- 10.20.193.28:0/4032270738 shutdown_connections 2026-02-24T09:18:05.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.254+0000 7f2ebe3f1e00 1 -- 10.20.193.28:0/4032270738 wait complete. 2026-02-24T09:18:05.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.254+0000 7f2ebe3f1e00 20 client.15561 trim_cache size 0 max 16384 2026-02-24T09:18:05.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.262+0000 7f2ebe3f1e00 1 Processor -- start 2026-02-24T09:18:05.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.262+0000 7f2ebe3f1e00 1 -- start start 2026-02-24T09:18:05.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.262+0000 7f2ebe3f1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f92e51a60 0x560f92f91ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:05.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.262+0000 7f2ebe3f1e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560f92f33740 0x560f92f92fe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:05.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.262+0000 7f2ebe3f1e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560f92f78270 0x560f92f93520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:05.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.263+0000 7f2eb9b7c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f92e51a60 0x560f92f91ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:05.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.263+0000 7f2eba37d640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560f92f78270 0x560f92f93520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:05.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.263+0000 7f2eb9b7c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f92e51a60 0x560f92f91ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46980/0 (socket says 10.20.193.28:46980) 2026-02-24T09:18:05.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.263+0000 7f2eb9b7c640 1 -- 10.20.193.28:0/256091376 learned_addr learned my addr 10.20.193.28:0/256091376 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:18:05.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.263+0000 7f2ebe3f1e00 1 -- 10.20.193.28:0/256091376 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560f92e3c9d0 con 0x560f92e51a60 2026-02-24T09:18:05.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.263+0000 7f2ebe3f1e00 1 -- 10.20.193.28:0/256091376 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x560f92b7df10 con 0x560f92f78270 2026-02-24T09:18:05.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.263+0000 7f2ebe3f1e00 1 -- 10.20.193.28:0/256091376 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x560f92ebb200 con 0x560f92f33740 2026-02-24T09:18:05.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.263+0000 7f2eb937b640 1 --2- 10.20.193.28:0/256091376 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560f92f33740 0x560f92f92fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:05.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.263+0000 7f2eb9b7c640 1 -- 10.20.193.28:0/256091376 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560f92f33740 msgr2=0x560f92f92fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:05.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.263+0000 7f2eb9b7c640 1 --2- 10.20.193.28:0/256091376 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560f92f33740 0x560f92f92fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:05.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.263+0000 7f2eb9b7c640 1 -- 10.20.193.28:0/256091376 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560f92f78270 msgr2=0x560f92f93520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:05.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.263+0000 7f2eb9b7c640 1 --2- 10.20.193.28:0/256091376 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560f92f78270 0x560f92f93520 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:05.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.263+0000 7f2eb9b7c640 1 -- 10.20.193.28:0/256091376 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f92dcf030 con 0x560f92e51a60 2026-02-24T09:18:05.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.263+0000 7f2eb9b7c640 1 --2- 10.20.193.28:0/256091376 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f92e51a60 0x560f92f91ab0 secure :-1 s=READY pgs=394 gs=1 cs=0 l=1 c_cookie=16721666204698711355 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ea4108de0 tx=0x7f2ea402f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80f4ad167b8953b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:05.268 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.264+0000 7f2e813fd640 1 -- 10.20.193.28:0/256091376 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2ea4009310 con 0x560f92e51a60 2026-02-24T09:18:05.268 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.264+0000 7f2e813fd640 1 -- 10.20.193.28:0/256091376 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2ea40d1f40 con 0x560f92e51a60 2026-02-24T09:18:05.268 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.264+0000 7f2e813fd640 1 -- 10.20.193.28:0/256091376 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2ea40d3400 con 0x560f92e51a60 2026-02-24T09:18:05.268 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.264+0000 7f2ebe3f1e00 1 -- 10.20.193.28:0/256091376 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f92e51a60 msgr2=0x560f92f91ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:05.268 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.264+0000 7f2ebe3f1e00 1 --2- 10.20.193.28:0/256091376 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f92e51a60 0x560f92f91ab0 secure :-1 s=READY pgs=394 gs=1 cs=0 l=1 c_cookie=16721666204698711355 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ea4108de0 tx=0x7f2ea402f190 comp rx=0 tx=0).stop 2026-02-24T09:18:05.268 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.264+0000 7f2ebe3f1e00 1 -- 10.20.193.28:0/256091376 shutdown_connections 2026-02-24T09:18:05.268 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.264+0000 7f2ebe3f1e00 1 --2- 10.20.193.28:0/256091376 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560f92f78270 0x560f92f93520 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:05.268 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.264+0000 7f2ebe3f1e00 1 --2- 10.20.193.28:0/256091376 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560f92f33740 0x560f92f92fe0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:05.268 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.264+0000 7f2ebe3f1e00 1 --2- 10.20.193.28:0/256091376 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f92e51a60 0x560f92f91ab0 unknown :-1 s=CLOSED pgs=394 gs=1 cs=0 l=1 c_cookie=16721666204698711355 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:05.268 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.264+0000 7f2ebe3f1e00 1 -- 10.20.193.28:0/256091376 >> 10.20.193.28:0/256091376 conn(0x560f92ecd490 msgr2=0x560f92f928d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:05.268 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.264+0000 7f2ebe3f1e00 1 -- 10.20.193.28:0/256091376 shutdown_connections 2026-02-24T09:18:05.268 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.264+0000 7f2ebe3f1e00 1 -- 10.20.193.28:0/256091376 wait complete. 2026-02-24T09:18:05.271 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.265+0000 7f2ebe3f1e00 1 -- start start 2026-02-24T09:18:05.271 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.265+0000 7f2ebe3f1e00 1 Processor -- start 2026-02-24T09:18:05.271 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.265+0000 7f2ebe3f1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f92e51a60 0x560f92faa530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:05.271 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.265+0000 7f2ebe3f1e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560f92f33740 0x560f92faaa70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:05.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.265+0000 7f2ebe3f1e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560f92f78270 0x560f92faafb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:05.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.265+0000 7f2ebe3f1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560f92faf580 con 0x560f92e51a60 2026-02-24T09:18:05.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.265+0000 7f2ebe3f1e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x560f92faf6f0 con 0x560f92f78270 2026-02-24T09:18:05.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.265+0000 7f2ebe3f1e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x560f92faf8b0 con 0x560f92f33740 2026-02-24T09:18:05.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.265+0000 7f2eb9b7c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f92e51a60 0x560f92faa530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:05.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.265+0000 7f2eb937b640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560f92f33740 0x560f92faaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:05.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.265+0000 7f2eb9b7c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f92e51a60 0x560f92faa530 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46994/0 (socket says 10.20.193.28:46994) 2026-02-24T09:18:05.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.265+0000 7f2eb9b7c640 1 -- 10.20.193.28:0/2352299671 learned_addr learned my addr 10.20.193.28:0/2352299671 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:18:05.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.265+0000 7f2eba37d640 1 --2- 10.20.193.28:0/2352299671 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560f92f78270 0x560f92faafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:05.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.266+0000 7f2eb9b7c640 1 -- 10.20.193.28:0/2352299671 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560f92f33740 msgr2=0x560f92faaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:05.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.266+0000 7f2eb9b7c640 1 --2- 10.20.193.28:0/2352299671 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560f92f33740 0x560f92faaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:05.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.266+0000 7f2eb9b7c640 1 -- 10.20.193.28:0/2352299671 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560f92f78270 msgr2=0x560f92faafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:05.273 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.266+0000 7f2eb9b7c640 1 --2- 10.20.193.28:0/2352299671 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560f92f78270 0x560f92faafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:05.273 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.266+0000 7f2eb9b7c640 1 -- 10.20.193.28:0/2352299671 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f92dc3010 con 0x560f92e51a60 2026-02-24T09:18:05.273 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.266+0000 7f2eb937b640 1 --2- 10.20.193.28:0/2352299671 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560f92f33740 0x560f92faaa70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:18:05.273 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.266+0000 7f2eb9b7c640 1 --2- 10.20.193.28:0/2352299671 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f92e51a60 0x560f92faa530 secure :-1 s=READY pgs=395 gs=2 cs=0 l=1 c_cookie=14521667525989832247 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ea4004030 tx=0x7f2ea4109120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c98753ad00f31637 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:05.273 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.266+0000 7f2e6affd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:18:05.273 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.266+0000 7f2e6affd640 1 -- 10.20.193.28:0/2352299671 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2ea40d3620 con 0x560f92e51a60 2026-02-24T09:18:05.273 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.266+0000 7f2e6affd640 1 -- 10.20.193.28:0/2352299671 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2ea40d9840 con 0x560f92e51a60 2026-02-24T09:18:05.273 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.266+0000 7f2ebe3f1e00 1 -- 10.20.193.28:0/2352299671 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eb4169da0 con 0x560f92e51a60 2026-02-24T09:18:05.273 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.266+0000 7f2e6affd640 1 -- 10.20.193.28:0/2352299671 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2ea4038c00 con 0x560f92e51a60 2026-02-24T09:18:05.273 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.266+0000 7f2ebe3f1e00 10 client.15567 _ll_register_callbacks cb 0x560f92dc9980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:05.273 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.266+0000 7f2ebe3f1e00 1 -- 10.20.193.28:0/2352299671 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560f92e6fd30 con 0x560f92e51a60 2026-02-24T09:18:05.273 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.266+0000 7f2e6affd640 1 -- 10.20.193.28:0/2352299671 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 8440+0+0 (secure 0 0 0) 0x7f2ea40d10e0 con 0x560f92e51a60 2026-02-24T09:18:05.274 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.266+0000 7f2e6affd640 1 -- 10.20.193.28:0/2352299671 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f2ea40d12c0 con 0x560f92e51a60 2026-02-24T09:18:05.274 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.266+0000 7f2ebe3f1e00 10 client.15567 fetch_fsmap learned FSMap version 23 2026-02-24T09:18:05.274 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.266+0000 7f2ebe3f1e00 1 -- 10.20.193.28:0/2352299671 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x560f92dd4810 con 0x560f92e51a60 2026-02-24T09:18:05.274 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.267+0000 7f2e6affd640 1 -- 10.20.193.28:0/2352299671 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f2ea40d21d0 con 0x560f92e51a60 2026-02-24T09:18:05.274 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.267+0000 7f2ebe3f1e00 10 client.15567 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:18:05.274 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.267+0000 7f2ebe3f1e00 10 client.15567 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:18:05.274 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.267+0000 7f2ebe3f1e00 20 client.15567 populate_metadata read hostname 'trial028' 2026-02-24T09:18:05.274 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.267+0000 7f2ebe3f1e00 1 --2- 10.20.193.28:0/2352299671 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x560f92fc94a0 0x560f92fc9910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:05.274 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.267+0000 7f2ebe3f1e00 4 client.15567 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-24T09:18:05.274 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.267+0000 7f2ebe3f1e00 1 -- 10.20.193.28:0/2352299671 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560f92b22640 con 0x560f92fc94a0 2026-02-24T09:18:05.274 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.267+0000 7f2eb937b640 1 --2- 10.20.193.28:0/2352299671 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x560f92fc94a0 0x560f92fc9910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:05.274 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.267+0000 7f2eb937b640 1 --2- 10.20.193.28:0/2352299671 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x560f92fc94a0 0x560f92fc9910 crc :-1 s=READY pgs=27 gs=4 cs=0 l=0 c_cookie=9848248383638930816 s_cookie=5666643657507911063 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88ac01ba069d0580 server_cookie=4ea3f662227ab597 in_seq=0 out_seq=0 2026-02-24T09:18:05.275 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.267+0000 7f2e6affd640 10 client.15567 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:18:05.276 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.271+0000 7f2e6affd640 1 -- 10.20.193.28:0/2352299671 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560f92b22640 con 0x560f92fc94a0 2026-02-24T09:18:05.276 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.271+0000 7f2e6affd640 10 client.15567 handle_command_reply: tid=0 2026-02-24T09:18:05.276 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.271+0000 7f2ebe3f1e00 1 client.15567 shutdown 2026-02-24T09:18:05.276 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.271+0000 7f2ebe3f1e00 1 -- 10.20.193.28:0/2352299671 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f92e51a60 msgr2=0x560f92faa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:05.276 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.271+0000 7f2ebe3f1e00 1 --2- 10.20.193.28:0/2352299671 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f92e51a60 0x560f92faa530 secure :-1 s=READY pgs=395 gs=2 cs=0 l=1 c_cookie=14521667525989832247 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ea4004030 tx=0x7f2ea4109120 comp rx=0 tx=0).stop 2026-02-24T09:18:05.276 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.272+0000 7f2ebe3f1e00 1 -- 10.20.193.28:0/2352299671 shutdown_connections 2026-02-24T09:18:05.276 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.272+0000 7f2ebe3f1e00 1 --2- 10.20.193.28:0/2352299671 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x560f92fc94a0 0x560f92fc9910 crc :-1 s=READY pgs=27 gs=4 cs=0 l=0 c_cookie=9848248383638930816 s_cookie=5666643657507911063 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:05.277 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.272+0000 7f2ebe3f1e00 1 --2- 10.20.193.28:0/2352299671 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560f92f78270 0x560f92faafb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:05.277 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.272+0000 7f2ebe3f1e00 1 --2- 10.20.193.28:0/2352299671 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560f92f33740 0x560f92faaa70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:05.277 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.272+0000 7f2e6affd640 0 client.15567 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:18:05.277 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.272+0000 7f2ebe3f1e00 1 --2- 10.20.193.28:0/2352299671 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f92e51a60 0x560f92faa530 unknown :-1 s=CLOSED pgs=395 gs=2 cs=0 l=1 c_cookie=14521667525989832247 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:05.277 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.272+0000 7f2ebe3f1e00 1 -- 10.20.193.28:0/2352299671 >> 10.20.193.28:0/2352299671 conn(0x560f92ecd490 msgr2=0x560f92f95410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:05.277 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.272+0000 7f2ebe3f1e00 1 -- 10.20.193.28:0/2352299671 shutdown_connections 2026-02-24T09:18:05.277 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.272+0000 7f2ebe3f1e00 1 -- 10.20.193.28:0/2352299671 wait complete. 2026-02-24T09:18:05.277 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.272+0000 7f2ebe3f1e00 20 client.15567 trim_cache size 0 max 16384 2026-02-24T09:18:05.277 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-24T09:18:05.278 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-24T09:18:05.278 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-24T09:18:05.278 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-24T09:18:05.279 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.272+0000 7f2ebab7e640 1 -- 10.20.193.28:0/2334339976 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f2e900b58c0 msgr2=0x7f2e900d5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:05.279 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.272+0000 7f2ebab7e640 1 --2- 10.20.193.28:0/2334339976 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f2e900b58c0 0x7f2e900d5d70 secure :-1 s=READY pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2eb00034b0 tx=0x7f2eb000af90 comp rx=0 tx=0).stop 2026-02-24T09:18:05.279 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.272+0000 7f2ebab7e640 1 -- 10.20.193.28:0/2334339976 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2eb4063070 msgr2=0x7f2eb4163630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:05.279 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.272+0000 7f2ebab7e640 1 --2- 10.20.193.28:0/2334339976 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2eb4063070 0x7f2eb4163630 secure :-1 s=READY pgs=392 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ea40098a0 tx=0x7f2ea40028d0 comp rx=0 tx=0).stop 2026-02-24T09:18:05.279 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.273+0000 7f2ebab7e640 1 -- 10.20.193.28:0/2334339976 shutdown_connections 2026-02-24T09:18:05.279 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.273+0000 7f2ebab7e640 1 --2- 10.20.193.28:0/2334339976 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f2e900b58c0 0x7f2e900d5d70 unknown :-1 s=CLOSED pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:05.279 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.273+0000 7f2ebab7e640 1 --2- 10.20.193.28:0/2334339976 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f2eb4159bd0 0x7f2eb4168f40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:05.279 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.273+0000 7f2ebab7e640 1 --2- 10.20.193.28:0/2334339976 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f2eb4066a30 0x7f2eb4163b70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:05.279 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.273+0000 7f2ebab7e640 1 --2- 10.20.193.28:0/2334339976 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2eb4063070 0x7f2eb4163630 unknown :-1 s=CLOSED pgs=392 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:05.279 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.273+0000 7f2ebab7e640 1 -- 10.20.193.28:0/2334339976 >> 10.20.193.28:0/2334339976 conn(0x7f2eb40ecc70 msgr2=0x7f2eb410d050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:05.279 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.273+0000 7f2ebab7e640 1 -- 10.20.193.28:0/2334339976 shutdown_connections 2026-02-24T09:18:05.280 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:05.273+0000 7f2ebab7e640 1 -- 10.20.193.28:0/2334339976 wait complete. 2026-02-24T09:18:06.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:06 trial159 ceph-mon[44242]: pgmap v215: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 22 op/s 2026-02-24T09:18:06.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:06 trial028 ceph-mon[40371]: pgmap v215: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 22 op/s 2026-02-24T09:18:06.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:06 trial074 ceph-mon[44412]: pgmap v215: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 22 op/s 2026-02-24T09:18:08.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:08 trial028 ceph-mon[40371]: pgmap v216: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2026-02-24T09:18:08.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:08 trial074 ceph-mon[44412]: pgmap v216: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2026-02-24T09:18:09.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:08 trial159 ceph-mon[44242]: pgmap v216: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2026-02-24T09:18:09.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:09 trial028 ceph-mon[40371]: pgmap v217: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2026-02-24T09:18:09.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:09 trial074 ceph-mon[44412]: pgmap v217: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2026-02-24T09:18:10.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:09 trial159 ceph-mon[44242]: pgmap v217: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2026-02-24T09:18:12.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:12 trial028 ceph-mon[40371]: pgmap v218: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2026-02-24T09:18:12.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:12 trial074 ceph-mon[44412]: pgmap v218: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2026-02-24T09:18:12.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:12 trial159 ceph-mon[44242]: pgmap v218: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2026-02-24T09:18:13.927 INFO:tasks.workunit.client.0.trial028.stderr:Note: switching to '5bc9a1ffc19df681248ece8c3c8c7191a571745b'. 2026-02-24T09:18:13.928 INFO:tasks.workunit.client.0.trial028.stderr: 2026-02-24T09:18:13.928 INFO:tasks.workunit.client.0.trial028.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-24T09:18:13.928 INFO:tasks.workunit.client.0.trial028.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-24T09:18:13.928 INFO:tasks.workunit.client.0.trial028.stderr:state without impacting any branches by switching back to a branch. 2026-02-24T09:18:13.928 INFO:tasks.workunit.client.0.trial028.stderr: 2026-02-24T09:18:13.928 INFO:tasks.workunit.client.0.trial028.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-24T09:18:13.929 INFO:tasks.workunit.client.0.trial028.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-24T09:18:13.929 INFO:tasks.workunit.client.0.trial028.stderr: 2026-02-24T09:18:13.929 INFO:tasks.workunit.client.0.trial028.stderr: git switch -c 2026-02-24T09:18:13.929 INFO:tasks.workunit.client.0.trial028.stderr: 2026-02-24T09:18:13.929 INFO:tasks.workunit.client.0.trial028.stderr:Or undo this operation with: 2026-02-24T09:18:13.929 INFO:tasks.workunit.client.0.trial028.stderr: 2026-02-24T09:18:13.929 INFO:tasks.workunit.client.0.trial028.stderr: git switch - 2026-02-24T09:18:13.929 INFO:tasks.workunit.client.0.trial028.stderr: 2026-02-24T09:18:13.929 INFO:tasks.workunit.client.0.trial028.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-24T09:18:13.929 INFO:tasks.workunit.client.0.trial028.stderr: 2026-02-24T09:18:13.929 INFO:tasks.workunit.client.0.trial028.stderr:HEAD is now at 5bc9a1ffc19 Merge PR #62351 into wip-vshankar-testing-20260223.155722 2026-02-24T09:18:13.947 DEBUG:teuthology.orchestra.run.trial028:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-24T09:18:13.991 INFO:tasks.workunit.client.0.trial028.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-24T09:18:13.995 INFO:tasks.workunit.client.0.trial028.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-24T09:18:13.996 INFO:tasks.workunit.client.0.trial028.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-24T09:18:14.149 INFO:tasks.workunit.client.0.trial028.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-24T09:18:14.209 INFO:tasks.workunit.client.0.trial028.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-24T09:18:14.262 INFO:tasks.workunit.client.0.trial028.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-24T09:18:14.266 INFO:tasks.workunit.client.0.trial028.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-24T09:18:14.266 INFO:tasks.workunit.client.0.trial028.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-24T09:18:14.316 INFO:tasks.workunit.client.0.trial028.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-24T09:18:14.323 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-24T09:18:14.324 DEBUG:teuthology.orchestra.run.trial028:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-24T09:18:14.403 INFO:tasks.workunit:Running workunits matching suites/iozone.sh on client.0... 2026-02-24T09:18:14.406 INFO:tasks.workunit:Running workunit suites/iozone.sh... 2026-02-24T09:18:14.406 DEBUG:teuthology.orchestra.run.trial028:workunit test suites/iozone.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5bc9a1ffc19df681248ece8c3c8c7191a571745b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh 2026-02-24T09:18:14.504 INFO:tasks.workunit.client.0.trial028.stderr:+ iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2026-02-24T09:18:14.540 INFO:tasks.workunit.client.0.trial028.stdout: Iozone: Performance Test of File I/O 2026-02-24T09:18:14.541 INFO:tasks.workunit.client.0.trial028.stdout: Version $Revision: 3.494 $ 2026-02-24T09:18:14.541 INFO:tasks.workunit.client.0.trial028.stdout: Compiled for 64 bit mode. 2026-02-24T09:18:14.541 INFO:tasks.workunit.client.0.trial028.stdout: Build: linux-AMD64 2026-02-24T09:18:14.541 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-24T09:18:14.541 INFO:tasks.workunit.client.0.trial028.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2026-02-24T09:18:14.541 INFO:tasks.workunit.client.0.trial028.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2026-02-24T09:18:14.541 INFO:tasks.workunit.client.0.trial028.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2026-02-24T09:18:14.541 INFO:tasks.workunit.client.0.trial028.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2026-02-24T09:18:14.542 INFO:tasks.workunit.client.0.trial028.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2026-02-24T09:18:14.542 INFO:tasks.workunit.client.0.trial028.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2026-02-24T09:18:14.542 INFO:tasks.workunit.client.0.trial028.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2026-02-24T09:18:14.542 INFO:tasks.workunit.client.0.trial028.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2026-02-24T09:18:14.542 INFO:tasks.workunit.client.0.trial028.stdout: Alexey Skidanov, Sudhir Kumar. 2026-02-24T09:18:14.542 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-24T09:18:14.542 INFO:tasks.workunit.client.0.trial028.stdout: Run began: Tue Feb 24 09:18:14 2026 2026-02-24T09:18:14.542 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-24T09:18:14.542 INFO:tasks.workunit.client.0.trial028.stdout: Include close in write timing 2026-02-24T09:18:14.542 INFO:tasks.workunit.client.0.trial028.stdout: Include fsync in write timing 2026-02-24T09:18:14.542 INFO:tasks.workunit.client.0.trial028.stdout: File size set to 1048576 kB 2026-02-24T09:18:14.542 INFO:tasks.workunit.client.0.trial028.stdout: Record Size 16 kB 2026-02-24T09:18:14.543 INFO:tasks.workunit.client.0.trial028.stdout: Command line used: iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2026-02-24T09:18:14.543 INFO:tasks.workunit.client.0.trial028.stdout: Output is in kBytes/sec 2026-02-24T09:18:14.543 INFO:tasks.workunit.client.0.trial028.stdout: Time Resolution = 0.000001 seconds. 2026-02-24T09:18:14.543 INFO:tasks.workunit.client.0.trial028.stdout: Processor cache size set to 1024 kBytes. 2026-02-24T09:18:14.543 INFO:tasks.workunit.client.0.trial028.stdout: Processor cache line size set to 32 bytes. 2026-02-24T09:18:14.543 INFO:tasks.workunit.client.0.trial028.stdout: File stride size set to 17 * record size. 2026-02-24T09:18:14.543 INFO:tasks.workunit.client.0.trial028.stdout: Throughput test with 1 process 2026-02-24T09:18:14.544 INFO:tasks.workunit.client.0.trial028.stdout: Each process writes a 1048576 kByte file in 16 kByte records 2026-02-24T09:18:14.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:14 trial028 ceph-mon[40371]: pgmap v219: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2026-02-24T09:18:14.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:14 trial074 ceph-mon[44412]: pgmap v219: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2026-02-24T09:18:14.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:14 trial159 ceph-mon[44242]: pgmap v219: 97 pgs: 97 active+clean; 1.4 MiB data, 331 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2026-02-24T09:18:16.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:16 trial028 ceph-mon[40371]: pgmap v220: 97 pgs: 97 active+clean; 1.4 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2026-02-24T09:18:16.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:16 trial074 ceph-mon[44412]: pgmap v220: 97 pgs: 97 active+clean; 1.4 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2026-02-24T09:18:16.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:16 trial159 ceph-mon[44242]: pgmap v220: 97 pgs: 97 active+clean; 1.4 MiB data, 335 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2026-02-24T09:18:18.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.347+0000 7efc25643640 1 -- 10.20.193.28:0/3831059219 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efc200607e0 msgr2=0x7efc20060bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:18.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.347+0000 7efc25643640 1 --2- 10.20.193.28:0/3831059219 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efc200607e0 0x7efc20060bb0 secure :-1 s=READY pgs=396 gs=1 cs=0 l=1 c_cookie=9162907087111543532 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc0c009950 tx=0x7efc0c02f190 comp rx=0 tx=0).stop 2026-02-24T09:18:18.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.347+0000 7efc25643640 1 -- 10.20.193.28:0/3831059219 shutdown_connections 2026-02-24T09:18:18.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.347+0000 7efc25643640 1 --2- 10.20.193.28:0/3831059219 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7efc201558f0 0x7efc20175cd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:18.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.347+0000 7efc25643640 1 --2- 10.20.193.28:0/3831059219 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7efc200610f0 0x7efc201553b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:18.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.347+0000 7efc25643640 1 --2- 10.20.193.28:0/3831059219 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efc200607e0 0x7efc20060bb0 unknown :-1 s=CLOSED pgs=396 gs=1 cs=0 l=1 c_cookie=9162907087111543532 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:18.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.347+0000 7efc25643640 1 -- 10.20.193.28:0/3831059219 >> 10.20.193.28:0/3831059219 conn(0x7efc200eaa80 msgr2=0x7efc2010ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:18.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.347+0000 7efc25643640 1 -- 10.20.193.28:0/3831059219 shutdown_connections 2026-02-24T09:18:18.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.347+0000 7efc25643640 1 -- 10.20.193.28:0/3831059219 wait complete. 2026-02-24T09:18:18.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.348+0000 7efc25643640 1 Processor -- start 2026-02-24T09:18:18.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.348+0000 7efc25643640 1 -- start start 2026-02-24T09:18:18.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.348+0000 7efc25643640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efc200607e0 0x7efc201620e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:18.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.348+0000 7efc25643640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7efc200610f0 0x7efc20162620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:18.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.348+0000 7efc25643640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7efc201558f0 0x7efc201679f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:18.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.348+0000 7efc25643640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efc20168010 con 0x7efc200607e0 2026-02-24T09:18:18.352 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.348+0000 7efc25643640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7efc20168180 con 0x7efc200610f0 2026-02-24T09:18:18.352 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.348+0000 7efc25643640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7efc20168340 con 0x7efc201558f0 2026-02-24T09:18:18.352 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.348+0000 7efc1ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efc200607e0 0x7efc201620e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:18.352 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.348+0000 7efc1ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efc200607e0 0x7efc201620e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48118/0 (socket says 10.20.193.28:48118) 2026-02-24T09:18:18.352 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.348+0000 7efc1ffff640 1 -- 10.20.193.28:0/545313530 learned_addr learned my addr 10.20.193.28:0/545313530 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:18:18.352 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.348+0000 7efc24e42640 1 --2- 10.20.193.28:0/545313530 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7efc201558f0 0x7efc201679f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:18.352 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.348+0000 7efc1f7fe640 1 --2- 10.20.193.28:0/545313530 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7efc200610f0 0x7efc20162620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:18.352 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.349+0000 7efc1ffff640 1 -- 10.20.193.28:0/545313530 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7efc201558f0 msgr2=0x7efc201679f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:18.352 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.349+0000 7efc1ffff640 1 --2- 10.20.193.28:0/545313530 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7efc201558f0 0x7efc201679f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:18.352 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.349+0000 7efc1ffff640 1 -- 10.20.193.28:0/545313530 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7efc200610f0 msgr2=0x7efc20162620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:18.352 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.349+0000 7efc1ffff640 1 --2- 10.20.193.28:0/545313530 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7efc200610f0 0x7efc20162620 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:18.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.349+0000 7efc1ffff640 1 -- 10.20.193.28:0/545313530 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc0c009570 con 0x7efc200607e0 2026-02-24T09:18:18.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.349+0000 7efc1ffff640 1 --2- 10.20.193.28:0/545313530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efc200607e0 0x7efc201620e0 secure :-1 s=READY pgs=397 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc0c0098a0 tx=0x7efc0c0028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:18.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.349+0000 7efc1d7fa640 1 -- 10.20.193.28:0/545313530 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc0c03d070 con 0x7efc200607e0 2026-02-24T09:18:18.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.349+0000 7efc1d7fa640 1 -- 10.20.193.28:0/545313530 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7efc0c002a70 con 0x7efc200607e0 2026-02-24T09:18:18.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.349+0000 7efc1d7fa640 1 -- 10.20.193.28:0/545313530 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc0c041890 con 0x7efc200607e0 2026-02-24T09:18:18.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.349+0000 7efc25643640 1 -- 10.20.193.28:0/545313530 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc201685c0 con 0x7efc200607e0 2026-02-24T09:18:18.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.349+0000 7efc25643640 1 -- 10.20.193.28:0/545313530 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc20151370 con 0x7efc200607e0 2026-02-24T09:18:18.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.352+0000 7efc1d7fa640 1 -- 10.20.193.28:0/545313530 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 22) ==== 157304+0+0 (secure 0 0 0) 0x7efc0c041a20 con 0x7efc200607e0 2026-02-24T09:18:18.354 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.353+0000 7efc1d7fa640 1 --2- 10.20.193.28:0/545313530 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7efbf40b5960 0x7efbf40d5e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:18.354 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.354+0000 7efc1d7fa640 1 -- 10.20.193.28:0/545313530 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8440+0+0 (secure 0 0 0) 0x7efc0c10b510 con 0x7efc200607e0 2026-02-24T09:18:18.354 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.354+0000 7efc28fcae00 1 Processor -- start 2026-02-24T09:18:18.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.354+0000 7efc28fcae00 1 -- start start 2026-02-24T09:18:18.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.354+0000 7efc1f7fe640 1 --2- 10.20.193.28:0/545313530 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7efbf40b5960 0x7efbf40d5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:18.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.354+0000 7efc28fcae00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5626ea1f6a60 0x5626ea2d8200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:18.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.354+0000 7efc28fcae00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5626ea2d8740 0x5626ea2d8b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:18.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.354+0000 7efc28fcae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ea31d270 0x5626ea33d650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:18.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.354+0000 7efc28fcae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5626ea1edf10 con 0x5626ea31d270 2026-02-24T09:18:18.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.354+0000 7efc28fcae00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x5626ea1e9c40 con 0x5626ea1f6a60 2026-02-24T09:18:18.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.354+0000 7efc28fcae00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x5626ea1e3da0 con 0x5626ea2d8740 2026-02-24T09:18:18.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.354+0000 7efc1ffff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5626ea1f6a60 0x5626ea2d8200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:18.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.354+0000 7efc1ffff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5626ea1f6a60 0x5626ea2d8200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:51538/0 (socket says 10.20.193.28:51538) 2026-02-24T09:18:18.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.354+0000 7efc1ffff640 1 -- 10.20.193.28:0/1683827683 learned_addr learned my addr 10.20.193.28:0/1683827683 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:18:18.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.354+0000 7efc1f7fe640 1 --2- 10.20.193.28:0/1683827683 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5626ea2d8740 0x5626ea2d8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:18.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.354+0000 7efc24e42640 1 --2- 10.20.193.28:0/1683827683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ea31d270 0x5626ea33d650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:18.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.355+0000 7efc1f7fe640 1 --2- 10.20.193.28:0/545313530 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7efbf40b5960 0x7efbf40d5e10 secure :-1 s=READY pgs=226 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc20168a80 tx=0x7efc100107a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:18.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.355+0000 7efc1ffff640 1 -- 10.20.193.28:0/1683827683 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5626ea2d8740 msgr2=0x5626ea2d8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:18.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.355+0000 7efc1ffff640 1 --2- 10.20.193.28:0/1683827683 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5626ea2d8740 0x5626ea2d8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:18.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.355+0000 7efc1ffff640 1 -- 10.20.193.28:0/1683827683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ea31d270 msgr2=0x5626ea33d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:18.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.355+0000 7efc1ffff640 1 --2- 10.20.193.28:0/1683827683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ea31d270 0x5626ea33d650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:18.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.355+0000 7efc1ffff640 1 -- 10.20.193.28:0/1683827683 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626ea18f340 con 0x5626ea1f6a60 2026-02-24T09:18:18.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.355+0000 7efc24e42640 1 --2- 10.20.193.28:0/1683827683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ea31d270 0x5626ea33d650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:18:18.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.355+0000 7efc1ffff640 1 --2- 10.20.193.28:0/1683827683 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5626ea1f6a60 0x5626ea2d8200 secure :-1 s=READY pgs=111 gs=1 cs=0 l=1 c_cookie=12927513746546731504 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc0c0cdb90 tx=0x7efc0c004490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b367c14273e5a9f0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:18.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.355+0000 7efbf0bfe640 1 -- 10.20.193.28:0/1683827683 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc0c0d7070 con 0x5626ea1f6a60 2026-02-24T09:18:18.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.355+0000 7efbf0bfe640 1 -- 10.20.193.28:0/1683827683 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7efc0c0d0dc0 con 0x5626ea1f6a60 2026-02-24T09:18:18.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.355+0000 7efbf0bfe640 1 -- 10.20.193.28:0/1683827683 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc0c0cf5a0 con 0x5626ea1f6a60 2026-02-24T09:18:18.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.355+0000 7efc28fcae00 1 -- 10.20.193.28:0/1683827683 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5626ea1f6a60 msgr2=0x5626ea2d8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:18.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.355+0000 7efc28fcae00 1 --2- 10.20.193.28:0/1683827683 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5626ea1f6a60 0x5626ea2d8200 secure :-1 s=READY pgs=111 gs=1 cs=0 l=1 c_cookie=12927513746546731504 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc0c0cdb90 tx=0x7efc0c004490 comp rx=0 tx=0).stop 2026-02-24T09:18:18.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.355+0000 7efc28fcae00 1 -- 10.20.193.28:0/1683827683 shutdown_connections 2026-02-24T09:18:18.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.355+0000 7efc28fcae00 1 --2- 10.20.193.28:0/1683827683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ea31d270 0x5626ea33d650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:18.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.355+0000 7efc28fcae00 1 --2- 10.20.193.28:0/1683827683 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5626ea2d8740 0x5626ea2d8b90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:18.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.355+0000 7efc28fcae00 1 --2- 10.20.193.28:0/1683827683 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5626ea1f6a60 0x5626ea2d8200 unknown :-1 s=CLOSED pgs=111 gs=1 cs=0 l=1 c_cookie=12927513746546731504 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:18.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.355+0000 7efc28fcae00 1 -- 10.20.193.28:0/1683827683 >> 10.20.193.28:0/1683827683 conn(0x5626ea272490 msgr2=0x5626ea2d6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:18.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.355+0000 7efc28fcae00 1 -- 10.20.193.28:0/1683827683 shutdown_connections 2026-02-24T09:18:18.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.355+0000 7efc28fcae00 1 -- 10.20.193.28:0/1683827683 wait complete. 2026-02-24T09:18:18.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.357+0000 7efc28fcae00 1 -- start start 2026-02-24T09:18:18.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.357+0000 7efc28fcae00 1 Processor -- start 2026-02-24T09:18:18.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.357+0000 7efc28fcae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ea1f6a60 0x5626ea334800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:18.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.357+0000 7efc28fcae00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5626ea2d8740 0x5626ea334d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:18.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.357+0000 7efc28fcae00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5626ea31d270 0x5626ea339d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:18.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.357+0000 7efc28fcae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5626ea33a270 con 0x5626ea1f6a60 2026-02-24T09:18:18.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.357+0000 7efc28fcae00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x5626ea33a3e0 con 0x5626ea31d270 2026-02-24T09:18:18.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.357+0000 7efc28fcae00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x5626ea33a5a0 con 0x5626ea2d8740 2026-02-24T09:18:18.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.357+0000 7efc1ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ea1f6a60 0x5626ea334800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:18.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.357+0000 7efc1ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ea1f6a60 0x5626ea334800 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48130/0 (socket says 10.20.193.28:48130) 2026-02-24T09:18:18.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.357+0000 7efc1ffff640 1 -- 10.20.193.28:0/2386417157 learned_addr learned my addr 10.20.193.28:0/2386417157 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:18:18.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.357+0000 7efc1f7fe640 1 --2- 10.20.193.28:0/2386417157 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5626ea2d8740 0x5626ea334d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:18.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.357+0000 7efc24e42640 1 --2- 10.20.193.28:0/2386417157 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5626ea31d270 0x5626ea339d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:18.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.358+0000 7efc1ffff640 1 -- 10.20.193.28:0/2386417157 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5626ea2d8740 msgr2=0x5626ea334d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:18.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.358+0000 7efc1ffff640 1 --2- 10.20.193.28:0/2386417157 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5626ea2d8740 0x5626ea334d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:18.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.358+0000 7efc1ffff640 1 -- 10.20.193.28:0/2386417157 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5626ea31d270 msgr2=0x5626ea339d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:18.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.358+0000 7efc1ffff640 1 --2- 10.20.193.28:0/2386417157 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5626ea31d270 0x5626ea339d30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:18.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.358+0000 7efc1ffff640 1 -- 10.20.193.28:0/2386417157 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc20151370 con 0x5626ea1f6a60 2026-02-24T09:18:18.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.358+0000 7efc1ffff640 1 --2- 10.20.193.28:0/2386417157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ea1f6a60 0x5626ea334800 secure :-1 s=READY pgs=398 gs=1 cs=0 l=1 c_cookie=10634288274239106999 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc0c0d1830 tx=0x7efc0c009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939494d7b11fafb7 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:18.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.358+0000 7efbe1ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:18:18.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.358+0000 7efbe1ffb640 1 -- 10.20.193.28:0/2386417157 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc0c096070 con 0x5626ea1f6a60 2026-02-24T09:18:18.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.358+0000 7efbe1ffb640 1 -- 10.20.193.28:0/2386417157 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7efc0c0d0dc0 con 0x5626ea1f6a60 2026-02-24T09:18:18.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.358+0000 7efbe1ffb640 1 -- 10.20.193.28:0/2386417157 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc0c10b040 con 0x5626ea1f6a60 2026-02-24T09:18:18.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.358+0000 7efc28fcae00 1 -- 10.20.193.28:0/2386417157 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc14008840 con 0x5626ea1f6a60 2026-02-24T09:18:18.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.358+0000 7efbe1ffb640 1 -- 10.20.193.28:0/2386417157 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 8440+0+0 (secure 0 0 0) 0x7efc0c10b1a0 con 0x5626ea1f6a60 2026-02-24T09:18:18.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.358+0000 7efbe1ffb640 10 client.15579 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-24T09:18:18.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.358+0000 7efc28fcae00 10 client.15579 _ll_register_callbacks cb 0x5626ea16e980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:18.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.358+0000 7efc28fcae00 1 -- 10.20.193.28:0/2386417157 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5626e9e83520 con 0x5626ea1f6a60 2026-02-24T09:18:18.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.358+0000 7efbe1ffb640 1 -- 10.20.193.28:0/2386417157 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7efc0c0d7230 con 0x5626ea1f6a60 2026-02-24T09:18:18.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.358+0000 7efc28fcae00 10 client.15579 fetch_fsmap learned FSMap version 23 2026-02-24T09:18:18.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.358+0000 7efc28fcae00 1 -- 10.20.193.28:0/2386417157 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x5626ea167ce0 con 0x5626ea1f6a60 2026-02-24T09:18:18.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.359+0000 7efbe1ffb640 1 -- 10.20.193.28:0/2386417157 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7efc0c0f2070 con 0x5626ea1f6a60 2026-02-24T09:18:18.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.359+0000 7efc28fcae00 10 client.15579 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:18:18.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.359+0000 7efc28fcae00 10 client.15579 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:18:18.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.359+0000 7efc28fcae00 20 client.15579 populate_metadata read hostname 'trial028' 2026-02-24T09:18:18.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.359+0000 7efc28fcae00 1 --2- 10.20.193.28:0/2386417157 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5626ea31a3b0 0x5626ea31a850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:18.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.359+0000 7efc28fcae00 4 client.15579 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:18:18.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.359+0000 7efc28fcae00 1 -- 10.20.193.28:0/2386417157 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5626ea1b59d0 con 0x5626ea31a3b0 2026-02-24T09:18:18.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.359+0000 7efc1f7fe640 1 --2- 10.20.193.28:0/2386417157 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5626ea31a3b0 0x5626ea31a850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:18.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.360+0000 7efc1f7fe640 1 --2- 10.20.193.28:0/2386417157 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5626ea31a3b0 0x5626ea31a850 crc :-1 s=READY pgs=28 gs=4 cs=0 l=0 c_cookie=13201579919055837322 s_cookie=17252969269423363620 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7356efdcd40d88a server_cookie=ef6edc23f0b5d624 in_seq=0 out_seq=0 2026-02-24T09:18:18.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.360+0000 7efbe1ffb640 10 client.15579 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:18:18.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.360+0000 7efbe1ffb640 1 -- 10.20.193.28:0/2386417157 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5626ea1b59d0 con 0x5626ea31a3b0 2026-02-24T09:18:18.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.360+0000 7efbe1ffb640 10 client.15579 handle_command_reply: tid=0 2026-02-24T09:18:18.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.360+0000 7efc28fcae00 1 client.15579 shutdown 2026-02-24T09:18:18.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.360+0000 7efc28fcae00 1 -- 10.20.193.28:0/2386417157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ea1f6a60 msgr2=0x5626ea334800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:18.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.360+0000 7efc28fcae00 1 --2- 10.20.193.28:0/2386417157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ea1f6a60 0x5626ea334800 secure :-1 s=READY pgs=398 gs=1 cs=0 l=1 c_cookie=10634288274239106999 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc0c0d1830 tx=0x7efc0c009310 comp rx=0 tx=0).stop 2026-02-24T09:18:18.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.361+0000 7efc28fcae00 1 -- 10.20.193.28:0/2386417157 shutdown_connections 2026-02-24T09:18:18.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.361+0000 7efc28fcae00 1 --2- 10.20.193.28:0/2386417157 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5626ea31a3b0 0x5626ea31a850 crc :-1 s=READY pgs=28 gs=4 cs=0 l=0 c_cookie=13201579919055837322 s_cookie=17252969269423363620 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:18.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.361+0000 7efc28fcae00 1 --2- 10.20.193.28:0/2386417157 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5626ea31d270 0x5626ea339d30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:18.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.361+0000 7efc28fcae00 1 --2- 10.20.193.28:0/2386417157 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5626ea2d8740 0x5626ea334d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:18.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.361+0000 7efc28fcae00 1 --2- 10.20.193.28:0/2386417157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ea1f6a60 0x5626ea334800 unknown :-1 s=CLOSED pgs=398 gs=1 cs=0 l=1 c_cookie=10634288274239106999 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:18.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.361+0000 7efc28fcae00 1 -- 10.20.193.28:0/2386417157 >> 10.20.193.28:0/2386417157 conn(0x5626ea272490 msgr2=0x5626ea2d62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:18.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.361+0000 7efbe1ffb640 0 client.15579 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:18:18.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.361+0000 7efc28fcae00 1 -- 10.20.193.28:0/2386417157 shutdown_connections 2026-02-24T09:18:18.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.361+0000 7efc28fcae00 1 -- 10.20.193.28:0/2386417157 wait complete. 2026-02-24T09:18:18.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.361+0000 7efc28fcae00 20 client.15579 trim_cache size 0 max 16384 2026-02-24T09:18:18.369 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.368+0000 7efc28fcae00 1 Processor -- start 2026-02-24T09:18:18.369 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.369+0000 7efc28fcae00 1 -- start start 2026-02-24T09:18:18.369 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.369+0000 7efc28fcae00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5626ea1f6a60 0x5626ea318410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:18.369 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.369+0000 7efc28fcae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ea2d8740 0x5626ea318950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:18.369 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.369+0000 7efc28fcae00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5626ea31d270 0x5626ea31bf40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:18.369 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.369+0000 7efc28fcae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5626ea1e19d0 con 0x5626ea2d8740 2026-02-24T09:18:18.369 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.369+0000 7efc28fcae00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x5626e9f22f10 con 0x5626ea31d270 2026-02-24T09:18:18.369 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.369+0000 7efc28fcae00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x5626ea247580 con 0x5626ea1f6a60 2026-02-24T09:18:18.370 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.369+0000 7efc1f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ea2d8740 0x5626ea318950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:18.370 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.369+0000 7efc1f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ea2d8740 0x5626ea318950 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48142/0 (socket says 10.20.193.28:48142) 2026-02-24T09:18:18.370 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.369+0000 7efc1f7fe640 1 -- 10.20.193.28:0/1159478454 learned_addr learned my addr 10.20.193.28:0/1159478454 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:18:18.370 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.369+0000 7efc1ffff640 1 --2- 10.20.193.28:0/1159478454 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5626ea1f6a60 0x5626ea318410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:18.370 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.369+0000 7efc24e42640 1 --2- 10.20.193.28:0/1159478454 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5626ea31d270 0x5626ea31bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:18.370 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.369+0000 7efc1f7fe640 1 -- 10.20.193.28:0/1159478454 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5626ea1f6a60 msgr2=0x5626ea318410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:18.370 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.369+0000 7efc1f7fe640 1 --2- 10.20.193.28:0/1159478454 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5626ea1f6a60 0x5626ea318410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:18.370 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.369+0000 7efc1f7fe640 1 -- 10.20.193.28:0/1159478454 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5626ea31d270 msgr2=0x5626ea31bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:18.370 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.369+0000 7efc1f7fe640 1 --2- 10.20.193.28:0/1159478454 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5626ea31d270 0x5626ea31bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:18.370 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.369+0000 7efc1f7fe640 1 -- 10.20.193.28:0/1159478454 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626ea326d70 con 0x5626ea2d8740 2026-02-24T09:18:18.370 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.369+0000 7efc1f7fe640 1 --2- 10.20.193.28:0/1159478454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ea2d8740 0x5626ea318950 secure :-1 s=READY pgs=399 gs=2 cs=0 l=1 c_cookie=11272489502702223595 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc10011630 tx=0x7efc10015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c6fed7a7ee2c0eb server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:18.370 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.370+0000 7efbe3fff640 1 -- 10.20.193.28:0/1159478454 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc10024040 con 0x5626ea2d8740 2026-02-24T09:18:18.370 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.370+0000 7efbe3fff640 1 -- 10.20.193.28:0/1159478454 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7efc10004d10 con 0x5626ea2d8740 2026-02-24T09:18:18.370 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.370+0000 7efbe3fff640 1 -- 10.20.193.28:0/1159478454 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc1002a320 con 0x5626ea2d8740 2026-02-24T09:18:18.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.370+0000 7efc28fcae00 1 -- 10.20.193.28:0/1159478454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ea2d8740 msgr2=0x5626ea318950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:18.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.370+0000 7efc28fcae00 1 --2- 10.20.193.28:0/1159478454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ea2d8740 0x5626ea318950 secure :-1 s=READY pgs=399 gs=2 cs=0 l=1 c_cookie=11272489502702223595 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc10011630 tx=0x7efc10015000 comp rx=0 tx=0).stop 2026-02-24T09:18:18.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.370+0000 7efc28fcae00 1 -- 10.20.193.28:0/1159478454 shutdown_connections 2026-02-24T09:18:18.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.370+0000 7efc28fcae00 1 --2- 10.20.193.28:0/1159478454 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5626ea31d270 0x5626ea31bf40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:18.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.370+0000 7efc28fcae00 1 --2- 10.20.193.28:0/1159478454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ea2d8740 0x5626ea318950 unknown :-1 s=CLOSED pgs=399 gs=2 cs=0 l=1 c_cookie=11272489502702223595 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:18.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.370+0000 7efc28fcae00 1 --2- 10.20.193.28:0/1159478454 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5626ea1f6a60 0x5626ea318410 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:18.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.370+0000 7efc28fcae00 1 -- 10.20.193.28:0/1159478454 >> 10.20.193.28:0/1159478454 conn(0x5626ea272490 msgr2=0x5626ea31a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:18.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.370+0000 7efc28fcae00 1 -- 10.20.193.28:0/1159478454 shutdown_connections 2026-02-24T09:18:18.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.370+0000 7efc28fcae00 1 -- 10.20.193.28:0/1159478454 wait complete. 2026-02-24T09:18:18.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.371+0000 7efc28fcae00 1 -- start start 2026-02-24T09:18:18.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.371+0000 7efc28fcae00 1 Processor -- start 2026-02-24T09:18:18.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.371+0000 7efc28fcae00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5626ea1f6a60 0x5626ea2bbf50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:18.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.371+0000 7efc28fcae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ea2d8740 0x5626ea2b7430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:18.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.371+0000 7efc28fcae00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5626ea31d270 0x5626ea2b7a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:18.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.371+0000 7efc28fcae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5626ea1edf10 con 0x5626ea2d8740 2026-02-24T09:18:18.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.371+0000 7efc28fcae00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x5626ea2b8170 con 0x5626ea1f6a60 2026-02-24T09:18:18.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.371+0000 7efc28fcae00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x5626ea382f20 con 0x5626ea31d270 2026-02-24T09:18:18.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.371+0000 7efc1ffff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5626ea1f6a60 0x5626ea2bbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:18.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.371+0000 7efc1f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ea2d8740 0x5626ea2b7430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:18.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.371+0000 7efc1ffff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5626ea1f6a60 0x5626ea2bbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:51552/0 (socket says 10.20.193.28:51552) 2026-02-24T09:18:18.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.371+0000 7efc1ffff640 1 -- 10.20.193.28:0/2747140720 learned_addr learned my addr 10.20.193.28:0/2747140720 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:18:18.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.371+0000 7efc1ffff640 1 -- 10.20.193.28:0/2747140720 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5626ea31d270 msgr2=0x5626ea2b7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:18.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.371+0000 7efc1ffff640 1 --2- 10.20.193.28:0/2747140720 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5626ea31d270 0x5626ea2b7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:18.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.371+0000 7efc1ffff640 1 -- 10.20.193.28:0/2747140720 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ea2d8740 msgr2=0x5626ea2b7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:18.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.372+0000 7efc1ffff640 1 --2- 10.20.193.28:0/2747140720 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ea2d8740 0x5626ea2b7430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:18.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.372+0000 7efc1ffff640 1 -- 10.20.193.28:0/2747140720 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626ea1795b0 con 0x5626ea1f6a60 2026-02-24T09:18:18.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.372+0000 7efc1f7fe640 1 --2- 10.20.193.28:0/2747140720 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ea2d8740 0x5626ea2b7430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:18:18.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.372+0000 7efc1ffff640 1 --2- 10.20.193.28:0/2747140720 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5626ea1f6a60 0x5626ea2bbf50 secure :-1 s=READY pgs=112 gs=1 cs=0 l=1 c_cookie=2979237686631553949 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc0c0ce830 tx=0x7efc0c10b730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=295860e42d215b9d server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:18.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.372+0000 7efbe1ffb640 10 client.0 ms_handle_connect on v2:10.20.193.74:3300/0 2026-02-24T09:18:18.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.372+0000 7efbe1ffb640 1 -- 10.20.193.28:0/2747140720 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc0c096070 con 0x5626ea1f6a60 2026-02-24T09:18:18.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.372+0000 7efbe1ffb640 1 -- 10.20.193.28:0/2747140720 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x5626e9e83520 con 0x5626ea1f6a60 2026-02-24T09:18:18.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.372+0000 7efbe1ffb640 1 -- 10.20.193.28:0/2747140720 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc0c10b340 con 0x5626ea1f6a60 2026-02-24T09:18:18.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.372+0000 7efc28fcae00 1 -- 10.20.193.28:0/2747140720 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc1000be30 con 0x5626ea1f6a60 2026-02-24T09:18:18.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.372+0000 7efbe1ffb640 1 -- 10.20.193.28:0/2747140720 <== mon.2 v2:10.20.193.74:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 8440+0+0 (secure 0 0 0) 0x7efc0c038820 con 0x5626ea1f6a60 2026-02-24T09:18:18.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.372+0000 7efc28fcae00 10 client.25382 _ll_register_callbacks cb 0x5626ea16e980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:18.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.372+0000 7efc28fcae00 1 -- 10.20.193.28:0/2747140720 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5626ea214d30 con 0x5626ea1f6a60 2026-02-24T09:18:18.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.373+0000 7efbe1ffb640 1 -- 10.20.193.28:0/2747140720 <== mon.2 v2:10.20.193.74:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7efc0c0d0dc0 con 0x5626ea1f6a60 2026-02-24T09:18:18.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.373+0000 7efc28fcae00 10 client.25382 fetch_fsmap learned FSMap version 23 2026-02-24T09:18:18.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.373+0000 7efc28fcae00 1 -- 10.20.193.28:0/2747140720 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({fsmap=23}) -- 0x5626ea174030 con 0x5626ea1f6a60 2026-02-24T09:18:18.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.373+0000 7efbe1ffb640 1 -- 10.20.193.28:0/2747140720 <== mon.2 v2:10.20.193.74:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7efc0c0d08b0 con 0x5626ea1f6a60 2026-02-24T09:18:18.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.373+0000 7efc28fcae00 10 client.25382 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:18:18.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.373+0000 7efc28fcae00 10 client.25382 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:18:18.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.373+0000 7efc28fcae00 20 client.25382 populate_metadata read hostname 'trial028' 2026-02-24T09:18:18.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.373+0000 7efc28fcae00 1 --2- 10.20.193.28:0/2747140720 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5626ea3ca830 0x5626ea3eace0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:18.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.373+0000 7efc28fcae00 4 client.25382 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-24T09:18:18.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.373+0000 7efc28fcae00 1 -- 10.20.193.28:0/2747140720 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5626e9ec7640 con 0x5626ea3ca830 2026-02-24T09:18:18.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.373+0000 7efc1f7fe640 1 --2- 10.20.193.28:0/2747140720 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5626ea3ca830 0x5626ea3eace0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:18.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.374+0000 7efc1f7fe640 1 --2- 10.20.193.28:0/2747140720 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5626ea3ca830 0x5626ea3eace0 crc :-1 s=READY pgs=29 gs=4 cs=0 l=0 c_cookie=15442897015440581498 s_cookie=1691587777687061425 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6503103fc46a37a server_cookie=1779ba1f136e03b1 in_seq=0 out_seq=0 2026-02-24T09:18:18.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.374+0000 7efbe1ffb640 10 client.25382 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:18:18.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.381+0000 7efbe1ffb640 1 -- 10.20.193.28:0/2747140720 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5626e9ec7640 con 0x5626ea3ca830 2026-02-24T09:18:18.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.381+0000 7efbe1ffb640 10 client.25382 handle_command_reply: tid=0 2026-02-24T09:18:18.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.381+0000 7efc28fcae00 1 client.25382 shutdown 2026-02-24T09:18:18.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.381+0000 7efc28fcae00 1 -- 10.20.193.28:0/2747140720 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5626ea1f6a60 msgr2=0x5626ea2bbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:18.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.381+0000 7efc28fcae00 1 --2- 10.20.193.28:0/2747140720 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5626ea1f6a60 0x5626ea2bbf50 secure :-1 s=READY pgs=112 gs=1 cs=0 l=1 c_cookie=2979237686631553949 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc0c0ce830 tx=0x7efc0c10b730 comp rx=0 tx=0).stop 2026-02-24T09:18:18.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.381+0000 7efc28fcae00 1 -- 10.20.193.28:0/2747140720 shutdown_connections 2026-02-24T09:18:18.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.381+0000 7efc28fcae00 1 --2- 10.20.193.28:0/2747140720 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5626ea3ca830 0x5626ea3eace0 crc :-1 s=READY pgs=29 gs=4 cs=0 l=0 c_cookie=15442897015440581498 s_cookie=1691587777687061425 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:18.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.381+0000 7efc28fcae00 1 --2- 10.20.193.28:0/2747140720 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5626ea31d270 0x5626ea2b7a40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:18.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.381+0000 7efc28fcae00 1 --2- 10.20.193.28:0/2747140720 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5626ea2d8740 0x5626ea2b7430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:18.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.381+0000 7efc28fcae00 1 --2- 10.20.193.28:0/2747140720 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5626ea1f6a60 0x5626ea2bbf50 unknown :-1 s=CLOSED pgs=112 gs=1 cs=0 l=1 c_cookie=2979237686631553949 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:18.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.381+0000 7efc28fcae00 1 -- 10.20.193.28:0/2747140720 >> 10.20.193.28:0/2747140720 conn(0x5626ea272490 msgr2=0x5626ea317bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:18.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.381+0000 7efbe1ffb640 0 client.25382 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:18:18.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.381+0000 7efc28fcae00 1 -- 10.20.193.28:0/2747140720 shutdown_connections 2026-02-24T09:18:18.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.381+0000 7efc28fcae00 1 -- 10.20.193.28:0/2747140720 wait complete. 2026-02-24T09:18:18.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.381+0000 7efc28fcae00 20 client.25382 trim_cache size 0 max 16384 2026-02-24T09:18:18.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-24T09:18:18.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-24T09:18:18.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-24T09:18:18.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-24T09:18:18.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.382+0000 7efc25643640 1 -- 10.20.193.28:0/545313530 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7efbf40b5960 msgr2=0x7efbf40d5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:18.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.382+0000 7efc25643640 1 --2- 10.20.193.28:0/545313530 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7efbf40b5960 0x7efbf40d5e10 secure :-1 s=READY pgs=226 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc20168a80 tx=0x7efc100107a0 comp rx=0 tx=0).stop 2026-02-24T09:18:18.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.382+0000 7efc25643640 1 -- 10.20.193.28:0/545313530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efc200607e0 msgr2=0x7efc201620e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:18.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.382+0000 7efc25643640 1 --2- 10.20.193.28:0/545313530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efc200607e0 0x7efc201620e0 secure :-1 s=READY pgs=397 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc0c0098a0 tx=0x7efc0c0028d0 comp rx=0 tx=0).stop 2026-02-24T09:18:18.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.383+0000 7efc25643640 1 -- 10.20.193.28:0/545313530 shutdown_connections 2026-02-24T09:18:18.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.383+0000 7efc25643640 1 --2- 10.20.193.28:0/545313530 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7efbf40b5960 0x7efbf40d5e10 unknown :-1 s=CLOSED pgs=226 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:18.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.383+0000 7efc25643640 1 --2- 10.20.193.28:0/545313530 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7efc201558f0 0x7efc201679f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:18.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.383+0000 7efc25643640 1 --2- 10.20.193.28:0/545313530 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7efc200610f0 0x7efc20162620 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:18.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.383+0000 7efc25643640 1 --2- 10.20.193.28:0/545313530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efc200607e0 0x7efc201620e0 unknown :-1 s=CLOSED pgs=397 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:18.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.383+0000 7efc25643640 1 -- 10.20.193.28:0/545313530 >> 10.20.193.28:0/545313530 conn(0x7efc200eaa80 msgr2=0x7efc2010ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:18.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.383+0000 7efc25643640 1 -- 10.20.193.28:0/545313530 shutdown_connections 2026-02-24T09:18:18.386 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:18.383+0000 7efc25643640 1 -- 10.20.193.28:0/545313530 wait complete. 2026-02-24T09:18:18.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:18 trial028 ceph-mon[40371]: pgmap v221: 97 pgs: 97 active+clean; 33 MiB data, 411 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 2.7 MiB/s wr, 9 op/s 2026-02-24T09:18:18.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:18 trial074 ceph-mon[44412]: pgmap v221: 97 pgs: 97 active+clean; 33 MiB data, 411 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 2.7 MiB/s wr, 9 op/s 2026-02-24T09:18:18.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:18 trial159 ceph-mon[44242]: pgmap v221: 97 pgs: 97 active+clean; 33 MiB data, 411 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 2.7 MiB/s wr, 9 op/s 2026-02-24T09:18:20.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:20 trial028 ceph-mon[40371]: pgmap v222: 97 pgs: 97 active+clean; 145 MiB data, 748 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 12 MiB/s wr, 11 op/s 2026-02-24T09:18:20.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:20 trial074 ceph-mon[44412]: pgmap v222: 97 pgs: 97 active+clean; 145 MiB data, 748 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 12 MiB/s wr, 11 op/s 2026-02-24T09:18:20.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:20 trial159 ceph-mon[44242]: pgmap v222: 97 pgs: 97 active+clean; 145 MiB data, 748 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 12 MiB/s wr, 11 op/s 2026-02-24T09:18:22.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:22 trial028 ceph-mon[40371]: pgmap v223: 97 pgs: 97 active+clean; 253 MiB data, 1016 MiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 21 MiB/s wr, 15 op/s 2026-02-24T09:18:22.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:22 trial074 ceph-mon[44412]: pgmap v223: 97 pgs: 97 active+clean; 253 MiB data, 1016 MiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 21 MiB/s wr, 15 op/s 2026-02-24T09:18:22.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:22 trial159 ceph-mon[44242]: pgmap v223: 97 pgs: 97 active+clean; 253 MiB data, 1016 MiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 21 MiB/s wr, 15 op/s 2026-02-24T09:18:24.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:24 trial028 ceph-mon[40371]: pgmap v224: 97 pgs: 97 active+clean; 425 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 8.2 KiB/s rd, 35 MiB/s wr, 19 op/s 2026-02-24T09:18:24.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:24 trial074 ceph-mon[44412]: pgmap v224: 97 pgs: 97 active+clean; 425 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 8.2 KiB/s rd, 35 MiB/s wr, 19 op/s 2026-02-24T09:18:24.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:24 trial159 ceph-mon[44242]: pgmap v224: 97 pgs: 97 active+clean; 425 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 8.2 KiB/s rd, 35 MiB/s wr, 19 op/s 2026-02-24T09:18:26.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:26 trial074 ceph-mon[44412]: pgmap v225: 97 pgs: 97 active+clean; 513 MiB data, 1.7 GiB used, 8.2 TiB / 8.2 TiB avail; 7.8 KiB/s rd, 43 MiB/s wr, 20 op/s 2026-02-24T09:18:26.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:26 trial159 ceph-mon[44242]: pgmap v225: 97 pgs: 97 active+clean; 513 MiB data, 1.7 GiB used, 8.2 TiB / 8.2 TiB avail; 7.8 KiB/s rd, 43 MiB/s wr, 20 op/s 2026-02-24T09:18:26.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:26 trial028 ceph-mon[40371]: pgmap v225: 97 pgs: 97 active+clean; 513 MiB data, 1.7 GiB used, 8.2 TiB / 8.2 TiB avail; 7.8 KiB/s rd, 43 MiB/s wr, 20 op/s 2026-02-24T09:18:28.623 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:28 trial074 ceph-mon[44412]: pgmap v226: 97 pgs: 97 active+clean; 706 MiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 59 MiB/s wr, 26 op/s 2026-02-24T09:18:28.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:28 trial159 ceph-mon[44242]: pgmap v226: 97 pgs: 97 active+clean; 706 MiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 59 MiB/s wr, 26 op/s 2026-02-24T09:18:28.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:28 trial028 ceph-mon[40371]: pgmap v226: 97 pgs: 97 active+clean; 706 MiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 59 MiB/s wr, 26 op/s 2026-02-24T09:18:29.594 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-24T09:18:29.595 INFO:tasks.workunit.client.0.trial028.stdout: Children see throughput for 1 initial writers = 69671.86 kB/sec 2026-02-24T09:18:29.595 INFO:tasks.workunit.client.0.trial028.stdout: Parent sees throughput for 1 initial writers = 69668.65 kB/sec 2026-02-24T09:18:29.595 INFO:tasks.workunit.client.0.trial028.stdout: Min throughput per process = 69671.86 kB/sec 2026-02-24T09:18:29.595 INFO:tasks.workunit.client.0.trial028.stdout: Max throughput per process = 69671.86 kB/sec 2026-02-24T09:18:29.595 INFO:tasks.workunit.client.0.trial028.stdout: Avg throughput per process = 69671.86 kB/sec 2026-02-24T09:18:29.595 INFO:tasks.workunit.client.0.trial028.stdout: Min xfer = 1048576.00 kB 2026-02-24T09:18:30.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:30 trial074 ceph-mon[44412]: pgmap v227: 97 pgs: 97 active+clean; 830 MiB data, 2.7 GiB used, 8.2 TiB / 8.2 TiB avail; 7.9 KiB/s rd, 66 MiB/s wr, 25 op/s 2026-02-24T09:18:30.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:30 trial159 ceph-mon[44242]: pgmap v227: 97 pgs: 97 active+clean; 830 MiB data, 2.7 GiB used, 8.2 TiB / 8.2 TiB avail; 7.9 KiB/s rd, 66 MiB/s wr, 25 op/s 2026-02-24T09:18:30.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:30 trial028 ceph-mon[40371]: pgmap v227: 97 pgs: 97 active+clean; 830 MiB data, 2.7 GiB used, 8.2 TiB / 8.2 TiB avail; 7.9 KiB/s rd, 66 MiB/s wr, 25 op/s 2026-02-24T09:18:31.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.454+0000 7fc03f043640 1 -- 10.20.193.28:0/1498752077 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc038114340 msgr2=0x7fc038119390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:31.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.454+0000 7fc03f043640 1 --2- 10.20.193.28:0/1498752077 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc038114340 0x7fc038119390 secure :-1 s=READY pgs=400 gs=1 cs=0 l=1 c_cookie=17959431726832387349 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc02c009950 tx=0x7fc02c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:18:31.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.454+0000 7fc03f043640 1 -- 10.20.193.28:0/1498752077 shutdown_connections 2026-02-24T09:18:31.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.454+0000 7fc03f043640 1 --2- 10.20.193.28:0/1498752077 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc038119b40 0x7fc03817a510 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:31.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.454+0000 7fc03f043640 1 --2- 10.20.193.28:0/1498752077 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc038114340 0x7fc038119390 unknown :-1 s=CLOSED pgs=400 gs=1 cs=0 l=1 c_cookie=17959431726832387349 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:31.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.454+0000 7fc03f043640 1 --2- 10.20.193.28:0/1498752077 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc038113950 0x7fc038113d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:31.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.454+0000 7fc03f043640 1 -- 10.20.193.28:0/1498752077 >> 10.20.193.28:0/1498752077 conn(0x7fc0380619a0 msgr2=0x7fc038061da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:31.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.454+0000 7fc03f043640 1 -- 10.20.193.28:0/1498752077 shutdown_connections 2026-02-24T09:18:31.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.454+0000 7fc03f043640 1 -- 10.20.193.28:0/1498752077 wait complete. 2026-02-24T09:18:31.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.455+0000 7fc03f043640 1 Processor -- start 2026-02-24T09:18:31.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.455+0000 7fc03f043640 1 -- start start 2026-02-24T09:18:31.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.455+0000 7fc03f043640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc038113950 0x7fc0380fb5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:31.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.455+0000 7fc03f043640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc038114340 0x7fc03817a410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:31.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.455+0000 7fc03f043640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc038119b40 0x7fc0380fbce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:31.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.455+0000 7fc03f043640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc038100ea0 con 0x7fc038113950 2026-02-24T09:18:31.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.455+0000 7fc03f043640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fc038101010 con 0x7fc038114340 2026-02-24T09:18:31.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.455+0000 7fc03f043640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc0381011d0 con 0x7fc038119b40 2026-02-24T09:18:31.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.456+0000 7fc03e041640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc038113950 0x7fc0380fb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:31.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.456+0000 7fc03e041640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc038113950 0x7fc0380fb5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45190/0 (socket says 10.20.193.28:45190) 2026-02-24T09:18:31.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.456+0000 7fc03e041640 1 -- 10.20.193.28:0/2596718033 learned_addr learned my addr 10.20.193.28:0/2596718033 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:18:31.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.456+0000 7fc03d840640 1 --2- 10.20.193.28:0/2596718033 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc038114340 0x7fc03817a410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:31.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.456+0000 7fc03e842640 1 --2- 10.20.193.28:0/2596718033 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc038119b40 0x7fc0380fbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:31.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.456+0000 7fc03e041640 1 -- 10.20.193.28:0/2596718033 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc038119b40 msgr2=0x7fc0380fbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:31.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.456+0000 7fc03e041640 1 --2- 10.20.193.28:0/2596718033 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc038119b40 0x7fc0380fbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:31.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.456+0000 7fc03e041640 1 -- 10.20.193.28:0/2596718033 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc038114340 msgr2=0x7fc03817a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:31.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.456+0000 7fc03e041640 1 --2- 10.20.193.28:0/2596718033 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc038114340 0x7fc03817a410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:31.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.456+0000 7fc03e041640 1 -- 10.20.193.28:0/2596718033 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc02c009570 con 0x7fc038113950 2026-02-24T09:18:31.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.456+0000 7fc03e041640 1 --2- 10.20.193.28:0/2596718033 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc038113950 0x7fc0380fb5e0 secure :-1 s=READY pgs=401 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc02800d950 tx=0x7fc02800de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:31.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.456+0000 7fc01f7fe640 1 -- 10.20.193.28:0/2596718033 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc028004540 con 0x7fc038113950 2026-02-24T09:18:31.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.456+0000 7fc01f7fe640 1 -- 10.20.193.28:0/2596718033 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc028009ce0 con 0x7fc038113950 2026-02-24T09:18:31.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.456+0000 7fc01f7fe640 1 -- 10.20.193.28:0/2596718033 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc0280106e0 con 0x7fc038113950 2026-02-24T09:18:31.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.456+0000 7fc03f043640 1 -- 10.20.193.28:0/2596718033 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0381014b0 con 0x7fc038113950 2026-02-24T09:18:31.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.456+0000 7fc03f043640 1 -- 10.20.193.28:0/2596718033 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc038101930 con 0x7fc038113950 2026-02-24T09:18:31.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.459+0000 7fc01f7fe640 1 -- 10.20.193.28:0/2596718033 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 22) ==== 157304+0+0 (secure 0 0 0) 0x7fc0280097c0 con 0x7fc038113950 2026-02-24T09:18:31.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.461+0000 7fc01f7fe640 1 --2- 10.20.193.28:0/2596718033 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc0140b5950 0x7fc0140d5e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:31.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.461+0000 7fc01f7fe640 1 -- 10.20.193.28:0/2596718033 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8440+0+0 (secure 0 0 0) 0x7fc0280e7320 con 0x7fc038113950 2026-02-24T09:18:31.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.461+0000 7fc03d840640 1 --2- 10.20.193.28:0/2596718033 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc0140b5950 0x7fc0140d5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:31.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.462+0000 7fc03d840640 1 --2- 10.20.193.28:0/2596718033 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc0140b5950 0x7fc0140d5e00 secure :-1 s=READY pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc038101f30 tx=0x7fc02c03a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:31.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.462+0000 7fc0428c7e00 1 Processor -- start 2026-02-24T09:18:31.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.462+0000 7fc0428c7e00 1 -- start start 2026-02-24T09:18:31.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.463+0000 7fc0428c7e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557a3bf1fa60 0x557a3c001200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:31.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.463+0000 7fc0428c7e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557a3c001740 0x557a3c001b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:31.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.463+0000 7fc0428c7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3c046270 0x557a3c066650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:31.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.463+0000 7fc0428c7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557a3bf16f10 con 0x557a3c046270 2026-02-24T09:18:31.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.463+0000 7fc0428c7e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x557a3bf12c40 con 0x557a3c001740 2026-02-24T09:18:31.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.463+0000 7fc0428c7e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x557a3bf0cda0 con 0x557a3bf1fa60 2026-02-24T09:18:31.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.463+0000 7fc03e842640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3c046270 0x557a3c066650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:31.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.463+0000 7fc03e842640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3c046270 0x557a3c066650 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45206/0 (socket says 10.20.193.28:45206) 2026-02-24T09:18:31.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.463+0000 7fc03e842640 1 -- 10.20.193.28:0/3581384228 learned_addr learned my addr 10.20.193.28:0/3581384228 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:18:31.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.463+0000 7fc03d840640 1 --2- 10.20.193.28:0/3581384228 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557a3c001740 0x557a3c001b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:31.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.463+0000 7fc03e041640 1 --2- 10.20.193.28:0/3581384228 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557a3bf1fa60 0x557a3c001200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:31.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.463+0000 7fc03e842640 1 -- 10.20.193.28:0/3581384228 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557a3bf1fa60 msgr2=0x557a3c001200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:31.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.463+0000 7fc03e842640 1 --2- 10.20.193.28:0/3581384228 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557a3bf1fa60 0x557a3c001200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:31.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.463+0000 7fc03e842640 1 -- 10.20.193.28:0/3581384228 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557a3c001740 msgr2=0x557a3c001b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:31.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.463+0000 7fc03e842640 1 --2- 10.20.193.28:0/3581384228 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557a3c001740 0x557a3c001b90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:31.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.463+0000 7fc03e842640 1 -- 10.20.193.28:0/3581384228 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a3beb8340 con 0x557a3c046270 2026-02-24T09:18:31.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.463+0000 7fc03e842640 1 --2- 10.20.193.28:0/3581384228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3c046270 0x557a3c066650 secure :-1 s=READY pgs=402 gs=2 cs=0 l=1 c_cookie=18437756477220896135 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc0340039d0 tx=0x7fc034003ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe011d41fe8bd87 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:31.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.464+0000 7fc0063ff640 1 -- 10.20.193.28:0/3581384228 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc034010c20 con 0x557a3c046270 2026-02-24T09:18:31.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.464+0000 7fc0063ff640 1 -- 10.20.193.28:0/3581384228 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc034010d80 con 0x557a3c046270 2026-02-24T09:18:31.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.464+0000 7fc0063ff640 1 -- 10.20.193.28:0/3581384228 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc03401a810 con 0x557a3c046270 2026-02-24T09:18:31.470 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.464+0000 7fc0428c7e00 1 -- 10.20.193.28:0/3581384228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3c046270 msgr2=0x557a3c066650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:31.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.464+0000 7fc0428c7e00 1 --2- 10.20.193.28:0/3581384228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3c046270 0x557a3c066650 secure :-1 s=READY pgs=402 gs=2 cs=0 l=1 c_cookie=18437756477220896135 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc0340039d0 tx=0x7fc034003ea0 comp rx=0 tx=0).stop 2026-02-24T09:18:31.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.464+0000 7fc0428c7e00 1 -- 10.20.193.28:0/3581384228 shutdown_connections 2026-02-24T09:18:31.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.464+0000 7fc0428c7e00 1 --2- 10.20.193.28:0/3581384228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3c046270 0x557a3c066650 unknown :-1 s=CLOSED pgs=402 gs=2 cs=0 l=1 c_cookie=18437756477220896135 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:31.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.464+0000 7fc0428c7e00 1 --2- 10.20.193.28:0/3581384228 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557a3c001740 0x557a3c001b90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:31.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.464+0000 7fc0428c7e00 1 --2- 10.20.193.28:0/3581384228 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557a3bf1fa60 0x557a3c001200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:31.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.464+0000 7fc0428c7e00 1 -- 10.20.193.28:0/3581384228 >> 10.20.193.28:0/3581384228 conn(0x557a3bf9b490 msgr2=0x557a3bfffae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:31.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.464+0000 7fc0428c7e00 1 -- 10.20.193.28:0/3581384228 shutdown_connections 2026-02-24T09:18:31.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.464+0000 7fc0428c7e00 1 -- 10.20.193.28:0/3581384228 wait complete. 2026-02-24T09:18:31.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.466+0000 7fc0428c7e00 1 -- start start 2026-02-24T09:18:31.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.466+0000 7fc0428c7e00 1 Processor -- start 2026-02-24T09:18:31.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.466+0000 7fc0428c7e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557a3bf1fa60 0x557a3c05d780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:31.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.466+0000 7fc0428c7e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557a3c001740 0x557a3c05dcc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:31.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.466+0000 7fc0428c7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3c046270 0x557a3c062cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:31.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.466+0000 7fc0428c7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557a3c0631f0 con 0x557a3c046270 2026-02-24T09:18:31.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.466+0000 7fc0428c7e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x557a3c063360 con 0x557a3bf1fa60 2026-02-24T09:18:31.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.466+0000 7fc0428c7e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x557a3c063520 con 0x557a3c001740 2026-02-24T09:18:31.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.467+0000 7fc03e041640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557a3bf1fa60 0x557a3c05d780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:31.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.467+0000 7fc03e041640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557a3bf1fa60 0x557a3c05d780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:35094/0 (socket says 10.20.193.28:35094) 2026-02-24T09:18:31.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.467+0000 7fc03e041640 1 -- 10.20.193.28:0/360928666 learned_addr learned my addr 10.20.193.28:0/360928666 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:18:31.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.467+0000 7fc03d840640 1 --2- 10.20.193.28:0/360928666 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557a3c001740 0x557a3c05dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:31.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.467+0000 7fc03e842640 1 --2- 10.20.193.28:0/360928666 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3c046270 0x557a3c062cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:31.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.467+0000 7fc03e041640 1 -- 10.20.193.28:0/360928666 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557a3c001740 msgr2=0x557a3c05dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:31.473 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.467+0000 7fc03e041640 1 --2- 10.20.193.28:0/360928666 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557a3c001740 0x557a3c05dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:31.473 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.467+0000 7fc03e041640 1 -- 10.20.193.28:0/360928666 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3c046270 msgr2=0x557a3c062cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:31.473 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.467+0000 7fc03e041640 1 --2- 10.20.193.28:0/360928666 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3c046270 0x557a3c062cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:31.473 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.467+0000 7fc03e041640 1 -- 10.20.193.28:0/360928666 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a3be90ce0 con 0x557a3bf1fa60 2026-02-24T09:18:31.473 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.467+0000 7fc03e842640 1 --2- 10.20.193.28:0/360928666 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3c046270 0x557a3c062cb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:18:31.473 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.467+0000 7fc03e041640 1 --2- 10.20.193.28:0/360928666 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557a3bf1fa60 0x557a3c05d780 secure :-1 s=READY pgs=113 gs=2 cs=0 l=1 c_cookie=18066842571944014988 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc028009610 tx=0x7fc028002a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=faba5198d1a0b48c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:31.473 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.467+0000 7fbff37fe640 10 client.0 ms_handle_connect on v2:10.20.193.74:3300/0 2026-02-24T09:18:31.473 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.467+0000 7fbff37fe640 1 -- 10.20.193.28:0/360928666 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc0280e4ef0 con 0x557a3bf1fa60 2026-02-24T09:18:31.473 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.467+0000 7fc0428c7e00 1 -- 10.20.193.28:0/360928666 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0340055b0 con 0x557a3bf1fa60 2026-02-24T09:18:31.473 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.468+0000 7fc0428c7e00 10 client.25394 _ll_register_callbacks cb 0x557a3be97980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:31.473 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.468+0000 7fc0428c7e00 1 -- 10.20.193.28:0/360928666 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557a3bbac520 con 0x557a3bf1fa60 2026-02-24T09:18:31.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.468+0000 7fbff37fe640 1 -- 10.20.193.28:0/360928666 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc0280adc10 con 0x557a3bf1fa60 2026-02-24T09:18:31.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.468+0000 7fbff37fe640 1 -- 10.20.193.28:0/360928666 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc0280b7ec0 con 0x557a3bf1fa60 2026-02-24T09:18:31.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.468+0000 7fbff37fe640 1 -- 10.20.193.28:0/360928666 <== mon.2 v2:10.20.193.74:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 8440+0+0 (secure 0 0 0) 0x7fc0280b8020 con 0x557a3bf1fa60 2026-02-24T09:18:31.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.468+0000 7fbff37fe640 1 -- 10.20.193.28:0/360928666 <== mon.2 v2:10.20.193.74:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fc0280722c0 con 0x557a3bf1fa60 2026-02-24T09:18:31.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.468+0000 7fc0428c7e00 10 client.25394 fetch_fsmap learned FSMap version 23 2026-02-24T09:18:31.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.468+0000 7fc0428c7e00 1 -- 10.20.193.28:0/360928666 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({fsmap=23}) -- 0x557a3bea25b0 con 0x557a3bf1fa60 2026-02-24T09:18:31.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.468+0000 7fbff37fe640 1 -- 10.20.193.28:0/360928666 <== mon.2 v2:10.20.193.74:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fc0280ab1f0 con 0x557a3bf1fa60 2026-02-24T09:18:31.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.468+0000 7fc0428c7e00 10 client.25394 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:18:31.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.468+0000 7fc0428c7e00 10 client.25394 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:18:31.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.468+0000 7fc0428c7e00 20 client.25394 populate_metadata read hostname 'trial028' 2026-02-24T09:18:31.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.468+0000 7fc0428c7e00 1 --2- 10.20.193.28:0/360928666 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x557a3c043710 0x557a3c043bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:31.475 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.468+0000 7fc0428c7e00 4 client.25394 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:18:31.475 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.468+0000 7fc0428c7e00 1 -- 10.20.193.28:0/360928666 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a3bede9d0 con 0x557a3c043710 2026-02-24T09:18:31.475 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.469+0000 7fc03d840640 1 --2- 10.20.193.28:0/360928666 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x557a3c043710 0x557a3c043bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:31.475 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.469+0000 7fc03d840640 1 --2- 10.20.193.28:0/360928666 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x557a3c043710 0x557a3c043bb0 crc :-1 s=READY pgs=30 gs=4 cs=0 l=0 c_cookie=18330743770103269690 s_cookie=8819826656032650707 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe63e256a5b5c93a server_cookie=7a66519d3d58f5d3 in_seq=0 out_seq=0 2026-02-24T09:18:31.475 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.469+0000 7fbff37fe640 10 client.25394 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:18:31.476 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.470+0000 7fbff37fe640 1 -- 10.20.193.28:0/360928666 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x557a3bede9d0 con 0x557a3c043710 2026-02-24T09:18:31.476 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.470+0000 7fbff37fe640 10 client.25394 handle_command_reply: tid=0 2026-02-24T09:18:31.476 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.470+0000 7fc0428c7e00 1 client.25394 shutdown 2026-02-24T09:18:31.476 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.470+0000 7fc0428c7e00 1 -- 10.20.193.28:0/360928666 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557a3bf1fa60 msgr2=0x557a3c05d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:31.476 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.470+0000 7fc0428c7e00 1 --2- 10.20.193.28:0/360928666 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557a3bf1fa60 0x557a3c05d780 secure :-1 s=READY pgs=113 gs=2 cs=0 l=1 c_cookie=18066842571944014988 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc028009610 tx=0x7fc028002a80 comp rx=0 tx=0).stop 2026-02-24T09:18:31.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.470+0000 7fc0428c7e00 1 -- 10.20.193.28:0/360928666 shutdown_connections 2026-02-24T09:18:31.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.470+0000 7fc0428c7e00 1 --2- 10.20.193.28:0/360928666 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x557a3c043710 0x557a3c043bb0 crc :-1 s=READY pgs=30 gs=4 cs=0 l=0 c_cookie=18330743770103269690 s_cookie=8819826656032650707 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:31.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.470+0000 7fc0428c7e00 1 --2- 10.20.193.28:0/360928666 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3c046270 0x557a3c062cb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:31.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.470+0000 7fc0428c7e00 1 --2- 10.20.193.28:0/360928666 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557a3c001740 0x557a3c05dcc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:31.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.470+0000 7fc0428c7e00 1 --2- 10.20.193.28:0/360928666 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557a3bf1fa60 0x557a3c05d780 unknown :-1 s=CLOSED pgs=113 gs=2 cs=0 l=1 c_cookie=18066842571944014988 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:31.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.470+0000 7fbff37fe640 0 client.25394 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:18:31.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.470+0000 7fc0428c7e00 1 -- 10.20.193.28:0/360928666 >> 10.20.193.28:0/360928666 conn(0x557a3bf9b490 msgr2=0x557a3bfff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:31.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.470+0000 7fc0428c7e00 1 -- 10.20.193.28:0/360928666 shutdown_connections 2026-02-24T09:18:31.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.470+0000 7fc0428c7e00 1 -- 10.20.193.28:0/360928666 wait complete. 2026-02-24T09:18:31.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.470+0000 7fc0428c7e00 20 client.25394 trim_cache size 0 max 16384 2026-02-24T09:18:31.480 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.478+0000 7fc0428c7e00 1 Processor -- start 2026-02-24T09:18:31.480 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.478+0000 7fc0428c7e00 1 -- start start 2026-02-24T09:18:31.481 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.478+0000 7fc0428c7e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557a3bf1fa60 0x557a3c062220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:31.481 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.478+0000 7fc0428c7e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557a3c001740 0x557a3c045280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:31.481 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.478+0000 7fc0428c7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3c046270 0x557a3c0457c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:31.481 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.478+0000 7fc0428c7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557a3bf0a9d0 con 0x557a3c046270 2026-02-24T09:18:31.481 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.478+0000 7fc0428c7e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x557a3bc4bf10 con 0x557a3c001740 2026-02-24T09:18:31.481 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.478+0000 7fc0428c7e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x557a3bf70580 con 0x557a3bf1fa60 2026-02-24T09:18:31.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.479+0000 7fc03e041640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557a3bf1fa60 0x557a3c062220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:31.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.479+0000 7fc03e041640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557a3bf1fa60 0x557a3c062220 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:56112/0 (socket says 10.20.193.28:56112) 2026-02-24T09:18:31.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.479+0000 7fc03e842640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3c046270 0x557a3c0457c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:31.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.479+0000 7fc03e041640 1 -- 10.20.193.28:0/1621161807 learned_addr learned my addr 10.20.193.28:0/1621161807 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:18:31.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.479+0000 7fc03d840640 1 --2- 10.20.193.28:0/1621161807 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557a3c001740 0x557a3c045280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:31.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.479+0000 7fc03e041640 1 -- 10.20.193.28:0/1621161807 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557a3c001740 msgr2=0x557a3c045280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:31.483 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.479+0000 7fc03e041640 1 --2- 10.20.193.28:0/1621161807 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557a3c001740 0x557a3c045280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:31.483 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.479+0000 7fc03e041640 1 -- 10.20.193.28:0/1621161807 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3c046270 msgr2=0x557a3c0457c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:31.483 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.479+0000 7fc03e041640 1 --2- 10.20.193.28:0/1621161807 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3c046270 0x557a3c0457c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:31.483 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.479+0000 7fc03e041640 1 -- 10.20.193.28:0/1621161807 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a3c04fcd0 con 0x557a3bf1fa60 2026-02-24T09:18:31.487 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.479+0000 7fc03e041640 1 --2- 10.20.193.28:0/1621161807 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557a3bf1fa60 0x557a3c062220 secure :-1 s=READY pgs=113 gs=1 cs=0 l=1 c_cookie=121012213179096939 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc0280e4ab0 tx=0x7fc02801b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1adebf77c061f6b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:31.488 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.479+0000 7fc005bfe640 1 -- 10.20.193.28:0/1621161807 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc0280adc10 con 0x557a3bf1fa60 2026-02-24T09:18:31.488 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.479+0000 7fc005bfe640 1 -- 10.20.193.28:0/1621161807 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc0280c8060 con 0x557a3bf1fa60 2026-02-24T09:18:31.488 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.479+0000 7fc005bfe640 1 -- 10.20.193.28:0/1621161807 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc0280b8350 con 0x557a3bf1fa60 2026-02-24T09:18:31.488 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.480+0000 7fc0428c7e00 1 -- 10.20.193.28:0/1621161807 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557a3bf1fa60 msgr2=0x557a3c062220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:31.488 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.480+0000 7fc0428c7e00 1 --2- 10.20.193.28:0/1621161807 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557a3bf1fa60 0x557a3c062220 secure :-1 s=READY pgs=113 gs=1 cs=0 l=1 c_cookie=121012213179096939 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc0280e4ab0 tx=0x7fc02801b000 comp rx=0 tx=0).stop 2026-02-24T09:18:31.488 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.480+0000 7fc0428c7e00 1 -- 10.20.193.28:0/1621161807 shutdown_connections 2026-02-24T09:18:31.488 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.480+0000 7fc0428c7e00 1 --2- 10.20.193.28:0/1621161807 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3c046270 0x557a3c0457c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:31.488 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.480+0000 7fc0428c7e00 1 --2- 10.20.193.28:0/1621161807 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557a3c001740 0x557a3c045280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:31.488 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.480+0000 7fc0428c7e00 1 --2- 10.20.193.28:0/1621161807 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557a3bf1fa60 0x557a3c062220 unknown :-1 s=CLOSED pgs=113 gs=1 cs=0 l=1 c_cookie=121012213179096939 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:31.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.480+0000 7fc0428c7e00 1 -- 10.20.193.28:0/1621161807 >> 10.20.193.28:0/1621161807 conn(0x557a3bf9b490 msgr2=0x557a3c061b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:31.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.480+0000 7fc0428c7e00 1 -- 10.20.193.28:0/1621161807 shutdown_connections 2026-02-24T09:18:31.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.480+0000 7fc0428c7e00 1 -- 10.20.193.28:0/1621161807 wait complete. 2026-02-24T09:18:31.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.480+0000 7fc0428c7e00 1 -- start start 2026-02-24T09:18:31.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.480+0000 7fc0428c7e00 1 Processor -- start 2026-02-24T09:18:31.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.481+0000 7fc0428c7e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557a3bf1fa60 0x557a3bfe4e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:31.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.481+0000 7fc0428c7e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557a3c001740 0x557a3bfe0610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:31.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.481+0000 7fc0428c7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3c046270 0x557a3bfe0b50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:31.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.481+0000 7fc0428c7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557a3bfe1250 con 0x557a3c046270 2026-02-24T09:18:31.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.481+0000 7fc0428c7e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x557a3bfe13c0 con 0x557a3bf1fa60 2026-02-24T09:18:31.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.481+0000 7fc0428c7e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x557a3c0ac170 con 0x557a3c001740 2026-02-24T09:18:31.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.481+0000 7fc03e842640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3c046270 0x557a3bfe0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:31.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.481+0000 7fc03e041640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557a3bf1fa60 0x557a3bfe4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:31.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.481+0000 7fc03d840640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557a3c001740 0x557a3bfe0610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:31.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.481+0000 7fc03e041640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557a3bf1fa60 0x557a3bfe4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:35100/0 (socket says 10.20.193.28:35100) 2026-02-24T09:18:31.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.481+0000 7fc03e041640 1 -- 10.20.193.28:0/2093550339 learned_addr learned my addr 10.20.193.28:0/2093550339 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:18:31.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.481+0000 7fc03e041640 1 -- 10.20.193.28:0/2093550339 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557a3c001740 msgr2=0x557a3bfe0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:31.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.481+0000 7fc03e041640 1 --2- 10.20.193.28:0/2093550339 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557a3c001740 0x557a3bfe0610 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:31.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.481+0000 7fc03e041640 1 -- 10.20.193.28:0/2093550339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3c046270 msgr2=0x557a3bfe0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:31.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.481+0000 7fc03e041640 1 --2- 10.20.193.28:0/2093550339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3c046270 0x557a3bfe0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:31.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.481+0000 7fc03e041640 1 -- 10.20.193.28:0/2093550339 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a3be9d030 con 0x557a3bf1fa60 2026-02-24T09:18:31.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.481+0000 7fc03d840640 1 --2- 10.20.193.28:0/2093550339 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557a3c001740 0x557a3bfe0610 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:18:31.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.481+0000 7fc03e041640 1 --2- 10.20.193.28:0/2093550339 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557a3bf1fa60 0x557a3bfe4e10 secure :-1 s=READY pgs=114 gs=1 cs=0 l=1 c_cookie=17109651991247826830 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc0280ad1a0 tx=0x7fc028002390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed71b1d5d0e1af8e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:31.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.481+0000 7fbff37fe640 10 client.0 ms_handle_connect on v2:10.20.193.74:3300/0 2026-02-24T09:18:31.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.482+0000 7fbff37fe640 1 -- 10.20.193.28:0/2093550339 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc0280e4ef0 con 0x557a3bf1fa60 2026-02-24T09:18:31.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.482+0000 7fbff37fe640 1 -- 10.20.193.28:0/2093550339 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x557a3bbac520 con 0x557a3bf1fa60 2026-02-24T09:18:31.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.482+0000 7fc0428c7e00 1 -- 10.20.193.28:0/2093550339 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a3bea25b0 con 0x557a3bf1fa60 2026-02-24T09:18:31.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.482+0000 7fbff37fe640 1 -- 10.20.193.28:0/2093550339 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc0280b8120 con 0x557a3bf1fa60 2026-02-24T09:18:31.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.482+0000 7fbff37fe640 1 -- 10.20.193.28:0/2093550339 <== mon.2 v2:10.20.193.74:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 8440+0+0 (secure 0 0 0) 0x7fc0280adea0 con 0x557a3bf1fa60 2026-02-24T09:18:31.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.482+0000 7fbff37fe640 10 client.25400 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-24T09:18:31.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.482+0000 7fc0428c7e00 10 client.25400 _ll_register_callbacks cb 0x557a3be97980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:31.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.482+0000 7fc0428c7e00 1 -- 10.20.193.28:0/2093550339 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557a3bf3dd30 con 0x557a3bf1fa60 2026-02-24T09:18:31.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.482+0000 7fbff37fe640 1 -- 10.20.193.28:0/2093550339 <== mon.2 v2:10.20.193.74:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fc0280b2fa0 con 0x557a3bf1fa60 2026-02-24T09:18:31.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.482+0000 7fc0428c7e00 10 client.25400 fetch_fsmap learned FSMap version 23 2026-02-24T09:18:31.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.482+0000 7fc0428c7e00 1 -- 10.20.193.28:0/2093550339 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({fsmap=23}) -- 0x557a3be91010 con 0x557a3bf1fa60 2026-02-24T09:18:31.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.482+0000 7fbff37fe640 1 -- 10.20.193.28:0/2093550339 <== mon.2 v2:10.20.193.74:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fc0280722c0 con 0x557a3bf1fa60 2026-02-24T09:18:31.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.482+0000 7fc0428c7e00 10 client.25400 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:18:31.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.482+0000 7fc0428c7e00 10 client.25400 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:18:31.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.482+0000 7fc0428c7e00 20 client.25400 populate_metadata read hostname 'trial028' 2026-02-24T09:18:31.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.482+0000 7fc0428c7e00 1 --2- 10.20.193.28:0/2093550339 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x557a3c0f3800 0x557a3c113be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:31.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.482+0000 7fc0428c7e00 4 client.25400 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-24T09:18:31.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.482+0000 7fc0428c7e00 1 -- 10.20.193.28:0/2093550339 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557a3bbf0640 con 0x557a3c0f3800 2026-02-24T09:18:31.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.483+0000 7fc03d840640 1 --2- 10.20.193.28:0/2093550339 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x557a3c0f3800 0x557a3c113be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:31.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.483+0000 7fc03d840640 1 --2- 10.20.193.28:0/2093550339 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x557a3c0f3800 0x557a3c113be0 crc :-1 s=READY pgs=31 gs=4 cs=0 l=0 c_cookie=14433796373033657405 s_cookie=7864614533143921843 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c84f2553e6fe243d server_cookie=6d24b93fd76b04b3 in_seq=0 out_seq=0 2026-02-24T09:18:31.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.483+0000 7fbff37fe640 10 client.25400 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:18:31.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.488+0000 7fbff37fe640 1 -- 10.20.193.28:0/2093550339 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557a3bbf0640 con 0x557a3c0f3800 2026-02-24T09:18:31.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.488+0000 7fbff37fe640 10 client.25400 handle_command_reply: tid=0 2026-02-24T09:18:31.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.488+0000 7fc0428c7e00 1 client.25400 shutdown 2026-02-24T09:18:31.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.488+0000 7fc0428c7e00 1 -- 10.20.193.28:0/2093550339 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557a3bf1fa60 msgr2=0x557a3bfe4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:31.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.488+0000 7fc0428c7e00 1 --2- 10.20.193.28:0/2093550339 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557a3bf1fa60 0x557a3bfe4e10 secure :-1 s=READY pgs=114 gs=1 cs=0 l=1 c_cookie=17109651991247826830 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc0280ad1a0 tx=0x7fc028002390 comp rx=0 tx=0).stop 2026-02-24T09:18:31.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.488+0000 7fc0428c7e00 1 -- 10.20.193.28:0/2093550339 shutdown_connections 2026-02-24T09:18:31.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.488+0000 7fc0428c7e00 1 --2- 10.20.193.28:0/2093550339 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x557a3c0f3800 0x557a3c113be0 crc :-1 s=READY pgs=31 gs=4 cs=0 l=0 c_cookie=14433796373033657405 s_cookie=7864614533143921843 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:31.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.488+0000 7fc0428c7e00 1 --2- 10.20.193.28:0/2093550339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3c046270 0x557a3bfe0b50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:31.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.488+0000 7fc0428c7e00 1 --2- 10.20.193.28:0/2093550339 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557a3c001740 0x557a3bfe0610 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:31.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.488+0000 7fc0428c7e00 1 --2- 10.20.193.28:0/2093550339 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557a3bf1fa60 0x557a3bfe4e10 unknown :-1 s=CLOSED pgs=114 gs=1 cs=0 l=1 c_cookie=17109651991247826830 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:31.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.488+0000 7fbff37fe640 0 client.25400 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:18:31.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.488+0000 7fc0428c7e00 1 -- 10.20.193.28:0/2093550339 >> 10.20.193.28:0/2093550339 conn(0x557a3bf9b490 msgr2=0x557a3c062300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:31.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.488+0000 7fc0428c7e00 1 -- 10.20.193.28:0/2093550339 shutdown_connections 2026-02-24T09:18:31.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.488+0000 7fc0428c7e00 1 -- 10.20.193.28:0/2093550339 wait complete. 2026-02-24T09:18:31.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.488+0000 7fc0428c7e00 20 client.25400 trim_cache size 0 max 16384 2026-02-24T09:18:31.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-24T09:18:31.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-24T09:18:31.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-24T09:18:31.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-24T09:18:31.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.489+0000 7fc03f043640 1 -- 10.20.193.28:0/2596718033 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc0140b5950 msgr2=0x7fc0140d5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:31.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.489+0000 7fc03f043640 1 --2- 10.20.193.28:0/2596718033 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc0140b5950 0x7fc0140d5e00 secure :-1 s=READY pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc038101f30 tx=0x7fc02c03a040 comp rx=0 tx=0).stop 2026-02-24T09:18:31.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.489+0000 7fc03f043640 1 -- 10.20.193.28:0/2596718033 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc038113950 msgr2=0x7fc0380fb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:31.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.489+0000 7fc03f043640 1 --2- 10.20.193.28:0/2596718033 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc038113950 0x7fc0380fb5e0 secure :-1 s=READY pgs=401 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc02800d950 tx=0x7fc02800de20 comp rx=0 tx=0).stop 2026-02-24T09:18:31.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.489+0000 7fc03f043640 1 -- 10.20.193.28:0/2596718033 shutdown_connections 2026-02-24T09:18:31.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.489+0000 7fc03f043640 1 --2- 10.20.193.28:0/2596718033 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc0140b5950 0x7fc0140d5e00 unknown :-1 s=CLOSED pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:31.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.489+0000 7fc03f043640 1 --2- 10.20.193.28:0/2596718033 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc038119b40 0x7fc0380fbce0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:31.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.489+0000 7fc03f043640 1 --2- 10.20.193.28:0/2596718033 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc038114340 0x7fc03817a410 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:31.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.489+0000 7fc03f043640 1 --2- 10.20.193.28:0/2596718033 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc038113950 0x7fc0380fb5e0 unknown :-1 s=CLOSED pgs=401 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:31.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.489+0000 7fc03f043640 1 -- 10.20.193.28:0/2596718033 >> 10.20.193.28:0/2596718033 conn(0x7fc0380619a0 msgr2=0x7fc038062d40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:31.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.489+0000 7fc03f043640 1 -- 10.20.193.28:0/2596718033 shutdown_connections 2026-02-24T09:18:31.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:31.489+0000 7fc03f043640 1 -- 10.20.193.28:0/2596718033 wait complete. 2026-02-24T09:18:32.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:32 trial074 ceph-mon[44412]: pgmap v228: 97 pgs: 97 active+clean; 958 MiB data, 3.0 GiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 68 MiB/s wr, 26 op/s 2026-02-24T09:18:32.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:32 trial159 ceph-mon[44242]: pgmap v228: 97 pgs: 97 active+clean; 958 MiB data, 3.0 GiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 68 MiB/s wr, 26 op/s 2026-02-24T09:18:32.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:32 trial028 ceph-mon[40371]: pgmap v228: 97 pgs: 97 active+clean; 958 MiB data, 3.0 GiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 68 MiB/s wr, 26 op/s 2026-02-24T09:18:34.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:34 trial074 ceph-mon[44412]: pgmap v229: 97 pgs: 97 active+clean; 1006 MiB data, 3.2 GiB used, 8.2 TiB / 8.2 TiB avail; 7.1 KiB/s rd, 63 MiB/s wr, 24 op/s 2026-02-24T09:18:34.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:34 trial159 ceph-mon[44242]: pgmap v229: 97 pgs: 97 active+clean; 1006 MiB data, 3.2 GiB used, 8.2 TiB / 8.2 TiB avail; 7.1 KiB/s rd, 63 MiB/s wr, 24 op/s 2026-02-24T09:18:34.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:34 trial028 ceph-mon[40371]: pgmap v229: 97 pgs: 97 active+clean; 1006 MiB data, 3.2 GiB used, 8.2 TiB / 8.2 TiB avail; 7.1 KiB/s rd, 63 MiB/s wr, 24 op/s 2026-02-24T09:18:36.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:36 trial159 ceph-mon[44242]: pgmap v230: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 263 KiB/s rd, 51 MiB/s wr, 84 op/s 2026-02-24T09:18:36.799 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:36 trial074 ceph-mon[44412]: pgmap v230: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 263 KiB/s rd, 51 MiB/s wr, 84 op/s 2026-02-24T09:18:36.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:36 trial028 ceph-mon[40371]: pgmap v230: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 263 KiB/s rd, 51 MiB/s wr, 84 op/s 2026-02-24T09:18:38.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:38 trial159 ceph-mon[44242]: pgmap v231: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 46 MiB/s wr, 277 op/s 2026-02-24T09:18:38.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:38 trial028 ceph-mon[40371]: pgmap v231: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 46 MiB/s wr, 277 op/s 2026-02-24T09:18:38.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:38 trial074 ceph-mon[44412]: pgmap v231: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 46 MiB/s wr, 277 op/s 2026-02-24T09:18:39.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:39 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]} : dispatch 2026-02-24T09:18:39.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:39 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]} : dispatch 2026-02-24T09:18:39.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:39 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]} : dispatch 2026-02-24T09:18:40.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:40 trial159 ceph-mon[44242]: pgmap v232: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 MiB/s rd, 36 MiB/s wr, 643 op/s 2026-02-24T09:18:40.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:40 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2026-02-24T09:18:40.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:40 trial159 ceph-mon[44242]: osdmap e95: 12 total, 12 up, 12 in 2026-02-24T09:18:40.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:40 trial028 ceph-mon[40371]: pgmap v232: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 MiB/s rd, 36 MiB/s wr, 643 op/s 2026-02-24T09:18:40.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:40 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2026-02-24T09:18:40.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:40 trial028 ceph-mon[40371]: osdmap e95: 12 total, 12 up, 12 in 2026-02-24T09:18:40.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:40 trial074 ceph-mon[44412]: pgmap v232: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 MiB/s rd, 36 MiB/s wr, 643 op/s 2026-02-24T09:18:40.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:40 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2026-02-24T09:18:40.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:40 trial074 ceph-mon[44412]: osdmap e95: 12 total, 12 up, 12 in 2026-02-24T09:18:41.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:41 trial159 ceph-mon[44242]: osdmap e96: 12 total, 12 up, 12 in 2026-02-24T09:18:41.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:41 trial028 ceph-mon[40371]: osdmap e96: 12 total, 12 up, 12 in 2026-02-24T09:18:41.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:41 trial074 ceph-mon[44412]: osdmap e96: 12 total, 12 up, 12 in 2026-02-24T09:18:42.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:42 trial028 ceph-mon[40371]: pgmap v235: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 4.9 MiB/s rd, 21 MiB/s wr, 1.27k op/s 2026-02-24T09:18:42.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:42 trial028 ceph-mon[40371]: mgrmap e23: x(active, since 5m), standbys: y, z 2026-02-24T09:18:42.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:42 trial159 ceph-mon[44242]: pgmap v235: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 4.9 MiB/s rd, 21 MiB/s wr, 1.27k op/s 2026-02-24T09:18:42.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:42 trial159 ceph-mon[44242]: mgrmap e23: x(active, since 5m), standbys: y, z 2026-02-24T09:18:42.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:42 trial074 ceph-mon[44412]: pgmap v235: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 4.9 MiB/s rd, 21 MiB/s wr, 1.27k op/s 2026-02-24T09:18:42.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:42 trial074 ceph-mon[44412]: mgrmap e23: x(active, since 5m), standbys: y, z 2026-02-24T09:18:44.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.567+0000 7fd697577640 1 -- 10.20.193.28:0/2661672565 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd69810f3c0 msgr2=0x7fd69810f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:44.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.567+0000 7fd697577640 1 --2- 10.20.193.28:0/2661672565 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd69810f3c0 0x7fd69810f790 secure :-1 s=READY pgs=403 gs=1 cs=0 l=1 c_cookie=13563739822205585973 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd68c009950 tx=0x7fd68c02f190 comp rx=0 tx=0).stop 2026-02-24T09:18:44.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.567+0000 7fd697577640 1 -- 10.20.193.28:0/2661672565 shutdown_connections 2026-02-24T09:18:44.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.567+0000 7fd697577640 1 --2- 10.20.193.28:0/2661672565 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fd6981155b0 0x7fd698175f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:44.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.567+0000 7fd697577640 1 --2- 10.20.193.28:0/2661672565 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fd69810fdb0 0x7fd698114e00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:44.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.567+0000 7fd697577640 1 --2- 10.20.193.28:0/2661672565 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd69810f3c0 0x7fd69810f790 unknown :-1 s=CLOSED pgs=403 gs=1 cs=0 l=1 c_cookie=13563739822205585973 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:44.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.567+0000 7fd697577640 1 -- 10.20.193.28:0/2661672565 >> 10.20.193.28:0/2661672565 conn(0x7fd6980ecc70 msgr2=0x7fd69810d080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:44.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.567+0000 7fd697577640 1 -- 10.20.193.28:0/2661672565 shutdown_connections 2026-02-24T09:18:44.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.568+0000 7fd697577640 1 -- 10.20.193.28:0/2661672565 wait complete. 2026-02-24T09:18:44.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.568+0000 7fd697577640 1 Processor -- start 2026-02-24T09:18:44.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.568+0000 7fd697577640 1 -- start start 2026-02-24T09:18:44.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.569+0000 7fd697577640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fd69810f3c0 0x7fd6980667c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:44.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.569+0000 7fd697577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd69810fdb0 0x7fd698062a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:44.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.569+0000 7fd697577640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fd6981155b0 0x7fd6980630e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:44.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.569+0000 7fd697577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd698063870 con 0x7fd69810fdb0 2026-02-24T09:18:44.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.569+0000 7fd697577640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fd698167b80 con 0x7fd69810f3c0 2026-02-24T09:18:44.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.569+0000 7fd697577640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd698167d40 con 0x7fd6981155b0 2026-02-24T09:18:44.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.569+0000 7fd695d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd69810fdb0 0x7fd698062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:44.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.569+0000 7fd695d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd69810fdb0 0x7fd698062a30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43298/0 (socket says 10.20.193.28:43298) 2026-02-24T09:18:44.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.569+0000 7fd695d74640 1 -- 10.20.193.28:0/3742735387 learned_addr learned my addr 10.20.193.28:0/3742735387 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:18:44.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.569+0000 7fd696575640 1 --2- 10.20.193.28:0/3742735387 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fd69810f3c0 0x7fd6980667c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:44.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.569+0000 7fd695d74640 1 -- 10.20.193.28:0/3742735387 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fd6981155b0 msgr2=0x7fd6980630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:44.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.569+0000 7fd695d74640 1 --2- 10.20.193.28:0/3742735387 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fd6981155b0 0x7fd6980630e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:44.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.569+0000 7fd695d74640 1 -- 10.20.193.28:0/3742735387 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fd69810f3c0 msgr2=0x7fd6980667c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:44.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.569+0000 7fd695d74640 1 --2- 10.20.193.28:0/3742735387 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fd69810f3c0 0x7fd6980667c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:44.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.569+0000 7fd695d74640 1 -- 10.20.193.28:0/3742735387 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd68c009570 con 0x7fd69810fdb0 2026-02-24T09:18:44.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.569+0000 7fd695d74640 1 --2- 10.20.193.28:0/3742735387 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd69810fdb0 0x7fd698062a30 secure :-1 s=READY pgs=404 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd680005db0 tx=0x7fd68000ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:44.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.570+0000 7fd67f7fe640 1 -- 10.20.193.28:0/3742735387 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd680004500 con 0x7fd69810fdb0 2026-02-24T09:18:44.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.570+0000 7fd67f7fe640 1 -- 10.20.193.28:0/3742735387 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd680004d10 con 0x7fd69810fdb0 2026-02-24T09:18:44.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.570+0000 7fd67f7fe640 1 -- 10.20.193.28:0/3742735387 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd680005280 con 0x7fd69810fdb0 2026-02-24T09:18:44.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.570+0000 7fd697577640 1 -- 10.20.193.28:0/3742735387 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd698167fc0 con 0x7fd69810fdb0 2026-02-24T09:18:44.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.570+0000 7fd697577640 1 -- 10.20.193.28:0/3742735387 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd698168440 con 0x7fd69810fdb0 2026-02-24T09:18:44.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.572+0000 7fd67f7fe640 1 -- 10.20.193.28:0/3742735387 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7fd680005410 con 0x7fd69810fdb0 2026-02-24T09:18:44.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.574+0000 7fd67f7fe640 1 --2- 10.20.193.28:0/3742735387 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fd6700b58d0 0x7fd6700d5d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:44.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.574+0000 7fd67f7fe640 1 -- 10.20.193.28:0/3742735387 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7fd6800e7060 con 0x7fd69810fdb0 2026-02-24T09:18:44.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.575+0000 7fd696575640 1 --2- 10.20.193.28:0/3742735387 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fd6700b58d0 0x7fd6700d5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:44.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.575+0000 7fd69f261e00 1 Processor -- start 2026-02-24T09:18:44.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.575+0000 7fd69f261e00 1 -- start start 2026-02-24T09:18:44.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.575+0000 7fd696575640 1 --2- 10.20.193.28:0/3742735387 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fd6700b58d0 0x7fd6700d5d80 secure :-1 s=READY pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd68c0023d0 tx=0x7fd68c031040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:44.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.575+0000 7fd69f261e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ef351a60 0x5637ef433200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:44.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.575+0000 7fd69f261e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5637ef433740 0x5637ef433b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:44.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.576+0000 7fd69f261e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5637ef478270 0x5637ef498650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:44.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.576+0000 7fd69f261e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5637ef348f10 con 0x5637ef351a60 2026-02-24T09:18:44.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.576+0000 7fd69f261e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x5637ef344c40 con 0x5637ef478270 2026-02-24T09:18:44.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.576+0000 7fd696575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ef351a60 0x5637ef433200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:44.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.576+0000 7fd696575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ef351a60 0x5637ef433200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43300/0 (socket says 10.20.193.28:43300) 2026-02-24T09:18:44.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.576+0000 7fd696575640 1 -- 10.20.193.28:0/1608053247 learned_addr learned my addr 10.20.193.28:0/1608053247 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:18:44.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.576+0000 7fd69f261e00 1 -- 10.20.193.28:0/1608053247 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x5637ef33eda0 con 0x5637ef433740 2026-02-24T09:18:44.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.576+0000 7fd695d74640 1 --2- 10.20.193.28:0/1608053247 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5637ef433740 0x5637ef433b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:44.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.576+0000 7fd696d76640 1 --2- 10.20.193.28:0/1608053247 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5637ef478270 0x5637ef498650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:44.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.576+0000 7fd696575640 1 -- 10.20.193.28:0/1608053247 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5637ef433740 msgr2=0x5637ef433b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:44.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.576+0000 7fd696575640 1 --2- 10.20.193.28:0/1608053247 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5637ef433740 0x5637ef433b90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:44.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.576+0000 7fd696575640 1 -- 10.20.193.28:0/1608053247 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5637ef478270 msgr2=0x5637ef498650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:44.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.576+0000 7fd696575640 1 --2- 10.20.193.28:0/1608053247 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5637ef478270 0x5637ef498650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:44.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.576+0000 7fd696575640 1 -- 10.20.193.28:0/1608053247 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637ef2ea340 con 0x5637ef351a60 2026-02-24T09:18:44.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.576+0000 7fd695d74640 1 --2- 10.20.193.28:0/1608053247 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5637ef433740 0x5637ef433b90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:18:44.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.576+0000 7fd696575640 1 --2- 10.20.193.28:0/1608053247 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ef351a60 0x5637ef433200 secure :-1 s=READY pgs=405 gs=1 cs=0 l=1 c_cookie=9531915959768970715 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd68c005920 tx=0x7fd68c040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84482b102ae7f5db server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:44.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.577+0000 7fd67cbfe640 1 -- 10.20.193.28:0/1608053247 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd68c02fc10 con 0x5637ef351a60 2026-02-24T09:18:44.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.577+0000 7fd67cbfe640 1 -- 10.20.193.28:0/1608053247 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd68c002e20 con 0x5637ef351a60 2026-02-24T09:18:44.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.577+0000 7fd67cbfe640 1 -- 10.20.193.28:0/1608053247 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd68c04f7a0 con 0x5637ef351a60 2026-02-24T09:18:44.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.577+0000 7fd69f261e00 1 -- 10.20.193.28:0/1608053247 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ef351a60 msgr2=0x5637ef433200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:44.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.577+0000 7fd69f261e00 1 --2- 10.20.193.28:0/1608053247 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ef351a60 0x5637ef433200 secure :-1 s=READY pgs=405 gs=1 cs=0 l=1 c_cookie=9531915959768970715 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd68c005920 tx=0x7fd68c040000 comp rx=0 tx=0).stop 2026-02-24T09:18:44.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.577+0000 7fd69f261e00 1 -- 10.20.193.28:0/1608053247 shutdown_connections 2026-02-24T09:18:44.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.577+0000 7fd69f261e00 1 --2- 10.20.193.28:0/1608053247 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5637ef478270 0x5637ef498650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:44.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.577+0000 7fd69f261e00 1 --2- 10.20.193.28:0/1608053247 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5637ef433740 0x5637ef433b90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:44.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.577+0000 7fd69f261e00 1 --2- 10.20.193.28:0/1608053247 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ef351a60 0x5637ef433200 unknown :-1 s=CLOSED pgs=405 gs=1 cs=0 l=1 c_cookie=9531915959768970715 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:44.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.577+0000 7fd69f261e00 1 -- 10.20.193.28:0/1608053247 >> 10.20.193.28:0/1608053247 conn(0x5637ef3cd490 msgr2=0x5637ef431ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:44.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.577+0000 7fd69f261e00 1 -- 10.20.193.28:0/1608053247 shutdown_connections 2026-02-24T09:18:44.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.577+0000 7fd69f261e00 1 -- 10.20.193.28:0/1608053247 wait complete. 2026-02-24T09:18:44.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.578+0000 7fd69f261e00 1 -- start start 2026-02-24T09:18:44.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.579+0000 7fd69f261e00 1 Processor -- start 2026-02-24T09:18:44.588 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.579+0000 7fd69f261e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5637ef351a60 0x5637ef48f6e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:44.588 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.579+0000 7fd69f261e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5637ef433740 0x5637ef48fc20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:44.588 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.579+0000 7fd69f261e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ef478270 0x5637ef494c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:44.588 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.579+0000 7fd69f261e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5637ef495150 con 0x5637ef478270 2026-02-24T09:18:44.588 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.579+0000 7fd69f261e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x5637ef4952c0 con 0x5637ef351a60 2026-02-24T09:18:44.588 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.579+0000 7fd69f261e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x5637ef495480 con 0x5637ef433740 2026-02-24T09:18:44.588 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.579+0000 7fd695d74640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5637ef433740 0x5637ef48fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:44.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.579+0000 7fd696d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ef478270 0x5637ef494c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:44.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.579+0000 7fd696575640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5637ef351a60 0x5637ef48f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:44.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.580+0000 7fd696d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ef478270 0x5637ef494c10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43308/0 (socket says 10.20.193.28:43308) 2026-02-24T09:18:44.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.580+0000 7fd696d76640 1 -- 10.20.193.28:0/2684679107 learned_addr learned my addr 10.20.193.28:0/2684679107 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:18:44.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.580+0000 7fd696d76640 1 -- 10.20.193.28:0/2684679107 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5637ef433740 msgr2=0x5637ef48fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:44.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.580+0000 7fd696d76640 1 --2- 10.20.193.28:0/2684679107 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5637ef433740 0x5637ef48fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:44.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.580+0000 7fd696d76640 1 -- 10.20.193.28:0/2684679107 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5637ef351a60 msgr2=0x5637ef48f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:44.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.580+0000 7fd696d76640 1 --2- 10.20.193.28:0/2684679107 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5637ef351a60 0x5637ef48f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:44.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.580+0000 7fd696d76640 1 -- 10.20.193.28:0/2684679107 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637ef2c2ce0 con 0x5637ef478270 2026-02-24T09:18:44.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.580+0000 7fd696d76640 1 --2- 10.20.193.28:0/2684679107 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ef478270 0x5637ef494c10 secure :-1 s=READY pgs=406 gs=3 cs=0 l=1 c_cookie=14561686914199092225 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd688003cb0 tx=0x7fd6880117a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca158118eb4a7c01 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:44.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.580+0000 7fd647fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:18:44.590 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.580+0000 7fd647fff640 1 -- 10.20.193.28:0/2684679107 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd688012660 con 0x5637ef478270 2026-02-24T09:18:44.590 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.580+0000 7fd647fff640 1 -- 10.20.193.28:0/2684679107 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd688012c80 con 0x5637ef478270 2026-02-24T09:18:44.590 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.580+0000 7fd647fff640 1 -- 10.20.193.28:0/2684679107 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd68801ad00 con 0x5637ef478270 2026-02-24T09:18:44.590 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.580+0000 7fd69f261e00 1 -- 10.20.193.28:0/2684679107 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6981767f0 con 0x5637ef478270 2026-02-24T09:18:44.590 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.580+0000 7fd647fff640 1 -- 10.20.193.28:0/2684679107 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7fd6880193c0 con 0x5637ef478270 2026-02-24T09:18:44.590 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.581+0000 7fd647fff640 10 client.15615 inactive, discarding osd_map(96..96 src has 1..96) 2026-02-24T09:18:44.590 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.581+0000 7fd69f261e00 10 client.15615 _ll_register_callbacks cb 0x5637ef2c9980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:44.590 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.581+0000 7fd69f261e00 1 -- 10.20.193.28:0/2684679107 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5637eefde520 con 0x5637ef478270 2026-02-24T09:18:44.590 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.581+0000 7fd647fff640 1 -- 10.20.193.28:0/2684679107 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fd68801ae90 con 0x5637ef478270 2026-02-24T09:18:44.590 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.581+0000 7fd69f261e00 10 client.15615 fetch_fsmap learned FSMap version 23 2026-02-24T09:18:44.590 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.581+0000 7fd69f261e00 1 -- 10.20.193.28:0/2684679107 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x5637ef2d45b0 con 0x5637ef478270 2026-02-24T09:18:44.590 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.581+0000 7fd647fff640 1 -- 10.20.193.28:0/2684679107 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fd68801a410 con 0x5637ef478270 2026-02-24T09:18:44.590 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.581+0000 7fd69f261e00 10 client.15615 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:18:44.591 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.581+0000 7fd69f261e00 10 client.15615 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:18:44.591 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.581+0000 7fd69f261e00 20 client.15615 populate_metadata read hostname 'trial028' 2026-02-24T09:18:44.591 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.581+0000 7fd69f261e00 1 --2- 10.20.193.28:0/2684679107 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5637ef4756e0 0x5637ef475b50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:44.591 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.581+0000 7fd69f261e00 4 client.15615 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:18:44.591 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.581+0000 7fd69f261e00 1 -- 10.20.193.28:0/2684679107 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637ef3109d0 con 0x5637ef4756e0 2026-02-24T09:18:44.591 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.582+0000 7fd696575640 1 --2- 10.20.193.28:0/2684679107 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5637ef4756e0 0x5637ef475b50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:44.591 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.582+0000 7fd696575640 1 --2- 10.20.193.28:0/2684679107 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5637ef4756e0 0x5637ef475b50 crc :-1 s=READY pgs=34 gs=4 cs=0 l=0 c_cookie=14917008063500834072 s_cookie=11028803851598538909 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf03dbccd09ad518 server_cookie=990e2eab7ffda89d in_seq=0 out_seq=0 2026-02-24T09:18:44.591 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.582+0000 7fd647fff640 10 client.15615 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:18:44.591 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.583+0000 7fd647fff640 1 -- 10.20.193.28:0/2684679107 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5637ef3109d0 con 0x5637ef4756e0 2026-02-24T09:18:44.591 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.583+0000 7fd647fff640 10 client.15615 handle_command_reply: tid=0 2026-02-24T09:18:44.591 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.583+0000 7fd69f261e00 1 client.15615 shutdown 2026-02-24T09:18:44.592 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.583+0000 7fd69f261e00 1 -- 10.20.193.28:0/2684679107 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ef478270 msgr2=0x5637ef494c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:44.592 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.583+0000 7fd69f261e00 1 --2- 10.20.193.28:0/2684679107 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ef478270 0x5637ef494c10 secure :-1 s=READY pgs=406 gs=3 cs=0 l=1 c_cookie=14561686914199092225 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd688003cb0 tx=0x7fd6880117a0 comp rx=0 tx=0).stop 2026-02-24T09:18:44.592 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.583+0000 7fd69f261e00 1 -- 10.20.193.28:0/2684679107 shutdown_connections 2026-02-24T09:18:44.592 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.583+0000 7fd69f261e00 1 --2- 10.20.193.28:0/2684679107 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5637ef4756e0 0x5637ef475b50 crc :-1 s=READY pgs=34 gs=4 cs=0 l=0 c_cookie=14917008063500834072 s_cookie=11028803851598538909 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:44.592 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.583+0000 7fd69f261e00 1 --2- 10.20.193.28:0/2684679107 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ef478270 0x5637ef494c10 unknown :-1 s=CLOSED pgs=406 gs=3 cs=0 l=1 c_cookie=14561686914199092225 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:44.592 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.583+0000 7fd69f261e00 1 --2- 10.20.193.28:0/2684679107 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5637ef433740 0x5637ef48fc20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:44.592 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.583+0000 7fd69f261e00 1 --2- 10.20.193.28:0/2684679107 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5637ef351a60 0x5637ef48f6e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:44.592 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.583+0000 7fd69f261e00 1 -- 10.20.193.28:0/2684679107 >> 10.20.193.28:0/2684679107 conn(0x5637ef3cd490 msgr2=0x5637ef4312f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:44.592 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.584+0000 7fd647fff640 0 client.15615 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:18:44.592 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.584+0000 7fd69f261e00 1 -- 10.20.193.28:0/2684679107 shutdown_connections 2026-02-24T09:18:44.592 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.584+0000 7fd69f261e00 1 -- 10.20.193.28:0/2684679107 wait complete. 2026-02-24T09:18:44.592 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.584+0000 7fd69f261e00 20 client.15615 trim_cache size 0 max 16384 2026-02-24T09:18:44.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.591+0000 7fd69f261e00 1 Processor -- start 2026-02-24T09:18:44.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.591+0000 7fd69f261e00 1 -- start start 2026-02-24T09:18:44.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.591+0000 7fd69f261e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5637ef351a60 0x5637ef4732d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:44.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.591+0000 7fd69f261e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5637ef433740 0x5637ef473810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:44.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.591+0000 7fd69f261e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ef478270 0x5637ef477220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:44.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.591+0000 7fd69f261e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5637ef33c9d0 con 0x5637ef478270 2026-02-24T09:18:44.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.591+0000 7fd69f261e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x5637ef07df10 con 0x5637ef433740 2026-02-24T09:18:44.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.591+0000 7fd69f261e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x5637ef3a6f30 con 0x5637ef351a60 2026-02-24T09:18:44.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.592+0000 7fd696d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ef478270 0x5637ef477220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:44.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.592+0000 7fd696d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ef478270 0x5637ef477220 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43312/0 (socket says 10.20.193.28:43312) 2026-02-24T09:18:44.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.592+0000 7fd696d76640 1 -- 10.20.193.28:0/742539363 learned_addr learned my addr 10.20.193.28:0/742539363 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:18:44.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.592+0000 7fd696575640 1 --2- 10.20.193.28:0/742539363 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5637ef351a60 0x5637ef4732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:44.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.592+0000 7fd695d74640 1 --2- 10.20.193.28:0/742539363 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5637ef433740 0x5637ef473810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:44.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.592+0000 7fd696d76640 1 -- 10.20.193.28:0/742539363 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5637ef351a60 msgr2=0x5637ef4732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:44.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.592+0000 7fd696d76640 1 --2- 10.20.193.28:0/742539363 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5637ef351a60 0x5637ef4732d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:44.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.592+0000 7fd696d76640 1 -- 10.20.193.28:0/742539363 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5637ef433740 msgr2=0x5637ef473810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:44.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.592+0000 7fd696d76640 1 --2- 10.20.193.28:0/742539363 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5637ef433740 0x5637ef473810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:44.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.592+0000 7fd696d76640 1 -- 10.20.193.28:0/742539363 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637ef2cf030 con 0x5637ef478270 2026-02-24T09:18:44.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.592+0000 7fd696575640 1 --2- 10.20.193.28:0/742539363 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5637ef351a60 0x5637ef4732d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:18:44.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.592+0000 7fd696d76640 1 --2- 10.20.193.28:0/742539363 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ef478270 0x5637ef477220 secure :-1 s=READY pgs=407 gs=2 cs=0 l=1 c_cookie=7760812760113804052 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd688005820 tx=0x7fd688014020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb3f21636e6f314 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:44.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.592+0000 7fd6623ff640 1 -- 10.20.193.28:0/742539363 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd68802be40 con 0x5637ef478270 2026-02-24T09:18:44.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.592+0000 7fd6623ff640 1 -- 10.20.193.28:0/742539363 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd688032070 con 0x5637ef478270 2026-02-24T09:18:44.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.592+0000 7fd6623ff640 1 -- 10.20.193.28:0/742539363 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd688005bb0 con 0x5637ef478270 2026-02-24T09:18:44.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.593+0000 7fd69f261e00 1 -- 10.20.193.28:0/742539363 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ef478270 msgr2=0x5637ef477220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:44.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.593+0000 7fd69f261e00 1 --2- 10.20.193.28:0/742539363 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ef478270 0x5637ef477220 secure :-1 s=READY pgs=407 gs=2 cs=0 l=1 c_cookie=7760812760113804052 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd688005820 tx=0x7fd688014020 comp rx=0 tx=0).stop 2026-02-24T09:18:44.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.593+0000 7fd69f261e00 1 -- 10.20.193.28:0/742539363 shutdown_connections 2026-02-24T09:18:44.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.593+0000 7fd69f261e00 1 --2- 10.20.193.28:0/742539363 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ef478270 0x5637ef477220 unknown :-1 s=CLOSED pgs=407 gs=2 cs=0 l=1 c_cookie=7760812760113804052 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:44.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.593+0000 7fd69f261e00 1 --2- 10.20.193.28:0/742539363 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5637ef433740 0x5637ef473810 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:44.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.593+0000 7fd69f261e00 1 --2- 10.20.193.28:0/742539363 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5637ef351a60 0x5637ef4732d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:44.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.593+0000 7fd69f261e00 1 -- 10.20.193.28:0/742539363 >> 10.20.193.28:0/742539363 conn(0x5637ef3cd490 msgr2=0x5637ef472bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:44.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.593+0000 7fd69f261e00 1 -- 10.20.193.28:0/742539363 shutdown_connections 2026-02-24T09:18:44.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.593+0000 7fd69f261e00 1 -- 10.20.193.28:0/742539363 wait complete. 2026-02-24T09:18:44.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.593+0000 7fd69f261e00 1 -- start start 2026-02-24T09:18:44.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.593+0000 7fd69f261e00 1 Processor -- start 2026-02-24T09:18:44.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.594+0000 7fd69f261e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5637ef351a60 0x5637ef4148b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:44.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.594+0000 7fd69f261e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5637ef433740 0x5637ef414df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:44.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.594+0000 7fd69f261e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ef478270 0x5637ef415330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:44.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.594+0000 7fd69f261e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5637ef4886a0 con 0x5637ef478270 2026-02-24T09:18:44.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.594+0000 7fd69f261e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x5637ef4de1f0 con 0x5637ef433740 2026-02-24T09:18:44.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.594+0000 7fd69f261e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x5637ef4de3b0 con 0x5637ef351a60 2026-02-24T09:18:44.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.594+0000 7fd696d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ef478270 0x5637ef415330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:44.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.594+0000 7fd696575640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5637ef351a60 0x5637ef4148b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:44.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.594+0000 7fd695d74640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5637ef433740 0x5637ef414df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:44.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.594+0000 7fd696d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ef478270 0x5637ef415330 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43326/0 (socket says 10.20.193.28:43326) 2026-02-24T09:18:44.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.594+0000 7fd696d76640 1 -- 10.20.193.28:0/618539516 learned_addr learned my addr 10.20.193.28:0/618539516 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:18:44.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.594+0000 7fd696d76640 1 -- 10.20.193.28:0/618539516 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5637ef351a60 msgr2=0x5637ef4148b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:44.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.594+0000 7fd696d76640 1 --2- 10.20.193.28:0/618539516 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5637ef351a60 0x5637ef4148b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:44.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.594+0000 7fd696d76640 1 -- 10.20.193.28:0/618539516 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5637ef433740 msgr2=0x5637ef414df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:44.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.594+0000 7fd696d76640 1 --2- 10.20.193.28:0/618539516 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5637ef433740 0x5637ef414df0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:44.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.594+0000 7fd696d76640 1 -- 10.20.193.28:0/618539516 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637ef2c3010 con 0x5637ef478270 2026-02-24T09:18:44.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.594+0000 7fd696d76640 1 --2- 10.20.193.28:0/618539516 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ef478270 0x5637ef415330 secure :-1 s=READY pgs=408 gs=3 cs=0 l=1 c_cookie=10585184922605611528 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd68801a560 tx=0x7fd688003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e6219ab9ba6a08 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:44.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.594+0000 7fd647fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:18:44.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.595+0000 7fd647fff640 1 -- 10.20.193.28:0/618539516 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd68802be40 con 0x5637ef478270 2026-02-24T09:18:44.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.595+0000 7fd647fff640 1 -- 10.20.193.28:0/618539516 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd68801ae90 con 0x5637ef478270 2026-02-24T09:18:44.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.595+0000 7fd69f261e00 1 -- 10.20.193.28:0/618539516 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637ef2d45b0 con 0x5637ef478270 2026-02-24T09:18:44.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.595+0000 7fd647fff640 1 -- 10.20.193.28:0/618539516 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6880233f0 con 0x5637ef478270 2026-02-24T09:18:44.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.595+0000 7fd69f261e00 10 client.15621 _ll_register_callbacks cb 0x5637ef2c9980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:44.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.595+0000 7fd69f261e00 1 -- 10.20.193.28:0/618539516 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5637ef36fd30 con 0x5637ef478270 2026-02-24T09:18:44.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.595+0000 7fd647fff640 1 -- 10.20.193.28:0/618539516 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7fd68803e030 con 0x5637ef478270 2026-02-24T09:18:44.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.595+0000 7fd647fff640 1 -- 10.20.193.28:0/618539516 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fd6880039a0 con 0x5637ef478270 2026-02-24T09:18:44.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.595+0000 7fd69f261e00 10 client.15621 fetch_fsmap learned FSMap version 23 2026-02-24T09:18:44.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.595+0000 7fd69f261e00 1 -- 10.20.193.28:0/618539516 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x5637ef2d4810 con 0x5637ef478270 2026-02-24T09:18:44.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.595+0000 7fd647fff640 1 -- 10.20.193.28:0/618539516 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fd68802b340 con 0x5637ef478270 2026-02-24T09:18:44.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.595+0000 7fd69f261e00 10 client.15621 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:18:44.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.595+0000 7fd69f261e00 10 client.15621 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:18:44.603 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.595+0000 7fd69f261e00 20 client.15621 populate_metadata read hostname 'trial028' 2026-02-24T09:18:44.603 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.595+0000 7fd69f261e00 1 --2- 10.20.193.28:0/618539516 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5637ef525ed0 0x5637ef546330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:44.603 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.595+0000 7fd69f261e00 4 client.15621 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-24T09:18:44.603 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.595+0000 7fd69f261e00 1 -- 10.20.193.28:0/618539516 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5637ef022640 con 0x5637ef525ed0 2026-02-24T09:18:44.603 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.596+0000 7fd696575640 1 --2- 10.20.193.28:0/618539516 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5637ef525ed0 0x5637ef546330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:44.603 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.596+0000 7fd696575640 1 --2- 10.20.193.28:0/618539516 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5637ef525ed0 0x5637ef546330 crc :-1 s=READY pgs=35 gs=4 cs=0 l=0 c_cookie=4895836228141838946 s_cookie=8584540718873830324 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43f1811c38e1f262 server_cookie=77226a4d0c59e3b4 in_seq=0 out_seq=0 2026-02-24T09:18:44.603 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.596+0000 7fd647fff640 10 client.15621 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:18:44.603 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.602+0000 7fd647fff640 1 -- 10.20.193.28:0/618539516 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5637ef022640 con 0x5637ef525ed0 2026-02-24T09:18:44.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.602+0000 7fd647fff640 10 client.15621 handle_command_reply: tid=0 2026-02-24T09:18:44.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.602+0000 7fd69f261e00 1 client.15621 shutdown 2026-02-24T09:18:44.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.603+0000 7fd69f261e00 1 -- 10.20.193.28:0/618539516 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ef478270 msgr2=0x5637ef415330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:44.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.603+0000 7fd69f261e00 1 --2- 10.20.193.28:0/618539516 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ef478270 0x5637ef415330 secure :-1 s=READY pgs=408 gs=3 cs=0 l=1 c_cookie=10585184922605611528 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd68801a560 tx=0x7fd688003730 comp rx=0 tx=0).stop 2026-02-24T09:18:44.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.603+0000 7fd69f261e00 1 -- 10.20.193.28:0/618539516 shutdown_connections 2026-02-24T09:18:44.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.603+0000 7fd69f261e00 1 --2- 10.20.193.28:0/618539516 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5637ef525ed0 0x5637ef546330 crc :-1 s=READY pgs=35 gs=4 cs=0 l=0 c_cookie=4895836228141838946 s_cookie=8584540718873830324 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:44.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.603+0000 7fd69f261e00 1 --2- 10.20.193.28:0/618539516 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5637ef478270 0x5637ef415330 unknown :-1 s=CLOSED pgs=408 gs=3 cs=0 l=1 c_cookie=10585184922605611528 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:44.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.603+0000 7fd69f261e00 1 --2- 10.20.193.28:0/618539516 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5637ef433740 0x5637ef414df0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:44.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.603+0000 7fd69f261e00 1 --2- 10.20.193.28:0/618539516 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5637ef351a60 0x5637ef4148b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:44.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.603+0000 7fd647fff640 0 client.15621 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:18:44.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.603+0000 7fd69f261e00 1 -- 10.20.193.28:0/618539516 >> 10.20.193.28:0/618539516 conn(0x5637ef3cd490 msgr2=0x5637ef4732d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:44.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.603+0000 7fd69f261e00 1 -- 10.20.193.28:0/618539516 shutdown_connections 2026-02-24T09:18:44.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.603+0000 7fd69f261e00 1 -- 10.20.193.28:0/618539516 wait complete. 2026-02-24T09:18:44.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.603+0000 7fd69f261e00 20 client.15621 trim_cache size 0 max 16384 2026-02-24T09:18:44.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-24T09:18:44.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-24T09:18:44.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-24T09:18:44.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-24T09:18:44.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.604+0000 7fd697577640 1 -- 10.20.193.28:0/3742735387 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fd6700b58d0 msgr2=0x7fd6700d5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:44.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.604+0000 7fd697577640 1 --2- 10.20.193.28:0/3742735387 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fd6700b58d0 0x7fd6700d5d80 secure :-1 s=READY pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd68c0023d0 tx=0x7fd68c031040 comp rx=0 tx=0).stop 2026-02-24T09:18:44.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.604+0000 7fd697577640 1 -- 10.20.193.28:0/3742735387 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd69810fdb0 msgr2=0x7fd698062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:44.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.604+0000 7fd697577640 1 --2- 10.20.193.28:0/3742735387 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd69810fdb0 0x7fd698062a30 secure :-1 s=READY pgs=404 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd680005db0 tx=0x7fd68000ddf0 comp rx=0 tx=0).stop 2026-02-24T09:18:44.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.604+0000 7fd697577640 1 -- 10.20.193.28:0/3742735387 shutdown_connections 2026-02-24T09:18:44.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.604+0000 7fd697577640 1 --2- 10.20.193.28:0/3742735387 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fd6700b58d0 0x7fd6700d5d80 unknown :-1 s=CLOSED pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:44.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.604+0000 7fd697577640 1 --2- 10.20.193.28:0/3742735387 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fd6981155b0 0x7fd6980630e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:44.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.604+0000 7fd697577640 1 --2- 10.20.193.28:0/3742735387 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd69810fdb0 0x7fd698062a30 unknown :-1 s=CLOSED pgs=404 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:44.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.604+0000 7fd697577640 1 --2- 10.20.193.28:0/3742735387 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fd69810f3c0 0x7fd6980667c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:44.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.604+0000 7fd697577640 1 -- 10.20.193.28:0/3742735387 >> 10.20.193.28:0/3742735387 conn(0x7fd6980ecc70 msgr2=0x7fd69810d050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:44.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.604+0000 7fd697577640 1 -- 10.20.193.28:0/3742735387 shutdown_connections 2026-02-24T09:18:44.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:44.604+0000 7fd697577640 1 -- 10.20.193.28:0/3742735387 wait complete. 2026-02-24T09:18:44.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:44 trial159 ceph-mon[44242]: pgmap v236: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 6.5 MiB/s rd, 25 MiB/s wr, 1.68k op/s 2026-02-24T09:18:44.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:44 trial028 ceph-mon[40371]: pgmap v236: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 6.5 MiB/s rd, 25 MiB/s wr, 1.68k op/s 2026-02-24T09:18:44.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:44 trial074 ceph-mon[44412]: pgmap v236: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 6.5 MiB/s rd, 25 MiB/s wr, 1.68k op/s 2026-02-24T09:18:46.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:46 trial159 ceph-mon[44242]: pgmap v237: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 6.1 MiB/s rd, 24 MiB/s wr, 1.56k op/s; 0 B/s, 0 objects/s recovering 2026-02-24T09:18:46.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:46 trial028 ceph-mon[40371]: pgmap v237: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 6.1 MiB/s rd, 24 MiB/s wr, 1.56k op/s; 0 B/s, 0 objects/s recovering 2026-02-24T09:18:46.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:46 trial074 ceph-mon[44412]: pgmap v237: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 6.1 MiB/s rd, 24 MiB/s wr, 1.56k op/s; 0 B/s, 0 objects/s recovering 2026-02-24T09:18:48.662 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:48 trial028 ceph-mon[40371]: pgmap v238: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 6.0 MiB/s rd, 24 MiB/s wr, 1.55k op/s; 0 B/s, 0 objects/s recovering 2026-02-24T09:18:48.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:48 trial159 ceph-mon[44242]: pgmap v238: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 6.0 MiB/s rd, 24 MiB/s wr, 1.55k op/s; 0 B/s, 0 objects/s recovering 2026-02-24T09:18:48.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:48 trial074 ceph-mon[44412]: pgmap v238: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 6.0 MiB/s rd, 24 MiB/s wr, 1.55k op/s; 0 B/s, 0 objects/s recovering 2026-02-24T09:18:50.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:50 trial159 ceph-mon[44242]: pgmap v239: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 7.1 MiB/s rd, 28 MiB/s wr, 1.83k op/s; 0 B/s, 0 objects/s recovering 2026-02-24T09:18:50.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:50 trial028 ceph-mon[40371]: pgmap v239: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 7.1 MiB/s rd, 28 MiB/s wr, 1.83k op/s; 0 B/s, 0 objects/s recovering 2026-02-24T09:18:50.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:50 trial074 ceph-mon[44412]: pgmap v239: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 7.1 MiB/s rd, 28 MiB/s wr, 1.83k op/s; 0 B/s, 0 objects/s recovering 2026-02-24T09:18:52.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:52 trial159 ceph-mon[44242]: pgmap v240: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 6.9 MiB/s rd, 27 MiB/s wr, 1.78k op/s; 0 B/s, 0 objects/s recovering 2026-02-24T09:18:52.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:52 trial028 ceph-mon[40371]: pgmap v240: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 6.9 MiB/s rd, 27 MiB/s wr, 1.78k op/s; 0 B/s, 0 objects/s recovering 2026-02-24T09:18:52.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:52 trial074 ceph-mon[44412]: pgmap v240: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 6.9 MiB/s rd, 27 MiB/s wr, 1.78k op/s; 0 B/s, 0 objects/s recovering 2026-02-24T09:18:54.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:54 trial159 ceph-mon[44242]: pgmap v241: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 7.2 MiB/s rd, 28 MiB/s wr, 1.85k op/s; 0 B/s, 0 objects/s recovering 2026-02-24T09:18:54.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:54 trial028 ceph-mon[40371]: pgmap v241: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 7.2 MiB/s rd, 28 MiB/s wr, 1.85k op/s; 0 B/s, 0 objects/s recovering 2026-02-24T09:18:54.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:54 trial074 ceph-mon[44412]: pgmap v241: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 7.2 MiB/s rd, 28 MiB/s wr, 1.85k op/s; 0 B/s, 0 objects/s recovering 2026-02-24T09:18:56.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:56 trial159 ceph-mon[44242]: pgmap v242: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 6.5 MiB/s rd, 26 MiB/s wr, 1.69k op/s; 0 B/s, 0 objects/s recovering 2026-02-24T09:18:56.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:56 trial028 ceph-mon[40371]: pgmap v242: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 6.5 MiB/s rd, 26 MiB/s wr, 1.69k op/s; 0 B/s, 0 objects/s recovering 2026-02-24T09:18:56.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:56 trial074 ceph-mon[44412]: pgmap v242: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 6.5 MiB/s rd, 26 MiB/s wr, 1.69k op/s; 0 B/s, 0 objects/s recovering 2026-02-24T09:18:57.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.686+0000 7fdd669be640 1 -- 10.20.193.28:0/4073269020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd60112260 msgr2=0x7fdd60172c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:57.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.686+0000 7fdd669be640 1 --2- 10.20.193.28:0/4073269020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd60112260 0x7fdd60172c30 secure :-1 s=READY pgs=409 gs=2 cs=0 l=1 c_cookie=1464999769271062061 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd5c00aa30 tx=0x7fdd5c030270 comp rx=0 tx=0).stop 2026-02-24T09:18:57.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.686+0000 7fdd669be640 1 -- 10.20.193.28:0/4073269020 shutdown_connections 2026-02-24T09:18:57.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.686+0000 7fdd669be640 1 --2- 10.20.193.28:0/4073269020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd60112260 0x7fdd60172c30 unknown :-1 s=CLOSED pgs=409 gs=2 cs=0 l=1 c_cookie=1464999769271062061 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:57.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.686+0000 7fdd669be640 1 --2- 10.20.193.28:0/4073269020 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fdd6010ca60 0x7fdd60111ab0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:57.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.686+0000 7fdd669be640 1 --2- 10.20.193.28:0/4073269020 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fdd6010c070 0x7fdd6010c440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:57.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.686+0000 7fdd669be640 1 -- 10.20.193.28:0/4073269020 >> 10.20.193.28:0/4073269020 conn(0x7fdd600e99a0 msgr2=0x7fdd60109db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:57.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.686+0000 7fdd669be640 1 -- 10.20.193.28:0/4073269020 shutdown_connections 2026-02-24T09:18:57.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.686+0000 7fdd669be640 1 -- 10.20.193.28:0/4073269020 wait complete. 2026-02-24T09:18:57.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.687+0000 7fdd669be640 1 Processor -- start 2026-02-24T09:18:57.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.687+0000 7fdd669be640 1 -- start start 2026-02-24T09:18:57.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.687+0000 7fdd669be640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fdd6010c070 0x7fdd600f45f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:57.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.687+0000 7fdd669be640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fdd6010ca60 0x7fdd60172b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:57.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.687+0000 7fdd669be640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd60112260 0x7fdd600f4cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:57.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.687+0000 7fdd669be640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdd600f9f00 con 0x7fdd60112260 2026-02-24T09:18:57.692 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.687+0000 7fdd669be640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fdd600fa070 con 0x7fdd6010c070 2026-02-24T09:18:57.692 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.687+0000 7fdd669be640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fdd600fa230 con 0x7fdd6010ca60 2026-02-24T09:18:57.692 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.687+0000 7fdd661bd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd60112260 0x7fdd600f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:57.692 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.687+0000 7fdd661bd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd60112260 0x7fdd600f4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56080/0 (socket says 10.20.193.28:56080) 2026-02-24T09:18:57.692 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.687+0000 7fdd661bd640 1 -- 10.20.193.28:0/2002504244 learned_addr learned my addr 10.20.193.28:0/2002504244 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:18:57.692 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.687+0000 7fdd659bc640 1 --2- 10.20.193.28:0/2002504244 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fdd6010c070 0x7fdd600f45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:57.692 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.688+0000 7fdd651bb640 1 --2- 10.20.193.28:0/2002504244 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fdd6010ca60 0x7fdd60172b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:57.692 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.688+0000 7fdd661bd640 1 -- 10.20.193.28:0/2002504244 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fdd6010ca60 msgr2=0x7fdd60172b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:57.692 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.688+0000 7fdd661bd640 1 --2- 10.20.193.28:0/2002504244 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fdd6010ca60 0x7fdd60172b30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:57.692 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.688+0000 7fdd661bd640 1 -- 10.20.193.28:0/2002504244 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fdd6010c070 msgr2=0x7fdd600f45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:57.692 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.688+0000 7fdd661bd640 1 --2- 10.20.193.28:0/2002504244 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fdd6010c070 0x7fdd600f45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:57.693 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.688+0000 7fdd661bd640 1 -- 10.20.193.28:0/2002504244 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd5c00a650 con 0x7fdd60112260 2026-02-24T09:18:57.693 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.688+0000 7fdd661bd640 1 --2- 10.20.193.28:0/2002504244 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd60112260 0x7fdd600f4cf0 secure :-1 s=READY pgs=410 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd5c032fe0 tx=0x7fdd5c030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:57.693 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.688+0000 7fdd4effd640 1 -- 10.20.193.28:0/2002504244 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd5c03e070 con 0x7fdd60112260 2026-02-24T09:18:57.693 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.688+0000 7fdd4effd640 1 -- 10.20.193.28:0/2002504244 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fdd5c0050c0 con 0x7fdd60112260 2026-02-24T09:18:57.693 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.688+0000 7fdd4effd640 1 -- 10.20.193.28:0/2002504244 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd5c0429c0 con 0x7fdd60112260 2026-02-24T09:18:57.693 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.688+0000 7fdd669be640 1 -- 10.20.193.28:0/2002504244 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd600fa4b0 con 0x7fdd60112260 2026-02-24T09:18:57.693 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.688+0000 7fdd669be640 1 -- 10.20.193.28:0/2002504244 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd600fa8d0 con 0x7fdd60112260 2026-02-24T09:18:57.693 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.691+0000 7fdd4effd640 1 -- 10.20.193.28:0/2002504244 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7fdd5c005230 con 0x7fdd60112260 2026-02-24T09:18:57.695 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.693+0000 7fdd4effd640 1 --2- 10.20.193.28:0/2002504244 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fdd3c0b58c0 0x7fdd3c0d5d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:57.695 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.693+0000 7fdd4effd640 1 -- 10.20.193.28:0/2002504244 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7fdd5c10c8c0 con 0x7fdd60112260 2026-02-24T09:18:57.695 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.693+0000 7fdd659bc640 1 --2- 10.20.193.28:0/2002504244 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fdd3c0b58c0 0x7fdd3c0d5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:57.697 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.694+0000 7fdd6a231e00 1 Processor -- start 2026-02-24T09:18:57.697 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.694+0000 7fdd6a231e00 1 -- start start 2026-02-24T09:18:57.697 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.694+0000 7fdd659bc640 1 --2- 10.20.193.28:0/2002504244 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fdd3c0b58c0 0x7fdd3c0d5d70 secure :-1 s=READY pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd50004740 tx=0x7fdd50005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:57.697 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.694+0000 7fdd6a231e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a8c3243a60 0x55a8c332dc10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:57.697 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.694+0000 7fdd6a231e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a8c332e150 0x55a8c332e5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:57.697 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.694+0000 7fdd6a231e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8c3372c80 0x55a8c3393060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:57.697 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.694+0000 7fdd6a231e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a8c323af10 con 0x55a8c3372c80 2026-02-24T09:18:57.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.694+0000 7fdd6a231e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55a8c3236c40 con 0x55a8c332e150 2026-02-24T09:18:57.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.694+0000 7fdd6a231e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55a8c3230da0 con 0x55a8c3243a60 2026-02-24T09:18:57.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.694+0000 7fdd661bd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8c3372c80 0x55a8c3393060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:57.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.694+0000 7fdd661bd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8c3372c80 0x55a8c3393060 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56082/0 (socket says 10.20.193.28:56082) 2026-02-24T09:18:57.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.694+0000 7fdd661bd640 1 -- 10.20.193.28:0/4119705853 learned_addr learned my addr 10.20.193.28:0/4119705853 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:18:57.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.694+0000 7fdd651bb640 1 --2- 10.20.193.28:0/4119705853 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a8c332e150 0x55a8c332e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:57.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.694+0000 7fdd661bd640 1 -- 10.20.193.28:0/4119705853 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a8c3243a60 msgr2=0x55a8c332dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:57.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.694+0000 7fdd661bd640 1 --2- 10.20.193.28:0/4119705853 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a8c3243a60 0x55a8c332dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:57.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.694+0000 7fdd661bd640 1 -- 10.20.193.28:0/4119705853 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a8c332e150 msgr2=0x55a8c332e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:57.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.694+0000 7fdd661bd640 1 --2- 10.20.193.28:0/4119705853 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a8c332e150 0x55a8c332e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:57.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.694+0000 7fdd661bd640 1 -- 10.20.193.28:0/4119705853 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8c31dc340 con 0x55a8c3372c80 2026-02-24T09:18:57.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.694+0000 7fdd661bd640 1 --2- 10.20.193.28:0/4119705853 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8c3372c80 0x55a8c3393060 secure :-1 s=READY pgs=411 gs=1 cs=0 l=1 c_cookie=13412867115593314536 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd5c10a210 tx=0x7fdd5c0424a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba241393c47530e8 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:57.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.695+0000 7fdd2dbfe640 1 -- 10.20.193.28:0/4119705853 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd5c0d8770 con 0x55a8c3372c80 2026-02-24T09:18:57.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.695+0000 7fdd2dbfe640 1 -- 10.20.193.28:0/4119705853 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fdd5c0dad50 con 0x55a8c3372c80 2026-02-24T09:18:57.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.695+0000 7fdd2dbfe640 1 -- 10.20.193.28:0/4119705853 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd5c0dd980 con 0x55a8c3372c80 2026-02-24T09:18:57.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.695+0000 7fdd6a231e00 1 -- 10.20.193.28:0/4119705853 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8c3372c80 msgr2=0x55a8c3393060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:57.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.695+0000 7fdd6a231e00 1 --2- 10.20.193.28:0/4119705853 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8c3372c80 0x55a8c3393060 secure :-1 s=READY pgs=411 gs=1 cs=0 l=1 c_cookie=13412867115593314536 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd5c10a210 tx=0x7fdd5c0424a0 comp rx=0 tx=0).stop 2026-02-24T09:18:57.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.695+0000 7fdd6a231e00 1 -- 10.20.193.28:0/4119705853 shutdown_connections 2026-02-24T09:18:57.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.695+0000 7fdd6a231e00 1 --2- 10.20.193.28:0/4119705853 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8c3372c80 0x55a8c3393060 unknown :-1 s=CLOSED pgs=411 gs=1 cs=0 l=1 c_cookie=13412867115593314536 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:57.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.695+0000 7fdd6a231e00 1 --2- 10.20.193.28:0/4119705853 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a8c332e150 0x55a8c332e5a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:57.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.695+0000 7fdd6a231e00 1 --2- 10.20.193.28:0/4119705853 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a8c3243a60 0x55a8c332dc10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:57.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.695+0000 7fdd6a231e00 1 -- 10.20.193.28:0/4119705853 >> 10.20.193.28:0/4119705853 conn(0x55a8c32bf490 msgr2=0x55a8c3323ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:57.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.695+0000 7fdd6a231e00 1 -- 10.20.193.28:0/4119705853 shutdown_connections 2026-02-24T09:18:57.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.695+0000 7fdd6a231e00 1 -- 10.20.193.28:0/4119705853 wait complete. 2026-02-24T09:18:57.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.696+0000 7fdd6a231e00 1 -- start start 2026-02-24T09:18:57.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.696+0000 7fdd6a231e00 1 Processor -- start 2026-02-24T09:18:57.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.697+0000 7fdd6a231e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8c3243a60 0x55a8c338a260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:57.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.697+0000 7fdd6a231e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a8c332e150 0x55a8c338a7a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:57.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.697+0000 7fdd6a231e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a8c3372c80 0x55a8c338f790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:57.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.697+0000 7fdd6a231e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a8c338fcd0 con 0x55a8c3243a60 2026-02-24T09:18:57.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.697+0000 7fdd6a231e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55a8c338fe40 con 0x55a8c3372c80 2026-02-24T09:18:57.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.697+0000 7fdd6a231e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55a8c3390000 con 0x55a8c332e150 2026-02-24T09:18:57.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.697+0000 7fdd659bc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8c3243a60 0x55a8c338a260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:57.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.697+0000 7fdd659bc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8c3243a60 0x55a8c338a260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56092/0 (socket says 10.20.193.28:56092) 2026-02-24T09:18:57.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.697+0000 7fdd661bd640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a8c3372c80 0x55a8c338f790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:57.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.697+0000 7fdd659bc640 1 -- 10.20.193.28:0/773065374 learned_addr learned my addr 10.20.193.28:0/773065374 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:18:57.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.697+0000 7fdd651bb640 1 --2- 10.20.193.28:0/773065374 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a8c332e150 0x55a8c338a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:57.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.697+0000 7fdd661bd640 1 -- 10.20.193.28:0/773065374 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a8c332e150 msgr2=0x55a8c338a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:57.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.697+0000 7fdd661bd640 1 --2- 10.20.193.28:0/773065374 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a8c332e150 0x55a8c338a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:57.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.697+0000 7fdd661bd640 1 -- 10.20.193.28:0/773065374 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8c3243a60 msgr2=0x55a8c338a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:57.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.697+0000 7fdd661bd640 1 --2- 10.20.193.28:0/773065374 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8c3243a60 0x55a8c338a260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:57.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.697+0000 7fdd661bd640 1 -- 10.20.193.28:0/773065374 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8c31b4ce0 con 0x55a8c3372c80 2026-02-24T09:18:57.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.698+0000 7fdd661bd640 1 --2- 10.20.193.28:0/773065374 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a8c3372c80 0x55a8c338f790 secure :-1 s=READY pgs=115 gs=2 cs=0 l=1 c_cookie=7147382893542560024 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd5c007010 tx=0x7fdd5c005510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63309adf8b4ed118 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:57.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.698+0000 7fdd1affd640 10 client.0 ms_handle_connect on v2:10.20.193.74:3300/0 2026-02-24T09:18:57.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.698+0000 7fdd1affd640 1 -- 10.20.193.28:0/773065374 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd5c0055a0 con 0x55a8c3372c80 2026-02-24T09:18:57.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.698+0000 7fdd6a231e00 1 -- 10.20.193.28:0/773065374 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd600fa8d0 con 0x55a8c3372c80 2026-02-24T09:18:57.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.698+0000 7fdd1affd640 1 -- 10.20.193.28:0/773065374 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fdd5c0d8770 con 0x55a8c3372c80 2026-02-24T09:18:57.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.698+0000 7fdd1affd640 1 -- 10.20.193.28:0/773065374 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd5c0d0c90 con 0x55a8c3372c80 2026-02-24T09:18:57.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.698+0000 7fdd6a231e00 10 client.25430 _ll_register_callbacks cb 0x55a8c31bb980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:57.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.698+0000 7fdd6a231e00 1 -- 10.20.193.28:0/773065374 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a8c2ed0520 con 0x55a8c3372c80 2026-02-24T09:18:57.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.698+0000 7fdd1affd640 1 -- 10.20.193.28:0/773065374 <== mon.2 v2:10.20.193.74:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7fdd5c0d4440 con 0x55a8c3372c80 2026-02-24T09:18:57.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.698+0000 7fdd1affd640 1 -- 10.20.193.28:0/773065374 <== mon.2 v2:10.20.193.74:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fdd5c0d4660 con 0x55a8c3372c80 2026-02-24T09:18:57.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.698+0000 7fdd6a231e00 10 client.25430 fetch_fsmap learned FSMap version 23 2026-02-24T09:18:57.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.698+0000 7fdd6a231e00 1 -- 10.20.193.28:0/773065374 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({fsmap=23}) -- 0x55a8c31c65b0 con 0x55a8c3372c80 2026-02-24T09:18:57.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.698+0000 7fdd1affd640 1 -- 10.20.193.28:0/773065374 <== mon.2 v2:10.20.193.74:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fdd5c039b40 con 0x55a8c3372c80 2026-02-24T09:18:57.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.698+0000 7fdd6a231e00 10 client.25430 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:18:57.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.698+0000 7fdd6a231e00 10 client.25430 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:18:57.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.699+0000 7fdd6a231e00 20 client.25430 populate_metadata read hostname 'trial028' 2026-02-24T09:18:57.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.699+0000 7fdd6a231e00 1 --2- 10.20.193.28:0/773065374 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55a8c336fdc0 0x55a8c3370260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:57.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.699+0000 7fdd6a231e00 4 client.25430 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:18:57.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.699+0000 7fdd6a231e00 1 -- 10.20.193.28:0/773065374 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a8c32029d0 con 0x55a8c336fdc0 2026-02-24T09:18:57.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.699+0000 7fdd659bc640 1 --2- 10.20.193.28:0/773065374 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55a8c336fdc0 0x55a8c3370260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:57.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.700+0000 7fdd659bc640 1 --2- 10.20.193.28:0/773065374 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55a8c336fdc0 0x55a8c3370260 crc :-1 s=READY pgs=36 gs=4 cs=0 l=0 c_cookie=14192475689016480212 s_cookie=9543913965343104418 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4f5cd71b731d1d4 server_cookie=8472cb2f872a5da2 in_seq=0 out_seq=0 2026-02-24T09:18:57.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.700+0000 7fdd1affd640 10 client.25430 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:18:57.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.700+0000 7fdd1affd640 1 -- 10.20.193.28:0/773065374 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55a8c32029d0 con 0x55a8c336fdc0 2026-02-24T09:18:57.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.700+0000 7fdd1affd640 10 client.25430 handle_command_reply: tid=0 2026-02-24T09:18:57.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.700+0000 7fdd6a231e00 1 client.25430 shutdown 2026-02-24T09:18:57.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.700+0000 7fdd6a231e00 1 -- 10.20.193.28:0/773065374 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a8c3372c80 msgr2=0x55a8c338f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:57.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.700+0000 7fdd6a231e00 1 --2- 10.20.193.28:0/773065374 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a8c3372c80 0x55a8c338f790 secure :-1 s=READY pgs=115 gs=2 cs=0 l=1 c_cookie=7147382893542560024 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd5c007010 tx=0x7fdd5c005510 comp rx=0 tx=0).stop 2026-02-24T09:18:57.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.700+0000 7fdd6a231e00 1 -- 10.20.193.28:0/773065374 shutdown_connections 2026-02-24T09:18:57.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.700+0000 7fdd6a231e00 1 --2- 10.20.193.28:0/773065374 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55a8c336fdc0 0x55a8c3370260 crc :-1 s=READY pgs=36 gs=4 cs=0 l=0 c_cookie=14192475689016480212 s_cookie=9543913965343104418 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:57.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.700+0000 7fdd6a231e00 1 --2- 10.20.193.28:0/773065374 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a8c3372c80 0x55a8c338f790 unknown :-1 s=CLOSED pgs=115 gs=2 cs=0 l=1 c_cookie=7147382893542560024 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:57.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.700+0000 7fdd6a231e00 1 --2- 10.20.193.28:0/773065374 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a8c332e150 0x55a8c338a7a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:57.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.700+0000 7fdd6a231e00 1 --2- 10.20.193.28:0/773065374 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8c3243a60 0x55a8c338a260 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:57.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.700+0000 7fdd1affd640 0 client.25430 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:18:57.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.700+0000 7fdd6a231e00 1 -- 10.20.193.28:0/773065374 >> 10.20.193.28:0/773065374 conn(0x55a8c32bf490 msgr2=0x55a8c33232f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:57.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.700+0000 7fdd6a231e00 1 -- 10.20.193.28:0/773065374 shutdown_connections 2026-02-24T09:18:57.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.700+0000 7fdd6a231e00 1 -- 10.20.193.28:0/773065374 wait complete. 2026-02-24T09:18:57.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.701+0000 7fdd6a231e00 20 client.25430 trim_cache size 0 max 16384 2026-02-24T09:18:57.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.708+0000 7fdd6a231e00 1 Processor -- start 2026-02-24T09:18:57.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.708+0000 7fdd6a231e00 1 -- start start 2026-02-24T09:18:57.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.708+0000 7fdd6a231e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8c3243a60 0x55a8c3387b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:57.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.708+0000 7fdd6a231e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a8c332e150 0x55a8c33718d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:57.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.708+0000 7fdd6a231e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a8c3372c80 0x55a8c3371e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:57.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.708+0000 7fdd6a231e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a8c322e9d0 con 0x55a8c3243a60 2026-02-24T09:18:57.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.708+0000 7fdd6a231e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55a8c2f6ff10 con 0x55a8c332e150 2026-02-24T09:18:57.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.708+0000 7fdd6a231e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55a8c3300550 con 0x55a8c3372c80 2026-02-24T09:18:57.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.709+0000 7fdd659bc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8c3243a60 0x55a8c3387b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:57.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.709+0000 7fdd659bc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8c3243a60 0x55a8c3387b80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56108/0 (socket says 10.20.193.28:56108) 2026-02-24T09:18:57.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.709+0000 7fdd659bc640 1 -- 10.20.193.28:0/3720038466 learned_addr learned my addr 10.20.193.28:0/3720038466 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:18:57.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.709+0000 7fdd651bb640 1 --2- 10.20.193.28:0/3720038466 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a8c332e150 0x55a8c33718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:57.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.709+0000 7fdd661bd640 1 --2- 10.20.193.28:0/3720038466 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a8c3372c80 0x55a8c3371e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:57.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.709+0000 7fdd659bc640 1 -- 10.20.193.28:0/3720038466 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a8c3372c80 msgr2=0x55a8c3371e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:57.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.709+0000 7fdd659bc640 1 --2- 10.20.193.28:0/3720038466 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a8c3372c80 0x55a8c3371e10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:57.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.709+0000 7fdd659bc640 1 -- 10.20.193.28:0/3720038466 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a8c332e150 msgr2=0x55a8c33718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:57.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.709+0000 7fdd659bc640 1 --2- 10.20.193.28:0/3720038466 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a8c332e150 0x55a8c33718d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:57.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.709+0000 7fdd659bc640 1 -- 10.20.193.28:0/3720038466 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8c31c1030 con 0x55a8c3243a60 2026-02-24T09:18:57.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.709+0000 7fdd659bc640 1 --2- 10.20.193.28:0/3720038466 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8c3243a60 0x55a8c3387b80 secure :-1 s=READY pgs=412 gs=2 cs=0 l=1 c_cookie=16349965139573233999 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd50009b50 tx=0x7fdd50014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e6beab2a48594f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:57.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.709+0000 7fdd2d3fd640 1 -- 10.20.193.28:0/3720038466 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd50021040 con 0x55a8c3243a60 2026-02-24T09:18:57.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.709+0000 7fdd2d3fd640 1 -- 10.20.193.28:0/3720038466 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fdd50011e40 con 0x55a8c3243a60 2026-02-24T09:18:57.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.709+0000 7fdd2d3fd640 1 -- 10.20.193.28:0/3720038466 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd50005310 con 0x55a8c3243a60 2026-02-24T09:18:57.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.710+0000 7fdd6a231e00 1 -- 10.20.193.28:0/3720038466 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8c3243a60 msgr2=0x55a8c3387b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:57.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.710+0000 7fdd6a231e00 1 --2- 10.20.193.28:0/3720038466 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8c3243a60 0x55a8c3387b80 secure :-1 s=READY pgs=412 gs=2 cs=0 l=1 c_cookie=16349965139573233999 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd50009b50 tx=0x7fdd50014000 comp rx=0 tx=0).stop 2026-02-24T09:18:57.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.710+0000 7fdd6a231e00 1 -- 10.20.193.28:0/3720038466 shutdown_connections 2026-02-24T09:18:57.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.710+0000 7fdd6a231e00 1 --2- 10.20.193.28:0/3720038466 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a8c3372c80 0x55a8c3371e10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:57.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.710+0000 7fdd6a231e00 1 --2- 10.20.193.28:0/3720038466 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a8c332e150 0x55a8c33718d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:57.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.710+0000 7fdd6a231e00 1 --2- 10.20.193.28:0/3720038466 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8c3243a60 0x55a8c3387b80 unknown :-1 s=CLOSED pgs=412 gs=2 cs=0 l=1 c_cookie=16349965139573233999 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:57.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.710+0000 7fdd6a231e00 1 -- 10.20.193.28:0/3720038466 >> 10.20.193.28:0/3720038466 conn(0x55a8c32bf490 msgr2=0x55a8c3386460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:57.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.710+0000 7fdd6a231e00 1 -- 10.20.193.28:0/3720038466 shutdown_connections 2026-02-24T09:18:57.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.710+0000 7fdd6a231e00 1 -- 10.20.193.28:0/3720038466 wait complete. 2026-02-24T09:18:57.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.710+0000 7fdd6a231e00 1 -- start start 2026-02-24T09:18:57.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.710+0000 7fdd6a231e00 1 Processor -- start 2026-02-24T09:18:57.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.711+0000 7fdd6a231e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a8c3243a60 0x55a8c3308c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:57.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.711+0000 7fdd6a231e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a8c332e150 0x55a8c3304610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:57.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.711+0000 7fdd6a231e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8c3372c80 0x55a8c3304b50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:57.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.711+0000 7fdd6a231e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a8c3375290 con 0x55a8c3372c80 2026-02-24T09:18:57.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.711+0000 7fdd6a231e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55a8c3370720 con 0x55a8c332e150 2026-02-24T09:18:57.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.711+0000 7fdd6a231e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55a8c3305090 con 0x55a8c3243a60 2026-02-24T09:18:57.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.711+0000 7fdd661bd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8c3372c80 0x55a8c3304b50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:57.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.711+0000 7fdd661bd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8c3372c80 0x55a8c3304b50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56122/0 (socket says 10.20.193.28:56122) 2026-02-24T09:18:57.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.711+0000 7fdd661bd640 1 -- 10.20.193.28:0/3462996259 learned_addr learned my addr 10.20.193.28:0/3462996259 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:18:57.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.711+0000 7fdd659bc640 1 --2- 10.20.193.28:0/3462996259 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a8c3243a60 0x55a8c3308c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:57.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.711+0000 7fdd651bb640 1 --2- 10.20.193.28:0/3462996259 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a8c332e150 0x55a8c3304610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:57.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.711+0000 7fdd661bd640 1 -- 10.20.193.28:0/3462996259 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a8c3243a60 msgr2=0x55a8c3308c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:57.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.711+0000 7fdd661bd640 1 --2- 10.20.193.28:0/3462996259 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a8c3243a60 0x55a8c3308c70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:57.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.711+0000 7fdd661bd640 1 -- 10.20.193.28:0/3462996259 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a8c332e150 msgr2=0x55a8c3304610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:57.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.711+0000 7fdd661bd640 1 --2- 10.20.193.28:0/3462996259 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a8c332e150 0x55a8c3304610 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:57.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.711+0000 7fdd661bd640 1 -- 10.20.193.28:0/3462996259 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8c31b5010 con 0x55a8c3372c80 2026-02-24T09:18:57.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.711+0000 7fdd661bd640 1 --2- 10.20.193.28:0/3462996259 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8c3372c80 0x55a8c3304b50 secure :-1 s=READY pgs=413 gs=2 cs=0 l=1 c_cookie=6052547115947656540 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd5c032040 tx=0x7fdd5c003b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53fef788c060055c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:57.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.711+0000 7fdd1affd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:18:57.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.711+0000 7fdd1affd640 1 -- 10.20.193.28:0/3462996259 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd5c0055a0 con 0x55a8c3372c80 2026-02-24T09:18:57.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.711+0000 7fdd1affd640 1 -- 10.20.193.28:0/3462996259 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x55a8c2ed0520 con 0x55a8c3372c80 2026-02-24T09:18:57.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.711+0000 7fdd1affd640 1 -- 10.20.193.28:0/3462996259 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd5c0d8360 con 0x55a8c3372c80 2026-02-24T09:18:57.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.711+0000 7fdd6a231e00 1 -- 10.20.193.28:0/3462996259 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd500098f0 con 0x55a8c3372c80 2026-02-24T09:18:57.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.712+0000 7fdd6a231e00 10 client.15639 _ll_register_callbacks cb 0x55a8c31bb980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:57.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.712+0000 7fdd6a231e00 1 -- 10.20.193.28:0/3462996259 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a8c3261d30 con 0x55a8c3372c80 2026-02-24T09:18:57.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.712+0000 7fdd1affd640 1 -- 10.20.193.28:0/3462996259 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7fdd5c0d84c0 con 0x55a8c3372c80 2026-02-24T09:18:57.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.712+0000 7fdd1affd640 1 -- 10.20.193.28:0/3462996259 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fdd5c0d36e0 con 0x55a8c3372c80 2026-02-24T09:18:57.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.712+0000 7fdd6a231e00 10 client.15639 fetch_fsmap learned FSMap version 23 2026-02-24T09:18:57.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.712+0000 7fdd6a231e00 1 -- 10.20.193.28:0/3462996259 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x55a8c31c6810 con 0x55a8c3372c80 2026-02-24T09:18:57.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.712+0000 7fdd1affd640 1 -- 10.20.193.28:0/3462996259 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fdd5c0d0a30 con 0x55a8c3372c80 2026-02-24T09:18:57.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.712+0000 7fdd6a231e00 10 client.15639 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:18:57.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.712+0000 7fdd6a231e00 10 client.15639 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:18:57.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.712+0000 7fdd6a231e00 20 client.15639 populate_metadata read hostname 'trial028' 2026-02-24T09:18:57.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.712+0000 7fdd6a231e00 1 --2- 10.20.193.28:0/3462996259 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55a8c33d9740 0x55a8c343ff60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:57.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.712+0000 7fdd6a231e00 4 client.15639 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-24T09:18:57.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.712+0000 7fdd6a231e00 1 -- 10.20.193.28:0/3462996259 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a8c2f14640 con 0x55a8c33d9740 2026-02-24T09:18:57.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.712+0000 7fdd659bc640 1 --2- 10.20.193.28:0/3462996259 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55a8c33d9740 0x55a8c343ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:57.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.713+0000 7fdd659bc640 1 --2- 10.20.193.28:0/3462996259 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55a8c33d9740 0x55a8c343ff60 crc :-1 s=READY pgs=37 gs=4 cs=0 l=0 c_cookie=14507326844383893191 s_cookie=7736526205039248464 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c95460e6dffd96c7 server_cookie=6b5da997f6dd8450 in_seq=0 out_seq=0 2026-02-24T09:18:57.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.713+0000 7fdd1affd640 10 client.15639 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:18:57.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.716+0000 7fdd1affd640 1 -- 10.20.193.28:0/3462996259 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a8c2f14640 con 0x55a8c33d9740 2026-02-24T09:18:57.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.716+0000 7fdd1affd640 10 client.15639 handle_command_reply: tid=0 2026-02-24T09:18:57.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.716+0000 7fdd6a231e00 1 client.15639 shutdown 2026-02-24T09:18:57.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.716+0000 7fdd6a231e00 1 -- 10.20.193.28:0/3462996259 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8c3372c80 msgr2=0x55a8c3304b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:57.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.716+0000 7fdd6a231e00 1 --2- 10.20.193.28:0/3462996259 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8c3372c80 0x55a8c3304b50 secure :-1 s=READY pgs=413 gs=2 cs=0 l=1 c_cookie=6052547115947656540 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd5c032040 tx=0x7fdd5c003b50 comp rx=0 tx=0).stop 2026-02-24T09:18:57.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.716+0000 7fdd6a231e00 1 -- 10.20.193.28:0/3462996259 shutdown_connections 2026-02-24T09:18:57.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.716+0000 7fdd6a231e00 1 --2- 10.20.193.28:0/3462996259 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55a8c33d9740 0x55a8c343ff60 crc :-1 s=READY pgs=37 gs=4 cs=0 l=0 c_cookie=14507326844383893191 s_cookie=7736526205039248464 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:57.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.716+0000 7fdd6a231e00 1 --2- 10.20.193.28:0/3462996259 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a8c3372c80 0x55a8c3304b50 unknown :-1 s=CLOSED pgs=413 gs=2 cs=0 l=1 c_cookie=6052547115947656540 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:57.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.716+0000 7fdd6a231e00 1 --2- 10.20.193.28:0/3462996259 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55a8c332e150 0x55a8c3304610 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:57.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.716+0000 7fdd6a231e00 1 --2- 10.20.193.28:0/3462996259 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55a8c3243a60 0x55a8c3308c70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:57.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.716+0000 7fdd1affd640 0 client.15639 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:18:57.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.716+0000 7fdd6a231e00 1 -- 10.20.193.28:0/3462996259 >> 10.20.193.28:0/3462996259 conn(0x55a8c32bf490 msgr2=0x55a8c3386c50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:57.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.717+0000 7fdd6a231e00 1 -- 10.20.193.28:0/3462996259 shutdown_connections 2026-02-24T09:18:57.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.717+0000 7fdd6a231e00 1 -- 10.20.193.28:0/3462996259 wait complete. 2026-02-24T09:18:57.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.717+0000 7fdd6a231e00 20 client.15639 trim_cache size 0 max 16384 2026-02-24T09:18:57.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-24T09:18:57.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-24T09:18:57.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-24T09:18:57.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-24T09:18:57.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.717+0000 7fdd669be640 1 -- 10.20.193.28:0/2002504244 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fdd3c0b58c0 msgr2=0x7fdd3c0d5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:57.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.717+0000 7fdd669be640 1 --2- 10.20.193.28:0/2002504244 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fdd3c0b58c0 0x7fdd3c0d5d70 secure :-1 s=READY pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd50004740 tx=0x7fdd50005f90 comp rx=0 tx=0).stop 2026-02-24T09:18:57.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.717+0000 7fdd669be640 1 -- 10.20.193.28:0/2002504244 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd60112260 msgr2=0x7fdd600f4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:57.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.717+0000 7fdd669be640 1 --2- 10.20.193.28:0/2002504244 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd60112260 0x7fdd600f4cf0 secure :-1 s=READY pgs=410 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd5c032fe0 tx=0x7fdd5c030d70 comp rx=0 tx=0).stop 2026-02-24T09:18:57.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.717+0000 7fdd669be640 1 -- 10.20.193.28:0/2002504244 shutdown_connections 2026-02-24T09:18:57.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.717+0000 7fdd669be640 1 --2- 10.20.193.28:0/2002504244 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fdd3c0b58c0 0x7fdd3c0d5d70 unknown :-1 s=CLOSED pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:57.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.717+0000 7fdd669be640 1 --2- 10.20.193.28:0/2002504244 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd60112260 0x7fdd600f4cf0 unknown :-1 s=CLOSED pgs=410 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:57.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.717+0000 7fdd669be640 1 --2- 10.20.193.28:0/2002504244 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fdd6010ca60 0x7fdd60172b30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:57.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.717+0000 7fdd669be640 1 --2- 10.20.193.28:0/2002504244 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fdd6010c070 0x7fdd600f45f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:57.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.717+0000 7fdd669be640 1 -- 10.20.193.28:0/2002504244 >> 10.20.193.28:0/2002504244 conn(0x7fdd600e99a0 msgr2=0x7fdd6010a560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:57.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.717+0000 7fdd669be640 1 -- 10.20.193.28:0/2002504244 shutdown_connections 2026-02-24T09:18:57.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:18:57.717+0000 7fdd669be640 1 -- 10.20.193.28:0/2002504244 wait complete. 2026-02-24T09:18:58.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:58 trial159 ceph-mon[44242]: pgmap v243: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 7.7 MiB/s rd, 31 MiB/s wr, 1.98k op/s 2026-02-24T09:18:58.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:58 trial028 ceph-mon[40371]: pgmap v243: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 7.7 MiB/s rd, 31 MiB/s wr, 1.98k op/s 2026-02-24T09:18:58.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:58 trial074 ceph-mon[44412]: pgmap v243: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 7.7 MiB/s rd, 31 MiB/s wr, 1.98k op/s 2026-02-24T09:18:59.734 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:18:59 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:18:59.737 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:18:59 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:18:59.742 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:18:59 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:19:00.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:00 trial159 ceph-mon[44242]: pgmap v244: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 7.1 MiB/s rd, 29 MiB/s wr, 1.82k op/s 2026-02-24T09:19:00.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:00 trial028 ceph-mon[40371]: pgmap v244: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 7.1 MiB/s rd, 29 MiB/s wr, 1.82k op/s 2026-02-24T09:19:00.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:00 trial074 ceph-mon[44412]: pgmap v244: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 7.1 MiB/s rd, 29 MiB/s wr, 1.82k op/s 2026-02-24T09:19:01.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:01 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:19:01.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:01 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:19:01.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:01 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:19:01.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:01 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:19:01.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:01 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:19:01.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:01 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:19:01.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:01 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:19:01.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:01 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:19:01.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:01 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:19:01.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:01 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:19:01.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:01 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:19:01.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:01 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:19:01.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:01 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:19:01.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:01 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:19:01.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:01 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:19:01.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:01 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:19:01.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:01 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:19:01.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:01 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:19:01.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:01 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:19:01.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:01 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:19:01.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:01 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:19:01.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:01 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:19:01.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:01 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:19:01.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:01 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:19:01.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:01 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:19:01.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:01 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:19:01.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:01 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:19:01.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:01 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:19:01.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:01 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:19:01.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:01 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:19:02.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:02 trial159 ceph-mon[44242]: pgmap v245: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 6.4 MiB/s rd, 26 MiB/s wr, 1.66k op/s 2026-02-24T09:19:02.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:02 trial028 ceph-mon[40371]: pgmap v245: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 6.4 MiB/s rd, 26 MiB/s wr, 1.66k op/s 2026-02-24T09:19:02.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:02 trial074 ceph-mon[44412]: pgmap v245: 97 pgs: 97 active+clean; 1.0 GiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 6.4 MiB/s rd, 26 MiB/s wr, 1.66k op/s 2026-02-24T09:19:04.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:04 trial159 ceph-mon[44242]: pgmap v246: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 8.2 TiB / 8.2 TiB avail; 7.3 MiB/s rd, 30 MiB/s wr, 1.89k op/s 2026-02-24T09:19:04.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:04 trial028 ceph-mon[40371]: pgmap v246: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 8.2 TiB / 8.2 TiB avail; 7.3 MiB/s rd, 30 MiB/s wr, 1.89k op/s 2026-02-24T09:19:04.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:04 trial074 ceph-mon[44412]: pgmap v246: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 8.2 TiB / 8.2 TiB avail; 7.3 MiB/s rd, 30 MiB/s wr, 1.89k op/s 2026-02-24T09:19:06.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:06 trial159 ceph-mon[44242]: pgmap v247: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.5 MiB/s rd, 26 MiB/s wr, 1.70k op/s 2026-02-24T09:19:06.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:06 trial028 ceph-mon[40371]: pgmap v247: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.5 MiB/s rd, 26 MiB/s wr, 1.70k op/s 2026-02-24T09:19:06.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:06 trial074 ceph-mon[44412]: pgmap v247: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.5 MiB/s rd, 26 MiB/s wr, 1.70k op/s 2026-02-24T09:19:08.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:08 trial159 ceph-mon[44242]: pgmap v248: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 8.2 TiB / 8.2 TiB avail; 7.1 MiB/s rd, 29 MiB/s wr, 1.85k op/s 2026-02-24T09:19:08.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:08 trial028 ceph-mon[40371]: pgmap v248: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 8.2 TiB / 8.2 TiB avail; 7.1 MiB/s rd, 29 MiB/s wr, 1.85k op/s 2026-02-24T09:19:08.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:08 trial074 ceph-mon[44412]: pgmap v248: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 8.2 TiB / 8.2 TiB avail; 7.1 MiB/s rd, 29 MiB/s wr, 1.85k op/s 2026-02-24T09:19:10.181 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-24T09:19:10.182 INFO:tasks.workunit.client.0.trial028.stdout: Children see throughput for 1 rewriters = 27960.55 kB/sec 2026-02-24T09:19:10.182 INFO:tasks.workunit.client.0.trial028.stdout: Parent sees throughput for 1 rewriters = 27960.07 kB/sec 2026-02-24T09:19:10.182 INFO:tasks.workunit.client.0.trial028.stdout: Min throughput per process = 27960.55 kB/sec 2026-02-24T09:19:10.182 INFO:tasks.workunit.client.0.trial028.stdout: Max throughput per process = 27960.55 kB/sec 2026-02-24T09:19:10.182 INFO:tasks.workunit.client.0.trial028.stdout: Avg throughput per process = 27960.55 kB/sec 2026-02-24T09:19:10.182 INFO:tasks.workunit.client.0.trial028.stdout: Min xfer = 1048576.00 kB 2026-02-24T09:19:10.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:10 trial159 ceph-mon[44242]: pgmap v249: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 6.4 MiB/s rd, 26 MiB/s wr, 1.66k op/s 2026-02-24T09:19:10.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.789+0000 7fee63fff640 1 -- 10.20.193.28:0/649138791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee64113950 msgr2=0x7fee64113d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:10.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.789+0000 7fee63fff640 1 --2- 10.20.193.28:0/649138791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee64113950 0x7fee64113d20 secure :-1 s=READY pgs=414 gs=3 cs=0 l=1 c_cookie=5465560582106042702 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee58009950 tx=0x7fee5802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.789+0000 7fee63fff640 1 -- 10.20.193.28:0/649138791 shutdown_connections 2026-02-24T09:19:10.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.789+0000 7fee63fff640 1 --2- 10.20.193.28:0/649138791 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fee64119b40 0x7fee6417a510 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.789+0000 7fee63fff640 1 --2- 10.20.193.28:0/649138791 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fee64114340 0x7fee64119390 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.789+0000 7fee63fff640 1 --2- 10.20.193.28:0/649138791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee64113950 0x7fee64113d20 unknown :-1 s=CLOSED pgs=414 gs=3 cs=0 l=1 c_cookie=5465560582106042702 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.789+0000 7fee63fff640 1 -- 10.20.193.28:0/649138791 >> 10.20.193.28:0/649138791 conn(0x7fee640619a0 msgr2=0x7fee64061da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:10.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.789+0000 7fee63fff640 1 -- 10.20.193.28:0/649138791 shutdown_connections 2026-02-24T09:19:10.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.789+0000 7fee63fff640 1 -- 10.20.193.28:0/649138791 wait complete. 2026-02-24T09:19:10.793 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.790+0000 7fee63fff640 1 Processor -- start 2026-02-24T09:19:10.793 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.790+0000 7fee63fff640 1 -- start start 2026-02-24T09:19:10.793 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.790+0000 7fee63fff640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fee64113950 0x7fee64122340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:10.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.790+0000 7fee63fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee64114340 0x7fee64122880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:10.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.790+0000 7fee63fff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fee64119b40 0x7fee64127bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:10.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.790+0000 7fee63fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fee641281d0 con 0x7fee64114340 2026-02-24T09:19:10.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.790+0000 7fee63fff640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fee64128340 con 0x7fee64119b40 2026-02-24T09:19:10.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.790+0000 7fee63fff640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fee64128500 con 0x7fee64113950 2026-02-24T09:19:10.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.791+0000 7fee627fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee64114340 0x7fee64122880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:10.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.791+0000 7fee627fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee64114340 0x7fee64122880 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35056/0 (socket says 10.20.193.28:35056) 2026-02-24T09:19:10.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.791+0000 7fee627fc640 1 -- 10.20.193.28:0/3317481553 learned_addr learned my addr 10.20.193.28:0/3317481553 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:19:10.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.791+0000 7fee637fe640 1 --2- 10.20.193.28:0/3317481553 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fee64119b40 0x7fee64127bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:10.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.791+0000 7fee62ffd640 1 --2- 10.20.193.28:0/3317481553 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fee64113950 0x7fee64122340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:10.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.791+0000 7fee627fc640 1 -- 10.20.193.28:0/3317481553 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fee64113950 msgr2=0x7fee64122340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:10.795 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.791+0000 7fee627fc640 1 --2- 10.20.193.28:0/3317481553 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fee64113950 0x7fee64122340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.795 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.791+0000 7fee627fc640 1 -- 10.20.193.28:0/3317481553 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fee64119b40 msgr2=0x7fee64127bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:10.795 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.791+0000 7fee627fc640 1 --2- 10.20.193.28:0/3317481553 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fee64119b40 0x7fee64127bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.795 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.791+0000 7fee627fc640 1 -- 10.20.193.28:0/3317481553 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee58009570 con 0x7fee64114340 2026-02-24T09:19:10.795 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.791+0000 7fee627fc640 1 --2- 10.20.193.28:0/3317481553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee64114340 0x7fee64122880 secure :-1 s=READY pgs=415 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee4c009480 tx=0x7fee4c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:10.795 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.791+0000 7fee43fff640 1 -- 10.20.193.28:0/3317481553 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee4c00cd40 con 0x7fee64114340 2026-02-24T09:19:10.795 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.791+0000 7fee43fff640 1 -- 10.20.193.28:0/3317481553 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fee4c004d10 con 0x7fee64114340 2026-02-24T09:19:10.795 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.791+0000 7fee63fff640 1 -- 10.20.193.28:0/3317481553 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee641287e0 con 0x7fee64114340 2026-02-24T09:19:10.795 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.791+0000 7fee43fff640 1 -- 10.20.193.28:0/3317481553 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee4c0106b0 con 0x7fee64114340 2026-02-24T09:19:10.795 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.791+0000 7fee63fff640 1 -- 10.20.193.28:0/3317481553 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee64168ee0 con 0x7fee64114340 2026-02-24T09:19:10.796 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.794+0000 7fee43fff640 1 -- 10.20.193.28:0/3317481553 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7fee4c01f060 con 0x7fee64114340 2026-02-24T09:19:10.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.796+0000 7fee43fff640 1 --2- 10.20.193.28:0/3317481553 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fee380b58d0 0x7fee380d5d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:10.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.796+0000 7fee43fff640 1 -- 10.20.193.28:0/3317481553 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7fee4c014070 con 0x7fee64114340 2026-02-24T09:19:10.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.796+0000 7fee62ffd640 1 --2- 10.20.193.28:0/3317481553 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fee380b58d0 0x7fee380d5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:10.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.796+0000 7fee6ba1fe00 1 Processor -- start 2026-02-24T09:19:10.799 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.796+0000 7fee6ba1fe00 1 -- start start 2026-02-24T09:19:10.799 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.796+0000 7fee62ffd640 1 --2- 10.20.193.28:0/3317481553 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fee380b58d0 0x7fee380d5d80 secure :-1 s=READY pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee580023d0 tx=0x7fee58031040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:10.799 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.797+0000 7fee6ba1fe00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6e8149a60 0x55e6e822b200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:10.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.797+0000 7fee6ba1fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6e822b740 0x55e6e822bb90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:10.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.797+0000 7fee6ba1fe00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6e8270270 0x55e6e8290650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:10.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.797+0000 7fee6ba1fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e6e8140f10 con 0x55e6e822b740 2026-02-24T09:19:10.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.797+0000 7fee6ba1fe00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55e6e813cc40 con 0x55e6e8149a60 2026-02-24T09:19:10.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.797+0000 7fee6ba1fe00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55e6e8136da0 con 0x55e6e8270270 2026-02-24T09:19:10.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.797+0000 7fee627fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6e822b740 0x55e6e822bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:10.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.797+0000 7fee627fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6e822b740 0x55e6e822bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35058/0 (socket says 10.20.193.28:35058) 2026-02-24T09:19:10.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.797+0000 7fee627fc640 1 -- 10.20.193.28:0/3599501658 learned_addr learned my addr 10.20.193.28:0/3599501658 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:19:10.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.797+0000 7fee637fe640 1 --2- 10.20.193.28:0/3599501658 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6e8270270 0x55e6e8290650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:10.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.797+0000 7fee62ffd640 1 --2- 10.20.193.28:0/3599501658 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6e8149a60 0x55e6e822b200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:10.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.797+0000 7fee627fc640 1 -- 10.20.193.28:0/3599501658 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6e8270270 msgr2=0x55e6e8290650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:10.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.797+0000 7fee627fc640 1 --2- 10.20.193.28:0/3599501658 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6e8270270 0x55e6e8290650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.797+0000 7fee627fc640 1 -- 10.20.193.28:0/3599501658 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6e8149a60 msgr2=0x55e6e822b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:10.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.797+0000 7fee627fc640 1 --2- 10.20.193.28:0/3599501658 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6e8149a60 0x55e6e822b200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.797+0000 7fee627fc640 1 -- 10.20.193.28:0/3599501658 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6e80e2340 con 0x55e6e822b740 2026-02-24T09:19:10.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.797+0000 7fee627fc640 1 --2- 10.20.193.28:0/3599501658 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6e822b740 0x55e6e822bb90 secure :-1 s=READY pgs=416 gs=2 cs=0 l=1 c_cookie=6356460697169676728 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee4c0e2a50 tx=0x7fee4c0a9890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5836af537b87c9b8 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:10.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.797+0000 7fee413fe640 1 -- 10.20.193.28:0/3599501658 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee4c0ac940 con 0x55e6e822b740 2026-02-24T09:19:10.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.797+0000 7fee413fe640 1 -- 10.20.193.28:0/3599501658 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fee4c0adb40 con 0x55e6e822b740 2026-02-24T09:19:10.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.797+0000 7fee413fe640 1 -- 10.20.193.28:0/3599501658 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee4c0e4cb0 con 0x55e6e822b740 2026-02-24T09:19:10.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.798+0000 7fee6ba1fe00 1 -- 10.20.193.28:0/3599501658 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6e822b740 msgr2=0x55e6e822bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:10.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.798+0000 7fee6ba1fe00 1 --2- 10.20.193.28:0/3599501658 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6e822b740 0x55e6e822bb90 secure :-1 s=READY pgs=416 gs=2 cs=0 l=1 c_cookie=6356460697169676728 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee4c0e2a50 tx=0x7fee4c0a9890 comp rx=0 tx=0).stop 2026-02-24T09:19:10.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.798+0000 7fee6ba1fe00 1 -- 10.20.193.28:0/3599501658 shutdown_connections 2026-02-24T09:19:10.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.798+0000 7fee6ba1fe00 1 --2- 10.20.193.28:0/3599501658 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6e8270270 0x55e6e8290650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.798+0000 7fee6ba1fe00 1 --2- 10.20.193.28:0/3599501658 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6e822b740 0x55e6e822bb90 unknown :-1 s=CLOSED pgs=416 gs=2 cs=0 l=1 c_cookie=6356460697169676728 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.798+0000 7fee6ba1fe00 1 --2- 10.20.193.28:0/3599501658 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6e8149a60 0x55e6e822b200 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.798+0000 7fee6ba1fe00 1 -- 10.20.193.28:0/3599501658 >> 10.20.193.28:0/3599501658 conn(0x55e6e81c5490 msgr2=0x55e6e8229ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:10.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.798+0000 7fee6ba1fe00 1 -- 10.20.193.28:0/3599501658 shutdown_connections 2026-02-24T09:19:10.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.798+0000 7fee6ba1fe00 1 -- 10.20.193.28:0/3599501658 wait complete. 2026-02-24T09:19:10.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.799+0000 7fee6ba1fe00 1 -- start start 2026-02-24T09:19:10.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.799+0000 7fee6ba1fe00 1 Processor -- start 2026-02-24T09:19:10.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.799+0000 7fee6ba1fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6e8149a60 0x55e6e82877c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:10.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.799+0000 7fee6ba1fe00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6e822b740 0x55e6e8287d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:10.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.799+0000 7fee6ba1fe00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6e8270270 0x55e6e828ccf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:10.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.800+0000 7fee6ba1fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e6e828d230 con 0x55e6e8149a60 2026-02-24T09:19:10.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.800+0000 7fee6ba1fe00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55e6e828d3a0 con 0x55e6e822b740 2026-02-24T09:19:10.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.800+0000 7fee6ba1fe00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55e6e828d560 con 0x55e6e8270270 2026-02-24T09:19:10.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.800+0000 7fee62ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6e8149a60 0x55e6e82877c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:10.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.800+0000 7fee62ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6e8149a60 0x55e6e82877c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35066/0 (socket says 10.20.193.28:35066) 2026-02-24T09:19:10.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.800+0000 7fee62ffd640 1 -- 10.20.193.28:0/3010072381 learned_addr learned my addr 10.20.193.28:0/3010072381 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:19:10.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.800+0000 7fee637fe640 1 --2- 10.20.193.28:0/3010072381 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6e8270270 0x55e6e828ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:10.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.800+0000 7fee627fc640 1 --2- 10.20.193.28:0/3010072381 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6e822b740 0x55e6e8287d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:10.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.800+0000 7fee62ffd640 1 -- 10.20.193.28:0/3010072381 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6e8270270 msgr2=0x55e6e828ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:10.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.800+0000 7fee62ffd640 1 --2- 10.20.193.28:0/3010072381 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6e8270270 0x55e6e828ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.807 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.800+0000 7fee62ffd640 1 -- 10.20.193.28:0/3010072381 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6e822b740 msgr2=0x55e6e8287d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:10.807 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.800+0000 7fee62ffd640 1 --2- 10.20.193.28:0/3010072381 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6e822b740 0x55e6e8287d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.807 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.800+0000 7fee62ffd640 1 -- 10.20.193.28:0/3010072381 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6e80bace0 con 0x55e6e8149a60 2026-02-24T09:19:10.807 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.800+0000 7fee637fe640 1 --2- 10.20.193.28:0/3010072381 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6e8270270 0x55e6e828ccf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:19:10.807 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.800+0000 7fee62ffd640 1 --2- 10.20.193.28:0/3010072381 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6e8149a60 0x55e6e82877c0 secure :-1 s=READY pgs=417 gs=1 cs=0 l=1 c_cookie=15330462821021494612 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee580042d0 tx=0x7fee5802f1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c0beb62151ad54 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:10.807 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.800+0000 7fee2cbfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:19:10.807 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.800+0000 7fee2cbfc640 1 -- 10.20.193.28:0/3010072381 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee58038ad0 con 0x55e6e8149a60 2026-02-24T09:19:10.807 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.800+0000 7fee2cbfc640 1 -- 10.20.193.28:0/3010072381 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fee58038c30 con 0x55e6e8149a60 2026-02-24T09:19:10.807 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.800+0000 7fee2cbfc640 1 -- 10.20.193.28:0/3010072381 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee58043680 con 0x55e6e8149a60 2026-02-24T09:19:10.807 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.801+0000 7fee6ba1fe00 1 -- 10.20.193.28:0/3010072381 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee64168ee0 con 0x55e6e8149a60 2026-02-24T09:19:10.807 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.801+0000 7fee2cbfc640 1 -- 10.20.193.28:0/3010072381 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7fee58043810 con 0x55e6e8149a60 2026-02-24T09:19:10.807 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.801+0000 7fee6ba1fe00 10 client.15651 _ll_register_callbacks cb 0x55e6e80c1980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:19:10.808 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.801+0000 7fee6ba1fe00 1 -- 10.20.193.28:0/3010072381 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e6e7dd6520 con 0x55e6e8149a60 2026-02-24T09:19:10.808 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.801+0000 7fee2cbfc640 1 -- 10.20.193.28:0/3010072381 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fee58038da0 con 0x55e6e8149a60 2026-02-24T09:19:10.808 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.801+0000 7fee6ba1fe00 10 client.15651 fetch_fsmap learned FSMap version 23 2026-02-24T09:19:10.808 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.801+0000 7fee6ba1fe00 1 -- 10.20.193.28:0/3010072381 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x55e6e80cc5b0 con 0x55e6e8149a60 2026-02-24T09:19:10.808 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.801+0000 7fee2cbfc640 1 -- 10.20.193.28:0/3010072381 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fee580439d0 con 0x55e6e8149a60 2026-02-24T09:19:10.808 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.801+0000 7fee6ba1fe00 10 client.15651 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:19:10.808 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.801+0000 7fee6ba1fe00 10 client.15651 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:19:10.808 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.801+0000 7fee6ba1fe00 20 client.15651 populate_metadata read hostname 'trial028' 2026-02-24T09:19:10.808 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.801+0000 7fee6ba1fe00 1 --2- 10.20.193.28:0/3010072381 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55e6e826d690 0x55e6e826db00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:10.808 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.801+0000 7fee6ba1fe00 4 client.15651 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:19:10.808 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.801+0000 7fee6ba1fe00 1 -- 10.20.193.28:0/3010072381 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6e81089d0 con 0x55e6e826d690 2026-02-24T09:19:10.808 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.802+0000 7fee627fc640 1 --2- 10.20.193.28:0/3010072381 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55e6e826d690 0x55e6e826db00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:10.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.802+0000 7fee627fc640 1 --2- 10.20.193.28:0/3010072381 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55e6e826d690 0x55e6e826db00 crc :-1 s=READY pgs=38 gs=4 cs=0 l=0 c_cookie=12460943683488513356 s_cookie=3380622282562876792 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acee2a425c7afd4c server_cookie=2eea620dffee3578 in_seq=0 out_seq=0 2026-02-24T09:19:10.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.802+0000 7fee2cbfc640 10 client.15651 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:19:10.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.803+0000 7fee2cbfc640 1 -- 10.20.193.28:0/3010072381 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55e6e81089d0 con 0x55e6e826d690 2026-02-24T09:19:10.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.803+0000 7fee2cbfc640 10 client.15651 handle_command_reply: tid=0 2026-02-24T09:19:10.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.803+0000 7fee6ba1fe00 1 client.15651 shutdown 2026-02-24T09:19:10.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.803+0000 7fee6ba1fe00 1 -- 10.20.193.28:0/3010072381 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6e8149a60 msgr2=0x55e6e82877c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:10.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.803+0000 7fee6ba1fe00 1 --2- 10.20.193.28:0/3010072381 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6e8149a60 0x55e6e82877c0 secure :-1 s=READY pgs=417 gs=1 cs=0 l=1 c_cookie=15330462821021494612 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee580042d0 tx=0x7fee5802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.803+0000 7fee6ba1fe00 1 -- 10.20.193.28:0/3010072381 shutdown_connections 2026-02-24T09:19:10.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.803+0000 7fee6ba1fe00 1 --2- 10.20.193.28:0/3010072381 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55e6e826d690 0x55e6e826db00 crc :-1 s=READY pgs=38 gs=4 cs=0 l=0 c_cookie=12460943683488513356 s_cookie=3380622282562876792 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.803+0000 7fee6ba1fe00 1 --2- 10.20.193.28:0/3010072381 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6e8270270 0x55e6e828ccf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.803+0000 7fee6ba1fe00 1 --2- 10.20.193.28:0/3010072381 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6e822b740 0x55e6e8287d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.803+0000 7fee6ba1fe00 1 --2- 10.20.193.28:0/3010072381 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6e8149a60 0x55e6e82877c0 unknown :-1 s=CLOSED pgs=417 gs=1 cs=0 l=1 c_cookie=15330462821021494612 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.803+0000 7fee2cbfc640 0 client.15651 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:19:10.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.803+0000 7fee6ba1fe00 1 -- 10.20.193.28:0/3010072381 >> 10.20.193.28:0/3010072381 conn(0x55e6e81c5490 msgr2=0x55e6e82292f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:10.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.803+0000 7fee6ba1fe00 1 -- 10.20.193.28:0/3010072381 shutdown_connections 2026-02-24T09:19:10.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.803+0000 7fee6ba1fe00 1 -- 10.20.193.28:0/3010072381 wait complete. 2026-02-24T09:19:10.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.803+0000 7fee6ba1fe00 20 client.15651 trim_cache size 0 max 16384 2026-02-24T09:19:10.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.810+0000 7fee6ba1fe00 1 Processor -- start 2026-02-24T09:19:10.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.810+0000 7fee6ba1fe00 1 -- start start 2026-02-24T09:19:10.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.811+0000 7fee6ba1fe00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6e8149a60 0x55e6e828c260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:10.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.811+0000 7fee6ba1fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6e822b740 0x55e6e826a400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:10.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.811+0000 7fee6ba1fe00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6e8270270 0x55e6e826a940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:10.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.811+0000 7fee6ba1fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e6e81349d0 con 0x55e6e822b740 2026-02-24T09:19:10.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.811+0000 7fee6ba1fe00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55e6e7e75f10 con 0x55e6e8270270 2026-02-24T09:19:10.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.811+0000 7fee6ba1fe00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55e6e819a580 con 0x55e6e8149a60 2026-02-24T09:19:10.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.811+0000 7fee627fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6e822b740 0x55e6e826a400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:10.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.811+0000 7fee62ffd640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6e8149a60 0x55e6e828c260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:10.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.811+0000 7fee627fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6e822b740 0x55e6e826a400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35082/0 (socket says 10.20.193.28:35082) 2026-02-24T09:19:10.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.811+0000 7fee627fc640 1 -- 10.20.193.28:0/1593956603 learned_addr learned my addr 10.20.193.28:0/1593956603 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:19:10.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.811+0000 7fee637fe640 1 --2- 10.20.193.28:0/1593956603 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6e8270270 0x55e6e826a940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:10.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.811+0000 7fee627fc640 1 -- 10.20.193.28:0/1593956603 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6e8149a60 msgr2=0x55e6e828c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:10.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.811+0000 7fee627fc640 1 --2- 10.20.193.28:0/1593956603 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6e8149a60 0x55e6e828c260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.811+0000 7fee627fc640 1 -- 10.20.193.28:0/1593956603 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6e8270270 msgr2=0x55e6e826a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:10.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.811+0000 7fee627fc640 1 --2- 10.20.193.28:0/1593956603 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6e8270270 0x55e6e826a940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.811+0000 7fee627fc640 1 -- 10.20.193.28:0/1593956603 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6e8279d10 con 0x55e6e822b740 2026-02-24T09:19:10.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.811+0000 7fee637fe640 1 --2- 10.20.193.28:0/1593956603 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6e8270270 0x55e6e826a940 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:19:10.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.811+0000 7fee627fc640 1 --2- 10.20.193.28:0/1593956603 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6e822b740 0x55e6e826a400 secure :-1 s=READY pgs=418 gs=2 cs=0 l=1 c_cookie=2972481794088542956 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee4c0a9710 tx=0x7fee4c0057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=294060715df6a2ec server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:10.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.811+0000 7fee40bfd640 1 -- 10.20.193.28:0/1593956603 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee4c0ac940 con 0x55e6e822b740 2026-02-24T09:19:10.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.811+0000 7fee40bfd640 1 -- 10.20.193.28:0/1593956603 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fee4c0adb40 con 0x55e6e822b740 2026-02-24T09:19:10.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.811+0000 7fee40bfd640 1 -- 10.20.193.28:0/1593956603 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee4c0addd0 con 0x55e6e822b740 2026-02-24T09:19:10.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.812+0000 7fee6ba1fe00 1 -- 10.20.193.28:0/1593956603 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6e822b740 msgr2=0x55e6e826a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:10.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.812+0000 7fee6ba1fe00 1 --2- 10.20.193.28:0/1593956603 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6e822b740 0x55e6e826a400 secure :-1 s=READY pgs=418 gs=2 cs=0 l=1 c_cookie=2972481794088542956 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee4c0a9710 tx=0x7fee4c0057b0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.812+0000 7fee6ba1fe00 1 -- 10.20.193.28:0/1593956603 shutdown_connections 2026-02-24T09:19:10.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.812+0000 7fee6ba1fe00 1 --2- 10.20.193.28:0/1593956603 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6e8270270 0x55e6e826a940 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.812+0000 7fee6ba1fe00 1 --2- 10.20.193.28:0/1593956603 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6e822b740 0x55e6e826a400 unknown :-1 s=CLOSED pgs=418 gs=2 cs=0 l=1 c_cookie=2972481794088542956 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.812+0000 7fee6ba1fe00 1 --2- 10.20.193.28:0/1593956603 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6e8149a60 0x55e6e828c260 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.812+0000 7fee6ba1fe00 1 -- 10.20.193.28:0/1593956603 >> 10.20.193.28:0/1593956603 conn(0x55e6e81c5490 msgr2=0x55e6e828bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:10.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.812+0000 7fee6ba1fe00 1 -- 10.20.193.28:0/1593956603 shutdown_connections 2026-02-24T09:19:10.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.812+0000 7fee6ba1fe00 1 -- 10.20.193.28:0/1593956603 wait complete. 2026-02-24T09:19:10.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.812+0000 7fee6ba1fe00 1 -- start start 2026-02-24T09:19:10.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.813+0000 7fee6ba1fe00 1 Processor -- start 2026-02-24T09:19:10.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.813+0000 7fee6ba1fe00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6e8149a60 0x55e6e820bda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:10.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.813+0000 7fee6ba1fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6e822b740 0x55e6e820c2e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:10.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.813+0000 7fee6ba1fe00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6e8270270 0x55e6e820c820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:10.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.813+0000 7fee6ba1fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e6e8287e90 con 0x55e6e822b740 2026-02-24T09:19:10.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.813+0000 7fee6ba1fe00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55e6e82d62c0 con 0x55e6e8149a60 2026-02-24T09:19:10.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.813+0000 7fee6ba1fe00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55e6e82d6480 con 0x55e6e8270270 2026-02-24T09:19:10.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.813+0000 7fee627fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6e822b740 0x55e6e820c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:10.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.813+0000 7fee627fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6e822b740 0x55e6e820c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35090/0 (socket says 10.20.193.28:35090) 2026-02-24T09:19:10.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.813+0000 7fee627fc640 1 -- 10.20.193.28:0/40077307 learned_addr learned my addr 10.20.193.28:0/40077307 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:19:10.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.813+0000 7fee62ffd640 1 --2- 10.20.193.28:0/40077307 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6e8149a60 0x55e6e820bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:10.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.813+0000 7fee637fe640 1 --2- 10.20.193.28:0/40077307 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6e8270270 0x55e6e820c820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:10.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.813+0000 7fee627fc640 1 -- 10.20.193.28:0/40077307 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6e8270270 msgr2=0x55e6e820c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:10.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.813+0000 7fee627fc640 1 --2- 10.20.193.28:0/40077307 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6e8270270 0x55e6e820c820 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.813+0000 7fee627fc640 1 -- 10.20.193.28:0/40077307 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6e8149a60 msgr2=0x55e6e820bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:10.819 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.813+0000 7fee627fc640 1 --2- 10.20.193.28:0/40077307 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6e8149a60 0x55e6e820bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.813+0000 7fee627fc640 1 -- 10.20.193.28:0/40077307 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6e80c7030 con 0x55e6e822b740 2026-02-24T09:19:10.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.813+0000 7fee627fc640 1 --2- 10.20.193.28:0/40077307 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6e822b740 0x55e6e820c2e0 secure :-1 s=READY pgs=419 gs=1 cs=0 l=1 c_cookie=17947461063234021242 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee4c0af3d0 tx=0x7fee4c00cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f91230bf4e37e77a server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:10.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.813+0000 7fee2cbfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:19:10.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.814+0000 7fee2cbfc640 1 -- 10.20.193.28:0/40077307 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee4c0ac940 con 0x55e6e822b740 2026-02-24T09:19:10.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.814+0000 7fee2cbfc640 1 -- 10.20.193.28:0/40077307 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fee4c0e4b20 con 0x55e6e822b740 2026-02-24T09:19:10.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.814+0000 7fee2cbfc640 1 -- 10.20.193.28:0/40077307 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee4c072280 con 0x55e6e822b740 2026-02-24T09:19:10.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.814+0000 7fee6ba1fe00 1 -- 10.20.193.28:0/40077307 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6e80e2340 con 0x55e6e822b740 2026-02-24T09:19:10.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.814+0000 7fee2cbfc640 1 -- 10.20.193.28:0/40077307 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7fee4c072410 con 0x55e6e822b740 2026-02-24T09:19:10.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.814+0000 7fee2cbfc640 10 client.15657 inactive, discarding osd_map(96..96 src has 1..96) 2026-02-24T09:19:10.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.814+0000 7fee6ba1fe00 10 client.15657 _ll_register_callbacks cb 0x55e6e80c1980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:19:10.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.814+0000 7fee6ba1fe00 1 -- 10.20.193.28:0/40077307 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e6e8167d30 con 0x55e6e822b740 2026-02-24T09:19:10.820 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.814+0000 7fee2cbfc640 1 -- 10.20.193.28:0/40077307 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fee4c0b2e60 con 0x55e6e822b740 2026-02-24T09:19:10.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.814+0000 7fee6ba1fe00 10 client.15657 fetch_fsmap learned FSMap version 23 2026-02-24T09:19:10.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.814+0000 7fee6ba1fe00 1 -- 10.20.193.28:0/40077307 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x55e6e80bb010 con 0x55e6e822b740 2026-02-24T09:19:10.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.814+0000 7fee2cbfc640 1 -- 10.20.193.28:0/40077307 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fee4c0b7df0 con 0x55e6e822b740 2026-02-24T09:19:10.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.814+0000 7fee6ba1fe00 10 client.15657 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:19:10.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.814+0000 7fee6ba1fe00 10 client.15657 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:19:10.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.814+0000 7fee6ba1fe00 20 client.15657 populate_metadata read hostname 'trial028' 2026-02-24T09:19:10.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.814+0000 7fee6ba1fe00 1 --2- 10.20.193.28:0/40077307 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55e6e831deb0 0x55e6e833e360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:10.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.814+0000 7fee6ba1fe00 4 client.15657 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-24T09:19:10.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.814+0000 7fee6ba1fe00 1 -- 10.20.193.28:0/40077307 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e6e7e1a640 con 0x55e6e831deb0 2026-02-24T09:19:10.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.815+0000 7fee62ffd640 1 --2- 10.20.193.28:0/40077307 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55e6e831deb0 0x55e6e833e360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:10.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.815+0000 7fee62ffd640 1 --2- 10.20.193.28:0/40077307 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55e6e831deb0 0x55e6e833e360 crc :-1 s=READY pgs=39 gs=4 cs=0 l=0 c_cookie=13798172233161793829 s_cookie=14804465647943901898 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf7cf48a4b446125 server_cookie=cd740711c32b62ca in_seq=0 out_seq=0 2026-02-24T09:19:10.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.815+0000 7fee2cbfc640 10 client.15657 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:19:10.823 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.819+0000 7fee2cbfc640 1 -- 10.20.193.28:0/40077307 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e6e7e1a640 con 0x55e6e831deb0 2026-02-24T09:19:10.823 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.819+0000 7fee2cbfc640 10 client.15657 handle_command_reply: tid=0 2026-02-24T09:19:10.823 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.819+0000 7fee6ba1fe00 1 client.15657 shutdown 2026-02-24T09:19:10.823 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.819+0000 7fee6ba1fe00 1 -- 10.20.193.28:0/40077307 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6e822b740 msgr2=0x55e6e820c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:10.823 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.819+0000 7fee6ba1fe00 1 --2- 10.20.193.28:0/40077307 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6e822b740 0x55e6e820c2e0 secure :-1 s=READY pgs=419 gs=1 cs=0 l=1 c_cookie=17947461063234021242 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee4c0af3d0 tx=0x7fee4c00cea0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.823 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.819+0000 7fee6ba1fe00 1 -- 10.20.193.28:0/40077307 shutdown_connections 2026-02-24T09:19:10.823 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.819+0000 7fee6ba1fe00 1 --2- 10.20.193.28:0/40077307 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55e6e831deb0 0x55e6e833e360 crc :-1 s=READY pgs=39 gs=4 cs=0 l=0 c_cookie=13798172233161793829 s_cookie=14804465647943901898 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.823 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.819+0000 7fee6ba1fe00 1 --2- 10.20.193.28:0/40077307 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6e8270270 0x55e6e820c820 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.824 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.819+0000 7fee6ba1fe00 1 --2- 10.20.193.28:0/40077307 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6e822b740 0x55e6e820c2e0 unknown :-1 s=CLOSED pgs=419 gs=1 cs=0 l=1 c_cookie=17947461063234021242 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.824 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.819+0000 7fee2cbfc640 0 client.15657 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:19:10.824 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.819+0000 7fee6ba1fe00 1 --2- 10.20.193.28:0/40077307 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6e8149a60 0x55e6e820bda0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.824 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.819+0000 7fee6ba1fe00 1 -- 10.20.193.28:0/40077307 >> 10.20.193.28:0/40077307 conn(0x55e6e81c5490 msgr2=0x55e6e826abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:10.824 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.819+0000 7fee6ba1fe00 1 -- 10.20.193.28:0/40077307 shutdown_connections 2026-02-24T09:19:10.824 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.819+0000 7fee6ba1fe00 1 -- 10.20.193.28:0/40077307 wait complete. 2026-02-24T09:19:10.824 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.820+0000 7fee6ba1fe00 20 client.15657 trim_cache size 0 max 16384 2026-02-24T09:19:10.824 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-24T09:19:10.824 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-24T09:19:10.825 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-24T09:19:10.825 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-24T09:19:10.825 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.820+0000 7fee63fff640 1 -- 10.20.193.28:0/3317481553 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fee380b58d0 msgr2=0x7fee380d5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:10.825 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.820+0000 7fee63fff640 1 --2- 10.20.193.28:0/3317481553 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fee380b58d0 0x7fee380d5d80 secure :-1 s=READY pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee580023d0 tx=0x7fee58031040 comp rx=0 tx=0).stop 2026-02-24T09:19:10.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.820+0000 7fee63fff640 1 -- 10.20.193.28:0/3317481553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee64114340 msgr2=0x7fee64122880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:10.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.820+0000 7fee63fff640 1 --2- 10.20.193.28:0/3317481553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee64114340 0x7fee64122880 secure :-1 s=READY pgs=415 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee4c009480 tx=0x7fee4c00ee60 comp rx=0 tx=0).stop 2026-02-24T09:19:10.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.820+0000 7fee63fff640 1 -- 10.20.193.28:0/3317481553 shutdown_connections 2026-02-24T09:19:10.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.820+0000 7fee63fff640 1 --2- 10.20.193.28:0/3317481553 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fee380b58d0 0x7fee380d5d80 unknown :-1 s=CLOSED pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.820+0000 7fee63fff640 1 --2- 10.20.193.28:0/3317481553 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fee64119b40 0x7fee64127bb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.820+0000 7fee63fff640 1 --2- 10.20.193.28:0/3317481553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee64114340 0x7fee64122880 unknown :-1 s=CLOSED pgs=415 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.820+0000 7fee63fff640 1 --2- 10.20.193.28:0/3317481553 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fee64113950 0x7fee64122340 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:10.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.820+0000 7fee63fff640 1 -- 10.20.193.28:0/3317481553 >> 10.20.193.28:0/3317481553 conn(0x7fee640619a0 msgr2=0x7fee64062d40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:10.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.820+0000 7fee63fff640 1 -- 10.20.193.28:0/3317481553 shutdown_connections 2026-02-24T09:19:10.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:10.820+0000 7fee63fff640 1 -- 10.20.193.28:0/3317481553 wait complete. 2026-02-24T09:19:10.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:10 trial028 ceph-mon[40371]: pgmap v249: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 6.4 MiB/s rd, 26 MiB/s wr, 1.66k op/s 2026-02-24T09:19:10.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:10 trial074 ceph-mon[44412]: pgmap v249: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 6.4 MiB/s rd, 26 MiB/s wr, 1.66k op/s 2026-02-24T09:19:12.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:12 trial159 ceph-mon[44242]: pgmap v250: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 8.2 TiB / 8.2 TiB avail; 6.8 MiB/s rd, 27 MiB/s wr, 1.77k op/s 2026-02-24T09:19:12.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:12 trial028 ceph-mon[40371]: pgmap v250: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 8.2 TiB / 8.2 TiB avail; 6.8 MiB/s rd, 27 MiB/s wr, 1.77k op/s 2026-02-24T09:19:12.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:12 trial074 ceph-mon[44412]: pgmap v250: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 8.2 TiB / 8.2 TiB avail; 6.8 MiB/s rd, 27 MiB/s wr, 1.77k op/s 2026-02-24T09:19:14.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:14 trial159 ceph-mon[44242]: pgmap v251: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 8.2 TiB / 8.2 TiB avail; 6.2 MiB/s rd, 25 MiB/s wr, 1.61k op/s 2026-02-24T09:19:14.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:14 trial028 ceph-mon[40371]: pgmap v251: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 8.2 TiB / 8.2 TiB avail; 6.2 MiB/s rd, 25 MiB/s wr, 1.61k op/s 2026-02-24T09:19:14.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:14 trial074 ceph-mon[44412]: pgmap v251: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 8.2 TiB / 8.2 TiB avail; 6.2 MiB/s rd, 25 MiB/s wr, 1.61k op/s 2026-02-24T09:19:16.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:16 trial159 ceph-mon[44242]: pgmap v252: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 7.5 MiB/s rd, 20 MiB/s wr, 1.26k op/s 2026-02-24T09:19:16.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:16 trial028 ceph-mon[40371]: pgmap v252: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 7.5 MiB/s rd, 20 MiB/s wr, 1.26k op/s 2026-02-24T09:19:16.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:16 trial074 ceph-mon[44412]: pgmap v252: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 7.5 MiB/s rd, 20 MiB/s wr, 1.26k op/s 2026-02-24T09:19:18.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:18 trial159 ceph-mon[44242]: pgmap v253: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 20 MiB/s rd, 18 MiB/s wr, 1.14k op/s 2026-02-24T09:19:18.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:18 trial028 ceph-mon[40371]: pgmap v253: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 20 MiB/s rd, 18 MiB/s wr, 1.14k op/s 2026-02-24T09:19:18.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:18 trial074 ceph-mon[44412]: pgmap v253: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 20 MiB/s rd, 18 MiB/s wr, 1.14k op/s 2026-02-24T09:19:20.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:20 trial159 ceph-mon[44242]: pgmap v254: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 36 MiB/s rd, 13 MiB/s wr, 809 op/s 2026-02-24T09:19:20.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:20 trial028 ceph-mon[40371]: pgmap v254: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 36 MiB/s rd, 13 MiB/s wr, 809 op/s 2026-02-24T09:19:20.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:20 trial074 ceph-mon[44412]: pgmap v254: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 36 MiB/s rd, 13 MiB/s wr, 809 op/s 2026-02-24T09:19:22.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:22 trial159 ceph-mon[44242]: pgmap v255: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 47 MiB/s rd, 9.3 MiB/s wr, 599 op/s 2026-02-24T09:19:22.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:22 trial028 ceph-mon[40371]: pgmap v255: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 47 MiB/s rd, 9.3 MiB/s wr, 599 op/s 2026-02-24T09:19:22.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:22 trial074 ceph-mon[44412]: pgmap v255: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 47 MiB/s rd, 9.3 MiB/s wr, 599 op/s 2026-02-24T09:19:23.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.890+0000 7fc48bfff640 1 -- 10.20.193.28:0/1451074674 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc48c10fe50 msgr2=0x7fc48c114ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:23.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.890+0000 7fc48bfff640 1 --2- 10.20.193.28:0/1451074674 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc48c10fe50 0x7fc48c114ea0 secure :-1 s=READY pgs=420 gs=1 cs=0 l=1 c_cookie=12339381604965909415 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc474009890 tx=0x7fc47402f120 comp rx=0 tx=0).stop 2026-02-24T09:19:23.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.891+0000 7fc48bfff640 1 -- 10.20.193.28:0/1451074674 shutdown_connections 2026-02-24T09:19:23.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.891+0000 7fc48bfff640 1 --2- 10.20.193.28:0/1451074674 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc48c115650 0x7fc48c176020 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:23.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.891+0000 7fc48bfff640 1 --2- 10.20.193.28:0/1451074674 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc48c10fe50 0x7fc48c114ea0 unknown :-1 s=CLOSED pgs=420 gs=1 cs=0 l=1 c_cookie=12339381604965909415 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:23.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.891+0000 7fc48bfff640 1 --2- 10.20.193.28:0/1451074674 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc48c10f460 0x7fc48c10f830 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:23.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.891+0000 7fc48bfff640 1 -- 10.20.193.28:0/1451074674 >> 10.20.193.28:0/1451074674 conn(0x7fc48c0ecd10 msgr2=0x7fc48c10d120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:23.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.891+0000 7fc48bfff640 1 -- 10.20.193.28:0/1451074674 shutdown_connections 2026-02-24T09:19:23.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.891+0000 7fc48bfff640 1 -- 10.20.193.28:0/1451074674 wait complete. 2026-02-24T09:19:23.895 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.891+0000 7fc48bfff640 1 Processor -- start 2026-02-24T09:19:23.895 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.892+0000 7fc48bfff640 1 -- start start 2026-02-24T09:19:23.895 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.892+0000 7fc48bfff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc48c10f460 0x7fc48c0f5750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:23.895 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.892+0000 7fc48bfff640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc48c10fe50 0x7fc48c175f20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:23.895 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.892+0000 7fc48bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc48c115650 0x7fc48c0f5e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:23.895 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.892+0000 7fc48bfff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc48c0fb060 con 0x7fc48c115650 2026-02-24T09:19:23.895 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.892+0000 7fc48bfff640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fc48c0fb1d0 con 0x7fc48c10f460 2026-02-24T09:19:23.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.892+0000 7fc48bfff640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc48c0fb390 con 0x7fc48c10fe50 2026-02-24T09:19:23.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.892+0000 7fc48affd640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc48c10f460 0x7fc48c0f5750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:23.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.892+0000 7fc48affd640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc48c10f460 0x7fc48c0f5750 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:51824/0 (socket says 10.20.193.28:51824) 2026-02-24T09:19:23.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.892+0000 7fc48affd640 1 -- 10.20.193.28:0/92751696 learned_addr learned my addr 10.20.193.28:0/92751696 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:19:23.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.893+0000 7fc48affd640 1 -- 10.20.193.28:0/92751696 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc48c10fe50 msgr2=0x7fc48c175f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:23.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.893+0000 7fc48affd640 1 --2- 10.20.193.28:0/92751696 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc48c10fe50 0x7fc48c175f20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:23.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.893+0000 7fc48affd640 1 -- 10.20.193.28:0/92751696 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc48c115650 msgr2=0x7fc48c0f5e50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-24T09:19:23.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.893+0000 7fc48affd640 1 --2- 10.20.193.28:0/92751696 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc48c115650 0x7fc48c0f5e50 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:23.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.893+0000 7fc48affd640 1 -- 10.20.193.28:0/92751696 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4740094b0 con 0x7fc48c10f460 2026-02-24T09:19:23.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.893+0000 7fc48affd640 1 --2- 10.20.193.28:0/92751696 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc48c10f460 0x7fc48c0f5750 secure :-1 s=READY pgs=116 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc48000e9c0 tx=0x7fc48000ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:23.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.893+0000 7fc46bfff640 1 -- 10.20.193.28:0/92751696 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc48000cd70 con 0x7fc48c10f460 2026-02-24T09:19:23.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.893+0000 7fc46bfff640 1 -- 10.20.193.28:0/92751696 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc480004d10 con 0x7fc48c10f460 2026-02-24T09:19:23.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.893+0000 7fc46bfff640 1 -- 10.20.193.28:0/92751696 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc4800106b0 con 0x7fc48c10f460 2026-02-24T09:19:23.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.894+0000 7fc48bfff640 1 -- 10.20.193.28:0/92751696 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc48c0fb670 con 0x7fc48c10f460 2026-02-24T09:19:23.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.894+0000 7fc48bfff640 1 -- 10.20.193.28:0/92751696 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc48c0fbac0 con 0x7fc48c10f460 2026-02-24T09:19:23.899 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.897+0000 7fc46bfff640 1 -- 10.20.193.28:0/92751696 <== mon.2 v2:10.20.193.74:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7fc480004770 con 0x7fc48c10f460 2026-02-24T09:19:23.900 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.899+0000 7fc46bfff640 1 --2- 10.20.193.28:0/92751696 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc4600b58c0 0x7fc4600d5d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:23.900 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.899+0000 7fc46bfff640 1 -- 10.20.193.28:0/92751696 <== mon.2 v2:10.20.193.74:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7fc480014070 con 0x7fc48c10f460 2026-02-24T09:19:23.900 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.899+0000 7fc48a7fc640 1 --2- 10.20.193.28:0/92751696 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc4600b58c0 0x7fc4600d5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:23.901 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.899+0000 7fc493e50e00 1 Processor -- start 2026-02-24T09:19:23.901 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.899+0000 7fc48a7fc640 1 --2- 10.20.193.28:0/92751696 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc4600b58c0 0x7fc4600d5d70 secure :-1 s=READY pgs=231 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc47402f630 tx=0x7fc474005900 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:23.902 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.901+0000 7fc493e50e00 1 -- start start 2026-02-24T09:19:23.902 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.901+0000 7fc493e50e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbea6cca60 0x55cbea7ae200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:23.903 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.901+0000 7fc493e50e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55cbea7ae740 0x55cbea7aeb90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:23.903 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.901+0000 7fc493e50e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55cbea7f3270 0x55cbea813650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:23.903 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.901+0000 7fc493e50e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cbea6c3f10 con 0x55cbea6cca60 2026-02-24T09:19:23.903 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.901+0000 7fc493e50e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55cbea6bfc40 con 0x55cbea7f3270 2026-02-24T09:19:23.903 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.901+0000 7fc493e50e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55cbea6b9da0 con 0x55cbea7ae740 2026-02-24T09:19:23.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.901+0000 7fc48affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbea6cca60 0x55cbea7ae200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:23.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.901+0000 7fc48affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbea6cca60 0x55cbea7ae200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:59630/0 (socket says 10.20.193.28:59630) 2026-02-24T09:19:23.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.901+0000 7fc48b7fe640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55cbea7f3270 0x55cbea813650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:23.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.901+0000 7fc48affd640 1 -- 10.20.193.28:0/834037768 learned_addr learned my addr 10.20.193.28:0/834037768 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:19:23.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.901+0000 7fc48a7fc640 1 --2- 10.20.193.28:0/834037768 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55cbea7ae740 0x55cbea7aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:23.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.902+0000 7fc48a7fc640 1 -- 10.20.193.28:0/834037768 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55cbea7f3270 msgr2=0x55cbea813650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:23.905 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.902+0000 7fc48a7fc640 1 --2- 10.20.193.28:0/834037768 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55cbea7f3270 0x55cbea813650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:23.905 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.902+0000 7fc48a7fc640 1 -- 10.20.193.28:0/834037768 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbea6cca60 msgr2=0x55cbea7ae200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:23.905 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.902+0000 7fc48a7fc640 1 --2- 10.20.193.28:0/834037768 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbea6cca60 0x55cbea7ae200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:23.905 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.902+0000 7fc48a7fc640 1 -- 10.20.193.28:0/834037768 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbea665340 con 0x55cbea7ae740 2026-02-24T09:19:23.905 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.902+0000 7fc48affd640 1 --2- 10.20.193.28:0/834037768 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbea6cca60 0x55cbea7ae200 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:19:23.905 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.903+0000 7fc48a7fc640 1 --2- 10.20.193.28:0/834037768 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55cbea7ae740 0x55cbea7aeb90 secure :-1 s=READY pgs=114 gs=3 cs=0 l=1 c_cookie=1196643190576707517 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc474009890 tx=0x7fc47403d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=109b54a44936f7bd server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:23.906 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.903+0000 7fc4577fe640 1 -- 10.20.193.28:0/834037768 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc47403d070 con 0x55cbea7ae740 2026-02-24T09:19:23.906 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.903+0000 7fc4577fe640 1 -- 10.20.193.28:0/834037768 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc474004580 con 0x55cbea7ae740 2026-02-24T09:19:23.906 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.903+0000 7fc4577fe640 1 -- 10.20.193.28:0/834037768 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc474002920 con 0x55cbea7ae740 2026-02-24T09:19:23.906 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.903+0000 7fc493e50e00 1 -- 10.20.193.28:0/834037768 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55cbea7ae740 msgr2=0x55cbea7aeb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:23.906 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.903+0000 7fc493e50e00 1 --2- 10.20.193.28:0/834037768 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55cbea7ae740 0x55cbea7aeb90 secure :-1 s=READY pgs=114 gs=3 cs=0 l=1 c_cookie=1196643190576707517 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc474009890 tx=0x7fc47403d000 comp rx=0 tx=0).stop 2026-02-24T09:19:23.906 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.903+0000 7fc493e50e00 1 -- 10.20.193.28:0/834037768 shutdown_connections 2026-02-24T09:19:23.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.903+0000 7fc493e50e00 1 --2- 10.20.193.28:0/834037768 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55cbea7f3270 0x55cbea813650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:23.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.903+0000 7fc493e50e00 1 --2- 10.20.193.28:0/834037768 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55cbea7ae740 0x55cbea7aeb90 unknown :-1 s=CLOSED pgs=114 gs=3 cs=0 l=1 c_cookie=1196643190576707517 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:23.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.903+0000 7fc493e50e00 1 --2- 10.20.193.28:0/834037768 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbea6cca60 0x55cbea7ae200 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:23.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.903+0000 7fc493e50e00 1 -- 10.20.193.28:0/834037768 >> 10.20.193.28:0/834037768 conn(0x55cbea748490 msgr2=0x55cbea7acae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:23.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.904+0000 7fc493e50e00 1 -- 10.20.193.28:0/834037768 shutdown_connections 2026-02-24T09:19:23.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.904+0000 7fc493e50e00 1 -- 10.20.193.28:0/834037768 wait complete. 2026-02-24T09:19:23.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.905+0000 7fc493e50e00 1 -- start start 2026-02-24T09:19:23.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.905+0000 7fc493e50e00 1 Processor -- start 2026-02-24T09:19:23.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.906+0000 7fc493e50e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbea6cca60 0x55cbea80a7f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:23.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.906+0000 7fc493e50e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55cbea7ae740 0x55cbea80ad30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:23.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.906+0000 7fc493e50e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55cbea7f3270 0x55cbea80fd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:23.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.906+0000 7fc493e50e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cbea810260 con 0x55cbea6cca60 2026-02-24T09:19:23.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.906+0000 7fc493e50e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55cbea8103d0 con 0x55cbea7ae740 2026-02-24T09:19:23.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.906+0000 7fc493e50e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55cbea810590 con 0x55cbea7f3270 2026-02-24T09:19:23.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.906+0000 7fc48a7fc640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55cbea7ae740 0x55cbea80ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:23.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.906+0000 7fc48a7fc640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55cbea7ae740 0x55cbea80ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:51846/0 (socket says 10.20.193.28:51846) 2026-02-24T09:19:23.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.906+0000 7fc48a7fc640 1 -- 10.20.193.28:0/1935431954 learned_addr learned my addr 10.20.193.28:0/1935431954 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:19:23.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.906+0000 7fc48affd640 1 --2- 10.20.193.28:0/1935431954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbea6cca60 0x55cbea80a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:23.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.906+0000 7fc48a7fc640 1 -- 10.20.193.28:0/1935431954 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55cbea7f3270 msgr2=0x55cbea80fd20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:19:23.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.906+0000 7fc48a7fc640 1 --2- 10.20.193.28:0/1935431954 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55cbea7f3270 0x55cbea80fd20 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:23.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.906+0000 7fc48a7fc640 1 -- 10.20.193.28:0/1935431954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbea6cca60 msgr2=0x55cbea80a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:23.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.906+0000 7fc48a7fc640 1 --2- 10.20.193.28:0/1935431954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbea6cca60 0x55cbea80a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:23.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.906+0000 7fc48a7fc640 1 -- 10.20.193.28:0/1935431954 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc48c176890 con 0x55cbea7ae740 2026-02-24T09:19:23.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.906+0000 7fc48affd640 1 --2- 10.20.193.28:0/1935431954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbea6cca60 0x55cbea80a7f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:19:23.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.907+0000 7fc48a7fc640 1 --2- 10.20.193.28:0/1935431954 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55cbea7ae740 0x55cbea80ad30 secure :-1 s=READY pgs=117 gs=1 cs=0 l=1 c_cookie=787990392246755130 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4740097e0 tx=0x7fc47402fae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aef81163849df3a server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:23.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.907+0000 7fc454ff9640 10 client.0 ms_handle_connect on v2:10.20.193.74:3300/0 2026-02-24T09:19:23.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.907+0000 7fc454ff9640 1 -- 10.20.193.28:0/1935431954 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc4740028c0 con 0x55cbea7ae740 2026-02-24T09:19:23.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.907+0000 7fc454ff9640 1 -- 10.20.193.28:0/1935431954 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc4740388f0 con 0x55cbea7ae740 2026-02-24T09:19:23.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.907+0000 7fc493e50e00 1 -- 10.20.193.28:0/1935431954 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc48c0fbac0 con 0x55cbea7ae740 2026-02-24T09:19:23.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.907+0000 7fc454ff9640 1 -- 10.20.193.28:0/1935431954 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc4740628c0 con 0x55cbea7ae740 2026-02-24T09:19:23.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.907+0000 7fc493e50e00 10 client.25466 _ll_register_callbacks cb 0x55cbea644980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:19:23.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.907+0000 7fc493e50e00 1 -- 10.20.193.28:0/1935431954 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cbea359520 con 0x55cbea7ae740 2026-02-24T09:19:23.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.907+0000 7fc454ff9640 1 -- 10.20.193.28:0/1935431954 <== mon.2 v2:10.20.193.74:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7fc474043410 con 0x55cbea7ae740 2026-02-24T09:19:23.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.907+0000 7fc454ff9640 1 -- 10.20.193.28:0/1935431954 <== mon.2 v2:10.20.193.74:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fc474043610 con 0x55cbea7ae740 2026-02-24T09:19:23.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.907+0000 7fc493e50e00 10 client.25466 fetch_fsmap learned FSMap version 23 2026-02-24T09:19:23.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.907+0000 7fc493e50e00 1 -- 10.20.193.28:0/1935431954 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({fsmap=23}) -- 0x55cbea63dce0 con 0x55cbea7ae740 2026-02-24T09:19:23.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.908+0000 7fc454ff9640 1 -- 10.20.193.28:0/1935431954 <== mon.2 v2:10.20.193.74:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fc474002b50 con 0x55cbea7ae740 2026-02-24T09:19:23.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.908+0000 7fc493e50e00 10 client.25466 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:19:23.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.908+0000 7fc493e50e00 10 client.25466 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:19:23.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.908+0000 7fc493e50e00 20 client.25466 populate_metadata read hostname 'trial028' 2026-02-24T09:19:23.913 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.908+0000 7fc493e50e00 1 --2- 10.20.193.28:0/1935431954 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55cbea7f0480 0x55cbea7f0920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:23.913 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.908+0000 7fc493e50e00 4 client.25466 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:19:23.913 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.908+0000 7fc493e50e00 1 -- 10.20.193.28:0/1935431954 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cbea68b9d0 con 0x55cbea7f0480 2026-02-24T09:19:23.913 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.908+0000 7fc48affd640 1 --2- 10.20.193.28:0/1935431954 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55cbea7f0480 0x55cbea7f0920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:23.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.909+0000 7fc48affd640 1 --2- 10.20.193.28:0/1935431954 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55cbea7f0480 0x55cbea7f0920 crc :-1 s=READY pgs=40 gs=3 cs=0 l=0 c_cookie=7934660764466463412 s_cookie=13290253004516224560 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e1d93ecf740c2b4 server_cookie=b87076b15d41ee30 in_seq=0 out_seq=0 2026-02-24T09:19:23.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.909+0000 7fc454ff9640 10 client.25466 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:19:23.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.910+0000 7fc454ff9640 1 -- 10.20.193.28:0/1935431954 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55cbea68b9d0 con 0x55cbea7f0480 2026-02-24T09:19:23.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.910+0000 7fc454ff9640 10 client.25466 handle_command_reply: tid=0 2026-02-24T09:19:23.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.910+0000 7fc493e50e00 1 client.25466 shutdown 2026-02-24T09:19:23.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.910+0000 7fc493e50e00 1 -- 10.20.193.28:0/1935431954 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55cbea7ae740 msgr2=0x55cbea80ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:23.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.910+0000 7fc493e50e00 1 --2- 10.20.193.28:0/1935431954 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55cbea7ae740 0x55cbea80ad30 secure :-1 s=READY pgs=117 gs=1 cs=0 l=1 c_cookie=787990392246755130 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4740097e0 tx=0x7fc47402fae0 comp rx=0 tx=0).stop 2026-02-24T09:19:23.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.910+0000 7fc493e50e00 1 -- 10.20.193.28:0/1935431954 shutdown_connections 2026-02-24T09:19:23.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.910+0000 7fc493e50e00 1 --2- 10.20.193.28:0/1935431954 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55cbea7f0480 0x55cbea7f0920 crc :-1 s=READY pgs=40 gs=3 cs=0 l=0 c_cookie=7934660764466463412 s_cookie=13290253004516224560 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:23.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.910+0000 7fc493e50e00 1 --2- 10.20.193.28:0/1935431954 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55cbea7f3270 0x55cbea80fd20 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:23.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.910+0000 7fc493e50e00 1 --2- 10.20.193.28:0/1935431954 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55cbea7ae740 0x55cbea80ad30 unknown :-1 s=CLOSED pgs=117 gs=1 cs=0 l=1 c_cookie=787990392246755130 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:23.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.910+0000 7fc493e50e00 1 --2- 10.20.193.28:0/1935431954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbea6cca60 0x55cbea80a7f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:23.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.910+0000 7fc493e50e00 1 -- 10.20.193.28:0/1935431954 >> 10.20.193.28:0/1935431954 conn(0x55cbea748490 msgr2=0x55cbea7ac2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:23.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.910+0000 7fc454ff9640 0 client.25466 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:19:23.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.910+0000 7fc493e50e00 1 -- 10.20.193.28:0/1935431954 shutdown_connections 2026-02-24T09:19:23.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.910+0000 7fc493e50e00 1 -- 10.20.193.28:0/1935431954 wait complete. 2026-02-24T09:19:23.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.910+0000 7fc493e50e00 20 client.25466 trim_cache size 0 max 16384 2026-02-24T09:19:23.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.918+0000 7fc493e50e00 1 Processor -- start 2026-02-24T09:19:23.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.918+0000 7fc493e50e00 1 -- start start 2026-02-24T09:19:23.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.918+0000 7fc493e50e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55cbea6cca60 0x55cbea7eeb20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:23.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.918+0000 7fc493e50e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55cbea7ae740 0x55cbea7f11c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:23.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.918+0000 7fc493e50e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbea7f3270 0x55cbea7f1700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:23.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.918+0000 7fc493e50e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cbea6b79d0 con 0x55cbea7f3270 2026-02-24T09:19:23.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.918+0000 7fc493e50e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55cbea3f8f10 con 0x55cbea6cca60 2026-02-24T09:19:23.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.918+0000 7fc493e50e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55cbea8106d0 con 0x55cbea7ae740 2026-02-24T09:19:23.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.919+0000 7fc48b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbea7f3270 0x55cbea7f1700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:23.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.919+0000 7fc48a7fc640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55cbea7ae740 0x55cbea7f11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:23.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.919+0000 7fc48b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbea7f3270 0x55cbea7f1700 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:59654/0 (socket says 10.20.193.28:59654) 2026-02-24T09:19:23.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.919+0000 7fc48b7fe640 1 -- 10.20.193.28:0/3458003193 learned_addr learned my addr 10.20.193.28:0/3458003193 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:19:23.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.919+0000 7fc48affd640 1 --2- 10.20.193.28:0/3458003193 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55cbea6cca60 0x55cbea7eeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:23.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.919+0000 7fc48b7fe640 1 -- 10.20.193.28:0/3458003193 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55cbea7ae740 msgr2=0x55cbea7f11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:23.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.919+0000 7fc48b7fe640 1 --2- 10.20.193.28:0/3458003193 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55cbea7ae740 0x55cbea7f11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:23.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.919+0000 7fc48b7fe640 1 -- 10.20.193.28:0/3458003193 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55cbea6cca60 msgr2=0x55cbea7eeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:23.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.919+0000 7fc48b7fe640 1 --2- 10.20.193.28:0/3458003193 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55cbea6cca60 0x55cbea7eeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:23.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.919+0000 7fc48b7fe640 1 -- 10.20.193.28:0/3458003193 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbea7fcd40 con 0x55cbea7f3270 2026-02-24T09:19:23.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.919+0000 7fc48b7fe640 1 --2- 10.20.193.28:0/3458003193 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbea7f3270 0x55cbea7f1700 secure :-1 s=READY pgs=421 gs=1 cs=0 l=1 c_cookie=6780745679583085495 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc47c005560 tx=0x7fc47c003b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e1a0c4507d083b7 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:23.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.919+0000 7fc456ffd640 1 -- 10.20.193.28:0/3458003193 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc47c003c90 con 0x55cbea7f3270 2026-02-24T09:19:23.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.919+0000 7fc456ffd640 1 -- 10.20.193.28:0/3458003193 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc47c003df0 con 0x55cbea7f3270 2026-02-24T09:19:23.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.919+0000 7fc456ffd640 1 -- 10.20.193.28:0/3458003193 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc47c0116b0 con 0x55cbea7f3270 2026-02-24T09:19:23.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.920+0000 7fc493e50e00 1 -- 10.20.193.28:0/3458003193 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbea7f3270 msgr2=0x55cbea7f1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:23.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.920+0000 7fc493e50e00 1 --2- 10.20.193.28:0/3458003193 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbea7f3270 0x55cbea7f1700 secure :-1 s=READY pgs=421 gs=1 cs=0 l=1 c_cookie=6780745679583085495 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc47c005560 tx=0x7fc47c003b50 comp rx=0 tx=0).stop 2026-02-24T09:19:23.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.920+0000 7fc493e50e00 1 -- 10.20.193.28:0/3458003193 shutdown_connections 2026-02-24T09:19:23.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.920+0000 7fc493e50e00 1 --2- 10.20.193.28:0/3458003193 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbea7f3270 0x55cbea7f1700 unknown :-1 s=CLOSED pgs=421 gs=1 cs=0 l=1 c_cookie=6780745679583085495 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:23.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.920+0000 7fc493e50e00 1 --2- 10.20.193.28:0/3458003193 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55cbea7ae740 0x55cbea7f11c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:23.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.920+0000 7fc493e50e00 1 --2- 10.20.193.28:0/3458003193 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55cbea6cca60 0x55cbea7eeb20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:23.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.920+0000 7fc493e50e00 1 -- 10.20.193.28:0/3458003193 >> 10.20.193.28:0/3458003193 conn(0x55cbea748490 msgr2=0x55cbea7ed400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:23.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.920+0000 7fc493e50e00 1 -- 10.20.193.28:0/3458003193 shutdown_connections 2026-02-24T09:19:23.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.920+0000 7fc493e50e00 1 -- 10.20.193.28:0/3458003193 wait complete. 2026-02-24T09:19:23.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.920+0000 7fc493e50e00 1 -- start start 2026-02-24T09:19:23.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.921+0000 7fc493e50e00 1 Processor -- start 2026-02-24T09:19:23.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.921+0000 7fc493e50e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55cbea6cca60 0x55cbea78ff00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:23.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.921+0000 7fc493e50e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55cbea7ae740 0x55cbea790440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:23.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.921+0000 7fc493e50e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbea7f3270 0x55cbea8390b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:23.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.921+0000 7fc493e50e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cbea789550 con 0x55cbea7f3270 2026-02-24T09:19:23.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.921+0000 7fc493e50e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55cbea810f60 con 0x55cbea6cca60 2026-02-24T09:19:23.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.921+0000 7fc493e50e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55cbea71d580 con 0x55cbea7ae740 2026-02-24T09:19:23.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.921+0000 7fc48b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbea7f3270 0x55cbea8390b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:23.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.921+0000 7fc48a7fc640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55cbea7ae740 0x55cbea790440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:23.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.921+0000 7fc48affd640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55cbea6cca60 0x55cbea78ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:23.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.921+0000 7fc48a7fc640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55cbea7ae740 0x55cbea790440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:51766/0 (socket says 10.20.193.28:51766) 2026-02-24T09:19:23.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.921+0000 7fc48a7fc640 1 -- 10.20.193.28:0/1666012189 learned_addr learned my addr 10.20.193.28:0/1666012189 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:19:23.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.921+0000 7fc48b7fe640 1 -- 10.20.193.28:0/1666012189 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55cbea7ae740 msgr2=0x55cbea790440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:23.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.921+0000 7fc48b7fe640 1 --2- 10.20.193.28:0/1666012189 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55cbea7ae740 0x55cbea790440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:23.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.921+0000 7fc48b7fe640 1 -- 10.20.193.28:0/1666012189 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55cbea6cca60 msgr2=0x55cbea78ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:23.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.921+0000 7fc48b7fe640 1 --2- 10.20.193.28:0/1666012189 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55cbea6cca60 0x55cbea78ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:23.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.921+0000 7fc48b7fe640 1 -- 10.20.193.28:0/1666012189 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbea64f5b0 con 0x55cbea7f3270 2026-02-24T09:19:23.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.922+0000 7fc48affd640 1 --2- 10.20.193.28:0/1666012189 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55cbea6cca60 0x55cbea78ff00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:19:23.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.922+0000 7fc48b7fe640 1 --2- 10.20.193.28:0/1666012189 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbea7f3270 0x55cbea8390b0 secure :-1 s=READY pgs=422 gs=3 cs=0 l=1 c_cookie=16363327407087733119 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55cbea733d00 tx=0x7fc47c011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e316379482e0c97f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:23.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.922+0000 7fc454ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:19:23.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.922+0000 7fc454ff9640 1 -- 10.20.193.28:0/1666012189 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc47c01f070 con 0x55cbea7f3270 2026-02-24T09:19:23.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.922+0000 7fc454ff9640 1 -- 10.20.193.28:0/1666012189 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc47c020040 con 0x55cbea7f3270 2026-02-24T09:19:23.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.922+0000 7fc454ff9640 1 -- 10.20.193.28:0/1666012189 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc47c005820 con 0x55cbea7f3270 2026-02-24T09:19:23.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.922+0000 7fc493e50e00 1 -- 10.20.193.28:0/1666012189 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc47c005200 con 0x55cbea7f3270 2026-02-24T09:19:23.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.922+0000 7fc454ff9640 1 -- 10.20.193.28:0/1666012189 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7fc47c0059b0 con 0x55cbea7f3270 2026-02-24T09:19:23.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.922+0000 7fc454ff9640 10 client.15672 inactive, discarding osd_map(96..96 src has 1..96) 2026-02-24T09:19:23.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.922+0000 7fc493e50e00 10 client.15672 _ll_register_callbacks cb 0x55cbea644980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:19:23.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.922+0000 7fc493e50e00 1 -- 10.20.193.28:0/1666012189 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cbea6ead30 con 0x55cbea7f3270 2026-02-24T09:19:23.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.922+0000 7fc454ff9640 1 -- 10.20.193.28:0/1666012189 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fc47c00ae70 con 0x55cbea7f3270 2026-02-24T09:19:23.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.922+0000 7fc493e50e00 10 client.15672 fetch_fsmap learned FSMap version 23 2026-02-24T09:19:23.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.922+0000 7fc493e50e00 1 -- 10.20.193.28:0/1666012189 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x55cbea64a030 con 0x55cbea7f3270 2026-02-24T09:19:23.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.923+0000 7fc454ff9640 1 -- 10.20.193.28:0/1666012189 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fc47c02d060 con 0x55cbea7f3270 2026-02-24T09:19:23.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.923+0000 7fc493e50e00 10 client.15672 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:19:23.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.923+0000 7fc493e50e00 10 client.15672 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:19:23.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.923+0000 7fc493e50e00 20 client.15672 populate_metadata read hostname 'trial028' 2026-02-24T09:19:23.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.923+0000 7fc493e50e00 1 --2- 10.20.193.28:0/1666012189 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55cbea8a15f0 0x55cbea8c1aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:23.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.923+0000 7fc493e50e00 4 client.15672 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-24T09:19:23.930 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.923+0000 7fc493e50e00 1 -- 10.20.193.28:0/1666012189 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cbea39d640 con 0x55cbea8a15f0 2026-02-24T09:19:23.930 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.923+0000 7fc48affd640 1 --2- 10.20.193.28:0/1666012189 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55cbea8a15f0 0x55cbea8c1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:23.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.924+0000 7fc48affd640 1 --2- 10.20.193.28:0/1666012189 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55cbea8a15f0 0x55cbea8c1aa0 crc :-1 s=READY pgs=41 gs=4 cs=0 l=0 c_cookie=7617219942597627385 s_cookie=2175824364893000019 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69b5cd2e168d8df9 server_cookie=1e3214bb5b165153 in_seq=0 out_seq=0 2026-02-24T09:19:23.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.924+0000 7fc454ff9640 10 client.15672 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:19:23.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.927+0000 7fc454ff9640 1 -- 10.20.193.28:0/1666012189 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cbea39d640 con 0x55cbea8a15f0 2026-02-24T09:19:23.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.927+0000 7fc454ff9640 10 client.15672 handle_command_reply: tid=0 2026-02-24T09:19:23.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.927+0000 7fc493e50e00 1 client.15672 shutdown 2026-02-24T09:19:23.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.927+0000 7fc493e50e00 1 -- 10.20.193.28:0/1666012189 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbea7f3270 msgr2=0x55cbea8390b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:23.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.927+0000 7fc493e50e00 1 --2- 10.20.193.28:0/1666012189 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbea7f3270 0x55cbea8390b0 secure :-1 s=READY pgs=422 gs=3 cs=0 l=1 c_cookie=16363327407087733119 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55cbea733d00 tx=0x7fc47c011660 comp rx=0 tx=0).stop 2026-02-24T09:19:23.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.927+0000 7fc493e50e00 1 -- 10.20.193.28:0/1666012189 shutdown_connections 2026-02-24T09:19:23.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.927+0000 7fc493e50e00 1 --2- 10.20.193.28:0/1666012189 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55cbea8a15f0 0x55cbea8c1aa0 crc :-1 s=READY pgs=41 gs=4 cs=0 l=0 c_cookie=7617219942597627385 s_cookie=2175824364893000019 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:23.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.927+0000 7fc493e50e00 1 --2- 10.20.193.28:0/1666012189 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cbea7f3270 0x55cbea8390b0 unknown :-1 s=CLOSED pgs=422 gs=3 cs=0 l=1 c_cookie=16363327407087733119 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:23.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.927+0000 7fc493e50e00 1 --2- 10.20.193.28:0/1666012189 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55cbea7ae740 0x55cbea790440 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:23.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.927+0000 7fc493e50e00 1 --2- 10.20.193.28:0/1666012189 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55cbea6cca60 0x55cbea78ff00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:23.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.927+0000 7fc454ff9640 0 client.15672 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:19:23.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.927+0000 7fc493e50e00 1 -- 10.20.193.28:0/1666012189 >> 10.20.193.28:0/1666012189 conn(0x55cbea748490 msgr2=0x55cbea7edbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:23.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.927+0000 7fc493e50e00 1 -- 10.20.193.28:0/1666012189 shutdown_connections 2026-02-24T09:19:23.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.927+0000 7fc493e50e00 1 -- 10.20.193.28:0/1666012189 wait complete. 2026-02-24T09:19:23.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.927+0000 7fc493e50e00 20 client.15672 trim_cache size 0 max 16384 2026-02-24T09:19:23.933 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-24T09:19:23.933 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-24T09:19:23.933 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-24T09:19:23.933 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-24T09:19:23.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.928+0000 7fc48bfff640 1 -- 10.20.193.28:0/92751696 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc4600b58c0 msgr2=0x7fc4600d5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:23.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.928+0000 7fc48bfff640 1 --2- 10.20.193.28:0/92751696 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc4600b58c0 0x7fc4600d5d70 secure :-1 s=READY pgs=231 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc47402f630 tx=0x7fc474005900 comp rx=0 tx=0).stop 2026-02-24T09:19:23.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.928+0000 7fc48bfff640 1 -- 10.20.193.28:0/92751696 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc48c10f460 msgr2=0x7fc48c0f5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:23.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.928+0000 7fc48bfff640 1 --2- 10.20.193.28:0/92751696 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc48c10f460 0x7fc48c0f5750 secure :-1 s=READY pgs=116 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc48000e9c0 tx=0x7fc48000ee90 comp rx=0 tx=0).stop 2026-02-24T09:19:23.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.928+0000 7fc48bfff640 1 -- 10.20.193.28:0/92751696 shutdown_connections 2026-02-24T09:19:23.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.928+0000 7fc48bfff640 1 --2- 10.20.193.28:0/92751696 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fc4600b58c0 0x7fc4600d5d70 unknown :-1 s=CLOSED pgs=231 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:23.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.928+0000 7fc48bfff640 1 --2- 10.20.193.28:0/92751696 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc48c115650 0x7fc48c0f5e50 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:23.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.928+0000 7fc48bfff640 1 --2- 10.20.193.28:0/92751696 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fc48c10fe50 0x7fc48c175f20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:23.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.928+0000 7fc48bfff640 1 --2- 10.20.193.28:0/92751696 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fc48c10f460 0x7fc48c0f5750 unknown :-1 s=CLOSED pgs=116 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:23.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.928+0000 7fc48bfff640 1 -- 10.20.193.28:0/92751696 >> 10.20.193.28:0/92751696 conn(0x7fc48c0ecd10 msgr2=0x7fc48c111c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:23.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.928+0000 7fc48bfff640 1 -- 10.20.193.28:0/92751696 shutdown_connections 2026-02-24T09:19:23.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:23.928+0000 7fc48bfff640 1 -- 10.20.193.28:0/92751696 wait complete. 2026-02-24T09:19:24.735 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-24T09:19:24.736 INFO:tasks.workunit.client.0.trial028.stdout: Children see throughput for 1 readers = 86873.56 kB/sec 2026-02-24T09:19:24.736 INFO:tasks.workunit.client.0.trial028.stdout: Parent sees throughput for 1 readers = 86869.56 kB/sec 2026-02-24T09:19:24.736 INFO:tasks.workunit.client.0.trial028.stdout: Min throughput per process = 86873.56 kB/sec 2026-02-24T09:19:24.736 INFO:tasks.workunit.client.0.trial028.stdout: Max throughput per process = 86873.56 kB/sec 2026-02-24T09:19:24.736 INFO:tasks.workunit.client.0.trial028.stdout: Avg throughput per process = 86873.56 kB/sec 2026-02-24T09:19:24.736 INFO:tasks.workunit.client.0.trial028.stdout: Min xfer = 1048576.00 kB 2026-02-24T09:19:24.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:24 trial159 ceph-mon[44242]: pgmap v256: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 61 MiB/s rd, 4.3 MiB/s wr, 280 op/s 2026-02-24T09:19:24.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:24 trial028 ceph-mon[40371]: pgmap v256: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 61 MiB/s rd, 4.3 MiB/s wr, 280 op/s 2026-02-24T09:19:24.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:24 trial074 ceph-mon[44412]: pgmap v256: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 61 MiB/s rd, 4.3 MiB/s wr, 280 op/s 2026-02-24T09:19:26.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:26 trial159 ceph-mon[44242]: pgmap v257: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 69 MiB/s rd, 1.7 MiB/s wr, 130 op/s 2026-02-24T09:19:26.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:26 trial028 ceph-mon[40371]: pgmap v257: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 69 MiB/s rd, 1.7 MiB/s wr, 130 op/s 2026-02-24T09:19:26.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:26 trial074 ceph-mon[44412]: pgmap v257: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 69 MiB/s rd, 1.7 MiB/s wr, 130 op/s 2026-02-24T09:19:28.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:28 trial159 ceph-mon[44242]: pgmap v258: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 79 MiB/s rd, 170 B/s wr, 27 op/s 2026-02-24T09:19:28.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:28 trial028 ceph-mon[40371]: pgmap v258: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 79 MiB/s rd, 170 B/s wr, 27 op/s 2026-02-24T09:19:28.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:28 trial074 ceph-mon[44412]: pgmap v258: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 79 MiB/s rd, 170 B/s wr, 27 op/s 2026-02-24T09:19:30.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:30 trial159 ceph-mon[44242]: pgmap v259: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 70 MiB/s rd, 170 B/s wr, 23 op/s 2026-02-24T09:19:30.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:30 trial028 ceph-mon[40371]: pgmap v259: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 70 MiB/s rd, 170 B/s wr, 23 op/s 2026-02-24T09:19:30.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:30 trial074 ceph-mon[44412]: pgmap v259: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 70 MiB/s rd, 170 B/s wr, 23 op/s 2026-02-24T09:19:32.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:32 trial159 ceph-mon[44242]: pgmap v260: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 52 MiB/s rd, 170 B/s wr, 20 op/s 2026-02-24T09:19:32.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:32 trial028 ceph-mon[40371]: pgmap v260: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 52 MiB/s rd, 170 B/s wr, 20 op/s 2026-02-24T09:19:32.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:32 trial074 ceph-mon[44412]: pgmap v260: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 52 MiB/s rd, 170 B/s wr, 20 op/s 2026-02-24T09:19:34.276 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-24T09:19:34.276 INFO:tasks.workunit.client.0.trial028.stdout: Children see throughput for 1 re-readers = 142384.81 kB/sec 2026-02-24T09:19:34.277 INFO:tasks.workunit.client.0.trial028.stdout: Parent sees throughput for 1 re-readers = 142373.83 kB/sec 2026-02-24T09:19:34.277 INFO:tasks.workunit.client.0.trial028.stdout: Min throughput per process = 142384.81 kB/sec 2026-02-24T09:19:34.277 INFO:tasks.workunit.client.0.trial028.stdout: Max throughput per process = 142384.81 kB/sec 2026-02-24T09:19:34.277 INFO:tasks.workunit.client.0.trial028.stdout: Avg throughput per process = 142384.81 kB/sec 2026-02-24T09:19:34.277 INFO:tasks.workunit.client.0.trial028.stdout: Min xfer = 1048576.00 kB 2026-02-24T09:19:34.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:34 trial159 ceph-mon[44242]: pgmap v261: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 40 MiB/s rd, 170 B/s wr, 16 op/s 2026-02-24T09:19:34.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:34 trial028 ceph-mon[40371]: pgmap v261: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 40 MiB/s rd, 170 B/s wr, 16 op/s 2026-02-24T09:19:34.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:34 trial074 ceph-mon[44412]: pgmap v261: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 40 MiB/s rd, 170 B/s wr, 16 op/s 2026-02-24T09:19:36.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:36 trial159 ceph-mon[44242]: pgmap v262: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 25 MiB/s rd, 170 B/s wr, 12 op/s 2026-02-24T09:19:36.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:36 trial028 ceph-mon[40371]: pgmap v262: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 25 MiB/s rd, 170 B/s wr, 12 op/s 2026-02-24T09:19:36.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:36 trial074 ceph-mon[44412]: pgmap v262: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 25 MiB/s rd, 170 B/s wr, 12 op/s 2026-02-24T09:19:37.003 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.001+0000 7f8ca93b5640 1 -- 10.20.193.28:0/1580402882 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ca4119a60 msgr2=0x7f8ca411a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:37.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.001+0000 7f8ca93b5640 1 --2- 10.20.193.28:0/1580402882 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ca4119a60 0x7f8ca411a440 secure :-1 s=READY pgs=423 gs=1 cs=0 l=1 c_cookie=8861524257863518790 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c9800aa30 tx=0x7f8c98030270 comp rx=0 tx=0).stop 2026-02-24T09:19:37.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.001+0000 7f8ca93b5640 1 -- 10.20.193.28:0/1580402882 shutdown_connections 2026-02-24T09:19:37.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.001+0000 7f8ca93b5640 1 --2- 10.20.193.28:0/1580402882 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ca4119a60 0x7f8ca411a440 unknown :-1 s=CLOSED pgs=423 gs=1 cs=0 l=1 c_cookie=8861524257863518790 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.001+0000 7f8ca93b5640 1 --2- 10.20.193.28:0/1580402882 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8ca4114a80 0x7f8ca41192d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.001+0000 7f8ca93b5640 1 --2- 10.20.193.28:0/1580402882 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8ca4114090 0x7f8ca4114460 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.001+0000 7f8ca93b5640 1 -- 10.20.193.28:0/1580402882 >> 10.20.193.28:0/1580402882 conn(0x7f8ca4058980 msgr2=0x7f8ca4058d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:37.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.001+0000 7f8ca93b5640 1 -- 10.20.193.28:0/1580402882 shutdown_connections 2026-02-24T09:19:37.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.001+0000 7f8ca93b5640 1 -- 10.20.193.28:0/1580402882 wait complete. 2026-02-24T09:19:37.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.002+0000 7f8ca93b5640 1 Processor -- start 2026-02-24T09:19:37.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.002+0000 7f8ca93b5640 1 -- start start 2026-02-24T09:19:37.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.002+0000 7f8ca93b5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ca4114090 0x7f8ca40fb840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.002+0000 7f8ca93b5640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8ca4114a80 0x7f8ca40fbd80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.002+0000 7f8ca93b5640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8ca4119a60 0x7f8ca4101150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.002+0000 7f8ca93b5640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca4101720 con 0x7f8ca4114090 2026-02-24T09:19:37.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.002+0000 7f8ca93b5640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca4101890 con 0x7f8ca4119a60 2026-02-24T09:19:37.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.002+0000 7f8ca93b5640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca4101a50 con 0x7f8ca4114a80 2026-02-24T09:19:37.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.003+0000 7f8ca3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ca4114090 0x7f8ca40fb840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.003+0000 7f8ca3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ca4114090 0x7f8ca40fb840 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45422/0 (socket says 10.20.193.28:45422) 2026-02-24T09:19:37.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.003+0000 7f8ca3fff640 1 -- 10.20.193.28:0/586466128 learned_addr learned my addr 10.20.193.28:0/586466128 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:19:37.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.003+0000 7f8ca37fe640 1 --2- 10.20.193.28:0/586466128 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8ca4114a80 0x7f8ca40fbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.003+0000 7f8ca8bb4640 1 --2- 10.20.193.28:0/586466128 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8ca4119a60 0x7f8ca4101150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.003+0000 7f8ca3fff640 1 -- 10.20.193.28:0/586466128 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8ca4114a80 msgr2=0x7f8ca40fbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:37.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.003+0000 7f8ca3fff640 1 --2- 10.20.193.28:0/586466128 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8ca4114a80 0x7f8ca40fbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.003+0000 7f8ca3fff640 1 -- 10.20.193.28:0/586466128 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8ca4119a60 msgr2=0x7f8ca4101150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:37.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.003+0000 7f8ca3fff640 1 --2- 10.20.193.28:0/586466128 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8ca4119a60 0x7f8ca4101150 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.003+0000 7f8ca3fff640 1 -- 10.20.193.28:0/586466128 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c9800a650 con 0x7f8ca4114090 2026-02-24T09:19:37.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.003+0000 7f8ca8bb4640 1 --2- 10.20.193.28:0/586466128 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8ca4119a60 0x7f8ca4101150 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:19:37.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.003+0000 7f8ca3fff640 1 --2- 10.20.193.28:0/586466128 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ca4114090 0x7f8ca40fb840 secure :-1 s=READY pgs=424 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c9000d950 tx=0x7f8c9000de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:37.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.003+0000 7f8ca17fa640 1 -- 10.20.193.28:0/586466128 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c90004540 con 0x7f8ca4114090 2026-02-24T09:19:37.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.003+0000 7f8ca17fa640 1 -- 10.20.193.28:0/586466128 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8c90009ce0 con 0x7f8ca4114090 2026-02-24T09:19:37.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.003+0000 7f8ca17fa640 1 -- 10.20.193.28:0/586466128 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c900106e0 con 0x7f8ca4114090 2026-02-24T09:19:37.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.003+0000 7f8ca93b5640 1 -- 10.20.193.28:0/586466128 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ca4101d30 con 0x7f8ca4114090 2026-02-24T09:19:37.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.003+0000 7f8ca93b5640 1 -- 10.20.193.28:0/586466128 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ca4102460 con 0x7f8ca4114090 2026-02-24T09:19:37.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.006+0000 7f8ca17fa640 1 -- 10.20.193.28:0/586466128 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7f8c900097c0 con 0x7f8ca4114090 2026-02-24T09:19:37.011 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.008+0000 7f8ca17fa640 1 --2- 10.20.193.28:0/586466128 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8c780b58d0 0x7f8c780d5d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.011 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.008+0000 7f8ca17fa640 1 -- 10.20.193.28:0/586466128 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7f8c900e7110 con 0x7f8ca4114090 2026-02-24T09:19:37.011 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.008+0000 7f8ca37fe640 1 --2- 10.20.193.28:0/586466128 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8c780b58d0 0x7f8c780d5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.011 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.008+0000 7f8cacc2ce00 1 Processor -- start 2026-02-24T09:19:37.011 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.008+0000 7f8cacc2ce00 1 -- start start 2026-02-24T09:19:37.011 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.009+0000 7f8cacc2ce00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55836f23fa60 0x55836f321200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.011 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.009+0000 7f8cacc2ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55836f321740 0x55836f321b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.009+0000 7f8cacc2ce00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55836f366270 0x55836f386650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.009+0000 7f8cacc2ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55836f236f10 con 0x55836f321740 2026-02-24T09:19:37.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.009+0000 7f8cacc2ce00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55836f232c40 con 0x55836f366270 2026-02-24T09:19:37.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.009+0000 7f8cacc2ce00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55836f22cda0 con 0x55836f23fa60 2026-02-24T09:19:37.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.009+0000 7f8ca8bb4640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55836f366270 0x55836f386650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.009+0000 7f8ca8bb4640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55836f366270 0x55836f386650 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:52404/0 (socket says 10.20.193.28:52404) 2026-02-24T09:19:37.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.009+0000 7f8ca8bb4640 1 -- 10.20.193.28:0/3639786485 learned_addr learned my addr 10.20.193.28:0/3639786485 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:19:37.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.009+0000 7f8ca3fff640 1 --2- 10.20.193.28:0/3639786485 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55836f23fa60 0x55836f321200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.009+0000 7f8ca37fe640 1 --2- 10.20.193.28:0/586466128 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8c780b58d0 0x7f8c780d5d80 secure :-1 s=READY pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ca41021e0 tx=0x7f8c9400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:37.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.009+0000 7f8ca37fe640 1 --2- 10.20.193.28:0/3639786485 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55836f321740 0x55836f321b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.009+0000 7f8ca3fff640 1 -- 10.20.193.28:0/3639786485 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55836f366270 msgr2=0x55836f386650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:37.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.009+0000 7f8ca3fff640 1 --2- 10.20.193.28:0/3639786485 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55836f366270 0x55836f386650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.009+0000 7f8ca3fff640 1 -- 10.20.193.28:0/3639786485 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55836f321740 msgr2=0x55836f321b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:37.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.009+0000 7f8ca3fff640 1 --2- 10.20.193.28:0/3639786485 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55836f321740 0x55836f321b90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.009+0000 7f8ca3fff640 1 -- 10.20.193.28:0/3639786485 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55836f1d8340 con 0x55836f23fa60 2026-02-24T09:19:37.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.010+0000 7f8ca3fff640 1 --2- 10.20.193.28:0/3639786485 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55836f23fa60 0x55836f321200 secure :-1 s=READY pgs=115 gs=2 cs=0 l=1 c_cookie=5996823525079748374 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c900ad3c0 tx=0x7f8c900a89f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5338ff3939158f16 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:37.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.010+0000 7f8c67fff640 1 -- 10.20.193.28:0/3639786485 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c90009e50 con 0x55836f23fa60 2026-02-24T09:19:37.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.010+0000 7f8c67fff640 1 -- 10.20.193.28:0/3639786485 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8c900adb50 con 0x55836f23fa60 2026-02-24T09:19:37.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.010+0000 7f8c67fff640 1 -- 10.20.193.28:0/3639786485 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c900a93c0 con 0x55836f23fa60 2026-02-24T09:19:37.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.010+0000 7f8cacc2ce00 1 -- 10.20.193.28:0/3639786485 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55836f23fa60 msgr2=0x55836f321200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:37.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.010+0000 7f8cacc2ce00 1 --2- 10.20.193.28:0/3639786485 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55836f23fa60 0x55836f321200 secure :-1 s=READY pgs=115 gs=2 cs=0 l=1 c_cookie=5996823525079748374 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c900ad3c0 tx=0x7f8c900a89f0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.010+0000 7f8cacc2ce00 1 -- 10.20.193.28:0/3639786485 shutdown_connections 2026-02-24T09:19:37.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.010+0000 7f8cacc2ce00 1 --2- 10.20.193.28:0/3639786485 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55836f366270 0x55836f386650 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.010+0000 7f8cacc2ce00 1 --2- 10.20.193.28:0/3639786485 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55836f321740 0x55836f321b90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.010+0000 7f8cacc2ce00 1 --2- 10.20.193.28:0/3639786485 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55836f23fa60 0x55836f321200 unknown :-1 s=CLOSED pgs=115 gs=2 cs=0 l=1 c_cookie=5996823525079748374 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.010+0000 7f8cacc2ce00 1 -- 10.20.193.28:0/3639786485 >> 10.20.193.28:0/3639786485 conn(0x55836f2bb490 msgr2=0x55836f31fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:37.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.010+0000 7f8cacc2ce00 1 -- 10.20.193.28:0/3639786485 shutdown_connections 2026-02-24T09:19:37.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.010+0000 7f8cacc2ce00 1 -- 10.20.193.28:0/3639786485 wait complete. 2026-02-24T09:19:37.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.012+0000 7f8cacc2ce00 1 -- start start 2026-02-24T09:19:37.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.012+0000 7f8cacc2ce00 1 Processor -- start 2026-02-24T09:19:37.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.012+0000 7f8cacc2ce00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55836f23fa60 0x55836f37d7e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.012+0000 7f8cacc2ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55836f321740 0x55836f37dd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.012+0000 7f8cacc2ce00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55836f366270 0x55836f382d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.012+0000 7f8cacc2ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55836f383250 con 0x55836f321740 2026-02-24T09:19:37.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.012+0000 7f8cacc2ce00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55836f3833c0 con 0x55836f23fa60 2026-02-24T09:19:37.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.012+0000 7f8cacc2ce00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55836f383580 con 0x55836f366270 2026-02-24T09:19:37.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.012+0000 7f8ca37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55836f321740 0x55836f37dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.013+0000 7f8ca37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55836f321740 0x55836f37dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45432/0 (socket says 10.20.193.28:45432) 2026-02-24T09:19:37.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.013+0000 7f8ca37fe640 1 -- 10.20.193.28:0/3548262776 learned_addr learned my addr 10.20.193.28:0/3548262776 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:19:37.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.013+0000 7f8ca3fff640 1 --2- 10.20.193.28:0/3548262776 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55836f23fa60 0x55836f37d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.013+0000 7f8ca8bb4640 1 --2- 10.20.193.28:0/3548262776 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55836f366270 0x55836f382d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.013+0000 7f8ca37fe640 1 -- 10.20.193.28:0/3548262776 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55836f366270 msgr2=0x55836f382d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:37.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.013+0000 7f8ca37fe640 1 --2- 10.20.193.28:0/3548262776 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55836f366270 0x55836f382d10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.013+0000 7f8ca37fe640 1 -- 10.20.193.28:0/3548262776 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55836f23fa60 msgr2=0x55836f37d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:37.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.013+0000 7f8ca37fe640 1 --2- 10.20.193.28:0/3548262776 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55836f23fa60 0x55836f37d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.013+0000 7f8ca37fe640 1 -- 10.20.193.28:0/3548262776 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55836f1b0ce0 con 0x55836f321740 2026-02-24T09:19:37.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.013+0000 7f8ca8bb4640 1 --2- 10.20.193.28:0/3548262776 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55836f366270 0x55836f382d10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:19:37.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.013+0000 7f8ca37fe640 1 --2- 10.20.193.28:0/3548262776 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55836f321740 0x55836f37dd20 secure :-1 s=READY pgs=425 gs=1 cs=0 l=1 c_cookie=15045354360097424076 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c9400be20 tx=0x7f8c940047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0cbd613a97b42cc server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:37.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.013+0000 7f8c657fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:19:37.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.013+0000 7f8c657fa640 1 -- 10.20.193.28:0/3548262776 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c9401ed70 con 0x55836f321740 2026-02-24T09:19:37.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.013+0000 7f8c657fa640 1 -- 10.20.193.28:0/3548262776 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8c94015070 con 0x55836f321740 2026-02-24T09:19:37.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.013+0000 7f8c657fa640 1 -- 10.20.193.28:0/3548262776 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c9401f8e0 con 0x55836f321740 2026-02-24T09:19:37.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.013+0000 7f8cacc2ce00 1 -- 10.20.193.28:0/3548262776 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ca4102460 con 0x55836f321740 2026-02-24T09:19:37.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.013+0000 7f8cacc2ce00 10 client.15684 _ll_register_callbacks cb 0x55836f1b7980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:19:37.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.013+0000 7f8cacc2ce00 1 -- 10.20.193.28:0/3548262776 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55836eecc520 con 0x55836f321740 2026-02-24T09:19:37.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.014+0000 7f8c657fa640 1 -- 10.20.193.28:0/3548262776 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7f8c94017070 con 0x55836f321740 2026-02-24T09:19:37.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.014+0000 7f8c657fa640 1 -- 10.20.193.28:0/3548262776 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f8c9401eed0 con 0x55836f321740 2026-02-24T09:19:37.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.014+0000 7f8cacc2ce00 10 client.15684 fetch_fsmap learned FSMap version 23 2026-02-24T09:19:37.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.014+0000 7f8cacc2ce00 1 -- 10.20.193.28:0/3548262776 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x55836f1c25b0 con 0x55836f321740 2026-02-24T09:19:37.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.014+0000 7f8c657fa640 1 -- 10.20.193.28:0/3548262776 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f8c9401a040 con 0x55836f321740 2026-02-24T09:19:37.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.014+0000 7f8cacc2ce00 10 client.15684 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:19:37.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.014+0000 7f8cacc2ce00 10 client.15684 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:19:37.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.014+0000 7f8cacc2ce00 20 client.15684 populate_metadata read hostname 'trial028' 2026-02-24T09:19:37.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.014+0000 7f8cacc2ce00 1 --2- 10.20.193.28:0/3548262776 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55836f363760 0x55836f363c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.014+0000 7f8cacc2ce00 4 client.15684 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:19:37.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.014+0000 7f8cacc2ce00 1 -- 10.20.193.28:0/3548262776 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55836f1fe9d0 con 0x55836f363760 2026-02-24T09:19:37.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.015+0000 7f8ca3fff640 1 --2- 10.20.193.28:0/3548262776 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55836f363760 0x55836f363c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.016+0000 7f8ca3fff640 1 --2- 10.20.193.28:0/3548262776 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55836f363760 0x55836f363c00 crc :-1 s=READY pgs=42 gs=4 cs=0 l=0 c_cookie=11040291596032503029 s_cookie=12076058546141142720 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9936feb66e3f6cf5 server_cookie=a796c74419901ec0 in_seq=0 out_seq=0 2026-02-24T09:19:37.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.016+0000 7f8c657fa640 10 client.15684 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:19:37.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.016+0000 7f8c657fa640 1 -- 10.20.193.28:0/3548262776 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55836f1fe9d0 con 0x55836f363760 2026-02-24T09:19:37.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.016+0000 7f8c657fa640 10 client.15684 handle_command_reply: tid=0 2026-02-24T09:19:37.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.016+0000 7f8cacc2ce00 1 client.15684 shutdown 2026-02-24T09:19:37.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.016+0000 7f8cacc2ce00 1 -- 10.20.193.28:0/3548262776 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55836f321740 msgr2=0x55836f37dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:37.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.016+0000 7f8cacc2ce00 1 --2- 10.20.193.28:0/3548262776 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55836f321740 0x55836f37dd20 secure :-1 s=READY pgs=425 gs=1 cs=0 l=1 c_cookie=15045354360097424076 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c9400be20 tx=0x7f8c940047e0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.016+0000 7f8cacc2ce00 1 -- 10.20.193.28:0/3548262776 shutdown_connections 2026-02-24T09:19:37.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.016+0000 7f8cacc2ce00 1 --2- 10.20.193.28:0/3548262776 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55836f363760 0x55836f363c00 crc :-1 s=READY pgs=42 gs=4 cs=0 l=0 c_cookie=11040291596032503029 s_cookie=12076058546141142720 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.016+0000 7f8cacc2ce00 1 --2- 10.20.193.28:0/3548262776 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55836f366270 0x55836f382d10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.016+0000 7f8cacc2ce00 1 --2- 10.20.193.28:0/3548262776 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55836f321740 0x55836f37dd20 unknown :-1 s=CLOSED pgs=425 gs=1 cs=0 l=1 c_cookie=15045354360097424076 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.016+0000 7f8cacc2ce00 1 --2- 10.20.193.28:0/3548262776 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55836f23fa60 0x55836f37d7e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.016+0000 7f8cacc2ce00 1 -- 10.20.193.28:0/3548262776 >> 10.20.193.28:0/3548262776 conn(0x55836f2bb490 msgr2=0x55836f31f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:37.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.016+0000 7f8c657fa640 0 client.15684 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:19:37.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.017+0000 7f8cacc2ce00 1 -- 10.20.193.28:0/3548262776 shutdown_connections 2026-02-24T09:19:37.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.017+0000 7f8cacc2ce00 1 -- 10.20.193.28:0/3548262776 wait complete. 2026-02-24T09:19:37.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.017+0000 7f8cacc2ce00 20 client.15684 trim_cache size 0 max 16384 2026-02-24T09:19:37.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.025+0000 7f8cacc2ce00 1 Processor -- start 2026-02-24T09:19:37.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.025+0000 7f8cacc2ce00 1 -- start start 2026-02-24T09:19:37.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.025+0000 7f8cacc2ce00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55836f23fa60 0x55836f36f560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.025+0000 7f8cacc2ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55836f321740 0x55836f361b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.025+0000 7f8cacc2ce00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55836f366270 0x55836f3642c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.025+0000 7f8cacc2ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55836f22a9d0 con 0x55836f321740 2026-02-24T09:19:37.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.025+0000 7f8cacc2ce00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55836ef6bf10 con 0x55836f23fa60 2026-02-24T09:19:37.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.025+0000 7f8cacc2ce00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55836f290580 con 0x55836f366270 2026-02-24T09:19:37.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.025+0000 7f8ca37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55836f321740 0x55836f361b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.025+0000 7f8ca37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55836f321740 0x55836f361b20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45444/0 (socket says 10.20.193.28:45444) 2026-02-24T09:19:37.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.025+0000 7f8ca37fe640 1 -- 10.20.193.28:0/3298684767 learned_addr learned my addr 10.20.193.28:0/3298684767 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:19:37.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.025+0000 7f8ca3fff640 1 --2- 10.20.193.28:0/3298684767 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55836f23fa60 0x55836f36f560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.025+0000 7f8ca37fe640 1 -- 10.20.193.28:0/3298684767 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55836f366270 msgr2=0x55836f3642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:37.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.025+0000 7f8ca37fe640 1 --2- 10.20.193.28:0/3298684767 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55836f366270 0x55836f3642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.025+0000 7f8ca37fe640 1 -- 10.20.193.28:0/3298684767 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55836f23fa60 msgr2=0x55836f36f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:37.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.025+0000 7f8ca37fe640 1 --2- 10.20.193.28:0/3298684767 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55836f23fa60 0x55836f36f560 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.025+0000 7f8ca37fe640 1 -- 10.20.193.28:0/3298684767 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55836f36fd30 con 0x55836f321740 2026-02-24T09:19:37.033 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.025+0000 7f8ca3fff640 1 --2- 10.20.193.28:0/3298684767 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55836f23fa60 0x55836f36f560 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:19:37.033 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.026+0000 7f8ca37fe640 1 --2- 10.20.193.28:0/3298684767 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55836f321740 0x55836f361b20 secure :-1 s=READY pgs=426 gs=2 cs=0 l=1 c_cookie=15265766097080229830 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c9401c5a0 tx=0x7f8c9402b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3dae56240ab1fc6 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:37.033 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.026+0000 7f8c677fe640 1 -- 10.20.193.28:0/3298684767 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c9401e790 con 0x55836f321740 2026-02-24T09:19:37.033 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.026+0000 7f8c677fe640 1 -- 10.20.193.28:0/3298684767 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x55836eecc520 con 0x55836f321740 2026-02-24T09:19:37.033 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.026+0000 7f8c677fe640 1 -- 10.20.193.28:0/3298684767 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c940269d0 con 0x55836f321740 2026-02-24T09:19:37.033 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.026+0000 7f8cacc2ce00 1 -- 10.20.193.28:0/3298684767 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55836f321740 msgr2=0x55836f361b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:37.033 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.026+0000 7f8cacc2ce00 1 --2- 10.20.193.28:0/3298684767 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55836f321740 0x55836f361b20 secure :-1 s=READY pgs=426 gs=2 cs=0 l=1 c_cookie=15265766097080229830 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c9401c5a0 tx=0x7f8c9402b000 comp rx=0 tx=0).stop 2026-02-24T09:19:37.033 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.026+0000 7f8cacc2ce00 1 -- 10.20.193.28:0/3298684767 shutdown_connections 2026-02-24T09:19:37.033 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.026+0000 7f8cacc2ce00 1 --2- 10.20.193.28:0/3298684767 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55836f366270 0x55836f3642c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.033 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.026+0000 7f8cacc2ce00 1 --2- 10.20.193.28:0/3298684767 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55836f321740 0x55836f361b20 unknown :-1 s=CLOSED pgs=426 gs=2 cs=0 l=1 c_cookie=15265766097080229830 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.033 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.026+0000 7f8cacc2ce00 1 --2- 10.20.193.28:0/3298684767 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55836f23fa60 0x55836f36f560 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.034 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.026+0000 7f8cacc2ce00 1 -- 10.20.193.28:0/3298684767 >> 10.20.193.28:0/3298684767 conn(0x55836f2bb490 msgr2=0x55836f360400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:37.034 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.026+0000 7f8cacc2ce00 1 -- 10.20.193.28:0/3298684767 shutdown_connections 2026-02-24T09:19:37.034 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.026+0000 7f8cacc2ce00 1 -- 10.20.193.28:0/3298684767 wait complete. 2026-02-24T09:19:37.034 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.027+0000 7f8cacc2ce00 1 -- start start 2026-02-24T09:19:37.034 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.027+0000 7f8cacc2ce00 1 Processor -- start 2026-02-24T09:19:37.034 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.027+0000 7f8cacc2ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55836f23fa60 0x55836f302740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.034 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.027+0000 7f8cacc2ce00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55836f321740 0x55836f302c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.034 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.027+0000 7f8cacc2ce00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55836f366270 0x55836f3031c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.034 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.027+0000 7f8cacc2ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55836f3867a0 con 0x55836f23fa60 2026-02-24T09:19:37.034 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.027+0000 7f8cacc2ce00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55836f3cc1e0 con 0x55836f366270 2026-02-24T09:19:37.034 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.027+0000 7f8cacc2ce00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55836f3cc3a0 con 0x55836f321740 2026-02-24T09:19:37.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.027+0000 7f8ca3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55836f23fa60 0x55836f302740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.027+0000 7f8ca3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55836f23fa60 0x55836f302740 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45448/0 (socket says 10.20.193.28:45448) 2026-02-24T09:19:37.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.027+0000 7f8ca3fff640 1 -- 10.20.193.28:0/261175350 learned_addr learned my addr 10.20.193.28:0/261175350 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:19:37.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.027+0000 7f8ca37fe640 1 --2- 10.20.193.28:0/261175350 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55836f321740 0x55836f302c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.028+0000 7f8ca8bb4640 1 --2- 10.20.193.28:0/261175350 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55836f366270 0x55836f3031c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.028+0000 7f8ca3fff640 1 -- 10.20.193.28:0/261175350 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55836f321740 msgr2=0x55836f302c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:37.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.028+0000 7f8ca3fff640 1 --2- 10.20.193.28:0/261175350 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55836f321740 0x55836f302c80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.028+0000 7f8ca3fff640 1 -- 10.20.193.28:0/261175350 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55836f366270 msgr2=0x55836f3031c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:37.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.028+0000 7f8ca3fff640 1 --2- 10.20.193.28:0/261175350 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55836f366270 0x55836f3031c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.028+0000 7f8ca3fff640 1 -- 10.20.193.28:0/261175350 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55836f1bd030 con 0x55836f23fa60 2026-02-24T09:19:37.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.028+0000 7f8ca3fff640 1 --2- 10.20.193.28:0/261175350 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55836f23fa60 0x55836f302740 secure :-1 s=READY pgs=427 gs=1 cs=0 l=1 c_cookie=8775722895909069332 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c900ad3c0 tx=0x7f8c90002c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c9a17a61ec2214 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:37.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.028+0000 7f8c657fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:19:37.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.028+0000 7f8c657fa640 1 -- 10.20.193.28:0/261175350 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c90009e50 con 0x55836f23fa60 2026-02-24T09:19:37.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.028+0000 7f8c657fa640 1 -- 10.20.193.28:0/261175350 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8c900adb50 con 0x55836f23fa60 2026-02-24T09:19:37.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.028+0000 7f8cacc2ce00 1 -- 10.20.193.28:0/261175350 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55836f1c25b0 con 0x55836f23fa60 2026-02-24T09:19:37.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.028+0000 7f8c657fa640 1 -- 10.20.193.28:0/261175350 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c900adde0 con 0x55836f23fa60 2026-02-24T09:19:37.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.028+0000 7f8cacc2ce00 10 client.15690 _ll_register_callbacks cb 0x55836f1b7980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:19:37.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.028+0000 7f8cacc2ce00 1 -- 10.20.193.28:0/261175350 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55836f25dd30 con 0x55836f23fa60 2026-02-24T09:19:37.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.028+0000 7f8c657fa640 1 -- 10.20.193.28:0/261175350 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7f8c900b7e00 con 0x55836f23fa60 2026-02-24T09:19:37.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.028+0000 7f8c657fa640 1 -- 10.20.193.28:0/261175350 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f8c900b8020 con 0x55836f23fa60 2026-02-24T09:19:37.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.028+0000 7f8cacc2ce00 10 client.15690 fetch_fsmap learned FSMap version 23 2026-02-24T09:19:37.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.028+0000 7f8cacc2ce00 1 -- 10.20.193.28:0/261175350 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x55836f1b1010 con 0x55836f23fa60 2026-02-24T09:19:37.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.028+0000 7f8c657fa640 1 -- 10.20.193.28:0/261175350 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f8c900cb020 con 0x55836f23fa60 2026-02-24T09:19:37.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.029+0000 7f8cacc2ce00 10 client.15690 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:19:37.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.029+0000 7f8cacc2ce00 10 client.15690 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:19:37.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.029+0000 7f8cacc2ce00 20 client.15690 populate_metadata read hostname 'trial028' 2026-02-24T09:19:37.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.029+0000 7f8cacc2ce00 1 --2- 10.20.193.28:0/261175350 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55836f4140b0 0x55836f434560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.029+0000 7f8cacc2ce00 4 client.15690 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-24T09:19:37.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.029+0000 7f8cacc2ce00 1 -- 10.20.193.28:0/261175350 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55836ef10640 con 0x55836f4140b0 2026-02-24T09:19:37.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.029+0000 7f8ca37fe640 1 --2- 10.20.193.28:0/261175350 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55836f4140b0 0x55836f434560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.038 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.030+0000 7f8ca37fe640 1 --2- 10.20.193.28:0/261175350 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55836f4140b0 0x55836f434560 crc :-1 s=READY pgs=43 gs=4 cs=0 l=0 c_cookie=10646135473741429230 s_cookie=10361900220861606160 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93beabcec70af9ee server_cookie=8fccdd59e67f6910 in_seq=0 out_seq=0 2026-02-24T09:19:37.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.030+0000 7f8c657fa640 10 client.15690 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:19:37.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.032+0000 7f8c657fa640 1 -- 10.20.193.28:0/261175350 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55836ef10640 con 0x55836f4140b0 2026-02-24T09:19:37.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.032+0000 7f8c657fa640 10 client.15690 handle_command_reply: tid=0 2026-02-24T09:19:37.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.032+0000 7f8cacc2ce00 1 client.15690 shutdown 2026-02-24T09:19:37.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.032+0000 7f8cacc2ce00 1 -- 10.20.193.28:0/261175350 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55836f23fa60 msgr2=0x55836f302740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:37.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.032+0000 7f8cacc2ce00 1 --2- 10.20.193.28:0/261175350 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55836f23fa60 0x55836f302740 secure :-1 s=READY pgs=427 gs=1 cs=0 l=1 c_cookie=8775722895909069332 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c900ad3c0 tx=0x7f8c90002c20 comp rx=0 tx=0).stop 2026-02-24T09:19:37.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.032+0000 7f8cacc2ce00 1 -- 10.20.193.28:0/261175350 shutdown_connections 2026-02-24T09:19:37.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.032+0000 7f8cacc2ce00 1 --2- 10.20.193.28:0/261175350 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55836f4140b0 0x55836f434560 crc :-1 s=READY pgs=43 gs=4 cs=0 l=0 c_cookie=10646135473741429230 s_cookie=10361900220861606160 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.032+0000 7f8cacc2ce00 1 --2- 10.20.193.28:0/261175350 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55836f366270 0x55836f3031c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.039 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.032+0000 7f8cacc2ce00 1 --2- 10.20.193.28:0/261175350 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55836f321740 0x55836f302c80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.032+0000 7f8cacc2ce00 1 --2- 10.20.193.28:0/261175350 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55836f23fa60 0x55836f302740 unknown :-1 s=CLOSED pgs=427 gs=1 cs=0 l=1 c_cookie=8775722895909069332 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.032+0000 7f8c657fa640 0 client.15690 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:19:37.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.032+0000 7f8cacc2ce00 1 -- 10.20.193.28:0/261175350 >> 10.20.193.28:0/261175350 conn(0x55836f2bb490 msgr2=0x55836f360bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:37.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.033+0000 7f8cacc2ce00 1 -- 10.20.193.28:0/261175350 shutdown_connections 2026-02-24T09:19:37.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.033+0000 7f8cacc2ce00 1 -- 10.20.193.28:0/261175350 wait complete. 2026-02-24T09:19:37.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.033+0000 7f8cacc2ce00 20 client.15690 trim_cache size 0 max 16384 2026-02-24T09:19:37.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-24T09:19:37.040 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-24T09:19:37.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-24T09:19:37.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-24T09:19:37.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.033+0000 7f8ca93b5640 1 -- 10.20.193.28:0/586466128 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8c780b58d0 msgr2=0x7f8c780d5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:37.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.033+0000 7f8ca93b5640 1 --2- 10.20.193.28:0/586466128 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8c780b58d0 0x7f8c780d5d80 secure :-1 s=READY pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ca41021e0 tx=0x7f8c9400b410 comp rx=0 tx=0).stop 2026-02-24T09:19:37.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.033+0000 7f8ca93b5640 1 -- 10.20.193.28:0/586466128 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ca4114090 msgr2=0x7f8ca40fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:37.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.033+0000 7f8ca93b5640 1 --2- 10.20.193.28:0/586466128 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ca4114090 0x7f8ca40fb840 secure :-1 s=READY pgs=424 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c9000d950 tx=0x7f8c9000de20 comp rx=0 tx=0).stop 2026-02-24T09:19:37.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.033+0000 7f8ca93b5640 1 -- 10.20.193.28:0/586466128 shutdown_connections 2026-02-24T09:19:37.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.033+0000 7f8ca93b5640 1 --2- 10.20.193.28:0/586466128 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8c780b58d0 0x7f8c780d5d80 unknown :-1 s=CLOSED pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.033+0000 7f8ca93b5640 1 --2- 10.20.193.28:0/586466128 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8ca4119a60 0x7f8ca4101150 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.033+0000 7f8ca93b5640 1 --2- 10.20.193.28:0/586466128 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8ca4114a80 0x7f8ca40fbd80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.033+0000 7f8ca93b5640 1 --2- 10.20.193.28:0/586466128 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ca4114090 0x7f8ca40fb840 unknown :-1 s=CLOSED pgs=424 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.033+0000 7f8ca93b5640 1 -- 10.20.193.28:0/586466128 >> 10.20.193.28:0/586466128 conn(0x7f8ca4058980 msgr2=0x7f8ca4118130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:37.042 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.033+0000 7f8ca93b5640 1 -- 10.20.193.28:0/586466128 shutdown_connections 2026-02-24T09:19:37.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:37.033+0000 7f8ca93b5640 1 -- 10.20.193.28:0/586466128 wait complete. 2026-02-24T09:19:38.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:38 trial159 ceph-mon[44242]: pgmap v263: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 17 MiB/s rd, 170 B/s wr, 11 op/s 2026-02-24T09:19:38.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:38 trial028 ceph-mon[40371]: pgmap v263: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 17 MiB/s rd, 170 B/s wr, 11 op/s 2026-02-24T09:19:38.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:38 trial074 ceph-mon[44412]: pgmap v263: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 17 MiB/s rd, 170 B/s wr, 11 op/s 2026-02-24T09:19:40.601 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-24T09:19:40.601 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-24T09:19:40.602 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-24T09:19:40.602 INFO:tasks.workunit.client.0.trial028.stdout:iozone test complete. 2026-02-24T09:19:40.604 INFO:tasks.workunit.client.0.trial028.stderr:+ iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2026-02-24T09:19:40.640 INFO:tasks.workunit.client.0.trial028.stdout: Iozone: Performance Test of File I/O 2026-02-24T09:19:40.640 INFO:tasks.workunit.client.0.trial028.stdout: Version $Revision: 3.494 $ 2026-02-24T09:19:40.640 INFO:tasks.workunit.client.0.trial028.stdout: Compiled for 64 bit mode. 2026-02-24T09:19:40.640 INFO:tasks.workunit.client.0.trial028.stdout: Build: linux-AMD64 2026-02-24T09:19:40.640 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-24T09:19:40.641 INFO:tasks.workunit.client.0.trial028.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2026-02-24T09:19:40.641 INFO:tasks.workunit.client.0.trial028.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2026-02-24T09:19:40.641 INFO:tasks.workunit.client.0.trial028.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2026-02-24T09:19:40.641 INFO:tasks.workunit.client.0.trial028.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2026-02-24T09:19:40.641 INFO:tasks.workunit.client.0.trial028.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2026-02-24T09:19:40.641 INFO:tasks.workunit.client.0.trial028.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2026-02-24T09:19:40.641 INFO:tasks.workunit.client.0.trial028.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2026-02-24T09:19:40.641 INFO:tasks.workunit.client.0.trial028.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2026-02-24T09:19:40.641 INFO:tasks.workunit.client.0.trial028.stdout: Alexey Skidanov, Sudhir Kumar. 2026-02-24T09:19:40.641 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-24T09:19:40.641 INFO:tasks.workunit.client.0.trial028.stdout: Run began: Tue Feb 24 09:19:40 2026 2026-02-24T09:19:40.642 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-24T09:19:40.642 INFO:tasks.workunit.client.0.trial028.stdout: Include close in write timing 2026-02-24T09:19:40.642 INFO:tasks.workunit.client.0.trial028.stdout: Include fsync in write timing 2026-02-24T09:19:40.642 INFO:tasks.workunit.client.0.trial028.stdout: File size set to 1048576 kB 2026-02-24T09:19:40.642 INFO:tasks.workunit.client.0.trial028.stdout: Record Size 1024 kB 2026-02-24T09:19:40.642 INFO:tasks.workunit.client.0.trial028.stdout: Command line used: iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2026-02-24T09:19:40.642 INFO:tasks.workunit.client.0.trial028.stdout: Output is in kBytes/sec 2026-02-24T09:19:40.642 INFO:tasks.workunit.client.0.trial028.stdout: Time Resolution = 0.000001 seconds. 2026-02-24T09:19:40.642 INFO:tasks.workunit.client.0.trial028.stdout: Processor cache size set to 1024 kBytes. 2026-02-24T09:19:40.642 INFO:tasks.workunit.client.0.trial028.stdout: Processor cache line size set to 32 bytes. 2026-02-24T09:19:40.642 INFO:tasks.workunit.client.0.trial028.stdout: File stride size set to 17 * record size. 2026-02-24T09:19:40.642 INFO:tasks.workunit.client.0.trial028.stdout: Throughput test with 1 process 2026-02-24T09:19:40.643 INFO:tasks.workunit.client.0.trial028.stdout: Each process writes a 1048576 kByte file in 1024 kByte records 2026-02-24T09:19:40.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:40 trial159 ceph-mon[44242]: pgmap v264: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 MiB/s rd, 0 B/s wr, 6 op/s 2026-02-24T09:19:40.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:40 trial028 ceph-mon[40371]: pgmap v264: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 MiB/s rd, 0 B/s wr, 6 op/s 2026-02-24T09:19:40.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:40 trial074 ceph-mon[44412]: pgmap v264: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 MiB/s rd, 0 B/s wr, 6 op/s 2026-02-24T09:19:42.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:42 trial159 ceph-mon[44242]: pgmap v265: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 7.0 KiB/s rd, 346 KiB/s wr, 7 op/s 2026-02-24T09:19:42.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:42 trial028 ceph-mon[40371]: pgmap v265: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 7.0 KiB/s rd, 346 KiB/s wr, 7 op/s 2026-02-24T09:19:42.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:42 trial074 ceph-mon[44412]: pgmap v265: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 7.0 KiB/s rd, 346 KiB/s wr, 7 op/s 2026-02-24T09:19:43.819 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-24T09:19:43.819 INFO:tasks.workunit.client.0.trial028.stdout: Children see throughput for 1 initial writers = 331252.34 kB/sec 2026-02-24T09:19:43.819 INFO:tasks.workunit.client.0.trial028.stdout: Parent sees throughput for 1 initial writers = 331168.33 kB/sec 2026-02-24T09:19:43.819 INFO:tasks.workunit.client.0.trial028.stdout: Min throughput per process = 331252.34 kB/sec 2026-02-24T09:19:43.819 INFO:tasks.workunit.client.0.trial028.stdout: Max throughput per process = 331252.34 kB/sec 2026-02-24T09:19:43.819 INFO:tasks.workunit.client.0.trial028.stdout: Avg throughput per process = 331252.34 kB/sec 2026-02-24T09:19:43.819 INFO:tasks.workunit.client.0.trial028.stdout: Min xfer = 1048576.00 kB 2026-02-24T09:19:44.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:44 trial159 ceph-mon[44242]: pgmap v266: 97 pgs: 97 active+clean; 1.4 GiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.7 KiB/s rd, 15 MiB/s wr, 18 op/s 2026-02-24T09:19:44.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:44 trial028 ceph-mon[40371]: pgmap v266: 97 pgs: 97 active+clean; 1.4 GiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.7 KiB/s rd, 15 MiB/s wr, 18 op/s 2026-02-24T09:19:44.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:44 trial074 ceph-mon[44412]: pgmap v266: 97 pgs: 97 active+clean; 1.4 GiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.7 KiB/s rd, 15 MiB/s wr, 18 op/s 2026-02-24T09:19:46.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:46 trial159 ceph-mon[44242]: pgmap v267: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 37 MiB/s wr, 28 op/s 2026-02-24T09:19:46.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:46 trial028 ceph-mon[40371]: pgmap v267: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 37 MiB/s wr, 28 op/s 2026-02-24T09:19:46.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:46 trial074 ceph-mon[44412]: pgmap v267: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 37 MiB/s wr, 28 op/s 2026-02-24T09:19:48.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:48 trial159 ceph-mon[44242]: pgmap v268: 97 pgs: 97 active+clean; 1.9 GiB data, 5.7 GiB used, 8.2 TiB / 8.2 TiB avail; 25 KiB/s rd, 78 MiB/s wr, 53 op/s 2026-02-24T09:19:48.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:48 trial028 ceph-mon[40371]: pgmap v268: 97 pgs: 97 active+clean; 1.9 GiB data, 5.7 GiB used, 8.2 TiB / 8.2 TiB avail; 25 KiB/s rd, 78 MiB/s wr, 53 op/s 2026-02-24T09:19:48.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:48 trial074 ceph-mon[44412]: pgmap v268: 97 pgs: 97 active+clean; 1.9 GiB data, 5.7 GiB used, 8.2 TiB / 8.2 TiB avail; 25 KiB/s rd, 78 MiB/s wr, 53 op/s 2026-02-24T09:19:50.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.107+0000 7f9d8f577640 1 -- 10.20.193.28:0/994866867 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d9010dbc0 msgr2=0x7f9d90112c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:50.109 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.107+0000 7f9d8f577640 1 --2- 10.20.193.28:0/994866867 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d9010dbc0 0x7f9d90112c10 secure :-1 s=READY pgs=428 gs=1 cs=0 l=1 c_cookie=6901603326417044146 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d78009950 tx=0x7f9d7802f1b0 comp rx=0 tx=0).stop 2026-02-24T09:19:50.109 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.107+0000 7f9d8f577640 1 -- 10.20.193.28:0/994866867 shutdown_connections 2026-02-24T09:19:50.110 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.107+0000 7f9d8f577640 1 --2- 10.20.193.28:0/994866867 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f9d901133c0 0x7f9d90173d90 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:50.110 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.107+0000 7f9d8f577640 1 --2- 10.20.193.28:0/994866867 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d9010dbc0 0x7f9d90112c10 unknown :-1 s=CLOSED pgs=428 gs=1 cs=0 l=1 c_cookie=6901603326417044146 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:50.110 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.107+0000 7f9d8f577640 1 --2- 10.20.193.28:0/994866867 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f9d9010d1d0 0x7f9d9010d5a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:50.110 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.107+0000 7f9d8f577640 1 -- 10.20.193.28:0/994866867 >> 10.20.193.28:0/994866867 conn(0x7f9d900eaa80 msgr2=0x7f9d9010ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:50.110 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.107+0000 7f9d8f577640 1 -- 10.20.193.28:0/994866867 shutdown_connections 2026-02-24T09:19:50.110 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.107+0000 7f9d8f577640 1 -- 10.20.193.28:0/994866867 wait complete. 2026-02-24T09:19:50.112 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.108+0000 7f9d8f577640 1 Processor -- start 2026-02-24T09:19:50.112 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.108+0000 7f9d8f577640 1 -- start start 2026-02-24T09:19:50.112 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.109+0000 7f9d8f577640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f9d9010d1d0 0x7f9d900607a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:50.112 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.109+0000 7f9d8f577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d9010dbc0 0x7f9d90173c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:50.112 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.109+0000 7f9d8f577640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f9d901133c0 0x7f9d90060ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:50.112 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.109+0000 7f9d8f577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9d90061220 con 0x7f9d9010dbc0 2026-02-24T09:19:50.112 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.109+0000 7f9d8f577640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f9d90061390 con 0x7f9d901133c0 2026-02-24T09:19:50.112 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.109+0000 7f9d8f577640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9d90061550 con 0x7f9d9010d1d0 2026-02-24T09:19:50.112 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.109+0000 7f9d8dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d9010dbc0 0x7f9d90173c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:50.113 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.109+0000 7f9d8dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d9010dbc0 0x7f9d90173c90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53858/0 (socket says 10.20.193.28:53858) 2026-02-24T09:19:50.113 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.109+0000 7f9d8dd74640 1 -- 10.20.193.28:0/577758421 learned_addr learned my addr 10.20.193.28:0/577758421 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:19:50.113 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.109+0000 7f9d8e575640 1 --2- 10.20.193.28:0/577758421 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f9d9010d1d0 0x7f9d900607a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:50.113 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.109+0000 7f9d8dd74640 1 -- 10.20.193.28:0/577758421 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f9d9010d1d0 msgr2=0x7f9d900607a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:50.113 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.109+0000 7f9d8dd74640 1 --2- 10.20.193.28:0/577758421 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f9d9010d1d0 0x7f9d900607a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:50.113 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.109+0000 7f9d8dd74640 1 -- 10.20.193.28:0/577758421 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f9d901133c0 msgr2=0x7f9d90060ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:50.113 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.109+0000 7f9d8ed76640 1 --2- 10.20.193.28:0/577758421 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f9d901133c0 0x7f9d90060ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:50.113 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.109+0000 7f9d8dd74640 1 --2- 10.20.193.28:0/577758421 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f9d901133c0 0x7f9d90060ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:50.113 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.109+0000 7f9d8dd74640 1 -- 10.20.193.28:0/577758421 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d78009570 con 0x7f9d9010dbc0 2026-02-24T09:19:50.113 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.109+0000 7f9d8e575640 1 --2- 10.20.193.28:0/577758421 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f9d9010d1d0 0x7f9d900607a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:19:50.113 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.109+0000 7f9d8dd74640 1 --2- 10.20.193.28:0/577758421 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d9010dbc0 0x7f9d90173c90 secure :-1 s=READY pgs=429 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d780023d0 tx=0x7f9d780028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:50.113 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.110+0000 7f9d777fe640 1 -- 10.20.193.28:0/577758421 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9d7803d070 con 0x7f9d9010dbc0 2026-02-24T09:19:50.114 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.110+0000 7f9d8f577640 1 -- 10.20.193.28:0/577758421 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d900fb750 con 0x7f9d9010dbc0 2026-02-24T09:19:50.114 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.110+0000 7f9d8f577640 1 -- 10.20.193.28:0/577758421 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d900fbc90 con 0x7f9d9010dbc0 2026-02-24T09:19:50.114 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.110+0000 7f9d777fe640 1 -- 10.20.193.28:0/577758421 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f9d78005e20 con 0x7f9d9010dbc0 2026-02-24T09:19:50.114 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.110+0000 7f9d777fe640 1 -- 10.20.193.28:0/577758421 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9d78041800 con 0x7f9d9010dbc0 2026-02-24T09:19:50.115 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.114+0000 7f9d777fe640 1 -- 10.20.193.28:0/577758421 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7f9d78041980 con 0x7f9d9010dbc0 2026-02-24T09:19:50.116 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.115+0000 7f9d777fe640 1 --2- 10.20.193.28:0/577758421 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f9d680b58d0 0x7f9d680d5d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:50.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.115+0000 7f9d777fe640 1 -- 10.20.193.28:0/577758421 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7f9d780d1f80 con 0x7f9d9010dbc0 2026-02-24T09:19:50.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.115+0000 7f9d8e575640 1 --2- 10.20.193.28:0/577758421 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f9d680b58d0 0x7f9d680d5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:50.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.116+0000 7f9d8e575640 1 --2- 10.20.193.28:0/577758421 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f9d680b58d0 0x7f9d680d5d80 secure :-1 s=READY pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d84004740 tx=0x7f9d84005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:50.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.116+0000 7f9d97280e00 1 Processor -- start 2026-02-24T09:19:50.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.116+0000 7f9d97280e00 1 -- start start 2026-02-24T09:19:50.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.117+0000 7f9d97280e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d2b9dfa60 0x560d2bac9c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:50.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.117+0000 7f9d97280e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560d2baca150 0x560d2baca5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:50.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.117+0000 7f9d97280e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560d2bb0ec80 0x560d2bb2f060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:50.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.117+0000 7f9d97280e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560d2b9d6f10 con 0x560d2b9dfa60 2026-02-24T09:19:50.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.117+0000 7f9d97280e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x560d2b9d2c40 con 0x560d2baca150 2026-02-24T09:19:50.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.117+0000 7f9d97280e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x560d2b9ccda0 con 0x560d2bb0ec80 2026-02-24T09:19:50.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.117+0000 7f9d8e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d2b9dfa60 0x560d2bac9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:50.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.117+0000 7f9d8e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d2b9dfa60 0x560d2bac9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53870/0 (socket says 10.20.193.28:53870) 2026-02-24T09:19:50.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.117+0000 7f9d8e575640 1 -- 10.20.193.28:0/2596725353 learned_addr learned my addr 10.20.193.28:0/2596725353 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:19:50.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.117+0000 7f9d8ed76640 1 --2- 10.20.193.28:0/2596725353 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560d2bb0ec80 0x560d2bb2f060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:50.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.117+0000 7f9d8e575640 1 -- 10.20.193.28:0/2596725353 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560d2bb0ec80 msgr2=0x560d2bb2f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:50.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.117+0000 7f9d8e575640 1 --2- 10.20.193.28:0/2596725353 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560d2bb0ec80 0x560d2bb2f060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:50.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.117+0000 7f9d8e575640 1 -- 10.20.193.28:0/2596725353 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560d2baca150 msgr2=0x560d2baca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:50.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.117+0000 7f9d8e575640 1 --2- 10.20.193.28:0/2596725353 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560d2baca150 0x560d2baca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:50.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.117+0000 7f9d8e575640 1 -- 10.20.193.28:0/2596725353 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d2b978340 con 0x560d2b9dfa60 2026-02-24T09:19:50.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.117+0000 7f9d8ed76640 1 --2- 10.20.193.28:0/2596725353 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560d2bb0ec80 0x560d2bb2f060 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:19:50.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.117+0000 7f9d8e575640 1 --2- 10.20.193.28:0/2596725353 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d2b9dfa60 0x560d2bac9c10 secure :-1 s=READY pgs=430 gs=3 cs=0 l=1 c_cookie=1763429040213369746 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d84009da0 tx=0x7f9d84013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1878f55e7886a392 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:50.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.118+0000 7f9d74bfe640 1 -- 10.20.193.28:0/2596725353 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9d84009ea0 con 0x560d2b9dfa60 2026-02-24T09:19:50.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.118+0000 7f9d74bfe640 1 -- 10.20.193.28:0/2596725353 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f9d84011e60 con 0x560d2b9dfa60 2026-02-24T09:19:50.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.118+0000 7f9d74bfe640 1 -- 10.20.193.28:0/2596725353 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9d8401db70 con 0x560d2b9dfa60 2026-02-24T09:19:50.124 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.118+0000 7f9d97280e00 1 -- 10.20.193.28:0/2596725353 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d2b9dfa60 msgr2=0x560d2bac9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:50.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.118+0000 7f9d97280e00 1 --2- 10.20.193.28:0/2596725353 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d2b9dfa60 0x560d2bac9c10 secure :-1 s=READY pgs=430 gs=3 cs=0 l=1 c_cookie=1763429040213369746 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d84009da0 tx=0x7f9d84013000 comp rx=0 tx=0).stop 2026-02-24T09:19:50.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.118+0000 7f9d97280e00 1 -- 10.20.193.28:0/2596725353 shutdown_connections 2026-02-24T09:19:50.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.118+0000 7f9d97280e00 1 --2- 10.20.193.28:0/2596725353 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560d2bb0ec80 0x560d2bb2f060 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:50.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.118+0000 7f9d97280e00 1 --2- 10.20.193.28:0/2596725353 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560d2baca150 0x560d2baca5a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:50.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.118+0000 7f9d97280e00 1 --2- 10.20.193.28:0/2596725353 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d2b9dfa60 0x560d2bac9c10 unknown :-1 s=CLOSED pgs=430 gs=3 cs=0 l=1 c_cookie=1763429040213369746 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:50.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.118+0000 7f9d97280e00 1 -- 10.20.193.28:0/2596725353 >> 10.20.193.28:0/2596725353 conn(0x560d2ba5b490 msgr2=0x560d2babfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:50.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.118+0000 7f9d97280e00 1 -- 10.20.193.28:0/2596725353 shutdown_connections 2026-02-24T09:19:50.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.118+0000 7f9d97280e00 1 -- 10.20.193.28:0/2596725353 wait complete. 2026-02-24T09:19:50.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.120+0000 7f9d97280e00 1 -- start start 2026-02-24T09:19:50.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.120+0000 7f9d97280e00 1 Processor -- start 2026-02-24T09:19:50.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.120+0000 7f9d97280e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560d2b9dfa60 0x560d2bb262a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:50.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.120+0000 7f9d97280e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d2baca150 0x560d2bb267e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:50.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.120+0000 7f9d97280e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560d2bb0ec80 0x560d2bb2b7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:50.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.120+0000 7f9d97280e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560d2bb2bd10 con 0x560d2baca150 2026-02-24T09:19:50.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.120+0000 7f9d97280e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x560d2bb2be80 con 0x560d2bb0ec80 2026-02-24T09:19:50.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.120+0000 7f9d97280e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x560d2bb2c040 con 0x560d2b9dfa60 2026-02-24T09:19:50.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.120+0000 7f9d8dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d2baca150 0x560d2bb267e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:50.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.121+0000 7f9d8e575640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560d2b9dfa60 0x560d2bb262a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:50.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.121+0000 7f9d8dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d2baca150 0x560d2bb267e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53872/0 (socket says 10.20.193.28:53872) 2026-02-24T09:19:50.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.121+0000 7f9d8dd74640 1 -- 10.20.193.28:0/3812879376 learned_addr learned my addr 10.20.193.28:0/3812879376 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:19:50.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.121+0000 7f9d8dd74640 1 -- 10.20.193.28:0/3812879376 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560d2b9dfa60 msgr2=0x560d2bb262a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:50.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.121+0000 7f9d8dd74640 1 --2- 10.20.193.28:0/3812879376 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560d2b9dfa60 0x560d2bb262a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:50.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.121+0000 7f9d8dd74640 1 -- 10.20.193.28:0/3812879376 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560d2bb0ec80 msgr2=0x560d2bb2b7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:19:50.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.121+0000 7f9d8dd74640 1 --2- 10.20.193.28:0/3812879376 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560d2bb0ec80 0x560d2bb2b7d0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:50.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.121+0000 7f9d8dd74640 1 -- 10.20.193.28:0/3812879376 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d2b950ce0 con 0x560d2baca150 2026-02-24T09:19:50.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.121+0000 7f9d8dd74640 1 --2- 10.20.193.28:0/3812879376 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d2baca150 0x560d2bb267e0 secure :-1 s=READY pgs=431 gs=1 cs=0 l=1 c_cookie=6077193222728073818 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d78009a80 tx=0x7f9d780cbd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54568709a81e425a server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:50.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.121+0000 7f9d3ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:19:50.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.121+0000 7f9d3ffff640 1 -- 10.20.193.28:0/3812879376 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9d780cdbd0 con 0x560d2baca150 2026-02-24T09:19:50.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.121+0000 7f9d3ffff640 1 -- 10.20.193.28:0/3812879376 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f9d780d1630 con 0x560d2baca150 2026-02-24T09:19:50.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.121+0000 7f9d3ffff640 1 -- 10.20.193.28:0/3812879376 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9d780cf800 con 0x560d2baca150 2026-02-24T09:19:50.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.121+0000 7f9d97280e00 1 -- 10.20.193.28:0/3812879376 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d84002e10 con 0x560d2baca150 2026-02-24T09:19:50.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.121+0000 7f9d97280e00 10 client.15702 _ll_register_callbacks cb 0x560d2b957980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:19:50.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.121+0000 7f9d97280e00 1 -- 10.20.193.28:0/3812879376 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560d2b66c520 con 0x560d2baca150 2026-02-24T09:19:50.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.122+0000 7f9d3ffff640 1 -- 10.20.193.28:0/3812879376 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7f9d780d0f60 con 0x560d2baca150 2026-02-24T09:19:50.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.122+0000 7f9d3ffff640 1 -- 10.20.193.28:0/3812879376 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f9d780d72a0 con 0x560d2baca150 2026-02-24T09:19:50.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.122+0000 7f9d97280e00 10 client.15702 fetch_fsmap learned FSMap version 23 2026-02-24T09:19:50.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.122+0000 7f9d97280e00 1 -- 10.20.193.28:0/3812879376 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x560d2b9625b0 con 0x560d2baca150 2026-02-24T09:19:50.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.122+0000 7f9d3ffff640 1 -- 10.20.193.28:0/3812879376 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f9d78041980 con 0x560d2baca150 2026-02-24T09:19:50.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.122+0000 7f9d97280e00 10 client.15702 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:19:50.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.122+0000 7f9d97280e00 10 client.15702 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:19:50.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.122+0000 7f9d97280e00 20 client.15702 populate_metadata read hostname 'trial028' 2026-02-24T09:19:50.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.122+0000 7f9d97280e00 1 --2- 10.20.193.28:0/3812879376 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x560d2bb0be60 0x560d2bb0c2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:50.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.122+0000 7f9d97280e00 4 client.15702 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:19:50.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.122+0000 7f9d97280e00 1 -- 10.20.193.28:0/3812879376 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d2b66c520 con 0x560d2bb0be60 2026-02-24T09:19:50.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.124+0000 7f9d8e575640 1 --2- 10.20.193.28:0/3812879376 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x560d2bb0be60 0x560d2bb0c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:50.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.127+0000 7f9d8e575640 1 --2- 10.20.193.28:0/3812879376 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x560d2bb0be60 0x560d2bb0c2d0 crc :-1 s=READY pgs=44 gs=3 cs=0 l=0 c_cookie=9874244849441797595 s_cookie=279492951251682452 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89085d5fe43575db server_cookie=3e0f55bbc950494 in_seq=0 out_seq=0 2026-02-24T09:19:50.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.127+0000 7f9d3ffff640 10 client.15702 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:19:50.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.130+0000 7f9d3ffff640 1 -- 10.20.193.28:0/3812879376 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x560d2b66c520 con 0x560d2bb0be60 2026-02-24T09:19:50.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.130+0000 7f9d3ffff640 10 client.15702 handle_command_reply: tid=0 2026-02-24T09:19:50.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.130+0000 7f9d97280e00 1 client.15702 shutdown 2026-02-24T09:19:50.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.131+0000 7f9d97280e00 1 -- 10.20.193.28:0/3812879376 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d2baca150 msgr2=0x560d2bb267e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:50.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.131+0000 7f9d97280e00 1 --2- 10.20.193.28:0/3812879376 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d2baca150 0x560d2bb267e0 secure :-1 s=READY pgs=431 gs=1 cs=0 l=1 c_cookie=6077193222728073818 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d78009a80 tx=0x7f9d780cbd00 comp rx=0 tx=0).stop 2026-02-24T09:19:50.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.131+0000 7f9d97280e00 1 -- 10.20.193.28:0/3812879376 shutdown_connections 2026-02-24T09:19:50.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.131+0000 7f9d97280e00 1 --2- 10.20.193.28:0/3812879376 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x560d2bb0be60 0x560d2bb0c2d0 crc :-1 s=READY pgs=44 gs=3 cs=0 l=0 c_cookie=9874244849441797595 s_cookie=279492951251682452 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:50.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.131+0000 7f9d97280e00 1 --2- 10.20.193.28:0/3812879376 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560d2bb0ec80 0x560d2bb2b7d0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:50.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.131+0000 7f9d97280e00 1 --2- 10.20.193.28:0/3812879376 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d2baca150 0x560d2bb267e0 unknown :-1 s=CLOSED pgs=431 gs=1 cs=0 l=1 c_cookie=6077193222728073818 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:50.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.131+0000 7f9d97280e00 1 --2- 10.20.193.28:0/3812879376 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560d2b9dfa60 0x560d2bb262a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:50.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.131+0000 7f9d97280e00 1 -- 10.20.193.28:0/3812879376 >> 10.20.193.28:0/3812879376 conn(0x560d2ba5b490 msgr2=0x560d2babf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:50.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.131+0000 7f9d3ffff640 0 client.15702 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:19:50.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.131+0000 7f9d97280e00 1 -- 10.20.193.28:0/3812879376 shutdown_connections 2026-02-24T09:19:50.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.131+0000 7f9d97280e00 1 -- 10.20.193.28:0/3812879376 wait complete. 2026-02-24T09:19:50.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.131+0000 7f9d97280e00 20 client.15702 trim_cache size 0 max 16384 2026-02-24T09:19:50.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.140+0000 7f9d97280e00 1 Processor -- start 2026-02-24T09:19:50.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.140+0000 7f9d97280e00 1 -- start start 2026-02-24T09:19:50.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.140+0000 7f9d97280e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560d2b9dfa60 0x560d2bb23bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:50.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.140+0000 7f9d97280e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d2baca150 0x560d2bb08e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:50.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.140+0000 7f9d97280e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560d2bb0ec80 0x560d2bb09350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:50.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.140+0000 7f9d97280e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560d2b9ca9d0 con 0x560d2baca150 2026-02-24T09:19:50.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.140+0000 7f9d97280e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x560d2b70bf10 con 0x560d2b9dfa60 2026-02-24T09:19:50.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.140+0000 7f9d97280e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x560d2bac9e50 con 0x560d2bb0ec80 2026-02-24T09:19:50.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.140+0000 7f9d8e575640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560d2b9dfa60 0x560d2bb23bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:50.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.140+0000 7f9d8dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d2baca150 0x560d2bb08e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:50.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.140+0000 7f9d8dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d2baca150 0x560d2bb08e10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53876/0 (socket says 10.20.193.28:53876) 2026-02-24T09:19:50.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.140+0000 7f9d8dd74640 1 -- 10.20.193.28:0/4030646477 learned_addr learned my addr 10.20.193.28:0/4030646477 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:19:50.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.141+0000 7f9d8dd74640 1 -- 10.20.193.28:0/4030646477 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560d2bb0ec80 msgr2=0x560d2bb09350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:50.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.141+0000 7f9d8dd74640 1 --2- 10.20.193.28:0/4030646477 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560d2bb0ec80 0x560d2bb09350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:50.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.141+0000 7f9d8dd74640 1 -- 10.20.193.28:0/4030646477 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560d2b9dfa60 msgr2=0x560d2bb23bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:50.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.141+0000 7f9d8dd74640 1 --2- 10.20.193.28:0/4030646477 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560d2b9dfa60 0x560d2bb23bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:50.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.141+0000 7f9d8dd74640 1 -- 10.20.193.28:0/4030646477 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d2b95d030 con 0x560d2baca150 2026-02-24T09:19:50.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.141+0000 7f9d8dd74640 1 --2- 10.20.193.28:0/4030646477 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d2baca150 0x560d2bb08e10 secure :-1 s=READY pgs=432 gs=2 cs=0 l=1 c_cookie=1249113084180569634 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d780cdb50 tx=0x7f9d78092000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1155bdbb62e01e22 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:50.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.141+0000 7f9d5a3ff640 1 -- 10.20.193.28:0/4030646477 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9d780cdbd0 con 0x560d2baca150 2026-02-24T09:19:50.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.141+0000 7f9d5a3ff640 1 -- 10.20.193.28:0/4030646477 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f9d780d1630 con 0x560d2baca150 2026-02-24T09:19:50.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.141+0000 7f9d5a3ff640 1 -- 10.20.193.28:0/4030646477 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9d780d3e50 con 0x560d2baca150 2026-02-24T09:19:50.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.142+0000 7f9d97280e00 1 -- 10.20.193.28:0/4030646477 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d2baca150 msgr2=0x560d2bb08e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:50.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.142+0000 7f9d97280e00 1 --2- 10.20.193.28:0/4030646477 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d2baca150 0x560d2bb08e10 secure :-1 s=READY pgs=432 gs=2 cs=0 l=1 c_cookie=1249113084180569634 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d780cdb50 tx=0x7f9d78092000 comp rx=0 tx=0).stop 2026-02-24T09:19:50.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.142+0000 7f9d97280e00 1 -- 10.20.193.28:0/4030646477 shutdown_connections 2026-02-24T09:19:50.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.142+0000 7f9d97280e00 1 --2- 10.20.193.28:0/4030646477 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560d2bb0ec80 0x560d2bb09350 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:50.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.142+0000 7f9d97280e00 1 --2- 10.20.193.28:0/4030646477 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d2baca150 0x560d2bb08e10 unknown :-1 s=CLOSED pgs=432 gs=2 cs=0 l=1 c_cookie=1249113084180569634 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:50.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.142+0000 7f9d97280e00 1 --2- 10.20.193.28:0/4030646477 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560d2b9dfa60 0x560d2bb23bc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:50.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.142+0000 7f9d97280e00 1 -- 10.20.193.28:0/4030646477 >> 10.20.193.28:0/4030646477 conn(0x560d2ba5b490 msgr2=0x560d2bb224a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:50.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.142+0000 7f9d97280e00 1 -- 10.20.193.28:0/4030646477 shutdown_connections 2026-02-24T09:19:50.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.142+0000 7f9d97280e00 1 -- 10.20.193.28:0/4030646477 wait complete. 2026-02-24T09:19:50.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.143+0000 7f9d97280e00 1 -- start start 2026-02-24T09:19:50.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.143+0000 7f9d97280e00 1 Processor -- start 2026-02-24T09:19:50.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.143+0000 7f9d97280e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560d2b9dfa60 0x560d2baa4800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:50.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.143+0000 7f9d97280e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560d2baca150 0x560d2baa4d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:50.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.143+0000 7f9d97280e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d2bb0ec80 0x560d2baa0610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:50.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.143+0000 7f9d97280e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560d2baa0b50 con 0x560d2bb0ec80 2026-02-24T09:19:50.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.143+0000 7f9d97280e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x560d2baa0cc0 con 0x560d2b9dfa60 2026-02-24T09:19:50.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.143+0000 7f9d97280e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x560d2baa0e80 con 0x560d2baca150 2026-02-24T09:19:50.149 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.143+0000 7f9d8ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d2bb0ec80 0x560d2baa0610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:50.149 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.144+0000 7f9d8ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d2bb0ec80 0x560d2baa0610 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53888/0 (socket says 10.20.193.28:53888) 2026-02-24T09:19:50.149 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.144+0000 7f9d8ed76640 1 -- 10.20.193.28:0/3379668438 learned_addr learned my addr 10.20.193.28:0/3379668438 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:19:50.149 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.144+0000 7f9d8ed76640 1 -- 10.20.193.28:0/3379668438 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560d2baca150 msgr2=0x560d2baa4d40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:19:50.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.144+0000 7f9d8ed76640 1 --2- 10.20.193.28:0/3379668438 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560d2baca150 0x560d2baa4d40 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:50.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.144+0000 7f9d8ed76640 1 -- 10.20.193.28:0/3379668438 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560d2b9dfa60 msgr2=0x560d2baa4800 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:19:50.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.144+0000 7f9d8ed76640 1 --2- 10.20.193.28:0/3379668438 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560d2b9dfa60 0x560d2baa4800 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:50.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.144+0000 7f9d8ed76640 1 -- 10.20.193.28:0/3379668438 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d2b951010 con 0x560d2bb0ec80 2026-02-24T09:19:50.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.144+0000 7f9d8ed76640 1 --2- 10.20.193.28:0/3379668438 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d2bb0ec80 0x560d2baa0610 secure :-1 s=READY pgs=433 gs=1 cs=0 l=1 c_cookie=6718410521087593848 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d8000dfc0 tx=0x7f9d8000f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d3c96c5f4ac4d78 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:50.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.144+0000 7f9d3ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:19:50.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.144+0000 7f9d3ffff640 1 -- 10.20.193.28:0/3379668438 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9d800052f0 con 0x560d2bb0ec80 2026-02-24T09:19:50.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.144+0000 7f9d3ffff640 1 -- 10.20.193.28:0/3379668438 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f9d80003ce0 con 0x560d2bb0ec80 2026-02-24T09:19:50.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.144+0000 7f9d3ffff640 1 -- 10.20.193.28:0/3379668438 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9d80013c90 con 0x560d2bb0ec80 2026-02-24T09:19:50.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.144+0000 7f9d97280e00 1 -- 10.20.193.28:0/3379668438 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d2b9625b0 con 0x560d2bb0ec80 2026-02-24T09:19:50.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.145+0000 7f9d3ffff640 1 -- 10.20.193.28:0/3379668438 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7f9d80013e20 con 0x560d2bb0ec80 2026-02-24T09:19:50.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.145+0000 7f9d3ffff640 10 client.15708 inactive, discarding osd_map(96..96 src has 1..96) 2026-02-24T09:19:50.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.145+0000 7f9d97280e00 10 client.15708 _ll_register_callbacks cb 0x560d2b957980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:19:50.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.145+0000 7f9d97280e00 1 -- 10.20.193.28:0/3379668438 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560d2b9fdd30 con 0x560d2bb0ec80 2026-02-24T09:19:50.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.145+0000 7f9d3ffff640 1 -- 10.20.193.28:0/3379668438 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f9d80003e50 con 0x560d2bb0ec80 2026-02-24T09:19:50.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.145+0000 7f9d97280e00 10 client.15708 fetch_fsmap learned FSMap version 23 2026-02-24T09:19:50.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.145+0000 7f9d97280e00 1 -- 10.20.193.28:0/3379668438 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x560d2b962810 con 0x560d2bb0ec80 2026-02-24T09:19:50.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.145+0000 7f9d3ffff640 1 -- 10.20.193.28:0/3379668438 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f9d80012070 con 0x560d2bb0ec80 2026-02-24T09:19:50.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.145+0000 7f9d97280e00 10 client.15708 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:19:50.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.145+0000 7f9d97280e00 10 client.15708 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:19:50.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.145+0000 7f9d97280e00 20 client.15708 populate_metadata read hostname 'trial028' 2026-02-24T09:19:50.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.145+0000 7f9d97280e00 1 --2- 10.20.193.28:0/3379668438 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x560d2bac1400 0x560d2bac18a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:50.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.145+0000 7f9d97280e00 4 client.15708 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-24T09:19:50.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.145+0000 7f9d97280e00 1 -- 10.20.193.28:0/3379668438 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560d2b99e9d0 con 0x560d2bac1400 2026-02-24T09:19:50.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.147+0000 7f9d8e575640 1 --2- 10.20.193.28:0/3379668438 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x560d2bac1400 0x560d2bac18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:50.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.150+0000 7f9d8e575640 1 --2- 10.20.193.28:0/3379668438 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x560d2bac1400 0x560d2bac18a0 crc :-1 s=READY pgs=45 gs=2 cs=0 l=0 c_cookie=16025456466360547869 s_cookie=3480825927173759611 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de65dbbfe8e83a1d server_cookie=304e60bd1229627b in_seq=0 out_seq=0 2026-02-24T09:19:50.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.150+0000 7f9d3ffff640 10 client.15708 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:19:50.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.159+0000 7f9d3ffff640 1 -- 10.20.193.28:0/3379668438 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560d2b99e9d0 con 0x560d2bac1400 2026-02-24T09:19:50.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.159+0000 7f9d3ffff640 10 client.15708 handle_command_reply: tid=0 2026-02-24T09:19:50.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.159+0000 7f9d97280e00 1 client.15708 shutdown 2026-02-24T09:19:50.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.159+0000 7f9d97280e00 1 -- 10.20.193.28:0/3379668438 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d2bb0ec80 msgr2=0x560d2baa0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:50.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.159+0000 7f9d97280e00 1 --2- 10.20.193.28:0/3379668438 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d2bb0ec80 0x560d2baa0610 secure :-1 s=READY pgs=433 gs=1 cs=0 l=1 c_cookie=6718410521087593848 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d8000dfc0 tx=0x7f9d8000f670 comp rx=0 tx=0).stop 2026-02-24T09:19:50.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.160+0000 7f9d97280e00 1 -- 10.20.193.28:0/3379668438 shutdown_connections 2026-02-24T09:19:50.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.160+0000 7f9d97280e00 1 --2- 10.20.193.28:0/3379668438 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x560d2bac1400 0x560d2bac18a0 crc :-1 s=READY pgs=45 gs=2 cs=0 l=0 c_cookie=16025456466360547869 s_cookie=3480825927173759611 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:50.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.160+0000 7f9d97280e00 1 --2- 10.20.193.28:0/3379668438 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d2bb0ec80 0x560d2baa0610 unknown :-1 s=CLOSED pgs=433 gs=1 cs=0 l=1 c_cookie=6718410521087593848 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:50.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.160+0000 7f9d97280e00 1 --2- 10.20.193.28:0/3379668438 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x560d2baca150 0x560d2baa4d40 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:50.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.160+0000 7f9d97280e00 1 --2- 10.20.193.28:0/3379668438 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x560d2b9dfa60 0x560d2baa4800 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:50.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.160+0000 7f9d97280e00 1 -- 10.20.193.28:0/3379668438 >> 10.20.193.28:0/3379668438 conn(0x560d2ba5b490 msgr2=0x560d2bb22c90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:50.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.160+0000 7f9d3ffff640 0 client.15708 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:19:50.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.160+0000 7f9d97280e00 1 -- 10.20.193.28:0/3379668438 shutdown_connections 2026-02-24T09:19:50.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.160+0000 7f9d97280e00 1 -- 10.20.193.28:0/3379668438 wait complete. 2026-02-24T09:19:50.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.160+0000 7f9d97280e00 20 client.15708 trim_cache size 0 max 16384 2026-02-24T09:19:50.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-24T09:19:50.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-24T09:19:50.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-24T09:19:50.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-24T09:19:50.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.160+0000 7f9d8f577640 1 -- 10.20.193.28:0/577758421 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f9d680b58d0 msgr2=0x7f9d680d5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:50.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.160+0000 7f9d8f577640 1 --2- 10.20.193.28:0/577758421 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f9d680b58d0 0x7f9d680d5d80 secure :-1 s=READY pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d84004740 tx=0x7f9d84005f90 comp rx=0 tx=0).stop 2026-02-24T09:19:50.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.160+0000 7f9d8f577640 1 -- 10.20.193.28:0/577758421 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d9010dbc0 msgr2=0x7f9d90173c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:50.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.160+0000 7f9d8f577640 1 --2- 10.20.193.28:0/577758421 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d9010dbc0 0x7f9d90173c90 secure :-1 s=READY pgs=429 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d780023d0 tx=0x7f9d780028d0 comp rx=0 tx=0).stop 2026-02-24T09:19:50.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.161+0000 7f9d8f577640 1 -- 10.20.193.28:0/577758421 shutdown_connections 2026-02-24T09:19:50.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.161+0000 7f9d8f577640 1 --2- 10.20.193.28:0/577758421 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f9d680b58d0 0x7f9d680d5d80 unknown :-1 s=CLOSED pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:50.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.161+0000 7f9d8f577640 1 --2- 10.20.193.28:0/577758421 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f9d901133c0 0x7f9d90060ce0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:50.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.161+0000 7f9d8f577640 1 --2- 10.20.193.28:0/577758421 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d9010dbc0 0x7f9d90173c90 unknown :-1 s=CLOSED pgs=429 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:50.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.161+0000 7f9d8f577640 1 --2- 10.20.193.28:0/577758421 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f9d9010d1d0 0x7f9d900607a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:50.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.161+0000 7f9d8f577640 1 -- 10.20.193.28:0/577758421 >> 10.20.193.28:0/577758421 conn(0x7f9d900eaa80 msgr2=0x7f9d9010b640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:50.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.161+0000 7f9d8f577640 1 -- 10.20.193.28:0/577758421 shutdown_connections 2026-02-24T09:19:50.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:19:50.161+0000 7f9d8f577640 1 -- 10.20.193.28:0/577758421 wait complete. 2026-02-24T09:19:50.260 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-24T09:19:50.260 INFO:tasks.workunit.client.0.trial028.stdout: Children see throughput for 1 rewriters = 260393.00 kB/sec 2026-02-24T09:19:50.260 INFO:tasks.workunit.client.0.trial028.stdout: Parent sees throughput for 1 rewriters = 260341.91 kB/sec 2026-02-24T09:19:50.260 INFO:tasks.workunit.client.0.trial028.stdout: Min throughput per process = 260393.00 kB/sec 2026-02-24T09:19:50.260 INFO:tasks.workunit.client.0.trial028.stdout: Max throughput per process = 260393.00 kB/sec 2026-02-24T09:19:50.260 INFO:tasks.workunit.client.0.trial028.stdout: Avg throughput per process = 260393.00 kB/sec 2026-02-24T09:19:50.260 INFO:tasks.workunit.client.0.trial028.stdout: Min xfer = 1048576.00 kB 2026-02-24T09:19:50.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:50 trial159 ceph-mon[44242]: pgmap v269: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 8.2 TiB / 8.2 TiB avail; 93 KiB/s rd, 106 MiB/s wr, 77 op/s 2026-02-24T09:19:50.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:50 trial028 ceph-mon[40371]: pgmap v269: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 8.2 TiB / 8.2 TiB avail; 93 KiB/s rd, 106 MiB/s wr, 77 op/s 2026-02-24T09:19:50.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:50 trial074 ceph-mon[44412]: pgmap v269: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 8.2 TiB / 8.2 TiB avail; 93 KiB/s rd, 106 MiB/s wr, 77 op/s 2026-02-24T09:19:52.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:52 trial159 ceph-mon[44242]: pgmap v270: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 8.2 TiB / 8.2 TiB avail; 211 KiB/s rd, 135 MiB/s wr, 114 op/s 2026-02-24T09:19:52.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:52 trial028 ceph-mon[40371]: pgmap v270: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 8.2 TiB / 8.2 TiB avail; 211 KiB/s rd, 135 MiB/s wr, 114 op/s 2026-02-24T09:19:52.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:52 trial074 ceph-mon[44412]: pgmap v270: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 8.2 TiB / 8.2 TiB avail; 211 KiB/s rd, 135 MiB/s wr, 114 op/s 2026-02-24T09:19:54.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:54 trial159 ceph-mon[44242]: pgmap v271: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 8.2 TiB / 8.2 TiB avail; 667 KiB/s rd, 164 MiB/s wr, 151 op/s 2026-02-24T09:19:54.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:54 trial028 ceph-mon[40371]: pgmap v271: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 8.2 TiB / 8.2 TiB avail; 667 KiB/s rd, 164 MiB/s wr, 151 op/s 2026-02-24T09:19:54.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:54 trial074 ceph-mon[44412]: pgmap v271: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 8.2 TiB / 8.2 TiB avail; 667 KiB/s rd, 164 MiB/s wr, 151 op/s 2026-02-24T09:19:56.421 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-24T09:19:56.421 INFO:tasks.workunit.client.0.trial028.stdout: Children see throughput for 1 readers = 277024.66 kB/sec 2026-02-24T09:19:56.421 INFO:tasks.workunit.client.0.trial028.stdout: Parent sees throughput for 1 readers = 276965.45 kB/sec 2026-02-24T09:19:56.422 INFO:tasks.workunit.client.0.trial028.stdout: Min throughput per process = 277024.66 kB/sec 2026-02-24T09:19:56.422 INFO:tasks.workunit.client.0.trial028.stdout: Max throughput per process = 277024.66 kB/sec 2026-02-24T09:19:56.422 INFO:tasks.workunit.client.0.trial028.stdout: Avg throughput per process = 277024.66 kB/sec 2026-02-24T09:19:56.422 INFO:tasks.workunit.client.0.trial028.stdout: Min xfer = 1048576.00 kB 2026-02-24T09:19:56.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:56 trial159 ceph-mon[44242]: pgmap v272: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 8.2 TiB / 8.2 TiB avail; 11 MiB/s rd, 155 MiB/s wr, 151 op/s 2026-02-24T09:19:56.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:56 trial028 ceph-mon[40371]: pgmap v272: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 8.2 TiB / 8.2 TiB avail; 11 MiB/s rd, 155 MiB/s wr, 151 op/s 2026-02-24T09:19:56.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:56 trial074 ceph-mon[44412]: pgmap v272: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 8.2 TiB / 8.2 TiB avail; 11 MiB/s rd, 155 MiB/s wr, 151 op/s 2026-02-24T09:19:58.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:19:58 trial159 ceph-mon[44242]: pgmap v273: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 8.2 TiB / 8.2 TiB avail; 51 MiB/s rd, 134 MiB/s wr, 152 op/s 2026-02-24T09:19:58.805 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-24T09:19:58.805 INFO:tasks.workunit.client.0.trial028.stdout: Children see throughput for 1 re-readers = 2985439.00 kB/sec 2026-02-24T09:19:58.805 INFO:tasks.workunit.client.0.trial028.stdout: Parent sees throughput for 1 re-readers = 2979044.69 kB/sec 2026-02-24T09:19:58.805 INFO:tasks.workunit.client.0.trial028.stdout: Min throughput per process = 2985439.00 kB/sec 2026-02-24T09:19:58.805 INFO:tasks.workunit.client.0.trial028.stdout: Max throughput per process = 2985439.00 kB/sec 2026-02-24T09:19:58.805 INFO:tasks.workunit.client.0.trial028.stdout: Avg throughput per process = 2985439.00 kB/sec 2026-02-24T09:19:58.805 INFO:tasks.workunit.client.0.trial028.stdout: Min xfer = 1048576.00 kB 2026-02-24T09:19:58.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:19:58 trial028 ceph-mon[40371]: pgmap v273: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 8.2 TiB / 8.2 TiB avail; 51 MiB/s rd, 134 MiB/s wr, 152 op/s 2026-02-24T09:19:58.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:19:58 trial074 ceph-mon[44412]: pgmap v273: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 8.2 TiB / 8.2 TiB avail; 51 MiB/s rd, 134 MiB/s wr, 152 op/s 2026-02-24T09:20:00.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:00 trial159 ceph-mon[44242]: pgmap v274: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 8.2 TiB / 8.2 TiB avail; 80 MiB/s rd, 93 MiB/s wr, 134 op/s 2026-02-24T09:20:00.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:00 trial159 ceph-mon[44242]: overall HEALTH_OK 2026-02-24T09:20:00.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:00 trial028 ceph-mon[40371]: pgmap v274: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 8.2 TiB / 8.2 TiB avail; 80 MiB/s rd, 93 MiB/s wr, 134 op/s 2026-02-24T09:20:00.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:00 trial028 ceph-mon[40371]: overall HEALTH_OK 2026-02-24T09:20:00.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:00 trial074 ceph-mon[44412]: pgmap v274: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 8.2 TiB / 8.2 TiB avail; 80 MiB/s rd, 93 MiB/s wr, 134 op/s 2026-02-24T09:20:00.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:00 trial074 ceph-mon[44412]: overall HEALTH_OK 2026-02-24T09:20:01.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:01 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:20:01.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:01 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:20:01.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:01 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:20:02.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:02 trial159 ceph-mon[44242]: pgmap v275: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 8.2 TiB / 8.2 TiB avail; 86 MiB/s rd, 65 MiB/s wr, 113 op/s 2026-02-24T09:20:02.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:02 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:20:02.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:02 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:20:02.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:02 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:20:02.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:02 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:20:02.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:02 trial028 ceph-mon[40371]: pgmap v275: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 8.2 TiB / 8.2 TiB avail; 86 MiB/s rd, 65 MiB/s wr, 113 op/s 2026-02-24T09:20:02.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:02 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:20:02.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:02 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:20:02.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:02 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:20:02.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:02 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:20:02.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:02 trial074 ceph-mon[44412]: pgmap v275: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 8.2 TiB / 8.2 TiB avail; 86 MiB/s rd, 65 MiB/s wr, 113 op/s 2026-02-24T09:20:02.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:02 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:20:02.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:02 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:20:02.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:02 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:20:02.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:02 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:20:03.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.233+0000 7f0fd631c640 1 -- 10.20.193.28:0/227068126 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0fd010fdb0 msgr2=0x7f0fd0114e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:03.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.233+0000 7f0fd631c640 1 --2- 10.20.193.28:0/227068126 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0fd010fdb0 0x7f0fd0114e00 secure :-1 s=READY pgs=434 gs=1 cs=0 l=1 c_cookie=10414761101282960981 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0fc4009950 tx=0x7f0fc402f190 comp rx=0 tx=0).stop 2026-02-24T09:20:03.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.234+0000 7f0fd631c640 1 -- 10.20.193.28:0/227068126 shutdown_connections 2026-02-24T09:20:03.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.234+0000 7f0fd631c640 1 --2- 10.20.193.28:0/227068126 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f0fd01155b0 0x7f0fd0175f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:03.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.234+0000 7f0fd631c640 1 --2- 10.20.193.28:0/227068126 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0fd010fdb0 0x7f0fd0114e00 unknown :-1 s=CLOSED pgs=434 gs=1 cs=0 l=1 c_cookie=10414761101282960981 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:03.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.234+0000 7f0fd631c640 1 --2- 10.20.193.28:0/227068126 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f0fd010f3c0 0x7f0fd010f790 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:03.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.234+0000 7f0fd631c640 1 -- 10.20.193.28:0/227068126 >> 10.20.193.28:0/227068126 conn(0x7f0fd00ecc70 msgr2=0x7f0fd010d080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:03.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.234+0000 7f0fd631c640 1 -- 10.20.193.28:0/227068126 shutdown_connections 2026-02-24T09:20:03.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.234+0000 7f0fd631c640 1 -- 10.20.193.28:0/227068126 wait complete. 2026-02-24T09:20:03.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.234+0000 7f0fd631c640 1 Processor -- start 2026-02-24T09:20:03.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.234+0000 7f0fd631c640 1 -- start start 2026-02-24T09:20:03.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.234+0000 7f0fd631c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0fd010f3c0 0x7f0fd00f4d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:03.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.235+0000 7f0fd631c640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f0fd010fdb0 0x7f0fd0175e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:03.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.235+0000 7f0fd631c640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f0fd01155b0 0x7f0fd00f5480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:03.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.235+0000 7f0fd631c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd00fa690 con 0x7f0fd010f3c0 2026-02-24T09:20:03.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.235+0000 7f0fd631c640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd00fa800 con 0x7f0fd01155b0 2026-02-24T09:20:03.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.235+0000 7f0fd631c640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd00fa9c0 con 0x7f0fd010fdb0 2026-02-24T09:20:03.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.235+0000 7f0fd531a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0fd010f3c0 0x7f0fd00f4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:03.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.235+0000 7f0fd531a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0fd010f3c0 0x7f0fd00f4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60000/0 (socket says 10.20.193.28:60000) 2026-02-24T09:20:03.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.235+0000 7f0fd531a640 1 -- 10.20.193.28:0/2137265412 learned_addr learned my addr 10.20.193.28:0/2137265412 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:20:03.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.235+0000 7f0fd5b1b640 1 --2- 10.20.193.28:0/2137265412 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f0fd01155b0 0x7f0fd00f5480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:03.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.235+0000 7f0fd531a640 1 -- 10.20.193.28:0/2137265412 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f0fd010fdb0 msgr2=0x7f0fd0175e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:03.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.235+0000 7f0fd531a640 1 --2- 10.20.193.28:0/2137265412 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f0fd010fdb0 0x7f0fd0175e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:03.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.235+0000 7f0fd531a640 1 -- 10.20.193.28:0/2137265412 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f0fd01155b0 msgr2=0x7f0fd00f5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:03.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.235+0000 7f0fd531a640 1 --2- 10.20.193.28:0/2137265412 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f0fd01155b0 0x7f0fd00f5480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:03.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.235+0000 7f0fd531a640 1 -- 10.20.193.28:0/2137265412 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc4009570 con 0x7f0fd010f3c0 2026-02-24T09:20:03.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.235+0000 7f0fd531a640 1 --2- 10.20.193.28:0/2137265412 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0fd010f3c0 0x7f0fd00f4d80 secure :-1 s=READY pgs=435 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0fc0005db0 tx=0x7f0fc000ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:03.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.235+0000 7f0fbe7fc640 1 -- 10.20.193.28:0/2137265412 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0fc0004500 con 0x7f0fd010f3c0 2026-02-24T09:20:03.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.235+0000 7f0fbe7fc640 1 -- 10.20.193.28:0/2137265412 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f0fc0004d10 con 0x7f0fd010f3c0 2026-02-24T09:20:03.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.235+0000 7f0fbe7fc640 1 -- 10.20.193.28:0/2137265412 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0fc0005280 con 0x7f0fd010f3c0 2026-02-24T09:20:03.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.235+0000 7f0fd631c640 1 -- 10.20.193.28:0/2137265412 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fd00faca0 con 0x7f0fd010f3c0 2026-02-24T09:20:03.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.235+0000 7f0fd631c640 1 -- 10.20.193.28:0/2137265412 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fd00fb120 con 0x7f0fd010f3c0 2026-02-24T09:20:03.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.238+0000 7f0fbe7fc640 1 -- 10.20.193.28:0/2137265412 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7f0fc0005410 con 0x7f0fd010f3c0 2026-02-24T09:20:03.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.240+0000 7f0fbe7fc640 1 --2- 10.20.193.28:0/2137265412 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f0fac0b5840 0x7f0fac0d5cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:03.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.240+0000 7f0fbe7fc640 1 -- 10.20.193.28:0/2137265412 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7f0fc00e7170 con 0x7f0fd010f3c0 2026-02-24T09:20:03.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.240+0000 7f0fd4b19640 1 --2- 10.20.193.28:0/2137265412 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f0fac0b5840 0x7f0fac0d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:03.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.240+0000 7f0fd9c71e00 1 Processor -- start 2026-02-24T09:20:03.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.241+0000 7f0fd4b19640 1 --2- 10.20.193.28:0/2137265412 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f0fac0b5840 0x7f0fac0d5cf0 secure :-1 s=READY pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0fc402f6a0 tx=0x7f0fc4005c30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:03.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.241+0000 7f0fd9c71e00 1 -- start start 2026-02-24T09:20:03.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.241+0000 7f0fd9c71e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x559d84b7ba60 0x559d84c5d200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:03.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.241+0000 7f0fd9c71e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d84c5d740 0x559d84c5db90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:03.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.241+0000 7f0fd9c71e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x559d84ca2270 0x559d84cc2650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:03.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.241+0000 7f0fd9c71e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559d84b72f10 con 0x559d84c5d740 2026-02-24T09:20:03.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.241+0000 7f0fd9c71e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x559d84b6ec40 con 0x559d84b7ba60 2026-02-24T09:20:03.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.241+0000 7f0fd9c71e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x559d84b68da0 con 0x559d84ca2270 2026-02-24T09:20:03.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.241+0000 7f0fd4b19640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d84c5d740 0x559d84c5db90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:03.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.241+0000 7f0fd4b19640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d84c5d740 0x559d84c5db90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60012/0 (socket says 10.20.193.28:60012) 2026-02-24T09:20:03.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.241+0000 7f0fd4b19640 1 -- 10.20.193.28:0/1111853619 learned_addr learned my addr 10.20.193.28:0/1111853619 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:20:03.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.241+0000 7f0fd531a640 1 --2- 10.20.193.28:0/1111853619 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x559d84b7ba60 0x559d84c5d200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:03.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.241+0000 7f0fd4b19640 1 -- 10.20.193.28:0/1111853619 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x559d84ca2270 msgr2=0x559d84cc2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:03.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.241+0000 7f0fd4b19640 1 --2- 10.20.193.28:0/1111853619 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x559d84ca2270 0x559d84cc2650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:03.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.241+0000 7f0fd4b19640 1 -- 10.20.193.28:0/1111853619 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x559d84b7ba60 msgr2=0x559d84c5d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:03.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.241+0000 7f0fd4b19640 1 --2- 10.20.193.28:0/1111853619 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x559d84b7ba60 0x559d84c5d200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:03.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.241+0000 7f0fd4b19640 1 -- 10.20.193.28:0/1111853619 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d84b14340 con 0x559d84c5d740 2026-02-24T09:20:03.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.242+0000 7f0fd4b19640 1 --2- 10.20.193.28:0/1111853619 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d84c5d740 0x559d84c5db90 secure :-1 s=READY pgs=436 gs=1 cs=0 l=1 c_cookie=17261850483034830477 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0fc4002c40 tx=0x7f0fc403d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef8e698e9f32368d server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:03.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.242+0000 7f0f9d7fe640 1 -- 10.20.193.28:0/1111853619 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0fc403d070 con 0x559d84c5d740 2026-02-24T09:20:03.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.242+0000 7f0f9d7fe640 1 -- 10.20.193.28:0/1111853619 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f0fc4002e80 con 0x559d84c5d740 2026-02-24T09:20:03.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.242+0000 7f0f9d7fe640 1 -- 10.20.193.28:0/1111853619 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0fc404f700 con 0x559d84c5d740 2026-02-24T09:20:03.248 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.242+0000 7f0fd9c71e00 1 -- 10.20.193.28:0/1111853619 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d84c5d740 msgr2=0x559d84c5db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:03.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.242+0000 7f0fd9c71e00 1 --2- 10.20.193.28:0/1111853619 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d84c5d740 0x559d84c5db90 secure :-1 s=READY pgs=436 gs=1 cs=0 l=1 c_cookie=17261850483034830477 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0fc4002c40 tx=0x7f0fc403d000 comp rx=0 tx=0).stop 2026-02-24T09:20:03.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.242+0000 7f0fd9c71e00 1 -- 10.20.193.28:0/1111853619 shutdown_connections 2026-02-24T09:20:03.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.242+0000 7f0fd9c71e00 1 --2- 10.20.193.28:0/1111853619 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x559d84ca2270 0x559d84cc2650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:03.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.242+0000 7f0fd9c71e00 1 --2- 10.20.193.28:0/1111853619 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d84c5d740 0x559d84c5db90 unknown :-1 s=CLOSED pgs=436 gs=1 cs=0 l=1 c_cookie=17261850483034830477 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:03.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.242+0000 7f0fd9c71e00 1 --2- 10.20.193.28:0/1111853619 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x559d84b7ba60 0x559d84c5d200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:03.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.242+0000 7f0fd9c71e00 1 -- 10.20.193.28:0/1111853619 >> 10.20.193.28:0/1111853619 conn(0x559d84bf7490 msgr2=0x559d84c5bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:03.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.242+0000 7f0fd9c71e00 1 -- 10.20.193.28:0/1111853619 shutdown_connections 2026-02-24T09:20:03.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.242+0000 7f0fd9c71e00 1 -- 10.20.193.28:0/1111853619 wait complete. 2026-02-24T09:20:03.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.244+0000 7f0fd9c71e00 1 -- start start 2026-02-24T09:20:03.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.244+0000 7f0fd9c71e00 1 Processor -- start 2026-02-24T09:20:03.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.244+0000 7f0fd9c71e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x559d84b7ba60 0x559d84cb9810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:03.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.244+0000 7f0fd9c71e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x559d84c5d740 0x559d84cb9d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:03.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.244+0000 7f0fd9c71e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d84ca2270 0x559d84cbed40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:03.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.244+0000 7f0fd9c71e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559d84cbf280 con 0x559d84ca2270 2026-02-24T09:20:03.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.244+0000 7f0fd9c71e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x559d84cbf3f0 con 0x559d84b7ba60 2026-02-24T09:20:03.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.244+0000 7f0fd9c71e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x559d84cbf5b0 con 0x559d84c5d740 2026-02-24T09:20:03.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.245+0000 7f0fd5b1b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d84ca2270 0x559d84cbed40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:03.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.245+0000 7f0fd5b1b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d84ca2270 0x559d84cbed40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60024/0 (socket says 10.20.193.28:60024) 2026-02-24T09:20:03.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.245+0000 7f0fd5b1b640 1 -- 10.20.193.28:0/2615121453 learned_addr learned my addr 10.20.193.28:0/2615121453 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:20:03.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.245+0000 7f0fd531a640 1 --2- 10.20.193.28:0/2615121453 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x559d84b7ba60 0x559d84cb9810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:03.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.245+0000 7f0fd4b19640 1 --2- 10.20.193.28:0/2615121453 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x559d84c5d740 0x559d84cb9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:03.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.245+0000 7f0fd5b1b640 1 -- 10.20.193.28:0/2615121453 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x559d84c5d740 msgr2=0x559d84cb9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:03.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.245+0000 7f0fd5b1b640 1 --2- 10.20.193.28:0/2615121453 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x559d84c5d740 0x559d84cb9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:03.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.245+0000 7f0fd5b1b640 1 -- 10.20.193.28:0/2615121453 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x559d84b7ba60 msgr2=0x559d84cb9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:03.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.245+0000 7f0fd5b1b640 1 --2- 10.20.193.28:0/2615121453 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x559d84b7ba60 0x559d84cb9810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:03.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.245+0000 7f0fd5b1b640 1 -- 10.20.193.28:0/2615121453 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d84aecce0 con 0x559d84ca2270 2026-02-24T09:20:03.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.245+0000 7f0fd531a640 1 --2- 10.20.193.28:0/2615121453 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x559d84b7ba60 0x559d84cb9810 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:20:03.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.245+0000 7f0fd5b1b640 1 --2- 10.20.193.28:0/2615121453 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d84ca2270 0x559d84cbed40 secure :-1 s=READY pgs=437 gs=2 cs=0 l=1 c_cookie=2898083657392712091 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0fcc003a00 tx=0x7f0fcc003ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28380fbb5041e99b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:03.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.245+0000 7f0f8a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:20:03.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.245+0000 7f0f8a7fc640 1 -- 10.20.193.28:0/2615121453 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0fcc012440 con 0x559d84ca2270 2026-02-24T09:20:03.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.245+0000 7f0f8a7fc640 1 -- 10.20.193.28:0/2615121453 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f0fcc012a60 con 0x559d84ca2270 2026-02-24T09:20:03.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.245+0000 7f0f8a7fc640 1 -- 10.20.193.28:0/2615121453 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0fcc01ac00 con 0x559d84ca2270 2026-02-24T09:20:03.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.245+0000 7f0fd9c71e00 1 -- 10.20.193.28:0/2615121453 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fd01767f0 con 0x559d84ca2270 2026-02-24T09:20:03.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.245+0000 7f0f8a7fc640 1 -- 10.20.193.28:0/2615121453 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7f0fcc0113d0 con 0x559d84ca2270 2026-02-24T09:20:03.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.246+0000 7f0f8a7fc640 10 client.15720 inactive, discarding osd_map(96..96 src has 1..96) 2026-02-24T09:20:03.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.246+0000 7f0fd9c71e00 10 client.15720 _ll_register_callbacks cb 0x559d84af3980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:03.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.246+0000 7f0fd9c71e00 1 -- 10.20.193.28:0/2615121453 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559d84808520 con 0x559d84ca2270 2026-02-24T09:20:03.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.246+0000 7f0f8a7fc640 1 -- 10.20.193.28:0/2615121453 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f0fcc012bd0 con 0x559d84ca2270 2026-02-24T09:20:03.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.246+0000 7f0fd9c71e00 10 client.15720 fetch_fsmap learned FSMap version 23 2026-02-24T09:20:03.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.246+0000 7f0fd9c71e00 1 -- 10.20.193.28:0/2615121453 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x559d84afe5b0 con 0x559d84ca2270 2026-02-24T09:20:03.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.246+0000 7f0f8a7fc640 1 -- 10.20.193.28:0/2615121453 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f0fcc018020 con 0x559d84ca2270 2026-02-24T09:20:03.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.246+0000 7f0fd9c71e00 10 client.15720 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:20:03.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.246+0000 7f0fd9c71e00 10 client.15720 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:20:03.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.246+0000 7f0fd9c71e00 20 client.15720 populate_metadata read hostname 'trial028' 2026-02-24T09:20:03.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.246+0000 7f0fd9c71e00 1 --2- 10.20.193.28:0/2615121453 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x559d84c9f780 0x559d84c9fc20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:03.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.246+0000 7f0fd9c71e00 4 client.15720 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:20:03.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.246+0000 7f0fd9c71e00 1 -- 10.20.193.28:0/2615121453 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d84b3a9d0 con 0x559d84c9f780 2026-02-24T09:20:03.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.246+0000 7f0fd531a640 1 --2- 10.20.193.28:0/2615121453 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x559d84c9f780 0x559d84c9fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:03.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.247+0000 7f0fd531a640 1 --2- 10.20.193.28:0/2615121453 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x559d84c9f780 0x559d84c9fc20 crc :-1 s=READY pgs=46 gs=4 cs=0 l=0 c_cookie=3027267672441080089 s_cookie=2864785127404089670 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a0303e8afdfc919 server_cookie=27c1c2e524be3146 in_seq=0 out_seq=0 2026-02-24T09:20:03.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.247+0000 7f0f8a7fc640 10 client.15720 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:20:03.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.248+0000 7f0f8a7fc640 1 -- 10.20.193.28:0/2615121453 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x559d84b3a9d0 con 0x559d84c9f780 2026-02-24T09:20:03.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.248+0000 7f0f8a7fc640 10 client.15720 handle_command_reply: tid=0 2026-02-24T09:20:03.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.248+0000 7f0fd9c71e00 1 client.15720 shutdown 2026-02-24T09:20:03.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.248+0000 7f0fd9c71e00 1 -- 10.20.193.28:0/2615121453 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d84ca2270 msgr2=0x559d84cbed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:03.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.248+0000 7f0fd9c71e00 1 --2- 10.20.193.28:0/2615121453 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d84ca2270 0x559d84cbed40 secure :-1 s=READY pgs=437 gs=2 cs=0 l=1 c_cookie=2898083657392712091 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0fcc003a00 tx=0x7f0fcc003ed0 comp rx=0 tx=0).stop 2026-02-24T09:20:03.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.248+0000 7f0fd9c71e00 1 -- 10.20.193.28:0/2615121453 shutdown_connections 2026-02-24T09:20:03.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.248+0000 7f0fd9c71e00 1 --2- 10.20.193.28:0/2615121453 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x559d84c9f780 0x559d84c9fc20 crc :-1 s=READY pgs=46 gs=4 cs=0 l=0 c_cookie=3027267672441080089 s_cookie=2864785127404089670 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:03.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.248+0000 7f0fd9c71e00 1 --2- 10.20.193.28:0/2615121453 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d84ca2270 0x559d84cbed40 unknown :-1 s=CLOSED pgs=437 gs=2 cs=0 l=1 c_cookie=2898083657392712091 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:03.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.248+0000 7f0fd9c71e00 1 --2- 10.20.193.28:0/2615121453 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x559d84c5d740 0x559d84cb9d50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:03.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.248+0000 7f0fd9c71e00 1 --2- 10.20.193.28:0/2615121453 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x559d84b7ba60 0x559d84cb9810 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:03.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.248+0000 7f0f8a7fc640 0 client.15720 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:20:03.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.248+0000 7f0fd9c71e00 1 -- 10.20.193.28:0/2615121453 >> 10.20.193.28:0/2615121453 conn(0x559d84bf7490 msgr2=0x559d84c5b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:03.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.248+0000 7f0fd9c71e00 1 -- 10.20.193.28:0/2615121453 shutdown_connections 2026-02-24T09:20:03.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.248+0000 7f0fd9c71e00 1 -- 10.20.193.28:0/2615121453 wait complete. 2026-02-24T09:20:03.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.248+0000 7f0fd9c71e00 20 client.15720 trim_cache size 0 max 16384 2026-02-24T09:20:03.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.256+0000 7f0fd9c71e00 1 Processor -- start 2026-02-24T09:20:03.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.256+0000 7f0fd9c71e00 1 -- start start 2026-02-24T09:20:03.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.256+0000 7f0fd9c71e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x559d84b7ba60 0x559d84ca12f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:03.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.256+0000 7f0fd9c71e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x559d84c5d740 0x559d84ca1830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:03.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.256+0000 7f0fd9c71e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d84ca2270 0x559d84c9d2a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:03.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.256+0000 7f0fd9c71e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559d84b669d0 con 0x559d84ca2270 2026-02-24T09:20:03.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.256+0000 7f0fd9c71e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x559d848a7f10 con 0x559d84c5d740 2026-02-24T09:20:03.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.256+0000 7f0fd9c71e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x559d84be5200 con 0x559d84b7ba60 2026-02-24T09:20:03.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.256+0000 7f0fd5b1b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d84ca2270 0x559d84c9d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:03.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.256+0000 7f0fd5b1b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d84ca2270 0x559d84c9d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60028/0 (socket says 10.20.193.28:60028) 2026-02-24T09:20:03.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.256+0000 7f0fd5b1b640 1 -- 10.20.193.28:0/3782899608 learned_addr learned my addr 10.20.193.28:0/3782899608 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:20:03.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.256+0000 7f0fd4b19640 1 --2- 10.20.193.28:0/3782899608 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x559d84c5d740 0x559d84ca1830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:03.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.256+0000 7f0fd531a640 1 --2- 10.20.193.28:0/3782899608 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x559d84b7ba60 0x559d84ca12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:03.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.256+0000 7f0fd5b1b640 1 -- 10.20.193.28:0/3782899608 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x559d84b7ba60 msgr2=0x559d84ca12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:03.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.256+0000 7f0fd5b1b640 1 --2- 10.20.193.28:0/3782899608 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x559d84b7ba60 0x559d84ca12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:03.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.256+0000 7f0fd5b1b640 1 -- 10.20.193.28:0/3782899608 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x559d84c5d740 msgr2=0x559d84ca1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:03.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.256+0000 7f0fd5b1b640 1 --2- 10.20.193.28:0/3782899608 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x559d84c5d740 0x559d84ca1830 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:03.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.256+0000 7f0fd5b1b640 1 -- 10.20.193.28:0/3782899608 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d84cabd60 con 0x559d84ca2270 2026-02-24T09:20:03.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.257+0000 7f0fd5b1b640 1 --2- 10.20.193.28:0/3782899608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d84ca2270 0x559d84c9d2a0 secure :-1 s=READY pgs=438 gs=2 cs=0 l=1 c_cookie=3938075204752769526 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0fcc011830 tx=0x7f0fcc01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36a6da88ae1001f6 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:03.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.257+0000 7f0f9cffd640 1 -- 10.20.193.28:0/3782899608 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0fcc0113d0 con 0x559d84ca2270 2026-02-24T09:20:03.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.257+0000 7f0f9cffd640 1 -- 10.20.193.28:0/3782899608 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x559d84808520 con 0x559d84ca2270 2026-02-24T09:20:03.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.257+0000 7f0f9cffd640 1 -- 10.20.193.28:0/3782899608 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0fcc0113d0 con 0x559d84ca2270 2026-02-24T09:20:03.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.257+0000 7f0fd9c71e00 1 -- 10.20.193.28:0/3782899608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d84ca2270 msgr2=0x559d84c9d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:03.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.257+0000 7f0fd9c71e00 1 --2- 10.20.193.28:0/3782899608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d84ca2270 0x559d84c9d2a0 secure :-1 s=READY pgs=438 gs=2 cs=0 l=1 c_cookie=3938075204752769526 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0fcc011830 tx=0x7f0fcc01e000 comp rx=0 tx=0).stop 2026-02-24T09:20:03.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.257+0000 7f0fd9c71e00 1 -- 10.20.193.28:0/3782899608 shutdown_connections 2026-02-24T09:20:03.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.257+0000 7f0fd9c71e00 1 --2- 10.20.193.28:0/3782899608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d84ca2270 0x559d84c9d2a0 unknown :-1 s=CLOSED pgs=438 gs=2 cs=0 l=1 c_cookie=3938075204752769526 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:03.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.257+0000 7f0fd9c71e00 1 --2- 10.20.193.28:0/3782899608 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x559d84c5d740 0x559d84ca1830 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:03.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.257+0000 7f0fd9c71e00 1 --2- 10.20.193.28:0/3782899608 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x559d84b7ba60 0x559d84ca12f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:03.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.257+0000 7f0fd9c71e00 1 -- 10.20.193.28:0/3782899608 >> 10.20.193.28:0/3782899608 conn(0x559d84bf7490 msgr2=0x559d84c9cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:03.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.257+0000 7f0fd9c71e00 1 -- 10.20.193.28:0/3782899608 shutdown_connections 2026-02-24T09:20:03.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.257+0000 7f0fd9c71e00 1 -- 10.20.193.28:0/3782899608 wait complete. 2026-02-24T09:20:03.264 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.258+0000 7f0fd9c71e00 1 -- start start 2026-02-24T09:20:03.264 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.258+0000 7f0fd9c71e00 1 Processor -- start 2026-02-24T09:20:03.264 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.258+0000 7f0fd9c71e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d84b7ba60 0x559d84c3fbc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:03.264 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.258+0000 7f0fd9c71e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x559d84c5d740 0x559d84c40100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:03.264 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.258+0000 7f0fd9c71e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x559d84ca2270 0x559d84c40640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:03.264 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.258+0000 7f0fd9c71e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559d84c414f0 con 0x559d84b7ba60 2026-02-24T09:20:03.264 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.258+0000 7f0fd9c71e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x559d84d08150 con 0x559d84ca2270 2026-02-24T09:20:03.264 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.258+0000 7f0fd9c71e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x559d84d08310 con 0x559d84c5d740 2026-02-24T09:20:03.264 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.258+0000 7f0fd531a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d84b7ba60 0x559d84c3fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:03.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.258+0000 7f0fd531a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d84b7ba60 0x559d84c3fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60036/0 (socket says 10.20.193.28:60036) 2026-02-24T09:20:03.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.258+0000 7f0fd531a640 1 -- 10.20.193.28:0/2339602525 learned_addr learned my addr 10.20.193.28:0/2339602525 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:20:03.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.259+0000 7f0fd5b1b640 1 --2- 10.20.193.28:0/2339602525 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x559d84ca2270 0x559d84c40640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:03.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.259+0000 7f0fd4b19640 1 --2- 10.20.193.28:0/2339602525 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x559d84c5d740 0x559d84c40100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:03.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.259+0000 7f0fd531a640 1 -- 10.20.193.28:0/2339602525 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x559d84c5d740 msgr2=0x559d84c40100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:03.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.259+0000 7f0fd531a640 1 --2- 10.20.193.28:0/2339602525 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x559d84c5d740 0x559d84c40100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:03.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.259+0000 7f0fd531a640 1 -- 10.20.193.28:0/2339602525 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x559d84ca2270 msgr2=0x559d84c40640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:03.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.259+0000 7f0fd531a640 1 --2- 10.20.193.28:0/2339602525 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x559d84ca2270 0x559d84c40640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:03.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.259+0000 7f0fd531a640 1 -- 10.20.193.28:0/2339602525 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d84af9030 con 0x559d84b7ba60 2026-02-24T09:20:03.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.259+0000 7f0fd531a640 1 --2- 10.20.193.28:0/2339602525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d84b7ba60 0x559d84c3fbc0 secure :-1 s=READY pgs=439 gs=1 cs=0 l=1 c_cookie=5646333296159840644 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0fc0009610 tx=0x7f0fc000df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e5bce37a1115984 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:03.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.259+0000 7f0f8a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:20:03.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.259+0000 7f0f8a7fc640 1 -- 10.20.193.28:0/2339602525 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0fc0076070 con 0x559d84b7ba60 2026-02-24T09:20:03.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.259+0000 7f0f8a7fc640 1 -- 10.20.193.28:0/2339602525 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f0fc0004e80 con 0x559d84b7ba60 2026-02-24T09:20:03.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.259+0000 7f0f8a7fc640 1 -- 10.20.193.28:0/2339602525 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0fc00acfd0 con 0x559d84b7ba60 2026-02-24T09:20:03.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.259+0000 7f0fd9c71e00 1 -- 10.20.193.28:0/2339602525 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d84afe5b0 con 0x559d84b7ba60 2026-02-24T09:20:03.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.259+0000 7f0f8a7fc640 1 -- 10.20.193.28:0/2339602525 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7f0fc00b82f0 con 0x559d84b7ba60 2026-02-24T09:20:03.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.259+0000 7f0f8a7fc640 10 client.15726 inactive, discarding osd_map(96..96 src has 1..96) 2026-02-24T09:20:03.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.259+0000 7f0fd9c71e00 10 client.15726 _ll_register_callbacks cb 0x559d84af3980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:03.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.259+0000 7f0fd9c71e00 1 -- 10.20.193.28:0/2339602525 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559d84b99d30 con 0x559d84b7ba60 2026-02-24T09:20:03.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.260+0000 7f0f8a7fc640 1 -- 10.20.193.28:0/2339602525 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f0fc0009940 con 0x559d84b7ba60 2026-02-24T09:20:03.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.260+0000 7f0fd9c71e00 10 client.15726 fetch_fsmap learned FSMap version 23 2026-02-24T09:20:03.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.260+0000 7f0fd9c71e00 1 -- 10.20.193.28:0/2339602525 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x559d84aed010 con 0x559d84b7ba60 2026-02-24T09:20:03.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.260+0000 7f0f8a7fc640 1 -- 10.20.193.28:0/2339602525 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f0fc0072260 con 0x559d84b7ba60 2026-02-24T09:20:03.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.260+0000 7f0fd9c71e00 10 client.15726 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:20:03.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.260+0000 7f0fd9c71e00 10 client.15726 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:20:03.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.260+0000 7f0fd9c71e00 20 client.15726 populate_metadata read hostname 'trial028' 2026-02-24T09:20:03.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.260+0000 7f0fd9c71e00 1 --2- 10.20.193.28:0/2339602525 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x559d84d503c0 0x559d84d70870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:03.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.260+0000 7f0fd9c71e00 4 client.15726 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-24T09:20:03.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.260+0000 7f0fd9c71e00 1 -- 10.20.193.28:0/2339602525 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559d8484c640 con 0x559d84d503c0 2026-02-24T09:20:03.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.260+0000 7f0fd4b19640 1 --2- 10.20.193.28:0/2339602525 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x559d84d503c0 0x559d84d70870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:03.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.261+0000 7f0fd4b19640 1 --2- 10.20.193.28:0/2339602525 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x559d84d503c0 0x559d84d70870 crc :-1 s=READY pgs=47 gs=4 cs=0 l=0 c_cookie=17038664083124077990 s_cookie=10566882691078759504 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec757eb579d145a6 server_cookie=92a51bd260f92450 in_seq=0 out_seq=0 2026-02-24T09:20:03.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.261+0000 7f0f8a7fc640 10 client.15726 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:20:03.269 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.267+0000 7f0f8a7fc640 1 -- 10.20.193.28:0/2339602525 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559d8484c640 con 0x559d84d503c0 2026-02-24T09:20:03.269 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.267+0000 7f0f8a7fc640 10 client.15726 handle_command_reply: tid=0 2026-02-24T09:20:03.269 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.267+0000 7f0fd9c71e00 1 client.15726 shutdown 2026-02-24T09:20:03.269 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.267+0000 7f0fd9c71e00 1 -- 10.20.193.28:0/2339602525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d84b7ba60 msgr2=0x559d84c3fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:03.269 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.267+0000 7f0fd9c71e00 1 --2- 10.20.193.28:0/2339602525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d84b7ba60 0x559d84c3fbc0 secure :-1 s=READY pgs=439 gs=1 cs=0 l=1 c_cookie=5646333296159840644 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0fc0009610 tx=0x7f0fc000df30 comp rx=0 tx=0).stop 2026-02-24T09:20:03.269 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.267+0000 7f0fd9c71e00 1 -- 10.20.193.28:0/2339602525 shutdown_connections 2026-02-24T09:20:03.269 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.267+0000 7f0fd9c71e00 1 --2- 10.20.193.28:0/2339602525 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x559d84d503c0 0x559d84d70870 crc :-1 s=READY pgs=47 gs=4 cs=0 l=0 c_cookie=17038664083124077990 s_cookie=10566882691078759504 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:03.269 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.267+0000 7f0fd9c71e00 1 --2- 10.20.193.28:0/2339602525 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x559d84ca2270 0x559d84c40640 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:03.269 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.267+0000 7f0fd9c71e00 1 --2- 10.20.193.28:0/2339602525 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x559d84c5d740 0x559d84c40100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:03.270 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.267+0000 7f0fd9c71e00 1 --2- 10.20.193.28:0/2339602525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d84b7ba60 0x559d84c3fbc0 unknown :-1 s=CLOSED pgs=439 gs=1 cs=0 l=1 c_cookie=5646333296159840644 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:03.270 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.267+0000 7f0fd9c71e00 1 -- 10.20.193.28:0/2339602525 >> 10.20.193.28:0/2339602525 conn(0x559d84bf7490 msgr2=0x559d84c9d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:03.270 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.267+0000 7f0f8a7fc640 0 client.15726 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:20:03.270 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.267+0000 7f0fd9c71e00 1 -- 10.20.193.28:0/2339602525 shutdown_connections 2026-02-24T09:20:03.270 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.267+0000 7f0fd9c71e00 1 -- 10.20.193.28:0/2339602525 wait complete. 2026-02-24T09:20:03.270 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.267+0000 7f0fd9c71e00 20 client.15726 trim_cache size 0 max 16384 2026-02-24T09:20:03.270 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-24T09:20:03.270 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-24T09:20:03.271 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-24T09:20:03.271 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-24T09:20:03.271 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.267+0000 7f0fd631c640 1 -- 10.20.193.28:0/2137265412 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f0fac0b5840 msgr2=0x7f0fac0d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:03.271 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.267+0000 7f0fd631c640 1 --2- 10.20.193.28:0/2137265412 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f0fac0b5840 0x7f0fac0d5cf0 secure :-1 s=READY pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0fc402f6a0 tx=0x7f0fc4005c30 comp rx=0 tx=0).stop 2026-02-24T09:20:03.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.267+0000 7f0fd631c640 1 -- 10.20.193.28:0/2137265412 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0fd010f3c0 msgr2=0x7f0fd00f4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:03.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.267+0000 7f0fd631c640 1 --2- 10.20.193.28:0/2137265412 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0fd010f3c0 0x7f0fd00f4d80 secure :-1 s=READY pgs=435 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0fc0005db0 tx=0x7f0fc000ddf0 comp rx=0 tx=0).stop 2026-02-24T09:20:03.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.267+0000 7f0fd631c640 1 -- 10.20.193.28:0/2137265412 shutdown_connections 2026-02-24T09:20:03.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.267+0000 7f0fd631c640 1 --2- 10.20.193.28:0/2137265412 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f0fac0b5840 0x7f0fac0d5cf0 unknown :-1 s=CLOSED pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:03.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.267+0000 7f0fd631c640 1 --2- 10.20.193.28:0/2137265412 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f0fd01155b0 0x7f0fd00f5480 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:03.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.267+0000 7f0fd631c640 1 --2- 10.20.193.28:0/2137265412 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f0fd010fdb0 0x7f0fd0175e80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:03.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.267+0000 7f0fd631c640 1 --2- 10.20.193.28:0/2137265412 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0fd010f3c0 0x7f0fd00f4d80 unknown :-1 s=CLOSED pgs=435 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:03.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.267+0000 7f0fd631c640 1 -- 10.20.193.28:0/2137265412 >> 10.20.193.28:0/2137265412 conn(0x7f0fd00ecc70 msgr2=0x7f0fd010da10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:03.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.267+0000 7f0fd631c640 1 -- 10.20.193.28:0/2137265412 shutdown_connections 2026-02-24T09:20:03.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:03.268+0000 7f0fd631c640 1 -- 10.20.193.28:0/2137265412 wait complete. 2026-02-24T09:20:04.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:04 trial159 ceph-mon[44242]: pgmap v276: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 8.2 TiB / 8.2 TiB avail; 85 MiB/s rd, 36 MiB/s wr, 90 op/s 2026-02-24T09:20:04.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:04 trial028 ceph-mon[40371]: pgmap v276: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 8.2 TiB / 8.2 TiB avail; 85 MiB/s rd, 36 MiB/s wr, 90 op/s 2026-02-24T09:20:04.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:04 trial074 ceph-mon[44412]: pgmap v276: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 8.2 TiB / 8.2 TiB avail; 85 MiB/s rd, 36 MiB/s wr, 90 op/s 2026-02-24T09:20:05.068 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-24T09:20:05.068 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-24T09:20:05.068 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-24T09:20:05.068 INFO:tasks.workunit.client.0.trial028.stdout:iozone test complete. 2026-02-24T09:20:05.073 INFO:tasks.workunit.client.0.trial028.stderr:+ iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2026-02-24T09:20:05.108 INFO:tasks.workunit.client.0.trial028.stdout: Iozone: Performance Test of File I/O 2026-02-24T09:20:05.108 INFO:tasks.workunit.client.0.trial028.stdout: Version $Revision: 3.494 $ 2026-02-24T09:20:05.108 INFO:tasks.workunit.client.0.trial028.stdout: Compiled for 64 bit mode. 2026-02-24T09:20:05.108 INFO:tasks.workunit.client.0.trial028.stdout: Build: linux-AMD64 2026-02-24T09:20:05.108 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-24T09:20:05.108 INFO:tasks.workunit.client.0.trial028.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2026-02-24T09:20:05.109 INFO:tasks.workunit.client.0.trial028.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2026-02-24T09:20:05.109 INFO:tasks.workunit.client.0.trial028.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2026-02-24T09:20:05.109 INFO:tasks.workunit.client.0.trial028.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2026-02-24T09:20:05.109 INFO:tasks.workunit.client.0.trial028.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2026-02-24T09:20:05.109 INFO:tasks.workunit.client.0.trial028.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2026-02-24T09:20:05.109 INFO:tasks.workunit.client.0.trial028.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2026-02-24T09:20:05.109 INFO:tasks.workunit.client.0.trial028.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2026-02-24T09:20:05.109 INFO:tasks.workunit.client.0.trial028.stdout: Alexey Skidanov, Sudhir Kumar. 2026-02-24T09:20:05.109 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-24T09:20:05.109 INFO:tasks.workunit.client.0.trial028.stdout: Run began: Tue Feb 24 09:20:05 2026 2026-02-24T09:20:05.109 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-24T09:20:05.109 INFO:tasks.workunit.client.0.trial028.stdout: Include close in write timing 2026-02-24T09:20:05.110 INFO:tasks.workunit.client.0.trial028.stdout: Include fsync in write timing 2026-02-24T09:20:05.110 INFO:tasks.workunit.client.0.trial028.stdout: File size set to 10485760 kB 2026-02-24T09:20:05.110 INFO:tasks.workunit.client.0.trial028.stdout: Record Size 1024 kB 2026-02-24T09:20:05.110 INFO:tasks.workunit.client.0.trial028.stdout: Command line used: iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2026-02-24T09:20:05.110 INFO:tasks.workunit.client.0.trial028.stdout: Output is in kBytes/sec 2026-02-24T09:20:05.110 INFO:tasks.workunit.client.0.trial028.stdout: Time Resolution = 0.000001 seconds. 2026-02-24T09:20:05.110 INFO:tasks.workunit.client.0.trial028.stdout: Processor cache size set to 1024 kBytes. 2026-02-24T09:20:05.110 INFO:tasks.workunit.client.0.trial028.stdout: Processor cache line size set to 32 bytes. 2026-02-24T09:20:05.110 INFO:tasks.workunit.client.0.trial028.stdout: File stride size set to 17 * record size. 2026-02-24T09:20:05.110 INFO:tasks.workunit.client.0.trial028.stdout: Throughput test with 1 process 2026-02-24T09:20:05.111 INFO:tasks.workunit.client.0.trial028.stdout: Each process writes a 10485760 kByte file in 1024 kByte records 2026-02-24T09:20:06.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:06 trial159 ceph-mon[44242]: pgmap v277: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 8.2 TiB / 8.2 TiB avail; 85 MiB/s rd, 6.4 MiB/s wr, 52 op/s 2026-02-24T09:20:06.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:06 trial028 ceph-mon[40371]: pgmap v277: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 8.2 TiB / 8.2 TiB avail; 85 MiB/s rd, 6.4 MiB/s wr, 52 op/s 2026-02-24T09:20:06.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:06 trial074 ceph-mon[44412]: pgmap v277: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 8.2 TiB / 8.2 TiB avail; 85 MiB/s rd, 6.4 MiB/s wr, 52 op/s 2026-02-24T09:20:08.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:08 trial159 ceph-mon[44242]: pgmap v278: 97 pgs: 97 active+clean; 2.1 GiB data, 6.6 GiB used, 8.2 TiB / 8.2 TiB avail; 75 MiB/s rd, 9.0 MiB/s wr, 51 op/s 2026-02-24T09:20:08.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:08 trial028 ceph-mon[40371]: pgmap v278: 97 pgs: 97 active+clean; 2.1 GiB data, 6.6 GiB used, 8.2 TiB / 8.2 TiB avail; 75 MiB/s rd, 9.0 MiB/s wr, 51 op/s 2026-02-24T09:20:08.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:08 trial074 ceph-mon[44412]: pgmap v278: 97 pgs: 97 active+clean; 2.1 GiB data, 6.6 GiB used, 8.2 TiB / 8.2 TiB avail; 75 MiB/s rd, 9.0 MiB/s wr, 51 op/s 2026-02-24T09:20:10.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:10 trial028 ceph-mon[40371]: pgmap v279: 97 pgs: 97 active+clean; 2.6 GiB data, 7.9 GiB used, 8.2 TiB / 8.2 TiB avail; 34 MiB/s rd, 53 MiB/s wr, 62 op/s 2026-02-24T09:20:10.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:10 trial074 ceph-mon[44412]: pgmap v279: 97 pgs: 97 active+clean; 2.6 GiB data, 7.9 GiB used, 8.2 TiB / 8.2 TiB avail; 34 MiB/s rd, 53 MiB/s wr, 62 op/s 2026-02-24T09:20:11.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:10 trial159 ceph-mon[44242]: pgmap v279: 97 pgs: 97 active+clean; 2.6 GiB data, 7.9 GiB used, 8.2 TiB / 8.2 TiB avail; 34 MiB/s rd, 53 MiB/s wr, 62 op/s 2026-02-24T09:20:12.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:12 trial028 ceph-mon[40371]: pgmap v280: 97 pgs: 97 active+clean; 3.3 GiB data, 9.7 GiB used, 8.2 TiB / 8.2 TiB avail; 5.4 MiB/s rd, 109 MiB/s wr, 77 op/s 2026-02-24T09:20:12.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:12 trial074 ceph-mon[44412]: pgmap v280: 97 pgs: 97 active+clean; 3.3 GiB data, 9.7 GiB used, 8.2 TiB / 8.2 TiB avail; 5.4 MiB/s rd, 109 MiB/s wr, 77 op/s 2026-02-24T09:20:13.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:12 trial159 ceph-mon[44242]: pgmap v280: 97 pgs: 97 active+clean; 3.3 GiB data, 9.7 GiB used, 8.2 TiB / 8.2 TiB avail; 5.4 MiB/s rd, 109 MiB/s wr, 77 op/s 2026-02-24T09:20:13.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:13 trial028 ceph-mon[40371]: pgmap v281: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 8.2 TiB / 8.2 TiB avail; 25 KiB/s rd, 173 MiB/s wr, 90 op/s 2026-02-24T09:20:13.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:13 trial074 ceph-mon[44412]: pgmap v281: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 8.2 TiB / 8.2 TiB avail; 25 KiB/s rd, 173 MiB/s wr, 90 op/s 2026-02-24T09:20:14.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:13 trial159 ceph-mon[44242]: pgmap v281: 97 pgs: 97 active+clean; 4.0 GiB data, 12 GiB used, 8.2 TiB / 8.2 TiB avail; 25 KiB/s rd, 173 MiB/s wr, 90 op/s 2026-02-24T09:20:16.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.342+0000 7f8a79330640 1 -- 10.20.193.28:0/4159044466 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a740607c0 msgr2=0x7f8a74060b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:16.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.342+0000 7f8a79330640 1 --2- 10.20.193.28:0/4159044466 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a740607c0 0x7f8a74060b90 secure :-1 s=READY pgs=440 gs=1 cs=0 l=1 c_cookie=2053716114727651429 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a60009950 tx=0x7f8a6002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.342+0000 7f8a79330640 1 -- 10.20.193.28:0/4159044466 shutdown_connections 2026-02-24T09:20:16.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.342+0000 7f8a79330640 1 --2- 10.20.193.28:0/4159044466 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8a74155910 0x7f8a74175cf0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.342+0000 7f8a79330640 1 --2- 10.20.193.28:0/4159044466 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8a740610d0 0x7f8a741553d0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.342+0000 7f8a79330640 1 --2- 10.20.193.28:0/4159044466 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a740607c0 0x7f8a74060b90 unknown :-1 s=CLOSED pgs=440 gs=1 cs=0 l=1 c_cookie=2053716114727651429 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.342+0000 7f8a79330640 1 -- 10.20.193.28:0/4159044466 >> 10.20.193.28:0/4159044466 conn(0x7f8a740eaa80 msgr2=0x7f8a7410ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:16.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.342+0000 7f8a79330640 1 -- 10.20.193.28:0/4159044466 shutdown_connections 2026-02-24T09:20:16.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.342+0000 7f8a79330640 1 -- 10.20.193.28:0/4159044466 wait complete. 2026-02-24T09:20:16.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.343+0000 7f8a79330640 1 Processor -- start 2026-02-24T09:20:16.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.343+0000 7f8a79330640 1 -- start start 2026-02-24T09:20:16.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.343+0000 7f8a79330640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8a740607c0 0x7f8a74162200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:16.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.343+0000 7f8a79330640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a740610d0 0x7f8a74162740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:16.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.343+0000 7f8a79330640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8a74155910 0x7f8a74167b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:16.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.343+0000 7f8a79330640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8a74168130 con 0x7f8a740610d0 2026-02-24T09:20:16.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.343+0000 7f8a79330640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f8a741682a0 con 0x7f8a740607c0 2026-02-24T09:20:16.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.343+0000 7f8a79330640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8a74168460 con 0x7f8a74155910 2026-02-24T09:20:16.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.343+0000 7f8a737fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a740610d0 0x7f8a74162740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:16.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.343+0000 7f8a737fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a740610d0 0x7f8a74162740 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33744/0 (socket says 10.20.193.28:33744) 2026-02-24T09:20:16.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.343+0000 7f8a737fe640 1 -- 10.20.193.28:0/1574059630 learned_addr learned my addr 10.20.193.28:0/1574059630 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:20:16.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.345+0000 7f8a78b2f640 1 --2- 10.20.193.28:0/1574059630 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8a74155910 0x7f8a74167b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:16.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.345+0000 7f8a737fe640 1 -- 10.20.193.28:0/1574059630 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8a74155910 msgr2=0x7f8a74167b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:16.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.345+0000 7f8a737fe640 1 --2- 10.20.193.28:0/1574059630 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8a74155910 0x7f8a74167b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.345+0000 7f8a737fe640 1 -- 10.20.193.28:0/1574059630 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8a740607c0 msgr2=0x7f8a74162200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:16.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.345+0000 7f8a737fe640 1 --2- 10.20.193.28:0/1574059630 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8a740607c0 0x7f8a74162200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.345+0000 7f8a737fe640 1 -- 10.20.193.28:0/1574059630 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a60009570 con 0x7f8a740610d0 2026-02-24T09:20:16.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.348+0000 7f8a737fe640 1 --2- 10.20.193.28:0/1574059630 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a740610d0 0x7f8a74162740 secure :-1 s=READY pgs=441 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a64006fd0 tx=0x7f8a6400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:16.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.348+0000 7f8a717fa640 1 -- 10.20.193.28:0/1574059630 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a640044a0 con 0x7f8a740610d0 2026-02-24T09:20:16.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.348+0000 7f8a717fa640 1 -- 10.20.193.28:0/1574059630 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8a64002c00 con 0x7f8a740610d0 2026-02-24T09:20:16.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.348+0000 7f8a717fa640 1 -- 10.20.193.28:0/1574059630 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a64011d80 con 0x7f8a740610d0 2026-02-24T09:20:16.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.348+0000 7f8a79330640 1 -- 10.20.193.28:0/1574059630 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a74168740 con 0x7f8a740610d0 2026-02-24T09:20:16.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.348+0000 7f8a79330640 1 -- 10.20.193.28:0/1574059630 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a74151530 con 0x7f8a740610d0 2026-02-24T09:20:16.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.351+0000 7f8a717fa640 1 -- 10.20.193.28:0/1574059630 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7f8a64002740 con 0x7f8a740610d0 2026-02-24T09:20:16.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.353+0000 7f8a717fa640 1 --2- 10.20.193.28:0/1574059630 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8a480b58d0 0x7f8a480d5d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:16.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.353+0000 7f8a717fa640 1 -- 10.20.193.28:0/1574059630 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7f8a640e5dd0 con 0x7f8a740610d0 2026-02-24T09:20:16.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.353+0000 7f8a73fff640 1 --2- 10.20.193.28:0/1574059630 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8a480b58d0 0x7f8a480d5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:16.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.354+0000 7f8a73fff640 1 --2- 10.20.193.28:0/1574059630 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8a480b58d0 0x7f8a480d5d80 secure :-1 s=READY pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a600098a0 tx=0x7f8a60005af0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:16.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.355+0000 7f8a7cc81e00 1 Processor -- start 2026-02-24T09:20:16.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.355+0000 7f8a7cc81e00 1 -- start start 2026-02-24T09:20:16.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.355+0000 7f8a7cc81e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564eca660a60 0x564eca74ac10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:16.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.355+0000 7f8a7cc81e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564eca74b150 0x564eca74b580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:16.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.355+0000 7f8a7cc81e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eca78fc80 0x564eca7b0060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:16.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.355+0000 7f8a7cc81e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564eca657f10 con 0x564eca78fc80 2026-02-24T09:20:16.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.355+0000 7f8a7cc81e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x564eca653c40 con 0x564eca660a60 2026-02-24T09:20:16.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.355+0000 7f8a7cc81e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x564eca64dda0 con 0x564eca74b150 2026-02-24T09:20:16.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.356+0000 7f8a78b2f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eca78fc80 0x564eca7b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:16.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.356+0000 7f8a78b2f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eca78fc80 0x564eca7b0060 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33756/0 (socket says 10.20.193.28:33756) 2026-02-24T09:20:16.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.356+0000 7f8a78b2f640 1 -- 10.20.193.28:0/4083575200 learned_addr learned my addr 10.20.193.28:0/4083575200 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:20:16.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.356+0000 7f8a78b2f640 1 -- 10.20.193.28:0/4083575200 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564eca74b150 msgr2=0x564eca74b580 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:20:16.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.356+0000 7f8a78b2f640 1 --2- 10.20.193.28:0/4083575200 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564eca74b150 0x564eca74b580 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.356+0000 7f8a78b2f640 1 -- 10.20.193.28:0/4083575200 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564eca660a60 msgr2=0x564eca74ac10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:20:16.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.356+0000 7f8a78b2f640 1 --2- 10.20.193.28:0/4083575200 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564eca660a60 0x564eca74ac10 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.356+0000 7f8a78b2f640 1 -- 10.20.193.28:0/4083575200 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eca5f9340 con 0x564eca78fc80 2026-02-24T09:20:16.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.356+0000 7f8a78b2f640 1 --2- 10.20.193.28:0/4083575200 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eca78fc80 0x564eca7b0060 secure :-1 s=READY pgs=442 gs=1 cs=0 l=1 c_cookie=2972762414415254631 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a68008830 tx=0x7f8a68008d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29415faa60da9467 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:16.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.357+0000 7f8a37fff640 1 -- 10.20.193.28:0/4083575200 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a68005500 con 0x564eca78fc80 2026-02-24T09:20:16.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.357+0000 7f8a37fff640 1 -- 10.20.193.28:0/4083575200 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8a68005660 con 0x564eca78fc80 2026-02-24T09:20:16.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.357+0000 7f8a37fff640 1 -- 10.20.193.28:0/4083575200 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a68014480 con 0x564eca78fc80 2026-02-24T09:20:16.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.357+0000 7f8a7cc81e00 1 -- 10.20.193.28:0/4083575200 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eca78fc80 msgr2=0x564eca7b0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:16.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.357+0000 7f8a7cc81e00 1 --2- 10.20.193.28:0/4083575200 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eca78fc80 0x564eca7b0060 secure :-1 s=READY pgs=442 gs=1 cs=0 l=1 c_cookie=2972762414415254631 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a68008830 tx=0x7f8a68008d00 comp rx=0 tx=0).stop 2026-02-24T09:20:16.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.357+0000 7f8a7cc81e00 1 -- 10.20.193.28:0/4083575200 shutdown_connections 2026-02-24T09:20:16.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.357+0000 7f8a7cc81e00 1 --2- 10.20.193.28:0/4083575200 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eca78fc80 0x564eca7b0060 unknown :-1 s=CLOSED pgs=442 gs=1 cs=0 l=1 c_cookie=2972762414415254631 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.357+0000 7f8a7cc81e00 1 --2- 10.20.193.28:0/4083575200 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564eca74b150 0x564eca74b580 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.357+0000 7f8a7cc81e00 1 --2- 10.20.193.28:0/4083575200 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564eca660a60 0x564eca74ac10 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.357+0000 7f8a7cc81e00 1 -- 10.20.193.28:0/4083575200 >> 10.20.193.28:0/4083575200 conn(0x564eca6dc490 msgr2=0x564eca7494f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:16.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.358+0000 7f8a7cc81e00 1 -- 10.20.193.28:0/4083575200 shutdown_connections 2026-02-24T09:20:16.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.358+0000 7f8a7cc81e00 1 -- 10.20.193.28:0/4083575200 wait complete. 2026-02-24T09:20:16.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.359+0000 7f8a7cc81e00 1 -- start start 2026-02-24T09:20:16.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.359+0000 7f8a7cc81e00 1 Processor -- start 2026-02-24T09:20:16.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.359+0000 7f8a7cc81e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564eca660a60 0x564eca7a72b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:16.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.359+0000 7f8a7cc81e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564eca74b150 0x564eca7a77f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:16.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.359+0000 7f8a7cc81e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eca78fc80 0x564eca7ac7e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:16.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.360+0000 7f8a7cc81e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564eca7acd20 con 0x564eca78fc80 2026-02-24T09:20:16.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.360+0000 7f8a7cc81e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x564eca7ace90 con 0x564eca660a60 2026-02-24T09:20:16.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.360+0000 7f8a7cc81e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x564eca7ad050 con 0x564eca74b150 2026-02-24T09:20:16.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.361+0000 7f8a78b2f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eca78fc80 0x564eca7ac7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:16.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.361+0000 7f8a78b2f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eca78fc80 0x564eca7ac7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33766/0 (socket says 10.20.193.28:33766) 2026-02-24T09:20:16.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.361+0000 7f8a78b2f640 1 -- 10.20.193.28:0/3465957208 learned_addr learned my addr 10.20.193.28:0/3465957208 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:20:16.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.362+0000 7f8a78b2f640 1 -- 10.20.193.28:0/3465957208 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564eca74b150 msgr2=0x564eca7a77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:16.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.362+0000 7f8a78b2f640 1 --2- 10.20.193.28:0/3465957208 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564eca74b150 0x564eca7a77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.362+0000 7f8a78b2f640 1 -- 10.20.193.28:0/3465957208 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564eca660a60 msgr2=0x564eca7a72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:16.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.362+0000 7f8a78b2f640 1 --2- 10.20.193.28:0/3465957208 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564eca660a60 0x564eca7a72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.362+0000 7f8a78b2f640 1 -- 10.20.193.28:0/3465957208 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eca5d1ce0 con 0x564eca78fc80 2026-02-24T09:20:16.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.362+0000 7f8a78b2f640 1 --2- 10.20.193.28:0/3465957208 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eca78fc80 0x564eca7ac7e0 secure :-1 s=READY pgs=443 gs=1 cs=0 l=1 c_cookie=12652946134829317027 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a6800eab0 tx=0x7f8a68008200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af984b78b0a73ba3 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:16.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.362+0000 7f8a357fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:20:16.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.363+0000 7f8a357fa640 1 -- 10.20.193.28:0/3465957208 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a680052e0 con 0x564eca78fc80 2026-02-24T09:20:16.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.363+0000 7f8a357fa640 1 -- 10.20.193.28:0/3465957208 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8a68003820 con 0x564eca78fc80 2026-02-24T09:20:16.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.363+0000 7f8a357fa640 1 -- 10.20.193.28:0/3465957208 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a68014b60 con 0x564eca78fc80 2026-02-24T09:20:16.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.363+0000 7f8a7cc81e00 1 -- 10.20.193.28:0/3465957208 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a6800f040 con 0x564eca78fc80 2026-02-24T09:20:16.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.363+0000 7f8a357fa640 1 -- 10.20.193.28:0/3465957208 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7f8a68014cf0 con 0x564eca78fc80 2026-02-24T09:20:16.367 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.363+0000 7f8a357fa640 10 client.15738 inactive, discarding osd_map(96..96 src has 1..96) 2026-02-24T09:20:16.367 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.363+0000 7f8a7cc81e00 10 client.15738 _ll_register_callbacks cb 0x564eca5d8980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:16.367 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.363+0000 7f8a7cc81e00 1 -- 10.20.193.28:0/3465957208 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564eca2ed520 con 0x564eca78fc80 2026-02-24T09:20:16.367 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.364+0000 7f8a357fa640 1 -- 10.20.193.28:0/3465957208 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f8a68014610 con 0x564eca78fc80 2026-02-24T09:20:16.367 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.364+0000 7f8a7cc81e00 10 client.15738 fetch_fsmap learned FSMap version 23 2026-02-24T09:20:16.368 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.364+0000 7f8a7cc81e00 1 -- 10.20.193.28:0/3465957208 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x564eca5e35b0 con 0x564eca78fc80 2026-02-24T09:20:16.368 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.366+0000 7f8a357fa640 1 -- 10.20.193.28:0/3465957208 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f8a68005440 con 0x564eca78fc80 2026-02-24T09:20:16.368 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.366+0000 7f8a7cc81e00 10 client.15738 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:20:16.368 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.366+0000 7f8a7cc81e00 10 client.15738 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:20:16.368 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.366+0000 7f8a7cc81e00 20 client.15738 populate_metadata read hostname 'trial028' 2026-02-24T09:20:16.369 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.366+0000 7f8a7cc81e00 1 --2- 10.20.193.28:0/3465957208 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x564eca78cf80 0x564eca78d3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:16.369 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.366+0000 7f8a7cc81e00 4 client.15738 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:20:16.369 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.366+0000 7f8a7cc81e00 1 -- 10.20.193.28:0/3465957208 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564eca61f9d0 con 0x564eca78cf80 2026-02-24T09:20:16.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.369+0000 7f8a73fff640 1 --2- 10.20.193.28:0/3465957208 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x564eca78cf80 0x564eca78d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:16.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.378+0000 7f8a73fff640 1 --2- 10.20.193.28:0/3465957208 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x564eca78cf80 0x564eca78d3f0 crc :-1 s=READY pgs=48 gs=4 cs=0 l=0 c_cookie=769199784756866852 s_cookie=15091741937560394980 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aacbf20fbbd6f24 server_cookie=d170a3552e271ce4 in_seq=0 out_seq=0 2026-02-24T09:20:16.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.378+0000 7f8a357fa640 10 client.15738 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:20:16.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.385+0000 7f8a357fa640 1 -- 10.20.193.28:0/3465957208 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x564eca61f9d0 con 0x564eca78cf80 2026-02-24T09:20:16.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.385+0000 7f8a357fa640 10 client.15738 handle_command_reply: tid=0 2026-02-24T09:20:16.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.385+0000 7f8a7cc81e00 1 client.15738 shutdown 2026-02-24T09:20:16.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.385+0000 7f8a7cc81e00 1 -- 10.20.193.28:0/3465957208 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eca78fc80 msgr2=0x564eca7ac7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:16.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.385+0000 7f8a7cc81e00 1 --2- 10.20.193.28:0/3465957208 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eca78fc80 0x564eca7ac7e0 secure :-1 s=READY pgs=443 gs=1 cs=0 l=1 c_cookie=12652946134829317027 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a6800eab0 tx=0x7f8a68008200 comp rx=0 tx=0).stop 2026-02-24T09:20:16.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.386+0000 7f8a7cc81e00 1 -- 10.20.193.28:0/3465957208 shutdown_connections 2026-02-24T09:20:16.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.386+0000 7f8a7cc81e00 1 --2- 10.20.193.28:0/3465957208 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x564eca78cf80 0x564eca78d3f0 crc :-1 s=READY pgs=48 gs=4 cs=0 l=0 c_cookie=769199784756866852 s_cookie=15091741937560394980 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.386+0000 7f8a7cc81e00 1 --2- 10.20.193.28:0/3465957208 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eca78fc80 0x564eca7ac7e0 unknown :-1 s=CLOSED pgs=443 gs=1 cs=0 l=1 c_cookie=12652946134829317027 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.386+0000 7f8a7cc81e00 1 --2- 10.20.193.28:0/3465957208 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564eca74b150 0x564eca7a77f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.386+0000 7f8a7cc81e00 1 --2- 10.20.193.28:0/3465957208 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564eca660a60 0x564eca7a72b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.386+0000 7f8a7cc81e00 1 -- 10.20.193.28:0/3465957208 >> 10.20.193.28:0/3465957208 conn(0x564eca6dc490 msgr2=0x564eca7494f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:16.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.386+0000 7f8a357fa640 0 client.15738 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:20:16.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.386+0000 7f8a7cc81e00 1 -- 10.20.193.28:0/3465957208 shutdown_connections 2026-02-24T09:20:16.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.386+0000 7f8a7cc81e00 1 -- 10.20.193.28:0/3465957208 wait complete. 2026-02-24T09:20:16.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.386+0000 7f8a7cc81e00 20 client.15738 trim_cache size 0 max 16384 2026-02-24T09:20:16.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.395+0000 7f8a7cc81e00 1 Processor -- start 2026-02-24T09:20:16.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.395+0000 7f8a7cc81e00 1 -- start start 2026-02-24T09:20:16.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.395+0000 7f8a7cc81e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564eca660a60 0x564eca7aad00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:16.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.395+0000 7f8a7cc81e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eca74b150 0x564eca78ad50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:16.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.395+0000 7f8a7cc81e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564eca78fc80 0x564eca78b290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:16.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.395+0000 7f8a7cc81e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564eca64b9d0 con 0x564eca74b150 2026-02-24T09:20:16.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.395+0000 7f8a7cc81e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x564eca38cf10 con 0x564eca78fc80 2026-02-24T09:20:16.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.395+0000 7f8a7cc81e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x564eca71d550 con 0x564eca660a60 2026-02-24T09:20:16.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.395+0000 7f8a737fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eca74b150 0x564eca78ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:16.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.396+0000 7f8a737fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eca74b150 0x564eca78ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33776/0 (socket says 10.20.193.28:33776) 2026-02-24T09:20:16.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.396+0000 7f8a737fe640 1 -- 10.20.193.28:0/1284671608 learned_addr learned my addr 10.20.193.28:0/1284671608 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:20:16.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.396+0000 7f8a737fe640 1 -- 10.20.193.28:0/1284671608 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564eca660a60 msgr2=0x564eca7aad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:16.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.396+0000 7f8a737fe640 1 --2- 10.20.193.28:0/1284671608 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564eca660a60 0x564eca7aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.396+0000 7f8a737fe640 1 -- 10.20.193.28:0/1284671608 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564eca78fc80 msgr2=0x564eca78b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:16.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.396+0000 7f8a737fe640 1 --2- 10.20.193.28:0/1284671608 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564eca78fc80 0x564eca78b290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.396+0000 7f8a737fe640 1 -- 10.20.193.28:0/1284671608 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eca5de030 con 0x564eca74b150 2026-02-24T09:20:16.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.396+0000 7f8a737fe640 1 --2- 10.20.193.28:0/1284671608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eca74b150 0x564eca78ad50 secure :-1 s=READY pgs=444 gs=1 cs=0 l=1 c_cookie=1585543913251372701 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a64004810 tx=0x7f8a64006b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1600fbc9dd217e9d server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:16.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.397+0000 7f8a377fe640 1 -- 10.20.193.28:0/1284671608 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a640ab680 con 0x564eca74b150 2026-02-24T09:20:16.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.397+0000 7f8a377fe640 1 -- 10.20.193.28:0/1284671608 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8a64002a20 con 0x564eca74b150 2026-02-24T09:20:16.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.397+0000 7f8a377fe640 1 -- 10.20.193.28:0/1284671608 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a640a80f0 con 0x564eca74b150 2026-02-24T09:20:16.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.397+0000 7f8a7cc81e00 1 -- 10.20.193.28:0/1284671608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eca74b150 msgr2=0x564eca78ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:16.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.397+0000 7f8a7cc81e00 1 --2- 10.20.193.28:0/1284671608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eca74b150 0x564eca78ad50 secure :-1 s=READY pgs=444 gs=1 cs=0 l=1 c_cookie=1585543913251372701 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a64004810 tx=0x7f8a64006b40 comp rx=0 tx=0).stop 2026-02-24T09:20:16.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.398+0000 7f8a7cc81e00 1 -- 10.20.193.28:0/1284671608 shutdown_connections 2026-02-24T09:20:16.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.398+0000 7f8a7cc81e00 1 --2- 10.20.193.28:0/1284671608 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564eca78fc80 0x564eca78b290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.402 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.398+0000 7f8a7cc81e00 1 --2- 10.20.193.28:0/1284671608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eca74b150 0x564eca78ad50 unknown :-1 s=CLOSED pgs=444 gs=1 cs=0 l=1 c_cookie=1585543913251372701 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.402 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.398+0000 7f8a7cc81e00 1 --2- 10.20.193.28:0/1284671608 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564eca660a60 0x564eca7aad00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.402 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.398+0000 7f8a7cc81e00 1 -- 10.20.193.28:0/1284671608 >> 10.20.193.28:0/1284671608 conn(0x564eca6dc490 msgr2=0x564eca7aa5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:16.402 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.398+0000 7f8a7cc81e00 1 -- 10.20.193.28:0/1284671608 shutdown_connections 2026-02-24T09:20:16.402 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.398+0000 7f8a7cc81e00 1 -- 10.20.193.28:0/1284671608 wait complete. 2026-02-24T09:20:16.403 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.398+0000 7f8a7cc81e00 1 -- start start 2026-02-24T09:20:16.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.399+0000 7f8a7cc81e00 1 Processor -- start 2026-02-24T09:20:16.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.399+0000 7f8a7cc81e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564eca660a60 0x564eca7294e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:16.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.399+0000 7f8a7cc81e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564eca74b150 0x564eca729a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:16.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.399+0000 7f8a7cc81e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eca78fc80 0x564eca729f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:16.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.399+0000 7f8a7cc81e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564eca7f6c40 con 0x564eca78fc80 2026-02-24T09:20:16.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.399+0000 7f8a7cc81e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x564eca72e530 con 0x564eca660a60 2026-02-24T09:20:16.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.399+0000 7f8a7cc81e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x564eca72e6f0 con 0x564eca74b150 2026-02-24T09:20:16.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.400+0000 7f8a78b2f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eca78fc80 0x564eca729f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:16.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.400+0000 7f8a78b2f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eca78fc80 0x564eca729f60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33780/0 (socket says 10.20.193.28:33780) 2026-02-24T09:20:16.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.400+0000 7f8a78b2f640 1 -- 10.20.193.28:0/3543423409 learned_addr learned my addr 10.20.193.28:0/3543423409 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:20:16.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.400+0000 7f8a78b2f640 1 -- 10.20.193.28:0/3543423409 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564eca74b150 msgr2=0x564eca729a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:20:16.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.400+0000 7f8a78b2f640 1 --2- 10.20.193.28:0/3543423409 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564eca74b150 0x564eca729a20 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.400+0000 7f8a78b2f640 1 -- 10.20.193.28:0/3543423409 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564eca660a60 msgr2=0x564eca7294e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:20:16.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.400+0000 7f8a78b2f640 1 --2- 10.20.193.28:0/3543423409 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564eca660a60 0x564eca7294e0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.400+0000 7f8a78b2f640 1 -- 10.20.193.28:0/3543423409 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eca5d2010 con 0x564eca78fc80 2026-02-24T09:20:16.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.400+0000 7f8a78b2f640 1 --2- 10.20.193.28:0/3543423409 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eca78fc80 0x564eca729f60 secure :-1 s=READY pgs=445 gs=1 cs=0 l=1 c_cookie=16762597947737976536 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a6801f4f0 tx=0x7f8a680058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a0b6057b9d2ed8 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:16.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.400+0000 7f8a357fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:20:16.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.400+0000 7f8a357fa640 1 -- 10.20.193.28:0/3543423409 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a68005500 con 0x564eca78fc80 2026-02-24T09:20:16.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.400+0000 7f8a357fa640 1 -- 10.20.193.28:0/3543423409 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x564eca2ed520 con 0x564eca78fc80 2026-02-24T09:20:16.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.400+0000 7f8a7cc81e00 1 -- 10.20.193.28:0/3543423409 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a74151530 con 0x564eca78fc80 2026-02-24T09:20:16.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.400+0000 7f8a357fa640 1 -- 10.20.193.28:0/3543423409 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a68031690 con 0x564eca78fc80 2026-02-24T09:20:16.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.401+0000 7f8a7cc81e00 10 client.15744 _ll_register_callbacks cb 0x564eca5d8980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:16.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.401+0000 7f8a7cc81e00 1 -- 10.20.193.28:0/3543423409 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564eca67ed30 con 0x564eca78fc80 2026-02-24T09:20:16.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.402+0000 7f8a357fa640 1 -- 10.20.193.28:0/3543423409 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7f8a680317f0 con 0x564eca78fc80 2026-02-24T09:20:16.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.402+0000 7f8a357fa640 1 -- 10.20.193.28:0/3543423409 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f8a68006b00 con 0x564eca78fc80 2026-02-24T09:20:16.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.403+0000 7f8a7cc81e00 10 client.15744 fetch_fsmap learned FSMap version 23 2026-02-24T09:20:16.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.403+0000 7f8a7cc81e00 1 -- 10.20.193.28:0/3543423409 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x564eca5e3810 con 0x564eca78fc80 2026-02-24T09:20:16.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.403+0000 7f8a357fa640 1 -- 10.20.193.28:0/3543423409 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f8a68006ca0 con 0x564eca78fc80 2026-02-24T09:20:16.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.403+0000 7f8a7cc81e00 10 client.15744 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:20:16.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.403+0000 7f8a7cc81e00 10 client.15744 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:20:16.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.403+0000 7f8a7cc81e00 20 client.15744 populate_metadata read hostname 'trial028' 2026-02-24T09:20:16.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.403+0000 7f8a7cc81e00 1 --2- 10.20.193.28:0/3543423409 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x564eca83dbd0 0x564eca85e080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:16.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.403+0000 7f8a7cc81e00 4 client.15744 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-24T09:20:16.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.403+0000 7f8a7cc81e00 1 -- 10.20.193.28:0/3543423409 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564eca331640 con 0x564eca83dbd0 2026-02-24T09:20:16.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.405+0000 7f8a73fff640 1 --2- 10.20.193.28:0/3543423409 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x564eca83dbd0 0x564eca85e080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:16.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.408+0000 7f8a73fff640 1 --2- 10.20.193.28:0/3543423409 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x564eca83dbd0 0x564eca85e080 crc :-1 s=READY pgs=49 gs=2 cs=0 l=0 c_cookie=6186791535423783494 s_cookie=18142603589737403185 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55dbe61f58540246 server_cookie=fbc779d75b065331 in_seq=0 out_seq=0 2026-02-24T09:20:16.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.408+0000 7f8a357fa640 10 client.15744 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:20:16.429 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.426+0000 7f8a357fa640 1 -- 10.20.193.28:0/3543423409 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564eca331640 con 0x564eca83dbd0 2026-02-24T09:20:16.429 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.426+0000 7f8a357fa640 10 client.15744 handle_command_reply: tid=0 2026-02-24T09:20:16.429 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.426+0000 7f8a7cc81e00 1 client.15744 shutdown 2026-02-24T09:20:16.429 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.426+0000 7f8a7cc81e00 1 -- 10.20.193.28:0/3543423409 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eca78fc80 msgr2=0x564eca729f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:16.429 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.426+0000 7f8a7cc81e00 1 --2- 10.20.193.28:0/3543423409 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eca78fc80 0x564eca729f60 secure :-1 s=READY pgs=445 gs=1 cs=0 l=1 c_cookie=16762597947737976536 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a6801f4f0 tx=0x7f8a680058b0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.427+0000 7f8a7cc81e00 1 -- 10.20.193.28:0/3543423409 shutdown_connections 2026-02-24T09:20:16.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.427+0000 7f8a7cc81e00 1 --2- 10.20.193.28:0/3543423409 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x564eca83dbd0 0x564eca85e080 crc :-1 s=READY pgs=49 gs=2 cs=0 l=0 c_cookie=6186791535423783494 s_cookie=18142603589737403185 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.427+0000 7f8a7cc81e00 1 --2- 10.20.193.28:0/3543423409 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eca78fc80 0x564eca729f60 unknown :-1 s=CLOSED pgs=445 gs=1 cs=0 l=1 c_cookie=16762597947737976536 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.427+0000 7f8a7cc81e00 1 --2- 10.20.193.28:0/3543423409 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x564eca74b150 0x564eca729a20 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.427+0000 7f8a7cc81e00 1 --2- 10.20.193.28:0/3543423409 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x564eca660a60 0x564eca7294e0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.427+0000 7f8a7cc81e00 1 -- 10.20.193.28:0/3543423409 >> 10.20.193.28:0/3543423409 conn(0x564eca6dc490 msgr2=0x564eca7abe30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:16.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.427+0000 7f8a357fa640 0 client.15744 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:20:16.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.427+0000 7f8a7cc81e00 1 -- 10.20.193.28:0/3543423409 shutdown_connections 2026-02-24T09:20:16.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.427+0000 7f8a7cc81e00 1 -- 10.20.193.28:0/3543423409 wait complete. 2026-02-24T09:20:16.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.427+0000 7f8a7cc81e00 20 client.15744 trim_cache size 0 max 16384 2026-02-24T09:20:16.432 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-24T09:20:16.432 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-24T09:20:16.432 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-24T09:20:16.432 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-24T09:20:16.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.427+0000 7f8a79330640 1 -- 10.20.193.28:0/1574059630 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8a480b58d0 msgr2=0x7f8a480d5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:16.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.427+0000 7f8a79330640 1 --2- 10.20.193.28:0/1574059630 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8a480b58d0 0x7f8a480d5d80 secure :-1 s=READY pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a600098a0 tx=0x7f8a60005af0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.427+0000 7f8a79330640 1 -- 10.20.193.28:0/1574059630 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a740610d0 msgr2=0x7f8a74162740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:16.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.427+0000 7f8a79330640 1 --2- 10.20.193.28:0/1574059630 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a740610d0 0x7f8a74162740 secure :-1 s=READY pgs=441 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a64006fd0 tx=0x7f8a6400b8d0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.428+0000 7f8a79330640 1 -- 10.20.193.28:0/1574059630 shutdown_connections 2026-02-24T09:20:16.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.428+0000 7f8a79330640 1 --2- 10.20.193.28:0/1574059630 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f8a480b58d0 0x7f8a480d5d80 unknown :-1 s=CLOSED pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.428+0000 7f8a79330640 1 --2- 10.20.193.28:0/1574059630 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f8a74155910 0x7f8a74167b10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.428+0000 7f8a79330640 1 --2- 10.20.193.28:0/1574059630 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a740610d0 0x7f8a74162740 unknown :-1 s=CLOSED pgs=441 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.428+0000 7f8a79330640 1 --2- 10.20.193.28:0/1574059630 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f8a740607c0 0x7f8a74162200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:16.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.428+0000 7f8a79330640 1 -- 10.20.193.28:0/1574059630 >> 10.20.193.28:0/1574059630 conn(0x7f8a740eaa80 msgr2=0x7f8a7410ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:16.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.429+0000 7f8a79330640 1 -- 10.20.193.28:0/1574059630 shutdown_connections 2026-02-24T09:20:16.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:16.429+0000 7f8a79330640 1 -- 10.20.193.28:0/1574059630 wait complete. 2026-02-24T09:20:16.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:16 trial074 ceph-mon[44412]: pgmap v282: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 217 MiB/s wr, 86 op/s 2026-02-24T09:20:16.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:16 trial159 ceph-mon[44242]: pgmap v282: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 217 MiB/s wr, 86 op/s 2026-02-24T09:20:16.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:16 trial028 ceph-mon[40371]: pgmap v282: 97 pgs: 97 active+clean; 4.5 GiB data, 14 GiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 217 MiB/s wr, 86 op/s 2026-02-24T09:20:18.664 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:18 trial028 ceph-mon[40371]: pgmap v283: 97 pgs: 97 active+clean; 5.5 GiB data, 16 GiB used, 8.2 TiB / 8.2 TiB avail; 20 KiB/s rd, 297 MiB/s wr, 107 op/s 2026-02-24T09:20:18.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:18 trial159 ceph-mon[44242]: pgmap v283: 97 pgs: 97 active+clean; 5.5 GiB data, 16 GiB used, 8.2 TiB / 8.2 TiB avail; 20 KiB/s rd, 297 MiB/s wr, 107 op/s 2026-02-24T09:20:18.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:18 trial074 ceph-mon[44412]: pgmap v283: 97 pgs: 97 active+clean; 5.5 GiB data, 16 GiB used, 8.2 TiB / 8.2 TiB avail; 20 KiB/s rd, 297 MiB/s wr, 107 op/s 2026-02-24T09:20:20.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:20 trial159 ceph-mon[44242]: pgmap v284: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 353 MiB/s wr, 115 op/s 2026-02-24T09:20:20.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:20 trial028 ceph-mon[40371]: pgmap v284: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 353 MiB/s wr, 115 op/s 2026-02-24T09:20:20.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:20 trial074 ceph-mon[44412]: pgmap v284: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 353 MiB/s wr, 115 op/s 2026-02-24T09:20:22.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:22 trial159 ceph-mon[44242]: pgmap v285: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 370 MiB/s wr, 109 op/s 2026-02-24T09:20:22.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:22 trial028 ceph-mon[40371]: pgmap v285: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 370 MiB/s wr, 109 op/s 2026-02-24T09:20:22.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:22 trial074 ceph-mon[44412]: pgmap v285: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 370 MiB/s wr, 109 op/s 2026-02-24T09:20:24.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:24 trial159 ceph-mon[44242]: pgmap v286: 97 pgs: 97 active+clean; 7.7 GiB data, 23 GiB used, 8.2 TiB / 8.2 TiB avail; 9.4 KiB/s rd, 376 MiB/s wr, 103 op/s 2026-02-24T09:20:24.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:24 trial028 ceph-mon[40371]: pgmap v286: 97 pgs: 97 active+clean; 7.7 GiB data, 23 GiB used, 8.2 TiB / 8.2 TiB avail; 9.4 KiB/s rd, 376 MiB/s wr, 103 op/s 2026-02-24T09:20:24.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:24 trial074 ceph-mon[44412]: pgmap v286: 97 pgs: 97 active+clean; 7.7 GiB data, 23 GiB used, 8.2 TiB / 8.2 TiB avail; 9.4 KiB/s rd, 376 MiB/s wr, 103 op/s 2026-02-24T09:20:26.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:26 trial159 ceph-mon[44242]: pgmap v287: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 8.2 TiB / 8.2 TiB avail; 9.0 KiB/s rd, 362 MiB/s wr, 99 op/s 2026-02-24T09:20:26.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:26 trial028 ceph-mon[40371]: pgmap v287: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 8.2 TiB / 8.2 TiB avail; 9.0 KiB/s rd, 362 MiB/s wr, 99 op/s 2026-02-24T09:20:26.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:26 trial074 ceph-mon[44412]: pgmap v287: 97 pgs: 97 active+clean; 8.3 GiB data, 25 GiB used, 8.2 TiB / 8.2 TiB avail; 9.0 KiB/s rd, 362 MiB/s wr, 99 op/s 2026-02-24T09:20:28.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:28 trial159 ceph-mon[44242]: pgmap v288: 97 pgs: 97 active+clean; 9.2 GiB data, 27 GiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 398 MiB/s wr, 109 op/s 2026-02-24T09:20:28.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:28 trial028 ceph-mon[40371]: pgmap v288: 97 pgs: 97 active+clean; 9.2 GiB data, 27 GiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 398 MiB/s wr, 109 op/s 2026-02-24T09:20:28.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:28 trial074 ceph-mon[44412]: pgmap v288: 97 pgs: 97 active+clean; 9.2 GiB data, 27 GiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 398 MiB/s wr, 109 op/s 2026-02-24T09:20:29.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.506+0000 7fb1463b5640 1 -- 10.20.193.28:0/1346477246 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb14010b580 msgr2=0x7fb14010b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:29.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.506+0000 7fb1463b5640 1 --2- 10.20.193.28:0/1346477246 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb14010b580 0x7fb14010b950 secure :-1 s=READY pgs=446 gs=1 cs=0 l=1 c_cookie=6686919239432815296 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb130009950 tx=0x7fb13002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:20:29.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.506+0000 7fb1463b5640 1 -- 10.20.193.28:0/1346477246 shutdown_connections 2026-02-24T09:20:29.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.506+0000 7fb1463b5640 1 --2- 10.20.193.28:0/1346477246 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb14010eec0 0x7fb14010f300 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:29.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.506+0000 7fb1463b5640 1 --2- 10.20.193.28:0/1346477246 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb14010be90 0x7fb14010e870 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:29.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.506+0000 7fb1463b5640 1 --2- 10.20.193.28:0/1346477246 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb14010b580 0x7fb14010b950 unknown :-1 s=CLOSED pgs=446 gs=1 cs=0 l=1 c_cookie=6686919239432815296 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:29.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.506+0000 7fb1463b5640 1 -- 10.20.193.28:0/1346477246 >> 10.20.193.28:0/1346477246 conn(0x7fb140064210 msgr2=0x7fb1401094a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:29.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.507+0000 7fb1463b5640 1 -- 10.20.193.28:0/1346477246 shutdown_connections 2026-02-24T09:20:29.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.507+0000 7fb1463b5640 1 -- 10.20.193.28:0/1346477246 wait complete. 2026-02-24T09:20:29.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.507+0000 7fb1463b5640 1 Processor -- start 2026-02-24T09:20:29.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.507+0000 7fb1463b5640 1 -- start start 2026-02-24T09:20:29.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.508+0000 7fb1463b5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb14010b580 0x7fb140123050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:29.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.508+0000 7fb1463b5640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb14010be90 0x7fb140123590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:29.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.508+0000 7fb1463b5640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb14010eec0 0x7fb140128910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:29.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.508+0000 7fb1463b5640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb140128f30 con 0x7fb14010b580 2026-02-24T09:20:29.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.508+0000 7fb1463b5640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fb1401290a0 con 0x7fb14010eec0 2026-02-24T09:20:29.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.508+0000 7fb1463b5640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb140129260 con 0x7fb14010be90 2026-02-24T09:20:29.511 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.509+0000 7fb1453b3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb14010b580 0x7fb140123050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:29.511 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.509+0000 7fb1453b3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb14010b580 0x7fb140123050 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44586/0 (socket says 10.20.193.28:44586) 2026-02-24T09:20:29.511 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.509+0000 7fb1453b3640 1 -- 10.20.193.28:0/3854433889 learned_addr learned my addr 10.20.193.28:0/3854433889 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:20:29.511 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.509+0000 7fb1453b3640 1 -- 10.20.193.28:0/3854433889 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb14010be90 msgr2=0x7fb140123590 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:20:29.511 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.509+0000 7fb1453b3640 1 --2- 10.20.193.28:0/3854433889 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb14010be90 0x7fb140123590 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:29.511 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.509+0000 7fb1453b3640 1 -- 10.20.193.28:0/3854433889 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb14010eec0 msgr2=0x7fb140128910 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:20:29.511 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.509+0000 7fb1453b3640 1 --2- 10.20.193.28:0/3854433889 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb14010eec0 0x7fb140128910 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:29.511 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.509+0000 7fb1453b3640 1 -- 10.20.193.28:0/3854433889 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb130009570 con 0x7fb14010b580 2026-02-24T09:20:29.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.509+0000 7fb1453b3640 1 --2- 10.20.193.28:0/3854433889 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb14010b580 0x7fb140123050 secure :-1 s=READY pgs=447 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb130004500 tx=0x7fb130002a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:29.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.509+0000 7fb12e7fc640 1 -- 10.20.193.28:0/3854433889 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb130038470 con 0x7fb14010b580 2026-02-24T09:20:29.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.509+0000 7fb12e7fc640 1 -- 10.20.193.28:0/3854433889 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb130038a90 con 0x7fb14010b580 2026-02-24T09:20:29.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.509+0000 7fb12e7fc640 1 -- 10.20.193.28:0/3854433889 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb130041a80 con 0x7fb14010b580 2026-02-24T09:20:29.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.509+0000 7fb1463b5640 1 -- 10.20.193.28:0/3854433889 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1401294e0 con 0x7fb14010b580 2026-02-24T09:20:29.513 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.509+0000 7fb1463b5640 1 -- 10.20.193.28:0/3854433889 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb140169aa0 con 0x7fb14010b580 2026-02-24T09:20:29.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.512+0000 7fb12e7fc640 1 -- 10.20.193.28:0/3854433889 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7fb13003f070 con 0x7fb14010b580 2026-02-24T09:20:29.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.515+0000 7fb12e7fc640 1 --2- 10.20.193.28:0/3854433889 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb11c0b58d0 0x7fb11c0d5d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:29.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.515+0000 7fb12e7fc640 1 -- 10.20.193.28:0/3854433889 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7fb13010b7b0 con 0x7fb14010b580 2026-02-24T09:20:29.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.515+0000 7fb144bb2640 1 --2- 10.20.193.28:0/3854433889 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb11c0b58d0 0x7fb11c0d5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:29.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.516+0000 7fb144bb2640 1 --2- 10.20.193.28:0/3854433889 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb11c0b58d0 0x7fb11c0d5d80 secure :-1 s=READY pgs=236 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1401299a0 tx=0x7fb134006c50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:29.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.517+0000 7fb149c26e00 1 Processor -- start 2026-02-24T09:20:29.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.517+0000 7fb149c26e00 1 -- start start 2026-02-24T09:20:29.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.518+0000 7fb149c26e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557c2d05ca60 0x557c2d13e200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:29.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.518+0000 7fb149c26e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557c2d13e740 0x557c2d13eb90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:29.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.518+0000 7fb149c26e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c2d183270 0x557c2d1a3650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:29.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.518+0000 7fb149c26e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557c2d053f10 con 0x557c2d183270 2026-02-24T09:20:29.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.518+0000 7fb149c26e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x557c2d04fc40 con 0x557c2d13e740 2026-02-24T09:20:29.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.519+0000 7fb149c26e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x557c2d049da0 con 0x557c2d05ca60 2026-02-24T09:20:29.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.519+0000 7fb145bb4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c2d183270 0x557c2d1a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:29.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.519+0000 7fb145bb4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c2d183270 0x557c2d1a3650 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44596/0 (socket says 10.20.193.28:44596) 2026-02-24T09:20:29.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.519+0000 7fb145bb4640 1 -- 10.20.193.28:0/2191832146 learned_addr learned my addr 10.20.193.28:0/2191832146 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:20:29.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.519+0000 7fb145bb4640 1 -- 10.20.193.28:0/2191832146 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557c2d05ca60 msgr2=0x557c2d13e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:29.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.519+0000 7fb145bb4640 1 --2- 10.20.193.28:0/2191832146 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557c2d05ca60 0x557c2d13e200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:29.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.519+0000 7fb145bb4640 1 -- 10.20.193.28:0/2191832146 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557c2d13e740 msgr2=0x557c2d13eb90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:20:29.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.519+0000 7fb145bb4640 1 --2- 10.20.193.28:0/2191832146 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557c2d13e740 0x557c2d13eb90 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:29.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.519+0000 7fb145bb4640 1 -- 10.20.193.28:0/2191832146 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c2cff5340 con 0x557c2d183270 2026-02-24T09:20:29.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.520+0000 7fb145bb4640 1 --2- 10.20.193.28:0/2191832146 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c2d183270 0x557c2d1a3650 secure :-1 s=READY pgs=448 gs=1 cs=0 l=1 c_cookie=5182572341936852155 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb13c00a840 tx=0x7fb13c00ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ec321627e90cbb server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:29.522 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.520+0000 7fb10d7fe640 1 -- 10.20.193.28:0/2191832146 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb13c005500 con 0x557c2d183270 2026-02-24T09:20:29.522 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.520+0000 7fb10d7fe640 1 -- 10.20.193.28:0/2191832146 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb13c005660 con 0x557c2d183270 2026-02-24T09:20:29.523 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.520+0000 7fb10d7fe640 1 -- 10.20.193.28:0/2191832146 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb13c012400 con 0x557c2d183270 2026-02-24T09:20:29.523 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.520+0000 7fb149c26e00 1 -- 10.20.193.28:0/2191832146 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c2d183270 msgr2=0x557c2d1a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:29.523 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.520+0000 7fb149c26e00 1 --2- 10.20.193.28:0/2191832146 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c2d183270 0x557c2d1a3650 secure :-1 s=READY pgs=448 gs=1 cs=0 l=1 c_cookie=5182572341936852155 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb13c00a840 tx=0x7fb13c00ad10 comp rx=0 tx=0).stop 2026-02-24T09:20:29.523 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.520+0000 7fb149c26e00 1 -- 10.20.193.28:0/2191832146 shutdown_connections 2026-02-24T09:20:29.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.520+0000 7fb149c26e00 1 --2- 10.20.193.28:0/2191832146 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c2d183270 0x557c2d1a3650 unknown :-1 s=CLOSED pgs=448 gs=1 cs=0 l=1 c_cookie=5182572341936852155 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:29.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.520+0000 7fb149c26e00 1 --2- 10.20.193.28:0/2191832146 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557c2d13e740 0x557c2d13eb90 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:29.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.520+0000 7fb149c26e00 1 --2- 10.20.193.28:0/2191832146 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557c2d05ca60 0x557c2d13e200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:29.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.520+0000 7fb149c26e00 1 -- 10.20.193.28:0/2191832146 >> 10.20.193.28:0/2191832146 conn(0x557c2d0d8490 msgr2=0x557c2d13cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:29.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.520+0000 7fb149c26e00 1 -- 10.20.193.28:0/2191832146 shutdown_connections 2026-02-24T09:20:29.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.520+0000 7fb149c26e00 1 -- 10.20.193.28:0/2191832146 wait complete. 2026-02-24T09:20:29.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.522+0000 7fb149c26e00 1 -- start start 2026-02-24T09:20:29.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.522+0000 7fb149c26e00 1 Processor -- start 2026-02-24T09:20:29.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.522+0000 7fb149c26e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557c2d05ca60 0x557c2d19a890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:29.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.522+0000 7fb149c26e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c2d13e740 0x557c2d19add0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:29.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.522+0000 7fb149c26e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557c2d183270 0x557c2d19fdc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:29.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.522+0000 7fb149c26e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557c2d1a0300 con 0x557c2d13e740 2026-02-24T09:20:29.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.522+0000 7fb149c26e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x557c2d1a0470 con 0x557c2d183270 2026-02-24T09:20:29.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.522+0000 7fb149c26e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x557c2d1a0630 con 0x557c2d05ca60 2026-02-24T09:20:29.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.523+0000 7fb144bb2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c2d13e740 0x557c2d19add0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:29.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.523+0000 7fb144bb2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c2d13e740 0x557c2d19add0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44608/0 (socket says 10.20.193.28:44608) 2026-02-24T09:20:29.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.523+0000 7fb144bb2640 1 -- 10.20.193.28:0/1307699749 learned_addr learned my addr 10.20.193.28:0/1307699749 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:20:29.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.523+0000 7fb144bb2640 1 -- 10.20.193.28:0/1307699749 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557c2d05ca60 msgr2=0x557c2d19a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:29.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.523+0000 7fb144bb2640 1 --2- 10.20.193.28:0/1307699749 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557c2d05ca60 0x557c2d19a890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:29.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.523+0000 7fb144bb2640 1 -- 10.20.193.28:0/1307699749 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557c2d183270 msgr2=0x557c2d19fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:29.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.523+0000 7fb144bb2640 1 --2- 10.20.193.28:0/1307699749 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557c2d183270 0x557c2d19fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:29.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.523+0000 7fb144bb2640 1 -- 10.20.193.28:0/1307699749 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c2cfcdce0 con 0x557c2d13e740 2026-02-24T09:20:29.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.524+0000 7fb144bb2640 1 --2- 10.20.193.28:0/1307699749 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c2d13e740 0x557c2d19add0 secure :-1 s=READY pgs=449 gs=1 cs=0 l=1 c_cookie=9289956458792006000 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb134006e70 tx=0x7fb134004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ec8e2dd124b170 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:29.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.524+0000 7fb0fe7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:20:29.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.524+0000 7fb0fe7fc640 1 -- 10.20.193.28:0/1307699749 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb13401a070 con 0x557c2d13e740 2026-02-24T09:20:29.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.524+0000 7fb0fe7fc640 1 -- 10.20.193.28:0/1307699749 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb134011d10 con 0x557c2d13e740 2026-02-24T09:20:29.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.524+0000 7fb0fe7fc640 1 -- 10.20.193.28:0/1307699749 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb134020e50 con 0x557c2d13e740 2026-02-24T09:20:29.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.524+0000 7fb149c26e00 1 -- 10.20.193.28:0/1307699749 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb13c00a430 con 0x557c2d13e740 2026-02-24T09:20:29.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.524+0000 7fb0fe7fc640 1 -- 10.20.193.28:0/1307699749 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7fb134013410 con 0x557c2d13e740 2026-02-24T09:20:29.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.525+0000 7fb0fe7fc640 10 client.15756 inactive, discarding osd_map(96..96 src has 1..96) 2026-02-24T09:20:29.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.525+0000 7fb149c26e00 10 client.15756 _ll_register_callbacks cb 0x557c2cfd4980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:29.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.525+0000 7fb149c26e00 1 -- 10.20.193.28:0/1307699749 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557c2cce9520 con 0x557c2d13e740 2026-02-24T09:20:29.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.525+0000 7fb0fe7fc640 1 -- 10.20.193.28:0/1307699749 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fb134020530 con 0x557c2d13e740 2026-02-24T09:20:29.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.526+0000 7fb149c26e00 10 client.15756 fetch_fsmap learned FSMap version 23 2026-02-24T09:20:29.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.526+0000 7fb149c26e00 1 -- 10.20.193.28:0/1307699749 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x557c2cfdf5b0 con 0x557c2d13e740 2026-02-24T09:20:29.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.526+0000 7fb0fe7fc640 1 -- 10.20.193.28:0/1307699749 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fb134011850 con 0x557c2d13e740 2026-02-24T09:20:29.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.526+0000 7fb149c26e00 10 client.15756 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:20:29.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.526+0000 7fb149c26e00 10 client.15756 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:20:29.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.526+0000 7fb149c26e00 20 client.15756 populate_metadata read hostname 'trial028' 2026-02-24T09:20:29.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.526+0000 7fb149c26e00 1 --2- 10.20.193.28:0/1307699749 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x557c2d180910 0x557c2d180db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:29.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.526+0000 7fb149c26e00 4 client.15756 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:20:29.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.526+0000 7fb149c26e00 1 -- 10.20.193.28:0/1307699749 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c2d01b9d0 con 0x557c2d180910 2026-02-24T09:20:29.530 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.529+0000 7fb1453b3640 1 --2- 10.20.193.28:0/1307699749 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x557c2d180910 0x557c2d180db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:29.537 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.536+0000 7fb1453b3640 1 --2- 10.20.193.28:0/1307699749 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x557c2d180910 0x557c2d180db0 crc :-1 s=READY pgs=50 gs=4 cs=0 l=0 c_cookie=14173038804150213884 s_cookie=3256294850526773067 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4b0bfb34d335cfc server_cookie=2d30aee9f994ff4b in_seq=0 out_seq=0 2026-02-24T09:20:29.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.536+0000 7fb0fe7fc640 10 client.15756 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:20:29.541 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.540+0000 7fb0fe7fc640 1 -- 10.20.193.28:0/1307699749 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x557c2d01b9d0 con 0x557c2d180910 2026-02-24T09:20:29.542 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.540+0000 7fb0fe7fc640 10 client.15756 handle_command_reply: tid=0 2026-02-24T09:20:29.542 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.540+0000 7fb149c26e00 1 client.15756 shutdown 2026-02-24T09:20:29.542 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.540+0000 7fb149c26e00 1 -- 10.20.193.28:0/1307699749 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c2d13e740 msgr2=0x557c2d19add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:29.542 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.540+0000 7fb149c26e00 1 --2- 10.20.193.28:0/1307699749 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c2d13e740 0x557c2d19add0 secure :-1 s=READY pgs=449 gs=1 cs=0 l=1 c_cookie=9289956458792006000 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb134006e70 tx=0x7fb134004760 comp rx=0 tx=0).stop 2026-02-24T09:20:29.542 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.540+0000 7fb149c26e00 1 -- 10.20.193.28:0/1307699749 shutdown_connections 2026-02-24T09:20:29.542 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.540+0000 7fb149c26e00 1 --2- 10.20.193.28:0/1307699749 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x557c2d180910 0x557c2d180db0 crc :-1 s=READY pgs=50 gs=4 cs=0 l=0 c_cookie=14173038804150213884 s_cookie=3256294850526773067 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:29.542 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.540+0000 7fb149c26e00 1 --2- 10.20.193.28:0/1307699749 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557c2d183270 0x557c2d19fdc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:29.542 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.540+0000 7fb149c26e00 1 --2- 10.20.193.28:0/1307699749 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c2d13e740 0x557c2d19add0 unknown :-1 s=CLOSED pgs=449 gs=1 cs=0 l=1 c_cookie=9289956458792006000 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:29.542 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.540+0000 7fb149c26e00 1 --2- 10.20.193.28:0/1307699749 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557c2d05ca60 0x557c2d19a890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:29.542 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.540+0000 7fb0fe7fc640 0 client.15756 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:20:29.542 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.540+0000 7fb149c26e00 1 -- 10.20.193.28:0/1307699749 >> 10.20.193.28:0/1307699749 conn(0x557c2d0d8490 msgr2=0x557c2d13c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:29.542 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.540+0000 7fb149c26e00 1 -- 10.20.193.28:0/1307699749 shutdown_connections 2026-02-24T09:20:29.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.541+0000 7fb149c26e00 1 -- 10.20.193.28:0/1307699749 wait complete. 2026-02-24T09:20:29.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.541+0000 7fb149c26e00 20 client.15756 trim_cache size 0 max 16384 2026-02-24T09:20:29.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.549+0000 7fb149c26e00 1 Processor -- start 2026-02-24T09:20:29.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.549+0000 7fb149c26e00 1 -- start start 2026-02-24T09:20:29.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.549+0000 7fb149c26e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557c2d05ca60 0x557c2d19f330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:29.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.549+0000 7fb149c26e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c2d13e740 0x557c2d17e410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:29.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.549+0000 7fb149c26e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557c2d183270 0x557c2d17e950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:29.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.549+0000 7fb149c26e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557c2d0479d0 con 0x557c2d13e740 2026-02-24T09:20:29.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.549+0000 7fb149c26e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x557c2cd88f10 con 0x557c2d05ca60 2026-02-24T09:20:29.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.549+0000 7fb149c26e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x557c2d0ad580 con 0x557c2d183270 2026-02-24T09:20:29.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.549+0000 7fb144bb2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c2d13e740 0x557c2d17e410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:29.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.549+0000 7fb144bb2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c2d13e740 0x557c2d17e410 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44622/0 (socket says 10.20.193.28:44622) 2026-02-24T09:20:29.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.549+0000 7fb144bb2640 1 -- 10.20.193.28:0/1286416945 learned_addr learned my addr 10.20.193.28:0/1286416945 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:20:29.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.550+0000 7fb144bb2640 1 -- 10.20.193.28:0/1286416945 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557c2d183270 msgr2=0x557c2d17e950 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:20:29.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.550+0000 7fb144bb2640 1 --2- 10.20.193.28:0/1286416945 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557c2d183270 0x557c2d17e950 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:29.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.550+0000 7fb144bb2640 1 -- 10.20.193.28:0/1286416945 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557c2d05ca60 msgr2=0x557c2d19f330 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:20:29.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.550+0000 7fb144bb2640 1 --2- 10.20.193.28:0/1286416945 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557c2d05ca60 0x557c2d19f330 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:29.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.550+0000 7fb144bb2640 1 -- 10.20.193.28:0/1286416945 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c2d18cde0 con 0x557c2d13e740 2026-02-24T09:20:29.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.550+0000 7fb144bb2640 1 --2- 10.20.193.28:0/1286416945 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c2d13e740 0x557c2d17e410 secure :-1 s=READY pgs=450 gs=1 cs=0 l=1 c_cookie=18090799616696545903 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb134028880 tx=0x7fb134024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb0f6e66f7f8726f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:29.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.550+0000 7fb10cffd640 1 -- 10.20.193.28:0/1286416945 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb13401a040 con 0x557c2d13e740 2026-02-24T09:20:29.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.551+0000 7fb10cffd640 1 -- 10.20.193.28:0/1286416945 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x557c2cce9520 con 0x557c2d13e740 2026-02-24T09:20:29.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.551+0000 7fb10cffd640 1 -- 10.20.193.28:0/1286416945 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb13401a040 con 0x557c2d13e740 2026-02-24T09:20:29.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.551+0000 7fb149c26e00 1 -- 10.20.193.28:0/1286416945 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c2d13e740 msgr2=0x557c2d17e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:29.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.551+0000 7fb149c26e00 1 --2- 10.20.193.28:0/1286416945 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c2d13e740 0x557c2d17e410 secure :-1 s=READY pgs=450 gs=1 cs=0 l=1 c_cookie=18090799616696545903 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb134028880 tx=0x7fb134024000 comp rx=0 tx=0).stop 2026-02-24T09:20:29.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.551+0000 7fb149c26e00 1 -- 10.20.193.28:0/1286416945 shutdown_connections 2026-02-24T09:20:29.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.551+0000 7fb149c26e00 1 --2- 10.20.193.28:0/1286416945 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557c2d183270 0x557c2d17e950 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:29.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.551+0000 7fb149c26e00 1 --2- 10.20.193.28:0/1286416945 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c2d13e740 0x557c2d17e410 unknown :-1 s=CLOSED pgs=450 gs=1 cs=0 l=1 c_cookie=18090799616696545903 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:29.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.551+0000 7fb149c26e00 1 --2- 10.20.193.28:0/1286416945 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557c2d05ca60 0x557c2d19f330 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:29.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.551+0000 7fb149c26e00 1 -- 10.20.193.28:0/1286416945 >> 10.20.193.28:0/1286416945 conn(0x557c2d0d8490 msgr2=0x557c2d19ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:29.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.552+0000 7fb149c26e00 1 -- 10.20.193.28:0/1286416945 shutdown_connections 2026-02-24T09:20:29.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.552+0000 7fb149c26e00 1 -- 10.20.193.28:0/1286416945 wait complete. 2026-02-24T09:20:29.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.552+0000 7fb149c26e00 1 -- start start 2026-02-24T09:20:29.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.552+0000 7fb149c26e00 1 Processor -- start 2026-02-24T09:20:29.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.553+0000 7fb149c26e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557c2d05ca60 0x557c2d121bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:29.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.553+0000 7fb149c26e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557c2d13e740 0x557c2d11e1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:29.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.553+0000 7fb149c26e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c2d183270 0x557c2d11e730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:29.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.553+0000 7fb149c26e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557c2d119550 con 0x557c2d183270 2026-02-24T09:20:29.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.553+0000 7fb149c26e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x557c2d1a1990 con 0x557c2d13e740 2026-02-24T09:20:29.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.553+0000 7fb149c26e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x557c2d122230 con 0x557c2d05ca60 2026-02-24T09:20:29.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.553+0000 7fb145bb4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c2d183270 0x557c2d11e730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:29.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.553+0000 7fb145bb4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c2d183270 0x557c2d11e730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44634/0 (socket says 10.20.193.28:44634) 2026-02-24T09:20:29.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.553+0000 7fb145bb4640 1 -- 10.20.193.28:0/2898138122 learned_addr learned my addr 10.20.193.28:0/2898138122 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:20:29.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.553+0000 7fb145bb4640 1 -- 10.20.193.28:0/2898138122 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557c2d05ca60 msgr2=0x557c2d121bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:20:29.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.553+0000 7fb145bb4640 1 --2- 10.20.193.28:0/2898138122 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557c2d05ca60 0x557c2d121bc0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:29.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.553+0000 7fb145bb4640 1 -- 10.20.193.28:0/2898138122 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557c2d13e740 msgr2=0x557c2d11e1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:20:29.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.553+0000 7fb145bb4640 1 --2- 10.20.193.28:0/2898138122 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557c2d13e740 0x557c2d11e1f0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:29.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.553+0000 7fb145bb4640 1 -- 10.20.193.28:0/2898138122 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c2cfda030 con 0x557c2d183270 2026-02-24T09:20:29.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.554+0000 7fb145bb4640 1 --2- 10.20.193.28:0/2898138122 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c2d183270 0x557c2d11e730 secure :-1 s=READY pgs=451 gs=1 cs=0 l=1 c_cookie=4208595873341241137 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb13c00b010 tx=0x7fb13c004a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a67efa611adf731 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:29.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.554+0000 7fb0fe7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:20:29.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.555+0000 7fb0fe7fc640 1 -- 10.20.193.28:0/2898138122 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb13c00c6c0 con 0x557c2d183270 2026-02-24T09:20:29.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.555+0000 7fb0fe7fc640 1 -- 10.20.193.28:0/2898138122 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb13c00cce0 con 0x557c2d183270 2026-02-24T09:20:29.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.555+0000 7fb0fe7fc640 1 -- 10.20.193.28:0/2898138122 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb13c012cf0 con 0x557c2d183270 2026-02-24T09:20:29.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.555+0000 7fb149c26e00 1 -- 10.20.193.28:0/2898138122 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c2cfdf5b0 con 0x557c2d183270 2026-02-24T09:20:29.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.555+0000 7fb0fe7fc640 1 -- 10.20.193.28:0/2898138122 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7fb13c01b400 con 0x557c2d183270 2026-02-24T09:20:29.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.555+0000 7fb0fe7fc640 10 client.15762 inactive, discarding osd_map(96..96 src has 1..96) 2026-02-24T09:20:29.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.557+0000 7fb149c26e00 10 client.15762 _ll_register_callbacks cb 0x557c2cfd4980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:29.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.557+0000 7fb149c26e00 1 -- 10.20.193.28:0/2898138122 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557c2d07ad30 con 0x557c2d183270 2026-02-24T09:20:29.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.557+0000 7fb0fe7fc640 1 -- 10.20.193.28:0/2898138122 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fb13c012400 con 0x557c2d183270 2026-02-24T09:20:29.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.557+0000 7fb149c26e00 10 client.15762 fetch_fsmap learned FSMap version 23 2026-02-24T09:20:29.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.557+0000 7fb149c26e00 1 -- 10.20.193.28:0/2898138122 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x557c2cfce010 con 0x557c2d183270 2026-02-24T09:20:29.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.557+0000 7fb0fe7fc640 1 -- 10.20.193.28:0/2898138122 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fb13c00c820 con 0x557c2d183270 2026-02-24T09:20:29.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.557+0000 7fb149c26e00 10 client.15762 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:20:29.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.557+0000 7fb149c26e00 10 client.15762 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:20:29.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.557+0000 7fb149c26e00 20 client.15762 populate_metadata read hostname 'trial028' 2026-02-24T09:20:29.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.557+0000 7fb149c26e00 1 --2- 10.20.193.28:0/2898138122 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x557c2d231aa0 0x557c2d251f50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:29.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.557+0000 7fb149c26e00 4 client.15762 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-24T09:20:29.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.557+0000 7fb149c26e00 1 -- 10.20.193.28:0/2898138122 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557c2cd2d640 con 0x557c2d231aa0 2026-02-24T09:20:29.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.569+0000 7fb1453b3640 1 --2- 10.20.193.28:0/2898138122 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x557c2d231aa0 0x557c2d251f50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:29.586 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.581+0000 7fb1453b3640 1 --2- 10.20.193.28:0/2898138122 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x557c2d231aa0 0x557c2d251f50 crc :-1 s=READY pgs=51 gs=2 cs=0 l=0 c_cookie=6613801092464573222 s_cookie=1147438253581749722 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bc8f10d5b70fb26 server_cookie=fec8503226f4dda in_seq=0 out_seq=0 2026-02-24T09:20:29.586 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.581+0000 7fb0fe7fc640 10 client.15762 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:20:29.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.616+0000 7fb0fe7fc640 1 -- 10.20.193.28:0/2898138122 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557c2cd2d640 con 0x557c2d231aa0 2026-02-24T09:20:29.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.616+0000 7fb0fe7fc640 10 client.15762 handle_command_reply: tid=0 2026-02-24T09:20:29.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.616+0000 7fb149c26e00 1 client.15762 shutdown 2026-02-24T09:20:29.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.616+0000 7fb149c26e00 1 -- 10.20.193.28:0/2898138122 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c2d183270 msgr2=0x557c2d11e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:29.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.616+0000 7fb149c26e00 1 --2- 10.20.193.28:0/2898138122 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c2d183270 0x557c2d11e730 secure :-1 s=READY pgs=451 gs=1 cs=0 l=1 c_cookie=4208595873341241137 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb13c00b010 tx=0x7fb13c004a60 comp rx=0 tx=0).stop 2026-02-24T09:20:29.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.617+0000 7fb149c26e00 1 -- 10.20.193.28:0/2898138122 shutdown_connections 2026-02-24T09:20:29.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.617+0000 7fb149c26e00 1 --2- 10.20.193.28:0/2898138122 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x557c2d231aa0 0x557c2d251f50 crc :-1 s=READY pgs=51 gs=2 cs=0 l=0 c_cookie=6613801092464573222 s_cookie=1147438253581749722 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:29.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.617+0000 7fb149c26e00 1 --2- 10.20.193.28:0/2898138122 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c2d183270 0x557c2d11e730 unknown :-1 s=CLOSED pgs=451 gs=1 cs=0 l=1 c_cookie=4208595873341241137 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:29.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.617+0000 7fb149c26e00 1 --2- 10.20.193.28:0/2898138122 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x557c2d13e740 0x557c2d11e1f0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:29.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.617+0000 7fb149c26e00 1 --2- 10.20.193.28:0/2898138122 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x557c2d05ca60 0x557c2d121bc0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:29.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.617+0000 7fb149c26e00 1 -- 10.20.193.28:0/2898138122 >> 10.20.193.28:0/2898138122 conn(0x557c2d0d8490 msgr2=0x557c2d19f410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:29.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.618+0000 7fb0fe7fc640 0 client.15762 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:20:29.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.618+0000 7fb149c26e00 1 -- 10.20.193.28:0/2898138122 shutdown_connections 2026-02-24T09:20:29.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.618+0000 7fb149c26e00 1 -- 10.20.193.28:0/2898138122 wait complete. 2026-02-24T09:20:29.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.618+0000 7fb149c26e00 20 client.15762 trim_cache size 0 max 16384 2026-02-24T09:20:29.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-24T09:20:29.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-24T09:20:29.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-24T09:20:29.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-24T09:20:29.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.619+0000 7fb1463b5640 1 -- 10.20.193.28:0/3854433889 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb11c0b58d0 msgr2=0x7fb11c0d5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:29.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.619+0000 7fb1463b5640 1 --2- 10.20.193.28:0/3854433889 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb11c0b58d0 0x7fb11c0d5d80 secure :-1 s=READY pgs=236 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1401299a0 tx=0x7fb134006c50 comp rx=0 tx=0).stop 2026-02-24T09:20:29.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.619+0000 7fb1463b5640 1 -- 10.20.193.28:0/3854433889 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb14010b580 msgr2=0x7fb140123050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:29.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.619+0000 7fb1463b5640 1 --2- 10.20.193.28:0/3854433889 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb14010b580 0x7fb140123050 secure :-1 s=READY pgs=447 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb130004500 tx=0x7fb130002a90 comp rx=0 tx=0).stop 2026-02-24T09:20:29.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.620+0000 7fb1463b5640 1 -- 10.20.193.28:0/3854433889 shutdown_connections 2026-02-24T09:20:29.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.620+0000 7fb1463b5640 1 --2- 10.20.193.28:0/3854433889 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb11c0b58d0 0x7fb11c0d5d80 unknown :-1 s=CLOSED pgs=236 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:29.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.620+0000 7fb1463b5640 1 --2- 10.20.193.28:0/3854433889 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb14010eec0 0x7fb140128910 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:29.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.620+0000 7fb1463b5640 1 --2- 10.20.193.28:0/3854433889 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb14010be90 0x7fb140123590 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:29.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.620+0000 7fb1463b5640 1 --2- 10.20.193.28:0/3854433889 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb14010b580 0x7fb140123050 unknown :-1 s=CLOSED pgs=447 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:29.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.620+0000 7fb1463b5640 1 -- 10.20.193.28:0/3854433889 >> 10.20.193.28:0/3854433889 conn(0x7fb140064210 msgr2=0x7fb1401094a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:29.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.620+0000 7fb1463b5640 1 -- 10.20.193.28:0/3854433889 shutdown_connections 2026-02-24T09:20:29.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:29.620+0000 7fb1463b5640 1 -- 10.20.193.28:0/3854433889 wait complete. 2026-02-24T09:20:30.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:30 trial159 ceph-mon[44242]: pgmap v289: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 8.2 TiB / 8.2 TiB avail; 7.2 KiB/s rd, 392 MiB/s wr, 106 op/s 2026-02-24T09:20:30.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:30 trial028 ceph-mon[40371]: pgmap v289: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 8.2 TiB / 8.2 TiB avail; 7.2 KiB/s rd, 392 MiB/s wr, 106 op/s 2026-02-24T09:20:30.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:30 trial074 ceph-mon[44412]: pgmap v289: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 8.2 TiB / 8.2 TiB avail; 7.2 KiB/s rd, 392 MiB/s wr, 106 op/s 2026-02-24T09:20:32.406 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-24T09:20:32.407 INFO:tasks.workunit.client.0.trial028.stdout: Children see throughput for 1 initial writers = 384296.41 kB/sec 2026-02-24T09:20:32.407 INFO:tasks.workunit.client.0.trial028.stdout: Parent sees throughput for 1 initial writers = 384286.03 kB/sec 2026-02-24T09:20:32.407 INFO:tasks.workunit.client.0.trial028.stdout: Min throughput per process = 384296.41 kB/sec 2026-02-24T09:20:32.407 INFO:tasks.workunit.client.0.trial028.stdout: Max throughput per process = 384296.41 kB/sec 2026-02-24T09:20:32.407 INFO:tasks.workunit.client.0.trial028.stdout: Avg throughput per process = 384296.41 kB/sec 2026-02-24T09:20:32.407 INFO:tasks.workunit.client.0.trial028.stdout: Min xfer = 10485760.00 kB 2026-02-24T09:20:32.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:32 trial159 ceph-mon[44242]: pgmap v290: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 376 MiB/s wr, 102 op/s 2026-02-24T09:20:32.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:32 trial028 ceph-mon[40371]: pgmap v290: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 376 MiB/s wr, 102 op/s 2026-02-24T09:20:32.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:32 trial074 ceph-mon[44412]: pgmap v290: 97 pgs: 97 active+clean; 11 GiB data, 32 GiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 376 MiB/s wr, 102 op/s 2026-02-24T09:20:34.676 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:34 trial074 ceph-mon[44412]: pgmap v291: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 378 MiB/s wr, 102 op/s 2026-02-24T09:20:34.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:34 trial159 ceph-mon[44242]: pgmap v291: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 378 MiB/s wr, 102 op/s 2026-02-24T09:20:34.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:34 trial028 ceph-mon[40371]: pgmap v291: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 378 MiB/s wr, 102 op/s 2026-02-24T09:20:36.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:36 trial159 ceph-mon[44242]: pgmap v292: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 8.2 TiB / 8.2 TiB avail; 5.6 KiB/s rd, 344 MiB/s wr, 93 op/s 2026-02-24T09:20:36.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:36 trial028 ceph-mon[40371]: pgmap v292: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 8.2 TiB / 8.2 TiB avail; 5.6 KiB/s rd, 344 MiB/s wr, 93 op/s 2026-02-24T09:20:36.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:36 trial074 ceph-mon[44412]: pgmap v292: 97 pgs: 97 active+clean; 12 GiB data, 35 GiB used, 8.2 TiB / 8.2 TiB avail; 5.6 KiB/s rd, 344 MiB/s wr, 93 op/s 2026-02-24T09:20:38.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:38 trial159 ceph-mon[44242]: pgmap v293: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 8.3 KiB/s rd, 318 MiB/s wr, 88 op/s 2026-02-24T09:20:38.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:38 trial028 ceph-mon[40371]: pgmap v293: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 8.3 KiB/s rd, 318 MiB/s wr, 88 op/s 2026-02-24T09:20:38.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:38 trial074 ceph-mon[44412]: pgmap v293: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 8.3 KiB/s rd, 318 MiB/s wr, 88 op/s 2026-02-24T09:20:40.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:40 trial159 ceph-mon[44242]: pgmap v294: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 20 KiB/s rd, 242 MiB/s wr, 72 op/s 2026-02-24T09:20:40.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:40 trial028 ceph-mon[40371]: pgmap v294: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 20 KiB/s rd, 242 MiB/s wr, 72 op/s 2026-02-24T09:20:40.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:40 trial074 ceph-mon[44412]: pgmap v294: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 20 KiB/s rd, 242 MiB/s wr, 72 op/s 2026-02-24T09:20:42.702 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.700+0000 7f59c3592640 1 -- 10.20.193.28:0/2518193661 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59bc119b40 msgr2=0x7f59bc17a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.700+0000 7f59c3592640 1 --2- 10.20.193.28:0/2518193661 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59bc119b40 0x7f59bc17a510 secure :-1 s=READY pgs=452 gs=1 cs=0 l=1 c_cookie=3943653854727382319 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59b000aa30 tx=0x7f59b00302b0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.700+0000 7f59c3592640 1 -- 10.20.193.28:0/2518193661 shutdown_connections 2026-02-24T09:20:42.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.700+0000 7f59c3592640 1 --2- 10.20.193.28:0/2518193661 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59bc119b40 0x7f59bc17a510 unknown :-1 s=CLOSED pgs=452 gs=1 cs=0 l=1 c_cookie=3943653854727382319 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.700+0000 7f59c3592640 1 --2- 10.20.193.28:0/2518193661 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f59bc114340 0x7f59bc119390 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.700+0000 7f59c3592640 1 --2- 10.20.193.28:0/2518193661 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f59bc113950 0x7f59bc113d20 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.700+0000 7f59c3592640 1 -- 10.20.193.28:0/2518193661 >> 10.20.193.28:0/2518193661 conn(0x7f59bc0619a0 msgr2=0x7f59bc061da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:42.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.700+0000 7f59c3592640 1 -- 10.20.193.28:0/2518193661 shutdown_connections 2026-02-24T09:20:42.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.700+0000 7f59c3592640 1 -- 10.20.193.28:0/2518193661 wait complete. 2026-02-24T09:20:42.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.701+0000 7f59c3592640 1 Processor -- start 2026-02-24T09:20:42.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.701+0000 7f59c3592640 1 -- start start 2026-02-24T09:20:42.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.701+0000 7f59c3592640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f59bc113950 0x7f59bc0fb670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.701+0000 7f59c3592640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f59bc114340 0x7f59bc17a410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.702+0000 7f59c3592640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59bc119b40 0x7f59bc0fbd70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.702+0000 7f59c3592640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f59bc100f80 con 0x7f59bc119b40 2026-02-24T09:20:42.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.702+0000 7f59c3592640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f59bc1010f0 con 0x7f59bc113950 2026-02-24T09:20:42.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.702+0000 7f59c3592640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f59bc1012b0 con 0x7f59bc114340 2026-02-24T09:20:42.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.702+0000 7f59c2590640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f59bc113950 0x7f59bc0fb670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.702+0000 7f59c2d91640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59bc119b40 0x7f59bc0fbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.702+0000 7f59c2d91640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59bc119b40 0x7f59bc0fbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51408/0 (socket says 10.20.193.28:51408) 2026-02-24T09:20:42.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.702+0000 7f59c2d91640 1 -- 10.20.193.28:0/2700969076 learned_addr learned my addr 10.20.193.28:0/2700969076 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:20:42.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.702+0000 7f59c2d91640 1 -- 10.20.193.28:0/2700969076 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f59bc114340 msgr2=0x7f59bc17a410 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:20:42.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.702+0000 7f59c2d91640 1 --2- 10.20.193.28:0/2700969076 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f59bc114340 0x7f59bc17a410 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.702+0000 7f59c2d91640 1 -- 10.20.193.28:0/2700969076 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f59bc113950 msgr2=0x7f59bc0fb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.702+0000 7f59c2d91640 1 --2- 10.20.193.28:0/2700969076 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f59bc113950 0x7f59bc0fb670 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.702+0000 7f59c2d91640 1 -- 10.20.193.28:0/2700969076 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b000a650 con 0x7f59bc119b40 2026-02-24T09:20:42.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.702+0000 7f59c2590640 1 --2- 10.20.193.28:0/2700969076 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f59bc113950 0x7f59bc0fb670 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:20:42.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.702+0000 7f59c2d91640 1 --2- 10.20.193.28:0/2700969076 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59bc119b40 0x7f59bc0fbd70 secure :-1 s=READY pgs=453 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59b0006c10 tx=0x7f59b00039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:42.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.703+0000 7f59a77fe640 1 -- 10.20.193.28:0/2700969076 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59b003e070 con 0x7f59bc119b40 2026-02-24T09:20:42.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.703+0000 7f59a77fe640 1 -- 10.20.193.28:0/2700969076 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f59b0003ae0 con 0x7f59bc119b40 2026-02-24T09:20:42.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.703+0000 7f59a77fe640 1 -- 10.20.193.28:0/2700969076 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59b0006020 con 0x7f59bc119b40 2026-02-24T09:20:42.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.703+0000 7f59c3592640 1 -- 10.20.193.28:0/2700969076 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59bc101530 con 0x7f59bc119b40 2026-02-24T09:20:42.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.703+0000 7f59c3592640 1 -- 10.20.193.28:0/2700969076 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59bc1018f0 con 0x7f59bc119b40 2026-02-24T09:20:42.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.706+0000 7f59a77fe640 1 -- 10.20.193.28:0/2700969076 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7f59b0005930 con 0x7f59bc119b40 2026-02-24T09:20:42.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.707+0000 7f59a77fe640 1 --2- 10.20.193.28:0/2700969076 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f59980b58c0 0x7f59980d5d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.707+0000 7f59a77fe640 1 -- 10.20.193.28:0/2700969076 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7f59b010c950 con 0x7f59bc119b40 2026-02-24T09:20:42.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.707+0000 7f59c2590640 1 --2- 10.20.193.28:0/2700969076 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f59980b58c0 0x7f59980d5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.708+0000 7f59c2590640 1 --2- 10.20.193.28:0/2700969076 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f59980b58c0 0x7f59980d5d70 secure :-1 s=READY pgs=237 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59b4004760 tx=0x7f59b4008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:42.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.709+0000 7f59c6e0ce00 1 Processor -- start 2026-02-24T09:20:42.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.709+0000 7f59c6e0ce00 1 -- start start 2026-02-24T09:20:42.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.709+0000 7f59c6e0ce00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d42a534a60 0x55d42a616200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.709+0000 7f59c6e0ce00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d42a616740 0x55d42a616b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.709+0000 7f59c6e0ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d42a65b270 0x55d42a67b650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.709+0000 7f59c6e0ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d42a52bf10 con 0x55d42a65b270 2026-02-24T09:20:42.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.709+0000 7f59c6e0ce00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55d42a527c40 con 0x55d42a616740 2026-02-24T09:20:42.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.709+0000 7f59c6e0ce00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55d42a521da0 con 0x55d42a534a60 2026-02-24T09:20:42.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.710+0000 7f59c2d91640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d42a65b270 0x55d42a67b650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.710+0000 7f59c2d91640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d42a65b270 0x55d42a67b650 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51416/0 (socket says 10.20.193.28:51416) 2026-02-24T09:20:42.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.710+0000 7f59c2d91640 1 -- 10.20.193.28:0/4265172746 learned_addr learned my addr 10.20.193.28:0/4265172746 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:20:42.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.710+0000 7f59c2d91640 1 -- 10.20.193.28:0/4265172746 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d42a534a60 msgr2=0x55d42a616200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:42.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.710+0000 7f59c2d91640 1 --2- 10.20.193.28:0/4265172746 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d42a534a60 0x55d42a616200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.710+0000 7f59c2d91640 1 -- 10.20.193.28:0/4265172746 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d42a616740 msgr2=0x55d42a616b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:42.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.710+0000 7f59c2d91640 1 --2- 10.20.193.28:0/4265172746 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d42a616740 0x55d42a616b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.710+0000 7f59c2d91640 1 -- 10.20.193.28:0/4265172746 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d42a4cd340 con 0x55d42a65b270 2026-02-24T09:20:42.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.710+0000 7f59c2d91640 1 --2- 10.20.193.28:0/4265172746 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d42a65b270 0x55d42a67b650 secure :-1 s=READY pgs=454 gs=1 cs=0 l=1 c_cookie=14943413413389968857 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59b00d2d10 tx=0x7f59b000a390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf61ab536ceaa5d9 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:42.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.710+0000 7f59a4bfe640 1 -- 10.20.193.28:0/4265172746 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59b0039e20 con 0x55d42a65b270 2026-02-24T09:20:42.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.710+0000 7f59a4bfe640 1 -- 10.20.193.28:0/4265172746 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f59b00d34a0 con 0x55d42a65b270 2026-02-24T09:20:42.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.710+0000 7f59a4bfe640 1 -- 10.20.193.28:0/4265172746 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59b00bc070 con 0x55d42a65b270 2026-02-24T09:20:42.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.711+0000 7f59c6e0ce00 1 -- 10.20.193.28:0/4265172746 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d42a65b270 msgr2=0x55d42a67b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.711+0000 7f59c6e0ce00 1 --2- 10.20.193.28:0/4265172746 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d42a65b270 0x55d42a67b650 secure :-1 s=READY pgs=454 gs=1 cs=0 l=1 c_cookie=14943413413389968857 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59b00d2d10 tx=0x7f59b000a390 comp rx=0 tx=0).stop 2026-02-24T09:20:42.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.715+0000 7f59c6e0ce00 1 -- 10.20.193.28:0/4265172746 shutdown_connections 2026-02-24T09:20:42.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.715+0000 7f59c6e0ce00 1 --2- 10.20.193.28:0/4265172746 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d42a65b270 0x55d42a67b650 unknown :-1 s=CLOSED pgs=454 gs=1 cs=0 l=1 c_cookie=14943413413389968857 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.715+0000 7f59c6e0ce00 1 --2- 10.20.193.28:0/4265172746 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d42a616740 0x55d42a616b90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.715+0000 7f59c6e0ce00 1 --2- 10.20.193.28:0/4265172746 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d42a534a60 0x55d42a616200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.715+0000 7f59c6e0ce00 1 -- 10.20.193.28:0/4265172746 >> 10.20.193.28:0/4265172746 conn(0x55d42a5b0490 msgr2=0x55d42a614ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:42.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.715+0000 7f59c6e0ce00 1 -- 10.20.193.28:0/4265172746 shutdown_connections 2026-02-24T09:20:42.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.715+0000 7f59c6e0ce00 1 -- 10.20.193.28:0/4265172746 wait complete. 2026-02-24T09:20:42.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.717+0000 7f59c6e0ce00 1 -- start start 2026-02-24T09:20:42.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.717+0000 7f59c6e0ce00 1 Processor -- start 2026-02-24T09:20:42.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.717+0000 7f59c6e0ce00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d42a534a60 0x55d42a672860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.717+0000 7f59c6e0ce00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d42a616740 0x55d42a672da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.717+0000 7f59c6e0ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d42a65b270 0x55d42a677d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.717+0000 7f59c6e0ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d42a6782d0 con 0x55d42a65b270 2026-02-24T09:20:42.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.717+0000 7f59c6e0ce00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55d42a678440 con 0x55d42a616740 2026-02-24T09:20:42.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.717+0000 7f59c6e0ce00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55d42a678600 con 0x55d42a534a60 2026-02-24T09:20:42.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.718+0000 7f59c2d91640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d42a65b270 0x55d42a677d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.718+0000 7f59c2d91640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d42a65b270 0x55d42a677d90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51426/0 (socket says 10.20.193.28:51426) 2026-02-24T09:20:42.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.718+0000 7f59c2d91640 1 -- 10.20.193.28:0/239779699 learned_addr learned my addr 10.20.193.28:0/239779699 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:20:42.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.718+0000 7f59c2d91640 1 -- 10.20.193.28:0/239779699 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d42a534a60 msgr2=0x55d42a672860 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:20:42.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.718+0000 7f59c2d91640 1 --2- 10.20.193.28:0/239779699 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d42a534a60 0x55d42a672860 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.718+0000 7f59c2d91640 1 -- 10.20.193.28:0/239779699 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d42a616740 msgr2=0x55d42a672da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:20:42.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.718+0000 7f59c2d91640 1 --2- 10.20.193.28:0/239779699 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d42a616740 0x55d42a672da0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.718+0000 7f59c2d91640 1 -- 10.20.193.28:0/239779699 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d42a4a5ce0 con 0x55d42a65b270 2026-02-24T09:20:42.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.718+0000 7f59c2d91640 1 --2- 10.20.193.28:0/239779699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d42a65b270 0x55d42a677d90 secure :-1 s=READY pgs=455 gs=1 cs=0 l=1 c_cookie=13826422863617795113 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59b010a260 tx=0x7f59b00302b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfe15256c4472429 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:42.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.718+0000 7f596ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:20:42.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.718+0000 7f596ffff640 1 -- 10.20.193.28:0/239779699 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59b0005e30 con 0x55d42a65b270 2026-02-24T09:20:42.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.718+0000 7f59c6e0ce00 1 -- 10.20.193.28:0/239779699 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59bc1018f0 con 0x55d42a65b270 2026-02-24T09:20:42.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.718+0000 7f596ffff640 1 -- 10.20.193.28:0/239779699 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f59b00dada0 con 0x55d42a65b270 2026-02-24T09:20:42.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.718+0000 7f596ffff640 1 -- 10.20.193.28:0/239779699 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59b00d3730 con 0x55d42a65b270 2026-02-24T09:20:42.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.718+0000 7f59c6e0ce00 10 client.15774 _ll_register_callbacks cb 0x55d42a4ac980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:42.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.718+0000 7f59c6e0ce00 1 -- 10.20.193.28:0/239779699 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d42a1c1520 con 0x55d42a65b270 2026-02-24T09:20:42.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.719+0000 7f596ffff640 1 -- 10.20.193.28:0/239779699 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7f59b00d38c0 con 0x55d42a65b270 2026-02-24T09:20:42.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.719+0000 7f596ffff640 1 -- 10.20.193.28:0/239779699 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f59b00dd750 con 0x55d42a65b270 2026-02-24T09:20:42.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.719+0000 7f59c6e0ce00 10 client.15774 fetch_fsmap learned FSMap version 23 2026-02-24T09:20:42.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.719+0000 7f59c6e0ce00 1 -- 10.20.193.28:0/239779699 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x55d42a4b75b0 con 0x55d42a65b270 2026-02-24T09:20:42.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.719+0000 7f596ffff640 1 -- 10.20.193.28:0/239779699 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f59b0041370 con 0x55d42a65b270 2026-02-24T09:20:42.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.719+0000 7f59c6e0ce00 10 client.15774 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:20:42.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.719+0000 7f59c6e0ce00 10 client.15774 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:20:42.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.719+0000 7f59c6e0ce00 20 client.15774 populate_metadata read hostname 'trial028' 2026-02-24T09:20:42.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.719+0000 7f59c6e0ce00 1 --2- 10.20.193.28:0/239779699 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55d42a6583b0 0x55d42a658850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.719+0000 7f59c6e0ce00 4 client.15774 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:20:42.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.719+0000 7f59c6e0ce00 1 -- 10.20.193.28:0/239779699 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d42a4f39d0 con 0x55d42a6583b0 2026-02-24T09:20:42.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.720+0000 7f59c2590640 1 --2- 10.20.193.28:0/239779699 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55d42a6583b0 0x55d42a658850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.726 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.723+0000 7f59c2590640 1 --2- 10.20.193.28:0/239779699 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55d42a6583b0 0x55d42a658850 crc :-1 s=READY pgs=52 gs=2 cs=0 l=0 c_cookie=815140499588041639 s_cookie=6149773375735296267 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4ff5f72ffacba7 server_cookie=5558624d65db710b in_seq=0 out_seq=0 2026-02-24T09:20:42.726 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.723+0000 7f596ffff640 10 client.15774 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:20:42.726 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.723+0000 7f596ffff640 1 -- 10.20.193.28:0/239779699 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55d42a4f39d0 con 0x55d42a6583b0 2026-02-24T09:20:42.726 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.723+0000 7f596ffff640 10 client.15774 handle_command_reply: tid=0 2026-02-24T09:20:42.726 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.724+0000 7f59c6e0ce00 1 client.15774 shutdown 2026-02-24T09:20:42.726 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.724+0000 7f59c6e0ce00 1 -- 10.20.193.28:0/239779699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d42a65b270 msgr2=0x55d42a677d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.726 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.724+0000 7f59c6e0ce00 1 --2- 10.20.193.28:0/239779699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d42a65b270 0x55d42a677d90 secure :-1 s=READY pgs=455 gs=1 cs=0 l=1 c_cookie=13826422863617795113 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59b010a260 tx=0x7f59b00302b0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.724+0000 7f59c6e0ce00 1 -- 10.20.193.28:0/239779699 shutdown_connections 2026-02-24T09:20:42.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.724+0000 7f59c6e0ce00 1 --2- 10.20.193.28:0/239779699 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55d42a6583b0 0x55d42a658850 crc :-1 s=READY pgs=52 gs=2 cs=0 l=0 c_cookie=815140499588041639 s_cookie=6149773375735296267 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.724+0000 7f59c6e0ce00 1 --2- 10.20.193.28:0/239779699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d42a65b270 0x55d42a677d90 unknown :-1 s=CLOSED pgs=455 gs=1 cs=0 l=1 c_cookie=13826422863617795113 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.724+0000 7f59c6e0ce00 1 --2- 10.20.193.28:0/239779699 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d42a616740 0x55d42a672da0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.724+0000 7f59c6e0ce00 1 --2- 10.20.193.28:0/239779699 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d42a534a60 0x55d42a672860 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.724+0000 7f59c6e0ce00 1 -- 10.20.193.28:0/239779699 >> 10.20.193.28:0/239779699 conn(0x55d42a5b0490 msgr2=0x55d42a6142f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:42.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.724+0000 7f596ffff640 0 client.15774 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:20:42.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.724+0000 7f59c6e0ce00 1 -- 10.20.193.28:0/239779699 shutdown_connections 2026-02-24T09:20:42.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.724+0000 7f59c6e0ce00 1 -- 10.20.193.28:0/239779699 wait complete. 2026-02-24T09:20:42.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.724+0000 7f59c6e0ce00 20 client.15774 trim_cache size 0 max 16384 2026-02-24T09:20:42.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.732+0000 7f59c6e0ce00 1 Processor -- start 2026-02-24T09:20:42.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.732+0000 7f59c6e0ce00 1 -- start start 2026-02-24T09:20:42.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.732+0000 7f59c6e0ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d42a534a60 0x55d42a66fc80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.732+0000 7f59c6e0ce00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d42a616740 0x55d42a6701c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.732+0000 7f59c6e0ce00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d42a65b270 0x55d42a656360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.733+0000 7f59c6e0ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d42a51f9d0 con 0x55d42a534a60 2026-02-24T09:20:42.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.733+0000 7f59c6e0ce00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55d42a260f10 con 0x55d42a616740 2026-02-24T09:20:42.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.733+0000 7f59c6e0ce00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55d42a585580 con 0x55d42a65b270 2026-02-24T09:20:42.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.733+0000 7f59c2590640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d42a534a60 0x55d42a66fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.733+0000 7f59c2590640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d42a534a60 0x55d42a66fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51432/0 (socket says 10.20.193.28:51432) 2026-02-24T09:20:42.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.733+0000 7f59c2590640 1 -- 10.20.193.28:0/2448665181 learned_addr learned my addr 10.20.193.28:0/2448665181 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:20:42.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.733+0000 7f59c2d91640 1 --2- 10.20.193.28:0/2448665181 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d42a65b270 0x55d42a656360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.733+0000 7f59c1d8f640 1 --2- 10.20.193.28:0/2448665181 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d42a616740 0x55d42a6701c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.733+0000 7f59c2590640 1 -- 10.20.193.28:0/2448665181 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d42a65b270 msgr2=0x55d42a656360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:42.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.733+0000 7f59c2590640 1 --2- 10.20.193.28:0/2448665181 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d42a65b270 0x55d42a656360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.733+0000 7f59c2590640 1 -- 10.20.193.28:0/2448665181 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d42a616740 msgr2=0x55d42a6701c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:42.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.733+0000 7f59c2590640 1 --2- 10.20.193.28:0/2448665181 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d42a616740 0x55d42a6701c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.733+0000 7f59c2590640 1 -- 10.20.193.28:0/2448665181 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d42a4b2030 con 0x55d42a534a60 2026-02-24T09:20:42.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.733+0000 7f59c2590640 1 --2- 10.20.193.28:0/2448665181 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d42a534a60 0x55d42a66fc80 secure :-1 s=READY pgs=456 gs=1 cs=0 l=1 c_cookie=4327737422498117116 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59b4004100 tx=0x7f59b4004000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c0f3641a52a35fc server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:42.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.734+0000 7f598a3ff640 1 -- 10.20.193.28:0/2448665181 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59b4002960 con 0x55d42a534a60 2026-02-24T09:20:42.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.734+0000 7f598a3ff640 1 -- 10.20.193.28:0/2448665181 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x55d42a4f39d0 con 0x55d42a534a60 2026-02-24T09:20:42.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.734+0000 7f598a3ff640 1 -- 10.20.193.28:0/2448665181 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59b4022df0 con 0x55d42a534a60 2026-02-24T09:20:42.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.735+0000 7f59c6e0ce00 1 -- 10.20.193.28:0/2448665181 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d42a534a60 msgr2=0x55d42a66fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.735+0000 7f59c6e0ce00 1 --2- 10.20.193.28:0/2448665181 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d42a534a60 0x55d42a66fc80 secure :-1 s=READY pgs=456 gs=1 cs=0 l=1 c_cookie=4327737422498117116 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59b4004100 tx=0x7f59b4004000 comp rx=0 tx=0).stop 2026-02-24T09:20:42.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.735+0000 7f59c6e0ce00 1 -- 10.20.193.28:0/2448665181 shutdown_connections 2026-02-24T09:20:42.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.735+0000 7f59c6e0ce00 1 --2- 10.20.193.28:0/2448665181 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d42a65b270 0x55d42a656360 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.735+0000 7f59c6e0ce00 1 --2- 10.20.193.28:0/2448665181 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d42a616740 0x55d42a6701c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.735+0000 7f59c6e0ce00 1 --2- 10.20.193.28:0/2448665181 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d42a534a60 0x55d42a66fc80 unknown :-1 s=CLOSED pgs=456 gs=1 cs=0 l=1 c_cookie=4327737422498117116 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.735+0000 7f59c6e0ce00 1 -- 10.20.193.28:0/2448665181 >> 10.20.193.28:0/2448665181 conn(0x55d42a5b0490 msgr2=0x55d42a6583b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:42.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.735+0000 7f59c6e0ce00 1 -- 10.20.193.28:0/2448665181 shutdown_connections 2026-02-24T09:20:42.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.735+0000 7f59c6e0ce00 1 -- 10.20.193.28:0/2448665181 wait complete. 2026-02-24T09:20:42.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.736+0000 7f59c6e0ce00 1 -- start start 2026-02-24T09:20:42.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.736+0000 7f59c6e0ce00 1 Processor -- start 2026-02-24T09:20:42.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.736+0000 7f59c6e0ce00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d42a534a60 0x55d42a5f6990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.736+0000 7f59c6e0ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d42a616740 0x55d42a5f6ed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.736+0000 7f59c6e0ce00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d42a65b270 0x55d42a6bff50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.736+0000 7f59c6e0ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d42a527c40 con 0x55d42a616740 2026-02-24T09:20:42.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.736+0000 7f59c6e0ce00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55d42a5f76f0 con 0x55d42a534a60 2026-02-24T09:20:42.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.736+0000 7f59c6e0ce00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55d42a6c0490 con 0x55d42a65b270 2026-02-24T09:20:42.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.737+0000 7f59c1d8f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d42a616740 0x55d42a5f6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.737+0000 7f59c1d8f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d42a616740 0x55d42a5f6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51434/0 (socket says 10.20.193.28:51434) 2026-02-24T09:20:42.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.737+0000 7f59c1d8f640 1 -- 10.20.193.28:0/3705710270 learned_addr learned my addr 10.20.193.28:0/3705710270 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:20:42.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.737+0000 7f59c1d8f640 1 -- 10.20.193.28:0/3705710270 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d42a65b270 msgr2=0x55d42a6bff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:42.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.737+0000 7f59c1d8f640 1 --2- 10.20.193.28:0/3705710270 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d42a65b270 0x55d42a6bff50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.737+0000 7f59c1d8f640 1 -- 10.20.193.28:0/3705710270 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d42a534a60 msgr2=0x55d42a5f6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:42.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.737+0000 7f59c1d8f640 1 --2- 10.20.193.28:0/3705710270 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d42a534a60 0x55d42a5f6990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.737+0000 7f59c1d8f640 1 -- 10.20.193.28:0/3705710270 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d42a4a6010 con 0x55d42a616740 2026-02-24T09:20:42.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.737+0000 7f59c1d8f640 1 --2- 10.20.193.28:0/3705710270 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d42a616740 0x55d42a5f6ed0 secure :-1 s=READY pgs=457 gs=1 cs=0 l=1 c_cookie=4293226780976224328 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59a800bda0 tx=0x7f59a800d530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b949b02c4481848 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:42.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.737+0000 7f596ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:20:42.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.737+0000 7f596ffff640 1 -- 10.20.193.28:0/3705710270 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59a80042f0 con 0x55d42a616740 2026-02-24T09:20:42.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.737+0000 7f596ffff640 1 -- 10.20.193.28:0/3705710270 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f59a800de60 con 0x55d42a616740 2026-02-24T09:20:42.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.737+0000 7f596ffff640 1 -- 10.20.193.28:0/3705710270 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59a8012830 con 0x55d42a616740 2026-02-24T09:20:42.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.737+0000 7f59c6e0ce00 1 -- 10.20.193.28:0/3705710270 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59b400e040 con 0x55d42a616740 2026-02-24T09:20:42.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.738+0000 7f59c6e0ce00 10 client.15780 _ll_register_callbacks cb 0x55d42a4ac980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:42.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.738+0000 7f596ffff640 1 -- 10.20.193.28:0/3705710270 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7f59a80129c0 con 0x55d42a616740 2026-02-24T09:20:42.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.738+0000 7f59c6e0ce00 1 -- 10.20.193.28:0/3705710270 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d42a552d30 con 0x55d42a616740 2026-02-24T09:20:42.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.738+0000 7f596ffff640 1 -- 10.20.193.28:0/3705710270 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f59a8004450 con 0x55d42a616740 2026-02-24T09:20:42.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.738+0000 7f59c6e0ce00 10 client.15780 fetch_fsmap learned FSMap version 23 2026-02-24T09:20:42.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.738+0000 7f59c6e0ce00 1 -- 10.20.193.28:0/3705710270 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x55d42a4b7810 con 0x55d42a616740 2026-02-24T09:20:42.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.738+0000 7f596ffff640 1 -- 10.20.193.28:0/3705710270 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f59a8012bc0 con 0x55d42a616740 2026-02-24T09:20:42.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.738+0000 7f59c6e0ce00 10 client.15780 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:20:42.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.738+0000 7f59c6e0ce00 10 client.15780 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:20:42.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.738+0000 7f59c6e0ce00 20 client.15780 populate_metadata read hostname 'trial028' 2026-02-24T09:20:42.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.738+0000 7f59c6e0ce00 1 --2- 10.20.193.28:0/3705710270 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55d42a7085a0 0x55d42a7289c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.738+0000 7f59c6e0ce00 4 client.15780 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-24T09:20:42.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.738+0000 7f59c6e0ce00 1 -- 10.20.193.28:0/3705710270 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d42a205640 con 0x55d42a7085a0 2026-02-24T09:20:42.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.739+0000 7f59c2590640 1 --2- 10.20.193.28:0/3705710270 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55d42a7085a0 0x55d42a7289c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.740+0000 7f59c2590640 1 --2- 10.20.193.28:0/3705710270 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55d42a7085a0 0x55d42a7289c0 crc :-1 s=READY pgs=53 gs=4 cs=0 l=0 c_cookie=8692116966617865282 s_cookie=5857495059343358581 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78a09a540d675c42 server_cookie=514a00b8ddc43a75 in_seq=0 out_seq=0 2026-02-24T09:20:42.745 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.740+0000 7f596ffff640 10 client.15780 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:20:42.750 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.748+0000 7f596ffff640 1 -- 10.20.193.28:0/3705710270 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d42a205640 con 0x55d42a7085a0 2026-02-24T09:20:42.750 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.748+0000 7f596ffff640 10 client.15780 handle_command_reply: tid=0 2026-02-24T09:20:42.750 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.748+0000 7f59c6e0ce00 1 client.15780 shutdown 2026-02-24T09:20:42.751 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.749+0000 7f59c6e0ce00 1 -- 10.20.193.28:0/3705710270 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d42a616740 msgr2=0x55d42a5f6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.751 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.749+0000 7f59c6e0ce00 1 --2- 10.20.193.28:0/3705710270 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d42a616740 0x55d42a5f6ed0 secure :-1 s=READY pgs=457 gs=1 cs=0 l=1 c_cookie=4293226780976224328 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59a800bda0 tx=0x7f59a800d530 comp rx=0 tx=0).stop 2026-02-24T09:20:42.751 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.750+0000 7f59c6e0ce00 1 -- 10.20.193.28:0/3705710270 shutdown_connections 2026-02-24T09:20:42.752 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.750+0000 7f59c6e0ce00 1 --2- 10.20.193.28:0/3705710270 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55d42a7085a0 0x55d42a7289c0 crc :-1 s=READY pgs=53 gs=4 cs=0 l=0 c_cookie=8692116966617865282 s_cookie=5857495059343358581 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.752 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.750+0000 7f59c6e0ce00 1 --2- 10.20.193.28:0/3705710270 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d42a65b270 0x55d42a6bff50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.752 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.750+0000 7f59c6e0ce00 1 --2- 10.20.193.28:0/3705710270 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d42a616740 0x55d42a5f6ed0 unknown :-1 s=CLOSED pgs=457 gs=1 cs=0 l=1 c_cookie=4293226780976224328 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.752 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.750+0000 7f59c6e0ce00 1 --2- 10.20.193.28:0/3705710270 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d42a534a60 0x55d42a5f6990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.752 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.750+0000 7f59c6e0ce00 1 -- 10.20.193.28:0/3705710270 >> 10.20.193.28:0/3705710270 conn(0x55d42a5b0490 msgr2=0x55d42a66fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:42.752 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.750+0000 7f596ffff640 0 client.15780 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:20:42.752 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.750+0000 7f59c6e0ce00 1 -- 10.20.193.28:0/3705710270 shutdown_connections 2026-02-24T09:20:42.752 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.750+0000 7f59c6e0ce00 1 -- 10.20.193.28:0/3705710270 wait complete. 2026-02-24T09:20:42.752 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.750+0000 7f59c6e0ce00 20 client.15780 trim_cache size 0 max 16384 2026-02-24T09:20:42.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-24T09:20:42.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-24T09:20:42.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-24T09:20:42.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-24T09:20:42.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.752+0000 7f59c3592640 1 -- 10.20.193.28:0/2700969076 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f59980b58c0 msgr2=0x7f59980d5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.752+0000 7f59c3592640 1 --2- 10.20.193.28:0/2700969076 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f59980b58c0 0x7f59980d5d70 secure :-1 s=READY pgs=237 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59b4004760 tx=0x7f59b4008040 comp rx=0 tx=0).stop 2026-02-24T09:20:42.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.752+0000 7f59c3592640 1 -- 10.20.193.28:0/2700969076 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59bc119b40 msgr2=0x7f59bc0fbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.752+0000 7f59c3592640 1 --2- 10.20.193.28:0/2700969076 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59bc119b40 0x7f59bc0fbd70 secure :-1 s=READY pgs=453 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59b0006c10 tx=0x7f59b00039b0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.752+0000 7f59c3592640 1 -- 10.20.193.28:0/2700969076 shutdown_connections 2026-02-24T09:20:42.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.752+0000 7f59c3592640 1 --2- 10.20.193.28:0/2700969076 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f59980b58c0 0x7f59980d5d70 unknown :-1 s=CLOSED pgs=237 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.752+0000 7f59c3592640 1 --2- 10.20.193.28:0/2700969076 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59bc119b40 0x7f59bc0fbd70 unknown :-1 s=CLOSED pgs=453 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.752+0000 7f59c3592640 1 --2- 10.20.193.28:0/2700969076 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f59bc114340 0x7f59bc17a410 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.752+0000 7f59c3592640 1 --2- 10.20.193.28:0/2700969076 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f59bc113950 0x7f59bc0fb670 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.752+0000 7f59c3592640 1 -- 10.20.193.28:0/2700969076 >> 10.20.193.28:0/2700969076 conn(0x7f59bc0619a0 msgr2=0x7f59bc062d40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:42.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.752+0000 7f59c3592640 1 -- 10.20.193.28:0/2700969076 shutdown_connections 2026-02-24T09:20:42.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:42.752+0000 7f59c3592640 1 -- 10.20.193.28:0/2700969076 wait complete. 2026-02-24T09:20:42.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:42 trial159 ceph-mon[44242]: pgmap v295: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 84 KiB/s rd, 183 MiB/s wr, 74 op/s 2026-02-24T09:20:42.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:42 trial028 ceph-mon[40371]: pgmap v295: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 84 KiB/s rd, 183 MiB/s wr, 74 op/s 2026-02-24T09:20:42.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:42 trial074 ceph-mon[44412]: pgmap v295: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 84 KiB/s rd, 183 MiB/s wr, 74 op/s 2026-02-24T09:20:44.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:44 trial159 ceph-mon[44242]: pgmap v296: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 213 KiB/s rd, 166 MiB/s wr, 101 op/s 2026-02-24T09:20:44.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:44 trial028 ceph-mon[40371]: pgmap v296: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 213 KiB/s rd, 166 MiB/s wr, 101 op/s 2026-02-24T09:20:44.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:44 trial074 ceph-mon[44412]: pgmap v296: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 213 KiB/s rd, 166 MiB/s wr, 101 op/s 2026-02-24T09:20:46.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:46 trial159 ceph-mon[44242]: pgmap v297: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 348 KiB/s rd, 137 MiB/s wr, 127 op/s 2026-02-24T09:20:46.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:46 trial028 ceph-mon[40371]: pgmap v297: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 348 KiB/s rd, 137 MiB/s wr, 127 op/s 2026-02-24T09:20:46.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:46 trial074 ceph-mon[44412]: pgmap v297: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 348 KiB/s rd, 137 MiB/s wr, 127 op/s 2026-02-24T09:20:48.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:48 trial159 ceph-mon[44242]: pgmap v298: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 580 KiB/s rd, 167 MiB/s wr, 193 op/s 2026-02-24T09:20:48.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:48 trial028 ceph-mon[40371]: pgmap v298: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 580 KiB/s rd, 167 MiB/s wr, 193 op/s 2026-02-24T09:20:48.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:48 trial074 ceph-mon[44412]: pgmap v298: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 580 KiB/s rd, 167 MiB/s wr, 193 op/s 2026-02-24T09:20:50.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:50 trial159 ceph-mon[44242]: pgmap v299: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 760 KiB/s rd, 188 MiB/s wr, 243 op/s 2026-02-24T09:20:50.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:50 trial028 ceph-mon[40371]: pgmap v299: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 760 KiB/s rd, 188 MiB/s wr, 243 op/s 2026-02-24T09:20:50.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:50 trial074 ceph-mon[44412]: pgmap v299: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 760 KiB/s rd, 188 MiB/s wr, 243 op/s 2026-02-24T09:20:52.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:52 trial159 ceph-mon[44242]: pgmap v300: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 905 KiB/s rd, 223 MiB/s wr, 289 op/s 2026-02-24T09:20:52.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:52 trial028 ceph-mon[40371]: pgmap v300: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 905 KiB/s rd, 223 MiB/s wr, 289 op/s 2026-02-24T09:20:52.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:52 trial074 ceph-mon[44412]: pgmap v300: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 905 KiB/s rd, 223 MiB/s wr, 289 op/s 2026-02-24T09:20:54.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:54 trial159 ceph-mon[44242]: pgmap v301: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 1015 KiB/s rd, 252 MiB/s wr, 323 op/s 2026-02-24T09:20:54.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:54 trial028 ceph-mon[40371]: pgmap v301: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 1015 KiB/s rd, 252 MiB/s wr, 323 op/s 2026-02-24T09:20:54.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:54 trial074 ceph-mon[44412]: pgmap v301: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 1015 KiB/s rd, 252 MiB/s wr, 323 op/s 2026-02-24T09:20:55.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.829+0000 7fad9b2c3640 1 -- 10.20.193.28:0/4252168714 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad9410fdb0 msgr2=0x7fad94114e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:55.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.829+0000 7fad9b2c3640 1 --2- 10.20.193.28:0/4252168714 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad9410fdb0 0x7fad94114e00 secure :-1 s=READY pgs=458 gs=1 cs=0 l=1 c_cookie=424608913529256547 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fad88009950 tx=0x7fad8802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:20:55.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.829+0000 7fad9b2c3640 1 -- 10.20.193.28:0/4252168714 shutdown_connections 2026-02-24T09:20:55.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.829+0000 7fad9b2c3640 1 --2- 10.20.193.28:0/4252168714 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fad941155b0 0x7fad94175f80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:55.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.829+0000 7fad9b2c3640 1 --2- 10.20.193.28:0/4252168714 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad9410fdb0 0x7fad94114e00 unknown :-1 s=CLOSED pgs=458 gs=1 cs=0 l=1 c_cookie=424608913529256547 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:55.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.829+0000 7fad9b2c3640 1 --2- 10.20.193.28:0/4252168714 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fad9410f3c0 0x7fad9410f790 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:55.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.829+0000 7fad9b2c3640 1 -- 10.20.193.28:0/4252168714 >> 10.20.193.28:0/4252168714 conn(0x7fad940ecc70 msgr2=0x7fad9410d080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:55.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.829+0000 7fad9b2c3640 1 -- 10.20.193.28:0/4252168714 shutdown_connections 2026-02-24T09:20:55.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.829+0000 7fad9b2c3640 1 -- 10.20.193.28:0/4252168714 wait complete. 2026-02-24T09:20:55.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.830+0000 7fad9b2c3640 1 Processor -- start 2026-02-24T09:20:55.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.830+0000 7fad9b2c3640 1 -- start start 2026-02-24T09:20:55.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.830+0000 7fad9b2c3640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fad9410f3c0 0x7fad940f4d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:55.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.830+0000 7fad9b2c3640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fad9410fdb0 0x7fad94175e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:55.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.830+0000 7fad9b2c3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad941155b0 0x7fad940f5480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:55.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.830+0000 7fad9b2c3640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fad940fa690 con 0x7fad941155b0 2026-02-24T09:20:55.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.830+0000 7fad9b2c3640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fad940fa800 con 0x7fad9410f3c0 2026-02-24T09:20:55.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.830+0000 7fad9b2c3640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fad940fa9c0 con 0x7fad9410fdb0 2026-02-24T09:20:55.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.830+0000 7fad9aac2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad941155b0 0x7fad940f5480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:55.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.830+0000 7fad99ac0640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fad9410fdb0 0x7fad94175e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:55.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.830+0000 7fad9aac2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad941155b0 0x7fad940f5480 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45300/0 (socket says 10.20.193.28:45300) 2026-02-24T09:20:55.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.830+0000 7fad9aac2640 1 -- 10.20.193.28:0/4080353595 learned_addr learned my addr 10.20.193.28:0/4080353595 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:20:55.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.831+0000 7fad9aac2640 1 -- 10.20.193.28:0/4080353595 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fad9410fdb0 msgr2=0x7fad94175e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:55.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.831+0000 7fad9aac2640 1 --2- 10.20.193.28:0/4080353595 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fad9410fdb0 0x7fad94175e80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:55.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.831+0000 7fad9aac2640 1 -- 10.20.193.28:0/4080353595 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fad9410f3c0 msgr2=0x7fad940f4d80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:20:55.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.831+0000 7fad9aac2640 1 --2- 10.20.193.28:0/4080353595 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fad9410f3c0 0x7fad940f4d80 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:55.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.831+0000 7fad9aac2640 1 -- 10.20.193.28:0/4080353595 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad88009570 con 0x7fad941155b0 2026-02-24T09:20:55.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.831+0000 7fad9aac2640 1 --2- 10.20.193.28:0/4080353595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad941155b0 0x7fad940f5480 secure :-1 s=READY pgs=459 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fad90006e90 tx=0x7fad9000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:55.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.832+0000 7fad7b7fe640 1 -- 10.20.193.28:0/4080353595 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fad90005500 con 0x7fad941155b0 2026-02-24T09:20:55.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.832+0000 7fad7b7fe640 1 -- 10.20.193.28:0/4080353595 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fad90005df0 con 0x7fad941155b0 2026-02-24T09:20:55.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.832+0000 7fad7b7fe640 1 -- 10.20.193.28:0/4080353595 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fad90003a00 con 0x7fad941155b0 2026-02-24T09:20:55.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.832+0000 7fad9b2c3640 1 -- 10.20.193.28:0/4080353595 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad940faca0 con 0x7fad941155b0 2026-02-24T09:20:55.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.832+0000 7fad9b2c3640 1 -- 10.20.193.28:0/4080353595 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad940fb1a0 con 0x7fad941155b0 2026-02-24T09:20:55.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.835+0000 7fad7b7fe640 1 -- 10.20.193.28:0/4080353595 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7fad90003b60 con 0x7fad941155b0 2026-02-24T09:20:55.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.836+0000 7fad7b7fe640 1 --2- 10.20.193.28:0/4080353595 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fad700b5990 0x7fad700d5e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:55.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.836+0000 7fad7b7fe640 1 -- 10.20.193.28:0/4080353595 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7fad900e7c20 con 0x7fad941155b0 2026-02-24T09:20:55.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.837+0000 7fad9a2c1640 1 --2- 10.20.193.28:0/4080353595 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fad700b5990 0x7fad700d5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:55.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.837+0000 7fad9a2c1640 1 --2- 10.20.193.28:0/4080353595 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fad700b5990 0x7fad700d5e40 secure :-1 s=READY pgs=238 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fad84004740 tx=0x7fad84006cd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:55.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.837+0000 7fad9ec48e00 1 Processor -- start 2026-02-24T09:20:55.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.838+0000 7fad9ec48e00 1 -- start start 2026-02-24T09:20:55.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.838+0000 7fad9ec48e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b159549a60 0x55b15962b200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:55.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.838+0000 7fad9ec48e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55b15962b740 0x55b15962bb90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:55.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.838+0000 7fad9ec48e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55b159670270 0x55b159690650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:55.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.838+0000 7fad9ec48e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b159540f10 con 0x55b159549a60 2026-02-24T09:20:55.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.838+0000 7fad9ec48e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55b15953cc40 con 0x55b159670270 2026-02-24T09:20:55.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.838+0000 7fad9ec48e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55b159536da0 con 0x55b15962b740 2026-02-24T09:20:55.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.838+0000 7fad9a2c1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b159549a60 0x55b15962b200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:55.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.838+0000 7fad9a2c1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b159549a60 0x55b15962b200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45310/0 (socket says 10.20.193.28:45310) 2026-02-24T09:20:55.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.838+0000 7fad9a2c1640 1 -- 10.20.193.28:0/1845713704 learned_addr learned my addr 10.20.193.28:0/1845713704 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:20:55.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.838+0000 7fad9a2c1640 1 -- 10.20.193.28:0/1845713704 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55b15962b740 msgr2=0x55b15962bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:55.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.838+0000 7fad9a2c1640 1 --2- 10.20.193.28:0/1845713704 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55b15962b740 0x55b15962bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:55.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.838+0000 7fad9a2c1640 1 -- 10.20.193.28:0/1845713704 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55b159670270 msgr2=0x55b159690650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:55.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.838+0000 7fad9a2c1640 1 --2- 10.20.193.28:0/1845713704 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55b159670270 0x55b159690650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:55.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.838+0000 7fad9a2c1640 1 -- 10.20.193.28:0/1845713704 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1594e2340 con 0x55b159549a60 2026-02-24T09:20:55.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.838+0000 7fad9a2c1640 1 --2- 10.20.193.28:0/1845713704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b159549a60 0x55b15962b200 secure :-1 s=READY pgs=460 gs=1 cs=0 l=1 c_cookie=11008796358681873245 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fad840042d0 tx=0x7fad8400e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c719f60bd8cb5d server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:55.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.839+0000 7fad623ff640 1 -- 10.20.193.28:0/1845713704 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fad8401a070 con 0x55b159549a60 2026-02-24T09:20:55.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.839+0000 7fad623ff640 1 -- 10.20.193.28:0/1845713704 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fad84002d80 con 0x55b159549a60 2026-02-24T09:20:55.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.839+0000 7fad623ff640 1 -- 10.20.193.28:0/1845713704 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fad84013430 con 0x55b159549a60 2026-02-24T09:20:55.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.839+0000 7fad9ec48e00 1 -- 10.20.193.28:0/1845713704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b159549a60 msgr2=0x55b15962b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:55.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.839+0000 7fad9ec48e00 1 --2- 10.20.193.28:0/1845713704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b159549a60 0x55b15962b200 secure :-1 s=READY pgs=460 gs=1 cs=0 l=1 c_cookie=11008796358681873245 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fad840042d0 tx=0x7fad8400e000 comp rx=0 tx=0).stop 2026-02-24T09:20:55.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.839+0000 7fad9ec48e00 1 -- 10.20.193.28:0/1845713704 shutdown_connections 2026-02-24T09:20:55.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.839+0000 7fad9ec48e00 1 --2- 10.20.193.28:0/1845713704 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55b159670270 0x55b159690650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:55.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.839+0000 7fad9ec48e00 1 --2- 10.20.193.28:0/1845713704 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55b15962b740 0x55b15962bb90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:55.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.839+0000 7fad9ec48e00 1 --2- 10.20.193.28:0/1845713704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b159549a60 0x55b15962b200 unknown :-1 s=CLOSED pgs=460 gs=1 cs=0 l=1 c_cookie=11008796358681873245 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:55.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.839+0000 7fad9ec48e00 1 -- 10.20.193.28:0/1845713704 >> 10.20.193.28:0/1845713704 conn(0x55b1595c5490 msgr2=0x55b159629ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:55.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.839+0000 7fad9ec48e00 1 -- 10.20.193.28:0/1845713704 shutdown_connections 2026-02-24T09:20:55.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.839+0000 7fad9ec48e00 1 -- 10.20.193.28:0/1845713704 wait complete. 2026-02-24T09:20:55.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.840+0000 7fad9ec48e00 1 -- start start 2026-02-24T09:20:55.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.841+0000 7fad9ec48e00 1 Processor -- start 2026-02-24T09:20:55.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.841+0000 7fad9ec48e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55b159549a60 0x55b15962c210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:55.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.841+0000 7fad9ec48e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b15962b740 0x55b15962c750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:55.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.841+0000 7fad9ec48e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55b159670270 0x55b159651270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:55.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.841+0000 7fad9ec48e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b15962cfe0 con 0x55b15962b740 2026-02-24T09:20:55.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.841+0000 7fad9ec48e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55b1596517b0 con 0x55b159670270 2026-02-24T09:20:55.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.841+0000 7fad9ec48e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55b159687620 con 0x55b159549a60 2026-02-24T09:20:55.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.841+0000 7fad99ac0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b15962b740 0x55b15962c750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:55.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.841+0000 7fad99ac0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b15962b740 0x55b15962c750 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45324/0 (socket says 10.20.193.28:45324) 2026-02-24T09:20:55.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.841+0000 7fad99ac0640 1 -- 10.20.193.28:0/885265096 learned_addr learned my addr 10.20.193.28:0/885265096 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:20:55.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.841+0000 7fad9aac2640 1 --2- 10.20.193.28:0/885265096 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55b159670270 0x55b159651270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:55.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.842+0000 7fad99ac0640 1 -- 10.20.193.28:0/885265096 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55b159549a60 msgr2=0x55b15962c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:55.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.842+0000 7fad99ac0640 1 --2- 10.20.193.28:0/885265096 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55b159549a60 0x55b15962c210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:55.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.842+0000 7fad99ac0640 1 -- 10.20.193.28:0/885265096 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55b159670270 msgr2=0x55b159651270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:55.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.842+0000 7fad99ac0640 1 --2- 10.20.193.28:0/885265096 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55b159670270 0x55b159651270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:55.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.842+0000 7fad99ac0640 1 -- 10.20.193.28:0/885265096 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1594bace0 con 0x55b15962b740 2026-02-24T09:20:55.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.842+0000 7fad99ac0640 1 --2- 10.20.193.28:0/885265096 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b15962b740 0x55b15962c750 secure :-1 s=READY pgs=461 gs=1 cs=0 l=1 c_cookie=11337681824650581682 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fad8802f6e0 tx=0x7fad88004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d57898cc6b356b2 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:55.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.842+0000 7fad4b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:20:55.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.842+0000 7fad4b7fe640 1 -- 10.20.193.28:0/885265096 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fad8803d050 con 0x55b15962b740 2026-02-24T09:20:55.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.842+0000 7fad4b7fe640 1 -- 10.20.193.28:0/885265096 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fad8803e040 con 0x55b15962b740 2026-02-24T09:20:55.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.842+0000 7fad4b7fe640 1 -- 10.20.193.28:0/885265096 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fad88038e10 con 0x55b15962b740 2026-02-24T09:20:55.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.842+0000 7fad9ec48e00 1 -- 10.20.193.28:0/885265096 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad84009df0 con 0x55b15962b740 2026-02-24T09:20:55.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.842+0000 7fad4b7fe640 1 -- 10.20.193.28:0/885265096 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7fad8804b400 con 0x55b15962b740 2026-02-24T09:20:55.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.842+0000 7fad4b7fe640 10 client.15792 inactive, discarding osd_map(96..96 src has 1..96) 2026-02-24T09:20:55.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.843+0000 7fad9ec48e00 10 client.15792 _ll_register_callbacks cb 0x55b1594c1980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:55.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.843+0000 7fad9ec48e00 1 -- 10.20.193.28:0/885265096 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b1591d6520 con 0x55b15962b740 2026-02-24T09:20:55.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.843+0000 7fad4b7fe640 1 -- 10.20.193.28:0/885265096 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fad88005e60 con 0x55b15962b740 2026-02-24T09:20:55.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.843+0000 7fad9ec48e00 10 client.15792 fetch_fsmap learned FSMap version 23 2026-02-24T09:20:55.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.843+0000 7fad9ec48e00 1 -- 10.20.193.28:0/885265096 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x55b1594cc5b0 con 0x55b15962b740 2026-02-24T09:20:55.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.843+0000 7fad4b7fe640 1 -- 10.20.193.28:0/885265096 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fad88052020 con 0x55b15962b740 2026-02-24T09:20:55.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.843+0000 7fad9ec48e00 10 client.15792 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:20:55.848 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.843+0000 7fad9ec48e00 10 client.15792 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:20:55.848 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.843+0000 7fad9ec48e00 20 client.15792 populate_metadata read hostname 'trial028' 2026-02-24T09:20:55.848 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.843+0000 7fad9ec48e00 1 --2- 10.20.193.28:0/885265096 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55b15968be00 0x55b15968c2a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:55.848 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.843+0000 7fad9ec48e00 4 client.15792 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:20:55.848 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.843+0000 7fad9ec48e00 1 -- 10.20.193.28:0/885265096 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1595089d0 con 0x55b15968be00 2026-02-24T09:20:55.848 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.847+0000 7fad9a2c1640 1 --2- 10.20.193.28:0/885265096 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55b15968be00 0x55b15968c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:55.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.852+0000 7fad9a2c1640 1 --2- 10.20.193.28:0/885265096 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55b15968be00 0x55b15968c2a0 crc :-1 s=READY pgs=54 gs=4 cs=0 l=0 c_cookie=6558284408970327506 s_cookie=9462459318253332549 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b03b4ec34a8b5d2 server_cookie=8351689d9e132845 in_seq=0 out_seq=0 2026-02-24T09:20:55.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.852+0000 7fad4b7fe640 10 client.15792 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:20:55.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.854+0000 7fad4b7fe640 1 -- 10.20.193.28:0/885265096 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55b1595089d0 con 0x55b15968be00 2026-02-24T09:20:55.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.854+0000 7fad4b7fe640 10 client.15792 handle_command_reply: tid=0 2026-02-24T09:20:55.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.854+0000 7fad9ec48e00 1 client.15792 shutdown 2026-02-24T09:20:55.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.855+0000 7fad9ec48e00 1 -- 10.20.193.28:0/885265096 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b15962b740 msgr2=0x55b15962c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:55.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.855+0000 7fad9ec48e00 1 --2- 10.20.193.28:0/885265096 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b15962b740 0x55b15962c750 secure :-1 s=READY pgs=461 gs=1 cs=0 l=1 c_cookie=11337681824650581682 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fad8802f6e0 tx=0x7fad88004290 comp rx=0 tx=0).stop 2026-02-24T09:20:55.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.855+0000 7fad9ec48e00 1 -- 10.20.193.28:0/885265096 shutdown_connections 2026-02-24T09:20:55.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.855+0000 7fad9ec48e00 1 --2- 10.20.193.28:0/885265096 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55b15968be00 0x55b15968c2a0 crc :-1 s=READY pgs=54 gs=4 cs=0 l=0 c_cookie=6558284408970327506 s_cookie=9462459318253332549 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:55.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.855+0000 7fad9ec48e00 1 --2- 10.20.193.28:0/885265096 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55b159670270 0x55b159651270 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:55.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.855+0000 7fad9ec48e00 1 --2- 10.20.193.28:0/885265096 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b15962b740 0x55b15962c750 unknown :-1 s=CLOSED pgs=461 gs=1 cs=0 l=1 c_cookie=11337681824650581682 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:55.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.855+0000 7fad9ec48e00 1 --2- 10.20.193.28:0/885265096 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55b159549a60 0x55b15962c210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:55.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.855+0000 7fad9ec48e00 1 -- 10.20.193.28:0/885265096 >> 10.20.193.28:0/885265096 conn(0x55b1595c5490 msgr2=0x55b1596292f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:55.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.855+0000 7fad4b7fe640 0 client.15792 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:20:55.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.855+0000 7fad9ec48e00 1 -- 10.20.193.28:0/885265096 shutdown_connections 2026-02-24T09:20:55.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.855+0000 7fad9ec48e00 1 -- 10.20.193.28:0/885265096 wait complete. 2026-02-24T09:20:55.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.855+0000 7fad9ec48e00 20 client.15792 trim_cache size 0 max 16384 2026-02-24T09:20:55.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.863+0000 7fad9ec48e00 1 Processor -- start 2026-02-24T09:20:55.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.863+0000 7fad9ec48e00 1 -- start start 2026-02-24T09:20:55.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.864+0000 7fad9ec48e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55b159549a60 0x55b15966faf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:55.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.864+0000 7fad9ec48e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b15962b740 0x55b159686d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:55.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.864+0000 7fad9ec48e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55b159670270 0x55b159683ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:55.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.864+0000 7fad9ec48e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b1595349d0 con 0x55b15962b740 2026-02-24T09:20:55.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.864+0000 7fad9ec48e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55b159275f10 con 0x55b159549a60 2026-02-24T09:20:55.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.864+0000 7fad9ec48e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55b15968ffa0 con 0x55b159670270 2026-02-24T09:20:55.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.864+0000 7fad99ac0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b15962b740 0x55b159686d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:55.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.864+0000 7fad99ac0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b15962b740 0x55b159686d80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45334/0 (socket says 10.20.193.28:45334) 2026-02-24T09:20:55.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.864+0000 7fad99ac0640 1 -- 10.20.193.28:0/3773165694 learned_addr learned my addr 10.20.193.28:0/3773165694 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:20:55.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.864+0000 7fad99ac0640 1 -- 10.20.193.28:0/3773165694 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55b159670270 msgr2=0x55b159683ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:20:55.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.864+0000 7fad99ac0640 1 --2- 10.20.193.28:0/3773165694 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55b159670270 0x55b159683ae0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:55.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.864+0000 7fad99ac0640 1 -- 10.20.193.28:0/3773165694 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55b159549a60 msgr2=0x55b15966faf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:20:55.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.864+0000 7fad99ac0640 1 --2- 10.20.193.28:0/3773165694 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55b159549a60 0x55b15966faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:55.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.864+0000 7fad99ac0640 1 -- 10.20.193.28:0/3773165694 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b159679e30 con 0x55b15962b740 2026-02-24T09:20:55.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.864+0000 7fad99ac0640 1 --2- 10.20.193.28:0/3773165694 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b15962b740 0x55b159686d80 secure :-1 s=READY pgs=462 gs=1 cs=0 l=1 c_cookie=2404668232340008111 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fad8802f6e0 tx=0x7fad8804d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=215f19044f4aecaf server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:55.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.865+0000 7fad61bfe640 1 -- 10.20.193.28:0/3773165694 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fad8803d070 con 0x55b15962b740 2026-02-24T09:20:55.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.865+0000 7fad61bfe640 1 -- 10.20.193.28:0/3773165694 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x55b1591d6520 con 0x55b15962b740 2026-02-24T09:20:55.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.865+0000 7fad61bfe640 1 -- 10.20.193.28:0/3773165694 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fad880388b0 con 0x55b15962b740 2026-02-24T09:20:55.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.866+0000 7fad9ec48e00 1 -- 10.20.193.28:0/3773165694 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b15962b740 msgr2=0x55b159686d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:55.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.866+0000 7fad9ec48e00 1 --2- 10.20.193.28:0/3773165694 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b15962b740 0x55b159686d80 secure :-1 s=READY pgs=462 gs=1 cs=0 l=1 c_cookie=2404668232340008111 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fad8802f6e0 tx=0x7fad8804d000 comp rx=0 tx=0).stop 2026-02-24T09:20:55.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.866+0000 7fad9ec48e00 1 -- 10.20.193.28:0/3773165694 shutdown_connections 2026-02-24T09:20:55.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.866+0000 7fad9ec48e00 1 --2- 10.20.193.28:0/3773165694 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55b159670270 0x55b159683ae0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:55.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.866+0000 7fad9ec48e00 1 --2- 10.20.193.28:0/3773165694 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b15962b740 0x55b159686d80 unknown :-1 s=CLOSED pgs=462 gs=1 cs=0 l=1 c_cookie=2404668232340008111 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:55.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.866+0000 7fad9ec48e00 1 --2- 10.20.193.28:0/3773165694 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55b159549a60 0x55b15966faf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:55.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.866+0000 7fad9ec48e00 1 -- 10.20.193.28:0/3773165694 >> 10.20.193.28:0/3773165694 conn(0x55b1595c5490 msgr2=0x55b15966f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:55.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.866+0000 7fad9ec48e00 1 -- 10.20.193.28:0/3773165694 shutdown_connections 2026-02-24T09:20:55.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.866+0000 7fad9ec48e00 1 -- 10.20.193.28:0/3773165694 wait complete. 2026-02-24T09:20:55.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.867+0000 7fad9ec48e00 1 -- start start 2026-02-24T09:20:55.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.867+0000 7fad9ec48e00 1 Processor -- start 2026-02-24T09:20:55.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.867+0000 7fad9ec48e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55b159549a60 0x55b15960bc00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:55.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.867+0000 7fad9ec48e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55b15962b740 0x55b15960c140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:55.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.867+0000 7fad9ec48e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b159670270 0x55b15972d250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:55.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.867+0000 7fad9ec48e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b15960ca60 con 0x55b159670270 2026-02-24T09:20:55.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.867+0000 7fad9ec48e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55b15972d790 con 0x55b15962b740 2026-02-24T09:20:55.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.867+0000 7fad9ec48e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55b15972d920 con 0x55b159549a60 2026-02-24T09:20:55.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.867+0000 7fad9aac2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b159670270 0x55b15972d250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:55.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.867+0000 7fad9aac2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b159670270 0x55b15972d250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45340/0 (socket says 10.20.193.28:45340) 2026-02-24T09:20:55.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.867+0000 7fad9aac2640 1 -- 10.20.193.28:0/1761862151 learned_addr learned my addr 10.20.193.28:0/1761862151 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:20:55.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.868+0000 7fad9aac2640 1 -- 10.20.193.28:0/1761862151 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55b159549a60 msgr2=0x55b15960bc00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:20:55.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.868+0000 7fad9aac2640 1 --2- 10.20.193.28:0/1761862151 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55b159549a60 0x55b15960bc00 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:55.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.868+0000 7fad9aac2640 1 -- 10.20.193.28:0/1761862151 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55b15962b740 msgr2=0x55b15960c140 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:20:55.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.868+0000 7fad9aac2640 1 --2- 10.20.193.28:0/1761862151 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55b15962b740 0x55b15960c140 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:55.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.868+0000 7fad9aac2640 1 -- 10.20.193.28:0/1761862151 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1594c7030 con 0x55b159670270 2026-02-24T09:20:55.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.868+0000 7fad9aac2640 1 --2- 10.20.193.28:0/1761862151 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b159670270 0x55b15972d250 secure :-1 s=READY pgs=463 gs=1 cs=0 l=1 c_cookie=13206450065680962743 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fad900e7e30 tx=0x7fad900aa180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b746bc5d2cd914b7 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:55.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.868+0000 7fad4b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:20:55.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.868+0000 7fad4b7fe640 1 -- 10.20.193.28:0/1761862151 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fad900b8b30 con 0x55b159670270 2026-02-24T09:20:55.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.868+0000 7fad9ec48e00 1 -- 10.20.193.28:0/1761862151 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1594cc5b0 con 0x55b159670270 2026-02-24T09:20:55.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.868+0000 7fad9ec48e00 10 client.15798 _ll_register_callbacks cb 0x55b1594c1980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:55.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.868+0000 7fad9ec48e00 1 -- 10.20.193.28:0/1761862151 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b159567d30 con 0x55b159670270 2026-02-24T09:20:55.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.868+0000 7fad4b7fe640 1 -- 10.20.193.28:0/1761862151 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fad90003e40 con 0x55b159670270 2026-02-24T09:20:55.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.868+0000 7fad4b7fe640 1 -- 10.20.193.28:0/1761862151 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fad900aeb50 con 0x55b159670270 2026-02-24T09:20:55.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.868+0000 7fad4b7fe640 1 -- 10.20.193.28:0/1761862151 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7fad9000c8d0 con 0x55b159670270 2026-02-24T09:20:55.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.868+0000 7fad4b7fe640 1 -- 10.20.193.28:0/1761862151 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fad900abc40 con 0x55b159670270 2026-02-24T09:20:55.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.868+0000 7fad9ec48e00 10 client.15798 fetch_fsmap learned FSMap version 23 2026-02-24T09:20:55.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.868+0000 7fad9ec48e00 1 -- 10.20.193.28:0/1761862151 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x55b1594bb010 con 0x55b159670270 2026-02-24T09:20:55.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.869+0000 7fad4b7fe640 1 -- 10.20.193.28:0/1761862151 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fad900af650 con 0x55b159670270 2026-02-24T09:20:55.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.869+0000 7fad9ec48e00 10 client.15798 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:20:55.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.869+0000 7fad9ec48e00 10 client.15798 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:20:55.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.869+0000 7fad9ec48e00 20 client.15798 populate_metadata read hostname 'trial028' 2026-02-24T09:20:55.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.869+0000 7fad9ec48e00 1 --2- 10.20.193.28:0/1761862151 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55b15972f670 0x55b15974fb20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:55.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.869+0000 7fad9ec48e00 4 client.15798 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-24T09:20:55.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.869+0000 7fad9ec48e00 1 -- 10.20.193.28:0/1761862151 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b15921a640 con 0x55b15972f670 2026-02-24T09:20:55.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.870+0000 7fad9a2c1640 1 --2- 10.20.193.28:0/1761862151 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55b15972f670 0x55b15974fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:55.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.871+0000 7fad9a2c1640 1 --2- 10.20.193.28:0/1761862151 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55b15972f670 0x55b15974fb20 crc :-1 s=READY pgs=55 gs=2 cs=0 l=0 c_cookie=18261415231284653880 s_cookie=15032552263781139518 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd6d946654a12f38 server_cookie=d09e5aa3562b443e in_seq=0 out_seq=0 2026-02-24T09:20:55.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.871+0000 7fad4b7fe640 10 client.15798 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:20:55.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.880+0000 7fad4b7fe640 1 -- 10.20.193.28:0/1761862151 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b15921a640 con 0x55b15972f670 2026-02-24T09:20:55.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.880+0000 7fad4b7fe640 10 client.15798 handle_command_reply: tid=0 2026-02-24T09:20:55.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.880+0000 7fad9ec48e00 1 client.15798 shutdown 2026-02-24T09:20:55.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.880+0000 7fad9ec48e00 1 -- 10.20.193.28:0/1761862151 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b159670270 msgr2=0x55b15972d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:55.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.880+0000 7fad9ec48e00 1 --2- 10.20.193.28:0/1761862151 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b159670270 0x55b15972d250 secure :-1 s=READY pgs=463 gs=1 cs=0 l=1 c_cookie=13206450065680962743 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fad900e7e30 tx=0x7fad900aa180 comp rx=0 tx=0).stop 2026-02-24T09:20:55.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.880+0000 7fad9ec48e00 1 -- 10.20.193.28:0/1761862151 shutdown_connections 2026-02-24T09:20:55.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.880+0000 7fad9ec48e00 1 --2- 10.20.193.28:0/1761862151 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55b15972f670 0x55b15974fb20 crc :-1 s=READY pgs=55 gs=2 cs=0 l=0 c_cookie=18261415231284653880 s_cookie=15032552263781139518 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:55.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.880+0000 7fad9ec48e00 1 --2- 10.20.193.28:0/1761862151 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b159670270 0x55b15972d250 unknown :-1 s=CLOSED pgs=463 gs=1 cs=0 l=1 c_cookie=13206450065680962743 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:55.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.880+0000 7fad9ec48e00 1 --2- 10.20.193.28:0/1761862151 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55b15962b740 0x55b15960c140 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:55.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.880+0000 7fad9ec48e00 1 --2- 10.20.193.28:0/1761862151 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55b159549a60 0x55b15960bc00 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:55.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.880+0000 7fad9ec48e00 1 -- 10.20.193.28:0/1761862151 >> 10.20.193.28:0/1761862151 conn(0x55b1595c5490 msgr2=0x55b159685d70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:55.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.880+0000 7fad4b7fe640 0 client.15798 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:20:55.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.880+0000 7fad9ec48e00 1 -- 10.20.193.28:0/1761862151 shutdown_connections 2026-02-24T09:20:55.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.880+0000 7fad9ec48e00 1 -- 10.20.193.28:0/1761862151 wait complete. 2026-02-24T09:20:55.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.881+0000 7fad9ec48e00 20 client.15798 trim_cache size 0 max 16384 2026-02-24T09:20:55.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-24T09:20:55.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-24T09:20:55.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-24T09:20:55.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-24T09:20:55.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.881+0000 7fad9b2c3640 1 -- 10.20.193.28:0/4080353595 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fad700b5990 msgr2=0x7fad700d5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:55.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.881+0000 7fad9b2c3640 1 --2- 10.20.193.28:0/4080353595 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fad700b5990 0x7fad700d5e40 secure :-1 s=READY pgs=238 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fad84004740 tx=0x7fad84006cd0 comp rx=0 tx=0).stop 2026-02-24T09:20:55.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.881+0000 7fad9b2c3640 1 -- 10.20.193.28:0/4080353595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad941155b0 msgr2=0x7fad940f5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:55.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.881+0000 7fad9b2c3640 1 --2- 10.20.193.28:0/4080353595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad941155b0 0x7fad940f5480 secure :-1 s=READY pgs=459 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fad90006e90 tx=0x7fad9000edf0 comp rx=0 tx=0).stop 2026-02-24T09:20:55.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.881+0000 7fad9b2c3640 1 -- 10.20.193.28:0/4080353595 shutdown_connections 2026-02-24T09:20:55.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.881+0000 7fad9b2c3640 1 --2- 10.20.193.28:0/4080353595 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fad700b5990 0x7fad700d5e40 unknown :-1 s=CLOSED pgs=238 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:55.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.881+0000 7fad9b2c3640 1 --2- 10.20.193.28:0/4080353595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad941155b0 0x7fad940f5480 unknown :-1 s=CLOSED pgs=459 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:55.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.881+0000 7fad9b2c3640 1 --2- 10.20.193.28:0/4080353595 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fad9410fdb0 0x7fad94175e80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:55.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.881+0000 7fad9b2c3640 1 --2- 10.20.193.28:0/4080353595 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fad9410f3c0 0x7fad940f4d80 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:55.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.881+0000 7fad9b2c3640 1 -- 10.20.193.28:0/4080353595 >> 10.20.193.28:0/4080353595 conn(0x7fad940ecc70 msgr2=0x7fad9410da70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:55.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.881+0000 7fad9b2c3640 1 -- 10.20.193.28:0/4080353595 shutdown_connections 2026-02-24T09:20:55.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:20:55.881+0000 7fad9b2c3640 1 -- 10.20.193.28:0/4080353595 wait complete. 2026-02-24T09:20:56.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:56 trial159 ceph-mon[44242]: pgmap v302: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 254 MiB/s wr, 326 op/s 2026-02-24T09:20:56.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:56 trial028 ceph-mon[40371]: pgmap v302: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 254 MiB/s wr, 326 op/s 2026-02-24T09:20:56.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:56 trial074 ceph-mon[44412]: pgmap v302: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 254 MiB/s wr, 326 op/s 2026-02-24T09:20:58.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:20:58 trial159 ceph-mon[44242]: pgmap v303: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 277 MiB/s wr, 355 op/s 2026-02-24T09:20:58.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:20:58 trial028 ceph-mon[40371]: pgmap v303: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 277 MiB/s wr, 355 op/s 2026-02-24T09:20:58.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:20:58 trial074 ceph-mon[44412]: pgmap v303: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 277 MiB/s wr, 355 op/s 2026-02-24T09:21:00.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:00 trial159 ceph-mon[44242]: pgmap v304: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 262 MiB/s wr, 335 op/s 2026-02-24T09:21:00.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:00 trial028 ceph-mon[40371]: pgmap v304: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 262 MiB/s wr, 335 op/s 2026-02-24T09:21:00.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:00 trial074 ceph-mon[44412]: pgmap v304: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 262 MiB/s wr, 335 op/s 2026-02-24T09:21:02.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:02 trial159 ceph-mon[44242]: pgmap v305: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 259 MiB/s wr, 333 op/s 2026-02-24T09:21:02.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:02 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:21:02.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:02 trial028 ceph-mon[40371]: pgmap v305: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 259 MiB/s wr, 333 op/s 2026-02-24T09:21:02.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:02 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:21:02.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:02 trial074 ceph-mon[44412]: pgmap v305: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 259 MiB/s wr, 333 op/s 2026-02-24T09:21:02.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:02 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:21:03.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:03 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:21:03.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:03 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:21:03.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:03 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:21:03.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:03 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:21:03.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:03 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:21:03.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:03 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:21:03.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:03 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:21:03.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:03 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:21:03.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:03 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:21:03.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:03 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:21:03.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:03 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:21:03.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:03 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:21:04.775 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:04 trial074 ceph-mon[44412]: pgmap v306: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 262 MiB/s wr, 350 op/s 2026-02-24T09:21:04.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:04 trial159 ceph-mon[44242]: pgmap v306: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 262 MiB/s wr, 350 op/s 2026-02-24T09:21:04.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:04 trial028 ceph-mon[40371]: pgmap v306: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 262 MiB/s wr, 350 op/s 2026-02-24T09:21:06.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:06 trial159 ceph-mon[44242]: pgmap v307: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 257 MiB/s wr, 344 op/s 2026-02-24T09:21:06.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:06 trial028 ceph-mon[40371]: pgmap v307: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 257 MiB/s wr, 344 op/s 2026-02-24T09:21:06.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:06 trial074 ceph-mon[44412]: pgmap v307: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 257 MiB/s wr, 344 op/s 2026-02-24T09:21:08.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:08 trial159 ceph-mon[44242]: pgmap v308: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 279 MiB/s wr, 371 op/s 2026-02-24T09:21:08.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:08 trial028 ceph-mon[40371]: pgmap v308: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 279 MiB/s wr, 371 op/s 2026-02-24T09:21:08.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:08 trial074 ceph-mon[44412]: pgmap v308: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 279 MiB/s wr, 371 op/s 2026-02-24T09:21:08.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.957+0000 7fce2b54b640 1 -- 10.20.193.28:0/1768661311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fce24113950 msgr2=0x7fce24113d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:08.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.957+0000 7fce2b54b640 1 --2- 10.20.193.28:0/1768661311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fce24113950 0x7fce24113d20 secure :-1 s=READY pgs=464 gs=1 cs=0 l=1 c_cookie=11400706498296555275 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce14009950 tx=0x7fce1402f190 comp rx=0 tx=0).stop 2026-02-24T09:21:08.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.957+0000 7fce2b54b640 1 -- 10.20.193.28:0/1768661311 shutdown_connections 2026-02-24T09:21:08.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.957+0000 7fce2b54b640 1 --2- 10.20.193.28:0/1768661311 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fce24119b40 0x7fce2417a510 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:08.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.957+0000 7fce2b54b640 1 --2- 10.20.193.28:0/1768661311 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fce24114340 0x7fce24119390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:08.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.957+0000 7fce2b54b640 1 --2- 10.20.193.28:0/1768661311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fce24113950 0x7fce24113d20 unknown :-1 s=CLOSED pgs=464 gs=1 cs=0 l=1 c_cookie=11400706498296555275 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:08.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.957+0000 7fce2b54b640 1 -- 10.20.193.28:0/1768661311 >> 10.20.193.28:0/1768661311 conn(0x7fce240619a0 msgr2=0x7fce24061da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:08.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.957+0000 7fce2b54b640 1 -- 10.20.193.28:0/1768661311 shutdown_connections 2026-02-24T09:21:08.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.957+0000 7fce2b54b640 1 -- 10.20.193.28:0/1768661311 wait complete. 2026-02-24T09:21:08.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.958+0000 7fce2b54b640 1 Processor -- start 2026-02-24T09:21:08.963 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.961+0000 7fce2b54b640 1 -- start start 2026-02-24T09:21:08.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.961+0000 7fce2b54b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fce24113950 0x7fce241222a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:08.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.961+0000 7fce2b54b640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fce24114340 0x7fce241227e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:08.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.961+0000 7fce2b54b640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fce24119b40 0x7fce24127bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:08.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.961+0000 7fce2b54b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fce241281d0 con 0x7fce24113950 2026-02-24T09:21:08.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.961+0000 7fce2b54b640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fce24128340 con 0x7fce24114340 2026-02-24T09:21:08.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.961+0000 7fce2b54b640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fce24128500 con 0x7fce24119b40 2026-02-24T09:21:08.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.962+0000 7fce2a549640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fce24113950 0x7fce241222a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:08.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.962+0000 7fce2a549640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fce24113950 0x7fce241222a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55824/0 (socket says 10.20.193.28:55824) 2026-02-24T09:21:08.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.962+0000 7fce2a549640 1 -- 10.20.193.28:0/2616521861 learned_addr learned my addr 10.20.193.28:0/2616521861 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:21:08.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.962+0000 7fce2a549640 1 -- 10.20.193.28:0/2616521861 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fce24119b40 msgr2=0x7fce24127bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:21:08.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.962+0000 7fce2a549640 1 --2- 10.20.193.28:0/2616521861 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fce24119b40 0x7fce24127bb0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:08.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.962+0000 7fce2a549640 1 -- 10.20.193.28:0/2616521861 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fce24114340 msgr2=0x7fce241227e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:21:08.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.962+0000 7fce2a549640 1 --2- 10.20.193.28:0/2616521861 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fce24114340 0x7fce241227e0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:08.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.962+0000 7fce2a549640 1 -- 10.20.193.28:0/2616521861 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce14009570 con 0x7fce24113950 2026-02-24T09:21:08.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.962+0000 7fce2a549640 1 --2- 10.20.193.28:0/2616521861 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fce24113950 0x7fce241222a0 secure :-1 s=READY pgs=465 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce140098a0 tx=0x7fce140028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:08.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.963+0000 7fce0b7fe640 1 -- 10.20.193.28:0/2616521861 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce1403d070 con 0x7fce24113950 2026-02-24T09:21:08.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.963+0000 7fce0b7fe640 1 -- 10.20.193.28:0/2616521861 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fce14002a70 con 0x7fce24113950 2026-02-24T09:21:08.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.963+0000 7fce0b7fe640 1 -- 10.20.193.28:0/2616521861 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce14041890 con 0x7fce24113950 2026-02-24T09:21:08.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.963+0000 7fce2b54b640 1 -- 10.20.193.28:0/2616521861 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce24128780 con 0x7fce24113950 2026-02-24T09:21:08.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.963+0000 7fce2b54b640 1 -- 10.20.193.28:0/2616521861 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce24168dc0 con 0x7fce24113950 2026-02-24T09:21:08.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.967+0000 7fce0b7fe640 1 -- 10.20.193.28:0/2616521861 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7fce14048020 con 0x7fce24113950 2026-02-24T09:21:08.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.969+0000 7fce2edbbe00 1 Processor -- start 2026-02-24T09:21:08.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.969+0000 7fce2edbbe00 1 -- start start 2026-02-24T09:21:08.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.969+0000 7fce2edbbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55653ac39a60 0x55653ad1b200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:08.972 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.969+0000 7fce2edbbe00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55653ad1b740 0x55653ad1bb90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:08.972 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.969+0000 7fce2edbbe00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55653ad60270 0x55653ad80650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:08.972 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.969+0000 7fce2edbbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55653ac30f10 con 0x55653ac39a60 2026-02-24T09:21:08.972 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.969+0000 7fce2edbbe00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55653ac2cc40 con 0x55653ad1b740 2026-02-24T09:21:08.973 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.969+0000 7fce2edbbe00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55653ac26da0 con 0x55653ad60270 2026-02-24T09:21:08.973 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.969+0000 7fce0b7fe640 1 --2- 10.20.193.28:0/2616521861 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fce000b58d0 0x7fce000d5d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:08.973 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.970+0000 7fce0b7fe640 1 -- 10.20.193.28:0/2616521861 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7fce1410b090 con 0x7fce24113950 2026-02-24T09:21:08.973 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.970+0000 7fce2ad4a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55653ac39a60 0x55653ad1b200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:08.973 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.970+0000 7fce2ad4a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55653ac39a60 0x55653ad1b200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55838/0 (socket says 10.20.193.28:55838) 2026-02-24T09:21:08.973 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.970+0000 7fce2ad4a640 1 -- 10.20.193.28:0/3776471606 learned_addr learned my addr 10.20.193.28:0/3776471606 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:21:08.973 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.970+0000 7fce2ad4a640 1 --2- 10.20.193.28:0/2616521861 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fce000b58d0 0x7fce000d5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:08.973 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.970+0000 7fce29d48640 1 --2- 10.20.193.28:0/3776471606 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55653ad60270 0x55653ad80650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:08.973 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.970+0000 7fce2ad4a640 1 --2- 10.20.193.28:0/2616521861 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fce000b58d0 0x7fce000d5d80 secure :-1 s=READY pgs=239 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce20006e90 tx=0x7fce2000b720 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:08.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.971+0000 7fce2ad4a640 1 -- 10.20.193.28:0/3776471606 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55653ad60270 msgr2=0x55653ad80650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:08.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.971+0000 7fce2ad4a640 1 --2- 10.20.193.28:0/3776471606 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55653ad60270 0x55653ad80650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:08.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.971+0000 7fce2ad4a640 1 -- 10.20.193.28:0/3776471606 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55653ad1b740 msgr2=0x55653ad1bb90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:21:08.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.971+0000 7fce2ad4a640 1 --2- 10.20.193.28:0/3776471606 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55653ad1b740 0x55653ad1bb90 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:08.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.971+0000 7fce2ad4a640 1 -- 10.20.193.28:0/3776471606 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55653abd2340 con 0x55653ac39a60 2026-02-24T09:21:08.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.971+0000 7fce2ad4a640 1 --2- 10.20.193.28:0/3776471606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55653ac39a60 0x55653ad1b200 secure :-1 s=READY pgs=466 gs=1 cs=0 l=1 c_cookie=5760134303749831111 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce200106f0 tx=0x7fce2001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff01ba1798cf9c7 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:08.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.971+0000 7fce08bfe640 1 -- 10.20.193.28:0/3776471606 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce20018070 con 0x55653ac39a60 2026-02-24T09:21:08.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.971+0000 7fce08bfe640 1 -- 10.20.193.28:0/3776471606 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fce20022070 con 0x55653ac39a60 2026-02-24T09:21:08.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.971+0000 7fce08bfe640 1 -- 10.20.193.28:0/3776471606 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce2001e410 con 0x55653ac39a60 2026-02-24T09:21:08.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.971+0000 7fce2edbbe00 1 -- 10.20.193.28:0/3776471606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55653ac39a60 msgr2=0x55653ad1b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:08.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.971+0000 7fce2edbbe00 1 --2- 10.20.193.28:0/3776471606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55653ac39a60 0x55653ad1b200 secure :-1 s=READY pgs=466 gs=1 cs=0 l=1 c_cookie=5760134303749831111 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce200106f0 tx=0x7fce2001a000 comp rx=0 tx=0).stop 2026-02-24T09:21:08.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.972+0000 7fce2edbbe00 1 -- 10.20.193.28:0/3776471606 shutdown_connections 2026-02-24T09:21:08.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.972+0000 7fce2edbbe00 1 --2- 10.20.193.28:0/3776471606 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55653ad60270 0x55653ad80650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:08.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.972+0000 7fce2edbbe00 1 --2- 10.20.193.28:0/3776471606 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55653ad1b740 0x55653ad1bb90 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:08.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.972+0000 7fce2edbbe00 1 --2- 10.20.193.28:0/3776471606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55653ac39a60 0x55653ad1b200 unknown :-1 s=CLOSED pgs=466 gs=1 cs=0 l=1 c_cookie=5760134303749831111 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:08.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.972+0000 7fce2edbbe00 1 -- 10.20.193.28:0/3776471606 >> 10.20.193.28:0/3776471606 conn(0x55653acb5490 msgr2=0x55653ad19ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:08.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.972+0000 7fce2edbbe00 1 -- 10.20.193.28:0/3776471606 shutdown_connections 2026-02-24T09:21:08.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.972+0000 7fce2edbbe00 1 -- 10.20.193.28:0/3776471606 wait complete. 2026-02-24T09:21:08.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.973+0000 7fce2edbbe00 1 -- start start 2026-02-24T09:21:08.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.973+0000 7fce2edbbe00 1 Processor -- start 2026-02-24T09:21:08.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.973+0000 7fce2edbbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55653ac39a60 0x55653ad778d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:08.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.974+0000 7fce2edbbe00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55653ad1b740 0x55653ad77e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:08.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.974+0000 7fce2edbbe00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55653ad60270 0x55653ad7ce00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:08.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.974+0000 7fce2edbbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55653ad7d340 con 0x55653ac39a60 2026-02-24T09:21:08.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.974+0000 7fce2edbbe00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55653ad7d4b0 con 0x55653ad60270 2026-02-24T09:21:08.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.974+0000 7fce2edbbe00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55653ad7d670 con 0x55653ad1b740 2026-02-24T09:21:08.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.974+0000 7fce2a549640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55653ac39a60 0x55653ad778d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:08.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.974+0000 7fce2a549640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55653ac39a60 0x55653ad778d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55852/0 (socket says 10.20.193.28:55852) 2026-02-24T09:21:08.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.974+0000 7fce2a549640 1 -- 10.20.193.28:0/3317348379 learned_addr learned my addr 10.20.193.28:0/3317348379 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:21:08.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.974+0000 7fce2a549640 1 -- 10.20.193.28:0/3317348379 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55653ad1b740 msgr2=0x55653ad77e10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:21:08.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.974+0000 7fce2a549640 1 --2- 10.20.193.28:0/3317348379 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55653ad1b740 0x55653ad77e10 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:08.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.974+0000 7fce2a549640 1 -- 10.20.193.28:0/3317348379 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55653ad60270 msgr2=0x55653ad7ce00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:21:08.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.974+0000 7fce2a549640 1 --2- 10.20.193.28:0/3317348379 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55653ad60270 0x55653ad7ce00 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:08.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.974+0000 7fce2a549640 1 -- 10.20.193.28:0/3317348379 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55653abaace0 con 0x55653ac39a60 2026-02-24T09:21:08.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.975+0000 7fce2a549640 1 --2- 10.20.193.28:0/3317348379 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55653ac39a60 0x55653ad778d0 secure :-1 s=READY pgs=467 gs=1 cs=0 l=1 c_cookie=3005816193777231836 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce1402ffd0 tx=0x7fce1402fef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b6cde71a3567dc server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:08.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.975+0000 7fcdd7fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:21:08.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.975+0000 7fcdd7fff640 1 -- 10.20.193.28:0/3317348379 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce140d12d0 con 0x55653ac39a60 2026-02-24T09:21:08.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.975+0000 7fcdd7fff640 1 -- 10.20.193.28:0/3317348379 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fce140d0c00 con 0x55653ac39a60 2026-02-24T09:21:08.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.975+0000 7fcdd7fff640 1 -- 10.20.193.28:0/3317348379 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce140dc3f0 con 0x55653ac39a60 2026-02-24T09:21:08.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.975+0000 7fce2edbbe00 1 -- 10.20.193.28:0/3317348379 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce20010440 con 0x55653ac39a60 2026-02-24T09:21:08.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.975+0000 7fcdd7fff640 1 -- 10.20.193.28:0/3317348379 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7fce14048e70 con 0x55653ac39a60 2026-02-24T09:21:08.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.975+0000 7fcdd7fff640 10 client.15810 inactive, discarding osd_map(96..96 src has 1..96) 2026-02-24T09:21:08.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.975+0000 7fce2edbbe00 10 client.15810 _ll_register_callbacks cb 0x55653abb1980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:21:08.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.975+0000 7fce2edbbe00 1 -- 10.20.193.28:0/3317348379 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55653a8c6520 con 0x55653ac39a60 2026-02-24T09:21:08.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.976+0000 7fcdd7fff640 1 -- 10.20.193.28:0/3317348379 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fce140d0a20 con 0x55653ac39a60 2026-02-24T09:21:08.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.976+0000 7fce2edbbe00 10 client.15810 fetch_fsmap learned FSMap version 23 2026-02-24T09:21:08.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.976+0000 7fce2edbbe00 1 -- 10.20.193.28:0/3317348379 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x55653abbc5b0 con 0x55653ac39a60 2026-02-24T09:21:08.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.976+0000 7fcdd7fff640 1 -- 10.20.193.28:0/3317348379 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fce140cf200 con 0x55653ac39a60 2026-02-24T09:21:08.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.976+0000 7fce2edbbe00 10 client.15810 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:21:08.983 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.976+0000 7fce2edbbe00 10 client.15810 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:21:08.983 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.976+0000 7fce2edbbe00 20 client.15810 populate_metadata read hostname 'trial028' 2026-02-24T09:21:08.983 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.976+0000 7fce2edbbe00 1 --2- 10.20.193.28:0/3317348379 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55653ad5d500 0x55653ad5d9a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:08.983 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.976+0000 7fce2edbbe00 4 client.15810 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:21:08.983 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.976+0000 7fce2edbbe00 1 -- 10.20.193.28:0/3317348379 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55653abf89d0 con 0x55653ad5d500 2026-02-24T09:21:08.984 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.979+0000 7fce29d48640 1 --2- 10.20.193.28:0/3317348379 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55653ad5d500 0x55653ad5d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:08.985 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.983+0000 7fcdd7fff640 10 client.15810 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:21:08.985 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.983+0000 7fce29d48640 1 --2- 10.20.193.28:0/3317348379 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55653ad5d500 0x55653ad5d9a0 crc :-1 s=READY pgs=56 gs=2 cs=0 l=0 c_cookie=5966646477194765345 s_cookie=15508619108570724673 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52cdc95bbd87a421 server_cookie=d739aee93b317941 in_seq=0 out_seq=0 2026-02-24T09:21:08.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.984+0000 7fcdd7fff640 1 -- 10.20.193.28:0/3317348379 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55653abf89d0 con 0x55653ad5d500 2026-02-24T09:21:08.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.984+0000 7fcdd7fff640 10 client.15810 handle_command_reply: tid=0 2026-02-24T09:21:08.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.984+0000 7fce2edbbe00 1 client.15810 shutdown 2026-02-24T09:21:08.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.985+0000 7fce2edbbe00 1 -- 10.20.193.28:0/3317348379 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55653ac39a60 msgr2=0x55653ad778d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:08.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.985+0000 7fce2edbbe00 1 --2- 10.20.193.28:0/3317348379 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55653ac39a60 0x55653ad778d0 secure :-1 s=READY pgs=467 gs=1 cs=0 l=1 c_cookie=3005816193777231836 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce1402ffd0 tx=0x7fce1402fef0 comp rx=0 tx=0).stop 2026-02-24T09:21:08.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.985+0000 7fce2edbbe00 1 -- 10.20.193.28:0/3317348379 shutdown_connections 2026-02-24T09:21:08.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.985+0000 7fce2edbbe00 1 --2- 10.20.193.28:0/3317348379 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55653ad5d500 0x55653ad5d9a0 crc :-1 s=READY pgs=56 gs=2 cs=0 l=0 c_cookie=5966646477194765345 s_cookie=15508619108570724673 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:08.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.985+0000 7fce2edbbe00 1 --2- 10.20.193.28:0/3317348379 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55653ad60270 0x55653ad7ce00 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:08.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.985+0000 7fce2edbbe00 1 --2- 10.20.193.28:0/3317348379 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55653ad1b740 0x55653ad77e10 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:08.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.985+0000 7fcdd7fff640 0 client.15810 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:21:08.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.985+0000 7fce2edbbe00 1 --2- 10.20.193.28:0/3317348379 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55653ac39a60 0x55653ad778d0 unknown :-1 s=CLOSED pgs=467 gs=1 cs=0 l=1 c_cookie=3005816193777231836 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:08.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.985+0000 7fce2edbbe00 1 -- 10.20.193.28:0/3317348379 >> 10.20.193.28:0/3317348379 conn(0x55653acb5490 msgr2=0x55653ad192f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:08.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.986+0000 7fce2edbbe00 1 -- 10.20.193.28:0/3317348379 shutdown_connections 2026-02-24T09:21:08.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.986+0000 7fce2edbbe00 1 -- 10.20.193.28:0/3317348379 wait complete. 2026-02-24T09:21:08.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.986+0000 7fce2edbbe00 20 client.15810 trim_cache size 0 max 16384 2026-02-24T09:21:08.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.994+0000 7fce2edbbe00 1 Processor -- start 2026-02-24T09:21:08.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.994+0000 7fce2edbbe00 1 -- start start 2026-02-24T09:21:08.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.994+0000 7fce2edbbe00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55653ac39a60 0x55653ad69650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:08.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.994+0000 7fce2edbbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55653ad1b740 0x55653ad7c370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:08.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.994+0000 7fce2edbbe00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55653ad60270 0x55653ad5f290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:08.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.994+0000 7fce2edbbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55653ac249d0 con 0x55653ad1b740 2026-02-24T09:21:08.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.994+0000 7fce2edbbe00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55653a965f10 con 0x55653ac39a60 2026-02-24T09:21:08.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.994+0000 7fce2edbbe00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55653ad7df20 con 0x55653ad60270 2026-02-24T09:21:08.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.995+0000 7fce2a549640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55653ac39a60 0x55653ad69650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:08.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.995+0000 7fce2a549640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55653ac39a60 0x55653ad69650 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:51670/0 (socket says 10.20.193.28:51670) 2026-02-24T09:21:08.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.995+0000 7fce2a549640 1 -- 10.20.193.28:0/3035224121 learned_addr learned my addr 10.20.193.28:0/3035224121 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:21:08.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.995+0000 7fce2a549640 1 -- 10.20.193.28:0/3035224121 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55653ad60270 msgr2=0x55653ad5f290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T09:21:08.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.996+0000 7fce2a549640 1 --2- 10.20.193.28:0/3035224121 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55653ad60270 0x55653ad5f290 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:08.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.996+0000 7fce2a549640 1 -- 10.20.193.28:0/3035224121 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55653ad1b740 msgr2=0x55653ad7c370 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T09:21:08.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.996+0000 7fce2a549640 1 --2- 10.20.193.28:0/3035224121 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55653ad1b740 0x55653ad7c370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:08.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.996+0000 7fce2a549640 1 -- 10.20.193.28:0/3035224121 --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55653ad69e20 con 0x55653ac39a60 2026-02-24T09:21:08.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.997+0000 7fce2a549640 1 --2- 10.20.193.28:0/3035224121 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55653ac39a60 0x55653ad69650 secure :-1 s=READY pgs=118 gs=1 cs=0 l=1 c_cookie=5581906983328117169 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce140ce490 tx=0x7fce1403a020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d76ead3be8b71b1 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:08.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.997+0000 7fcdf23ff640 1 -- 10.20.193.28:0/3035224121 <== mon.2 v2:10.20.193.74:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce14096030 con 0x55653ac39a60 2026-02-24T09:21:08.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.997+0000 7fcdf23ff640 1 -- 10.20.193.28:0/3035224121 <== mon.2 v2:10.20.193.74:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x55653a8c6520 con 0x55653ac39a60 2026-02-24T09:21:08.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.997+0000 7fcdf23ff640 1 -- 10.20.193.28:0/3035224121 <== mon.2 v2:10.20.193.74:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce140d1c20 con 0x55653ac39a60 2026-02-24T09:21:09.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.997+0000 7fce2edbbe00 1 -- 10.20.193.28:0/3035224121 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55653ac39a60 msgr2=0x55653ad69650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:09.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.997+0000 7fce2edbbe00 1 --2- 10.20.193.28:0/3035224121 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55653ac39a60 0x55653ad69650 secure :-1 s=READY pgs=118 gs=1 cs=0 l=1 c_cookie=5581906983328117169 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce140ce490 tx=0x7fce1403a020 comp rx=0 tx=0).stop 2026-02-24T09:21:09.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.998+0000 7fce2edbbe00 1 -- 10.20.193.28:0/3035224121 shutdown_connections 2026-02-24T09:21:09.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.998+0000 7fce2edbbe00 1 --2- 10.20.193.28:0/3035224121 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55653ad60270 0x55653ad5f290 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:09.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.998+0000 7fce2edbbe00 1 --2- 10.20.193.28:0/3035224121 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55653ad1b740 0x55653ad7c370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:09.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.998+0000 7fce2edbbe00 1 --2- 10.20.193.28:0/3035224121 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55653ac39a60 0x55653ad69650 unknown :-1 s=CLOSED pgs=118 gs=1 cs=0 l=1 c_cookie=5581906983328117169 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:09.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.998+0000 7fce2edbbe00 1 -- 10.20.193.28:0/3035224121 >> 10.20.193.28:0/3035224121 conn(0x55653acb5490 msgr2=0x55653ad7bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:09.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.998+0000 7fce2edbbe00 1 -- 10.20.193.28:0/3035224121 shutdown_connections 2026-02-24T09:21:09.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.998+0000 7fce2edbbe00 1 -- 10.20.193.28:0/3035224121 wait complete. 2026-02-24T09:21:09.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.998+0000 7fce2edbbe00 1 -- start start 2026-02-24T09:21:09.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.998+0000 7fce2edbbe00 1 Processor -- start 2026-02-24T09:21:09.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.999+0000 7fce2edbbe00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55653ac39a60 0x55653ad5f6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:09.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.999+0000 7fce2edbbe00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55653ad1b740 0x55653ad5fc00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:09.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.999+0000 7fce2edbbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55653ad60270 0x55653ad810c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:09.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.999+0000 7fce2edbbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55653ad817c0 con 0x55653ad60270 2026-02-24T09:21:09.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.999+0000 7fce2edbbe00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55653ad81930 con 0x55653ad1b740 2026-02-24T09:21:09.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.999+0000 7fce2edbbe00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55653ad81af0 con 0x55653ac39a60 2026-02-24T09:21:09.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.999+0000 7fce2a549640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55653ac39a60 0x55653ad5f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:09.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.999+0000 7fce2a549640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55653ac39a60 0x55653ad5f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:41510/0 (socket says 10.20.193.28:41510) 2026-02-24T09:21:09.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.999+0000 7fce2a549640 1 -- 10.20.193.28:0/3324866665 learned_addr learned my addr 10.20.193.28:0/3324866665 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:21:09.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.999+0000 7fce29d48640 1 --2- 10.20.193.28:0/3324866665 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55653ad1b740 0x55653ad5fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:09.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:08.999+0000 7fce2ad4a640 1 --2- 10.20.193.28:0/3324866665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55653ad60270 0x55653ad810c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:09.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.000+0000 7fce2ad4a640 1 -- 10.20.193.28:0/3324866665 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55653ac39a60 msgr2=0x55653ad5f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:09.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.000+0000 7fce2ad4a640 1 --2- 10.20.193.28:0/3324866665 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55653ac39a60 0x55653ad5f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:09.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.000+0000 7fce2ad4a640 1 -- 10.20.193.28:0/3324866665 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55653ad1b740 msgr2=0x55653ad5fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:09.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.000+0000 7fce2ad4a640 1 --2- 10.20.193.28:0/3324866665 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55653ad1b740 0x55653ad5fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:09.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.000+0000 7fce2ad4a640 1 -- 10.20.193.28:0/3324866665 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55653abb7030 con 0x55653ad60270 2026-02-24T09:21:09.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.000+0000 7fce2a549640 1 --2- 10.20.193.28:0/3324866665 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55653ac39a60 0x55653ad5f6c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:21:09.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.000+0000 7fce2ad4a640 1 --2- 10.20.193.28:0/3324866665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55653ad60270 0x55653ad810c0 secure :-1 s=READY pgs=468 gs=2 cs=0 l=1 c_cookie=9544430147142022922 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce200106f0 tx=0x7fce2000b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8474a0a677edf70a server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:09.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.000+0000 7fcdd7fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:21:09.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.000+0000 7fcdd7fff640 1 -- 10.20.193.28:0/3324866665 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce20018050 con 0x55653ad60270 2026-02-24T09:21:09.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.001+0000 7fce29d48640 1 --2- 10.20.193.28:0/3324866665 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55653ad1b740 0x55653ad5fc00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:21:09.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.001+0000 7fcdd7fff640 1 -- 10.20.193.28:0/3324866665 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fce20022040 con 0x55653ad60270 2026-02-24T09:21:09.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.001+0000 7fcdd7fff640 1 -- 10.20.193.28:0/3324866665 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce20027450 con 0x55653ad60270 2026-02-24T09:21:09.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.001+0000 7fce2edbbe00 1 -- 10.20.193.28:0/3324866665 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55653abbc5b0 con 0x55653ad60270 2026-02-24T09:21:09.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.001+0000 7fce2edbbe00 10 client.15813 _ll_register_callbacks cb 0x55653abb1980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:21:09.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.001+0000 7fce2edbbe00 1 -- 10.20.193.28:0/3324866665 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55653ac57d30 con 0x55653ad60270 2026-02-24T09:21:09.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.001+0000 7fcdd7fff640 1 -- 10.20.193.28:0/3324866665 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7fce200055c0 con 0x55653ad60270 2026-02-24T09:21:09.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.001+0000 7fcdd7fff640 1 -- 10.20.193.28:0/3324866665 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fce20005080 con 0x55653ad60270 2026-02-24T09:21:09.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.001+0000 7fce2edbbe00 10 client.15813 fetch_fsmap learned FSMap version 23 2026-02-24T09:21:09.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.001+0000 7fce2edbbe00 1 -- 10.20.193.28:0/3324866665 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x55653abab010 con 0x55653ad60270 2026-02-24T09:21:09.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.002+0000 7fcdd7fff640 1 -- 10.20.193.28:0/3324866665 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fce200051e0 con 0x55653ad60270 2026-02-24T09:21:09.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.002+0000 7fce2edbbe00 10 client.15813 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:21:09.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.002+0000 7fce2edbbe00 10 client.15813 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:21:09.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.002+0000 7fce2edbbe00 20 client.15813 populate_metadata read hostname 'trial028' 2026-02-24T09:21:09.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.002+0000 7fce2edbbe00 1 --2- 10.20.193.28:0/3324866665 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55653ae1f2e0 0x55653ae3f790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:09.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.002+0000 7fce2edbbe00 4 client.15813 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-24T09:21:09.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.002+0000 7fce2edbbe00 1 -- 10.20.193.28:0/3324866665 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55653a90a640 con 0x55653ae1f2e0 2026-02-24T09:21:09.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.003+0000 7fce2a549640 1 --2- 10.20.193.28:0/3324866665 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55653ae1f2e0 0x55653ae3f790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:09.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.006+0000 7fce2a549640 1 --2- 10.20.193.28:0/3324866665 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55653ae1f2e0 0x55653ae3f790 crc :-1 s=READY pgs=57 gs=4 cs=0 l=0 c_cookie=17642973714988418549 s_cookie=15027140257694179072 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4d86f1e077045f5 server_cookie=d08b207279d55f00 in_seq=0 out_seq=0 2026-02-24T09:21:09.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.006+0000 7fcdd7fff640 10 client.15813 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:21:09.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.014+0000 7fcdd7fff640 1 -- 10.20.193.28:0/3324866665 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55653a90a640 con 0x55653ae1f2e0 2026-02-24T09:21:09.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.014+0000 7fcdd7fff640 10 client.15813 handle_command_reply: tid=0 2026-02-24T09:21:09.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.014+0000 7fce2edbbe00 1 client.15813 shutdown 2026-02-24T09:21:09.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.015+0000 7fce2edbbe00 1 -- 10.20.193.28:0/3324866665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55653ad60270 msgr2=0x55653ad810c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:09.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.015+0000 7fce2edbbe00 1 --2- 10.20.193.28:0/3324866665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55653ad60270 0x55653ad810c0 secure :-1 s=READY pgs=468 gs=2 cs=0 l=1 c_cookie=9544430147142022922 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce200106f0 tx=0x7fce2000b3d0 comp rx=0 tx=0).stop 2026-02-24T09:21:09.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.016+0000 7fce2edbbe00 1 -- 10.20.193.28:0/3324866665 shutdown_connections 2026-02-24T09:21:09.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.016+0000 7fce2edbbe00 1 --2- 10.20.193.28:0/3324866665 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55653ae1f2e0 0x55653ae3f790 crc :-1 s=READY pgs=57 gs=4 cs=0 l=0 c_cookie=17642973714988418549 s_cookie=15027140257694179072 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:09.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-24T09:21:09.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-24T09:21:09.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-24T09:21:09.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-24T09:21:09.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.016+0000 7fce2edbbe00 1 --2- 10.20.193.28:0/3324866665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55653ad60270 0x55653ad810c0 unknown :-1 s=CLOSED pgs=468 gs=2 cs=0 l=1 c_cookie=9544430147142022922 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:09.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.016+0000 7fce2edbbe00 1 --2- 10.20.193.28:0/3324866665 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55653ad1b740 0x55653ad5fc00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:09.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.016+0000 7fce2edbbe00 1 --2- 10.20.193.28:0/3324866665 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55653ac39a60 0x55653ad5f6c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:09.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.016+0000 7fce2edbbe00 1 -- 10.20.193.28:0/3324866665 >> 10.20.193.28:0/3324866665 conn(0x55653acb5490 msgr2=0x55653ad742c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:09.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.016+0000 7fcdd7fff640 0 client.15813 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:21:09.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.016+0000 7fce2edbbe00 1 -- 10.20.193.28:0/3324866665 shutdown_connections 2026-02-24T09:21:09.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.016+0000 7fce2edbbe00 1 -- 10.20.193.28:0/3324866665 wait complete. 2026-02-24T09:21:09.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.016+0000 7fce2edbbe00 20 client.15813 trim_cache size 0 max 16384 2026-02-24T09:21:09.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.018+0000 7fce2b54b640 1 -- 10.20.193.28:0/2616521861 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fce000b58d0 msgr2=0x7fce000d5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:09.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.018+0000 7fce2b54b640 1 --2- 10.20.193.28:0/2616521861 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fce000b58d0 0x7fce000d5d80 secure :-1 s=READY pgs=239 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce20006e90 tx=0x7fce2000b720 comp rx=0 tx=0).stop 2026-02-24T09:21:09.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.018+0000 7fce2b54b640 1 -- 10.20.193.28:0/2616521861 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fce24113950 msgr2=0x7fce241222a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:09.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.018+0000 7fce2b54b640 1 --2- 10.20.193.28:0/2616521861 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fce24113950 0x7fce241222a0 secure :-1 s=READY pgs=465 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce140098a0 tx=0x7fce140028d0 comp rx=0 tx=0).stop 2026-02-24T09:21:09.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.018+0000 7fce2b54b640 1 -- 10.20.193.28:0/2616521861 shutdown_connections 2026-02-24T09:21:09.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.018+0000 7fce2b54b640 1 --2- 10.20.193.28:0/2616521861 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fce000b58d0 0x7fce000d5d80 unknown :-1 s=CLOSED pgs=239 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:09.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.018+0000 7fce2b54b640 1 --2- 10.20.193.28:0/2616521861 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fce24119b40 0x7fce24127bb0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:09.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.018+0000 7fce2b54b640 1 --2- 10.20.193.28:0/2616521861 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fce24114340 0x7fce241227e0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:09.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.018+0000 7fce2b54b640 1 --2- 10.20.193.28:0/2616521861 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fce24113950 0x7fce241222a0 unknown :-1 s=CLOSED pgs=465 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:09.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.018+0000 7fce2b54b640 1 -- 10.20.193.28:0/2616521861 >> 10.20.193.28:0/2616521861 conn(0x7fce240619a0 msgr2=0x7fce24117990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:09.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.018+0000 7fce2b54b640 1 -- 10.20.193.28:0/2616521861 shutdown_connections 2026-02-24T09:21:09.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:09.018+0000 7fce2b54b640 1 -- 10.20.193.28:0/2616521861 wait complete. 2026-02-24T09:21:10.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:10 trial159 ceph-mon[44242]: pgmap v309: 97 pgs: 97 active+clean; 14 GiB data, 41 GiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 275 MiB/s wr, 366 op/s 2026-02-24T09:21:10.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:10 trial028 ceph-mon[40371]: pgmap v309: 97 pgs: 97 active+clean; 14 GiB data, 41 GiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 275 MiB/s wr, 366 op/s 2026-02-24T09:21:10.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:10 trial074 ceph-mon[44412]: pgmap v309: 97 pgs: 97 active+clean; 14 GiB data, 41 GiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 275 MiB/s wr, 366 op/s 2026-02-24T09:21:12.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:12 trial159 ceph-mon[44242]: pgmap v310: 97 pgs: 97 active+clean; 14 GiB data, 42 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 265 MiB/s wr, 353 op/s 2026-02-24T09:21:12.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:12 trial028 ceph-mon[40371]: pgmap v310: 97 pgs: 97 active+clean; 14 GiB data, 42 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 265 MiB/s wr, 353 op/s 2026-02-24T09:21:12.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:12 trial074 ceph-mon[44412]: pgmap v310: 97 pgs: 97 active+clean; 14 GiB data, 42 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 265 MiB/s wr, 353 op/s 2026-02-24T09:21:14.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:14 trial159 ceph-mon[44242]: pgmap v311: 97 pgs: 97 active+clean; 15 GiB data, 44 GiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 267 MiB/s wr, 356 op/s 2026-02-24T09:21:14.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:14 trial028 ceph-mon[40371]: pgmap v311: 97 pgs: 97 active+clean; 15 GiB data, 44 GiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 267 MiB/s wr, 356 op/s 2026-02-24T09:21:14.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:14 trial074 ceph-mon[44412]: pgmap v311: 97 pgs: 97 active+clean; 15 GiB data, 44 GiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 267 MiB/s wr, 356 op/s 2026-02-24T09:21:16.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:16 trial159 ceph-mon[44242]: pgmap v312: 97 pgs: 97 active+clean; 15 GiB data, 45 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 256 MiB/s wr, 327 op/s 2026-02-24T09:21:16.854 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-24T09:21:16.854 INFO:tasks.workunit.client.0.trial028.stdout: Children see throughput for 1 rewriters = 271539.12 kB/sec 2026-02-24T09:21:16.854 INFO:tasks.workunit.client.0.trial028.stdout: Parent sees throughput for 1 rewriters = 271534.18 kB/sec 2026-02-24T09:21:16.855 INFO:tasks.workunit.client.0.trial028.stdout: Min throughput per process = 271539.12 kB/sec 2026-02-24T09:21:16.855 INFO:tasks.workunit.client.0.trial028.stdout: Max throughput per process = 271539.12 kB/sec 2026-02-24T09:21:16.855 INFO:tasks.workunit.client.0.trial028.stdout: Avg throughput per process = 271539.12 kB/sec 2026-02-24T09:21:16.855 INFO:tasks.workunit.client.0.trial028.stdout: Min xfer = 10485760.00 kB 2026-02-24T09:21:16.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:16 trial028 ceph-mon[40371]: pgmap v312: 97 pgs: 97 active+clean; 15 GiB data, 45 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 256 MiB/s wr, 327 op/s 2026-02-24T09:21:16.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:16 trial074 ceph-mon[44412]: pgmap v312: 97 pgs: 97 active+clean; 15 GiB data, 45 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 256 MiB/s wr, 327 op/s 2026-02-24T09:21:18.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:18 trial159 ceph-mon[44242]: pgmap v313: 97 pgs: 97 active+clean; 16 GiB data, 47 GiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 279 MiB/s wr, 356 op/s 2026-02-24T09:21:18.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:18 trial028 ceph-mon[40371]: pgmap v313: 97 pgs: 97 active+clean; 16 GiB data, 47 GiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 279 MiB/s wr, 356 op/s 2026-02-24T09:21:18.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:18 trial074 ceph-mon[44412]: pgmap v313: 97 pgs: 97 active+clean; 16 GiB data, 47 GiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 279 MiB/s wr, 356 op/s 2026-02-24T09:21:20.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:20 trial159 ceph-mon[44242]: pgmap v314: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 258 MiB/s wr, 328 op/s 2026-02-24T09:21:20.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:20 trial028 ceph-mon[40371]: pgmap v314: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 258 MiB/s wr, 328 op/s 2026-02-24T09:21:20.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:20 trial074 ceph-mon[44412]: pgmap v314: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 258 MiB/s wr, 328 op/s 2026-02-24T09:21:22.094 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.092+0000 7f99e0e83640 1 -- 10.20.193.28:0/3739110131 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f99dc0607e0 msgr2=0x7f99dc060bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:22.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.092+0000 7f99e0e83640 1 --2- 10.20.193.28:0/3739110131 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f99dc0607e0 0x7f99dc060bb0 secure :-1 s=READY pgs=469 gs=1 cs=0 l=1 c_cookie=827878679848360364 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99c8009950 tx=0x7f99c802f190 comp rx=0 tx=0).stop 2026-02-24T09:21:22.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.092+0000 7f99e0e83640 1 -- 10.20.193.28:0/3739110131 shutdown_connections 2026-02-24T09:21:22.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.092+0000 7f99e0e83640 1 --2- 10.20.193.28:0/3739110131 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f99dc1558f0 0x7f99dc175cd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.092+0000 7f99e0e83640 1 --2- 10.20.193.28:0/3739110131 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f99dc0610f0 0x7f99dc1553b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.092+0000 7f99e0e83640 1 --2- 10.20.193.28:0/3739110131 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f99dc0607e0 0x7f99dc060bb0 unknown :-1 s=CLOSED pgs=469 gs=1 cs=0 l=1 c_cookie=827878679848360364 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.092+0000 7f99e0e83640 1 -- 10.20.193.28:0/3739110131 >> 10.20.193.28:0/3739110131 conn(0x7f99dc0eaaa0 msgr2=0x7f99dc10aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:22.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.092+0000 7f99e0e83640 1 -- 10.20.193.28:0/3739110131 shutdown_connections 2026-02-24T09:21:22.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.092+0000 7f99e0e83640 1 -- 10.20.193.28:0/3739110131 wait complete. 2026-02-24T09:21:22.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.093+0000 7f99e0e83640 1 Processor -- start 2026-02-24T09:21:22.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.093+0000 7f99e0e83640 1 -- start start 2026-02-24T09:21:22.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.094+0000 7f99e0e83640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f99dc0607e0 0x7f99dc1620a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:22.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.094+0000 7f99e0e83640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f99dc0610f0 0x7f99dc1625e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:22.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.094+0000 7f99e0e83640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f99dc1558f0 0x7f99dc1679b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:22.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.094+0000 7f99e0e83640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc167fd0 con 0x7f99dc0607e0 2026-02-24T09:21:22.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.094+0000 7f99e0e83640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc168140 con 0x7f99dc0610f0 2026-02-24T09:21:22.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.094+0000 7f99e0e83640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc168300 con 0x7f99dc1558f0 2026-02-24T09:21:22.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.094+0000 7f99db7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f99dc0607e0 0x7f99dc1620a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:22.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.094+0000 7f99db7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f99dc0607e0 0x7f99dc1620a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33470/0 (socket says 10.20.193.28:33470) 2026-02-24T09:21:22.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.094+0000 7f99db7fe640 1 -- 10.20.193.28:0/4273818742 learned_addr learned my addr 10.20.193.28:0/4273818742 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:21:22.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.094+0000 7f99dbfff640 1 --2- 10.20.193.28:0/4273818742 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f99dc1558f0 0x7f99dc1679b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:22.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.094+0000 7f99daffd640 1 --2- 10.20.193.28:0/4273818742 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f99dc0610f0 0x7f99dc1625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:22.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.094+0000 7f99db7fe640 1 -- 10.20.193.28:0/4273818742 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f99dc1558f0 msgr2=0x7f99dc1679b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:22.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.094+0000 7f99db7fe640 1 --2- 10.20.193.28:0/4273818742 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f99dc1558f0 0x7f99dc1679b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.094+0000 7f99db7fe640 1 -- 10.20.193.28:0/4273818742 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f99dc0610f0 msgr2=0x7f99dc1625e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:22.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.094+0000 7f99db7fe640 1 --2- 10.20.193.28:0/4273818742 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f99dc0610f0 0x7f99dc1625e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.094+0000 7f99db7fe640 1 -- 10.20.193.28:0/4273818742 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c8009570 con 0x7f99dc0607e0 2026-02-24T09:21:22.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.094+0000 7f99db7fe640 1 --2- 10.20.193.28:0/4273818742 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f99dc0607e0 0x7f99dc1620a0 secure :-1 s=READY pgs=470 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99c80098a0 tx=0x7f99c80028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:22.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.094+0000 7f99d8ff9640 1 -- 10.20.193.28:0/4273818742 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f99c803d070 con 0x7f99dc0607e0 2026-02-24T09:21:22.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.094+0000 7f99d8ff9640 1 -- 10.20.193.28:0/4273818742 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f99c8002a70 con 0x7f99dc0607e0 2026-02-24T09:21:22.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.094+0000 7f99d8ff9640 1 -- 10.20.193.28:0/4273818742 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f99c8041890 con 0x7f99dc0607e0 2026-02-24T09:21:22.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.094+0000 7f99e0e83640 1 -- 10.20.193.28:0/4273818742 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99dc168580 con 0x7f99dc0607e0 2026-02-24T09:21:22.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.095+0000 7f99e0e83640 1 -- 10.20.193.28:0/4273818742 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99dc151510 con 0x7f99dc0607e0 2026-02-24T09:21:22.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.097+0000 7f99d8ff9640 1 -- 10.20.193.28:0/4273818742 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7f99c8041a20 con 0x7f99dc0607e0 2026-02-24T09:21:22.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.099+0000 7f99d8ff9640 1 --2- 10.20.193.28:0/4273818742 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f99b00b58d0 0x7f99b00d5d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:22.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.099+0000 7f99d8ff9640 1 -- 10.20.193.28:0/4273818742 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7f99c810b4d0 con 0x7f99dc0607e0 2026-02-24T09:21:22.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.099+0000 7f99daffd640 1 --2- 10.20.193.28:0/4273818742 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f99b00b58d0 0x7f99b00d5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:22.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.099+0000 7f99daffd640 1 --2- 10.20.193.28:0/4273818742 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f99b00b58d0 0x7f99b00d5d80 secure :-1 s=READY pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99cc005970 tx=0x7f99cc005900 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:22.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.100+0000 7f99e47dde00 1 Processor -- start 2026-02-24T09:21:22.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.100+0000 7f99e47dde00 1 -- start start 2026-02-24T09:21:22.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.100+0000 7f99e47dde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56203160aa60 0x5620316f4c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:22.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.100+0000 7f99e47dde00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5620316f5150 0x5620316f55a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:22.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.100+0000 7f99e47dde00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x562031739c80 0x56203175a060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:22.104 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.100+0000 7f99e47dde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562031601f10 con 0x56203160aa60 2026-02-24T09:21:22.104 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.100+0000 7f99e47dde00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x5620315fdc40 con 0x5620316f5150 2026-02-24T09:21:22.104 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.100+0000 7f99e47dde00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x5620315f7da0 con 0x562031739c80 2026-02-24T09:21:22.104 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.100+0000 7f99db7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56203160aa60 0x5620316f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:22.104 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.100+0000 7f99db7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56203160aa60 0x5620316f4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33486/0 (socket says 10.20.193.28:33486) 2026-02-24T09:21:22.104 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.100+0000 7f99db7fe640 1 -- 10.20.193.28:0/4220779820 learned_addr learned my addr 10.20.193.28:0/4220779820 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:21:22.104 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.100+0000 7f99daffd640 1 --2- 10.20.193.28:0/4220779820 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5620316f5150 0x5620316f55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:22.104 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.100+0000 7f99dbfff640 1 --2- 10.20.193.28:0/4220779820 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x562031739c80 0x56203175a060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:22.104 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.101+0000 7f99db7fe640 1 -- 10.20.193.28:0/4220779820 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x562031739c80 msgr2=0x56203175a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:22.104 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.101+0000 7f99db7fe640 1 --2- 10.20.193.28:0/4220779820 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x562031739c80 0x56203175a060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.104 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.101+0000 7f99db7fe640 1 -- 10.20.193.28:0/4220779820 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5620316f5150 msgr2=0x5620316f55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:22.104 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.101+0000 7f99db7fe640 1 --2- 10.20.193.28:0/4220779820 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5620316f5150 0x5620316f55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.101+0000 7f99db7fe640 1 -- 10.20.193.28:0/4220779820 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620315a3340 con 0x56203160aa60 2026-02-24T09:21:22.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.101+0000 7f99db7fe640 1 --2- 10.20.193.28:0/4220779820 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56203160aa60 0x5620316f4c10 secure :-1 s=READY pgs=471 gs=1 cs=0 l=1 c_cookie=12547490595322764889 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99c80cdbf0 tx=0x7f99c8038f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae21a4378cc49e59 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:22.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.101+0000 7f999ffff640 1 -- 10.20.193.28:0/4220779820 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f99c80d7170 con 0x56203160aa60 2026-02-24T09:21:22.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.101+0000 7f999ffff640 1 -- 10.20.193.28:0/4220779820 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f99c8041d00 con 0x56203160aa60 2026-02-24T09:21:22.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.101+0000 7f999ffff640 1 -- 10.20.193.28:0/4220779820 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f99c80d2530 con 0x56203160aa60 2026-02-24T09:21:22.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.101+0000 7f99e47dde00 1 -- 10.20.193.28:0/4220779820 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56203160aa60 msgr2=0x5620316f4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:22.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.101+0000 7f99e47dde00 1 --2- 10.20.193.28:0/4220779820 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56203160aa60 0x5620316f4c10 secure :-1 s=READY pgs=471 gs=1 cs=0 l=1 c_cookie=12547490595322764889 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99c80cdbf0 tx=0x7f99c8038f30 comp rx=0 tx=0).stop 2026-02-24T09:21:22.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.101+0000 7f99e47dde00 1 -- 10.20.193.28:0/4220779820 shutdown_connections 2026-02-24T09:21:22.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.101+0000 7f99e47dde00 1 --2- 10.20.193.28:0/4220779820 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x562031739c80 0x56203175a060 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.101+0000 7f99e47dde00 1 --2- 10.20.193.28:0/4220779820 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5620316f5150 0x5620316f55a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.101+0000 7f99e47dde00 1 --2- 10.20.193.28:0/4220779820 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56203160aa60 0x5620316f4c10 unknown :-1 s=CLOSED pgs=471 gs=1 cs=0 l=1 c_cookie=12547490595322764889 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.101+0000 7f99e47dde00 1 -- 10.20.193.28:0/4220779820 >> 10.20.193.28:0/4220779820 conn(0x562031686490 msgr2=0x5620316eaae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:22.106 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.101+0000 7f99e47dde00 1 -- 10.20.193.28:0/4220779820 shutdown_connections 2026-02-24T09:21:22.106 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.101+0000 7f99e47dde00 1 -- 10.20.193.28:0/4220779820 wait complete. 2026-02-24T09:21:22.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.102+0000 7f99e47dde00 1 -- start start 2026-02-24T09:21:22.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.103+0000 7f99e47dde00 1 Processor -- start 2026-02-24T09:21:22.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.103+0000 7f99e47dde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56203160aa60 0x5620316da780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:22.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.103+0000 7f99e47dde00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5620316f5150 0x5620316dacc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:22.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.103+0000 7f99e47dde00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x562031739c80 0x5620316dfcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:22.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.103+0000 7f99e47dde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5620316e01f0 con 0x56203160aa60 2026-02-24T09:21:22.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.103+0000 7f99e47dde00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x5620316e0360 con 0x5620316f5150 2026-02-24T09:21:22.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.103+0000 7f99e47dde00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x5620316e0520 con 0x562031739c80 2026-02-24T09:21:22.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.103+0000 7f99db7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56203160aa60 0x5620316da780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:22.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.103+0000 7f99db7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56203160aa60 0x5620316da780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33494/0 (socket says 10.20.193.28:33494) 2026-02-24T09:21:22.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.103+0000 7f99db7fe640 1 -- 10.20.193.28:0/1536973794 learned_addr learned my addr 10.20.193.28:0/1536973794 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:21:22.109 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.103+0000 7f99dbfff640 1 --2- 10.20.193.28:0/1536973794 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x562031739c80 0x5620316dfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:22.109 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.103+0000 7f99daffd640 1 --2- 10.20.193.28:0/1536973794 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5620316f5150 0x5620316dacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:22.109 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.103+0000 7f99db7fe640 1 -- 10.20.193.28:0/1536973794 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x562031739c80 msgr2=0x5620316dfcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:22.109 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.104+0000 7f99db7fe640 1 --2- 10.20.193.28:0/1536973794 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x562031739c80 0x5620316dfcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.109 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.104+0000 7f99db7fe640 1 -- 10.20.193.28:0/1536973794 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5620316f5150 msgr2=0x5620316dacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:22.109 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.104+0000 7f99db7fe640 1 --2- 10.20.193.28:0/1536973794 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5620316f5150 0x5620316dacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.109 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.104+0000 7f99db7fe640 1 -- 10.20.193.28:0/1536973794 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56203157bce0 con 0x56203160aa60 2026-02-24T09:21:22.109 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.104+0000 7f99dbfff640 1 --2- 10.20.193.28:0/1536973794 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x562031739c80 0x5620316dfcb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:21:22.109 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.104+0000 7f99daffd640 1 --2- 10.20.193.28:0/1536973794 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5620316f5150 0x5620316dacc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:21:22.109 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.104+0000 7f99db7fe640 1 --2- 10.20.193.28:0/1536973794 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56203160aa60 0x5620316da780 secure :-1 s=READY pgs=472 gs=1 cs=0 l=1 c_cookie=8189981306735151778 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99c8108de0 tx=0x7f99c8004490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a8a89b2909caa2 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:22.109 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.104+0000 7f999d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:21:22.109 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.104+0000 7f999d7fa640 1 -- 10.20.193.28:0/1536973794 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f99c8041d00 con 0x56203160aa60 2026-02-24T09:21:22.109 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.104+0000 7f999d7fa640 1 -- 10.20.193.28:0/1536973794 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f99c80d7170 con 0x56203160aa60 2026-02-24T09:21:22.110 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.104+0000 7f999d7fa640 1 -- 10.20.193.28:0/1536973794 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f99c80d22b0 con 0x56203160aa60 2026-02-24T09:21:22.110 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.104+0000 7f99e47dde00 1 -- 10.20.193.28:0/1536973794 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99dc151510 con 0x56203160aa60 2026-02-24T09:21:22.110 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.104+0000 7f99e47dde00 10 client.15825 _ll_register_callbacks cb 0x562031582980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:21:22.110 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.104+0000 7f99e47dde00 1 -- 10.20.193.28:0/1536973794 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562031297520 con 0x56203160aa60 2026-02-24T09:21:22.110 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.104+0000 7f999d7fa640 1 -- 10.20.193.28:0/1536973794 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7f99c80d2440 con 0x56203160aa60 2026-02-24T09:21:22.110 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.104+0000 7f999d7fa640 1 -- 10.20.193.28:0/1536973794 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f99c8096760 con 0x56203160aa60 2026-02-24T09:21:22.110 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.104+0000 7f99e47dde00 10 client.15825 fetch_fsmap learned FSMap version 23 2026-02-24T09:21:22.110 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.104+0000 7f99e47dde00 1 -- 10.20.193.28:0/1536973794 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x56203158d5b0 con 0x56203160aa60 2026-02-24T09:21:22.110 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.105+0000 7f999d7fa640 1 -- 10.20.193.28:0/1536973794 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f99c80cf600 con 0x56203160aa60 2026-02-24T09:21:22.110 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.105+0000 7f99e47dde00 10 client.15825 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:21:22.110 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.105+0000 7f99e47dde00 10 client.15825 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:21:22.110 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.105+0000 7f99e47dde00 20 client.15825 populate_metadata read hostname 'trial028' 2026-02-24T09:21:22.110 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.105+0000 7f99e47dde00 1 --2- 10.20.193.28:0/1536973794 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5620316e0e20 0x5620316e1290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:22.111 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.105+0000 7f99e47dde00 4 client.15825 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:21:22.111 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.105+0000 7f99e47dde00 1 -- 10.20.193.28:0/1536973794 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620315c99d0 con 0x5620316e0e20 2026-02-24T09:21:22.111 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.105+0000 7f99daffd640 1 --2- 10.20.193.28:0/1536973794 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5620316e0e20 0x5620316e1290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:22.111 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.106+0000 7f99daffd640 1 --2- 10.20.193.28:0/1536973794 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5620316e0e20 0x5620316e1290 crc :-1 s=READY pgs=58 gs=4 cs=0 l=0 c_cookie=15303759460346979758 s_cookie=7115379720794751256 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d461e0257a0165ae server_cookie=62bee8283bfd4118 in_seq=0 out_seq=0 2026-02-24T09:21:22.111 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.106+0000 7f999d7fa640 10 client.15825 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:21:22.112 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.107+0000 7f999d7fa640 1 -- 10.20.193.28:0/1536973794 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5620315c99d0 con 0x5620316e0e20 2026-02-24T09:21:22.112 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.107+0000 7f999d7fa640 10 client.15825 handle_command_reply: tid=0 2026-02-24T09:21:22.112 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.107+0000 7f99e47dde00 1 client.15825 shutdown 2026-02-24T09:21:22.112 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.107+0000 7f99e47dde00 1 -- 10.20.193.28:0/1536973794 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56203160aa60 msgr2=0x5620316da780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:22.113 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.107+0000 7f99e47dde00 1 --2- 10.20.193.28:0/1536973794 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56203160aa60 0x5620316da780 secure :-1 s=READY pgs=472 gs=1 cs=0 l=1 c_cookie=8189981306735151778 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99c8108de0 tx=0x7f99c8004490 comp rx=0 tx=0).stop 2026-02-24T09:21:22.113 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.107+0000 7f99e47dde00 1 -- 10.20.193.28:0/1536973794 shutdown_connections 2026-02-24T09:21:22.113 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.107+0000 7f99e47dde00 1 --2- 10.20.193.28:0/1536973794 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5620316e0e20 0x5620316e1290 crc :-1 s=READY pgs=58 gs=4 cs=0 l=0 c_cookie=15303759460346979758 s_cookie=7115379720794751256 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.113 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.107+0000 7f99e47dde00 1 --2- 10.20.193.28:0/1536973794 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x562031739c80 0x5620316dfcb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.113 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.107+0000 7f99e47dde00 1 --2- 10.20.193.28:0/1536973794 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5620316f5150 0x5620316dacc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.113 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.107+0000 7f99e47dde00 1 --2- 10.20.193.28:0/1536973794 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56203160aa60 0x5620316da780 unknown :-1 s=CLOSED pgs=472 gs=1 cs=0 l=1 c_cookie=8189981306735151778 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.113 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.107+0000 7f99e47dde00 1 -- 10.20.193.28:0/1536973794 >> 10.20.193.28:0/1536973794 conn(0x562031686490 msgr2=0x5620316ed470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:22.113 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.107+0000 7f999d7fa640 0 client.15825 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:21:22.113 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.107+0000 7f99e47dde00 1 -- 10.20.193.28:0/1536973794 shutdown_connections 2026-02-24T09:21:22.113 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.107+0000 7f99e47dde00 1 -- 10.20.193.28:0/1536973794 wait complete. 2026-02-24T09:21:22.113 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.107+0000 7f99e47dde00 20 client.15825 trim_cache size 0 max 16384 2026-02-24T09:21:22.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.115+0000 7f99e47dde00 1 Processor -- start 2026-02-24T09:21:22.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.115+0000 7f99e47dde00 1 -- start start 2026-02-24T09:21:22.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.115+0000 7f99e47dde00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x56203160aa60 0x5620316df220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:22.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.115+0000 7f99e47dde00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5620316f5150 0x5620316d7970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:22.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.115+0000 7f99e47dde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562031739c80 0x5620316d7eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:22.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.115+0000 7f99e47dde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5620315f59d0 con 0x562031739c80 2026-02-24T09:21:22.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.115+0000 7f99e47dde00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x562031336f10 con 0x5620316f5150 2026-02-24T09:21:22.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.115+0000 7f99e47dde00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x5620316d3740 con 0x56203160aa60 2026-02-24T09:21:22.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.115+0000 7f99dbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562031739c80 0x5620316d7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:22.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.116+0000 7f99dbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562031739c80 0x5620316d7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33506/0 (socket says 10.20.193.28:33506) 2026-02-24T09:21:22.120 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.116+0000 7f99daffd640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5620316f5150 0x5620316d7970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:22.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.116+0000 7f99dbfff640 1 -- 10.20.193.28:0/3448813132 learned_addr learned my addr 10.20.193.28:0/3448813132 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:21:22.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.116+0000 7f99db7fe640 1 --2- 10.20.193.28:0/3448813132 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x56203160aa60 0x5620316df220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:22.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.116+0000 7f99dbfff640 1 -- 10.20.193.28:0/3448813132 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x56203160aa60 msgr2=0x5620316df220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:22.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.116+0000 7f99dbfff640 1 --2- 10.20.193.28:0/3448813132 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x56203160aa60 0x5620316df220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.116+0000 7f99dbfff640 1 -- 10.20.193.28:0/3448813132 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5620316f5150 msgr2=0x5620316d7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:22.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.116+0000 7f99dbfff640 1 --2- 10.20.193.28:0/3448813132 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5620316f5150 0x5620316d7970 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.116+0000 7f99dbfff640 1 -- 10.20.193.28:0/3448813132 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562031588030 con 0x562031739c80 2026-02-24T09:21:22.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.116+0000 7f99dbfff640 1 --2- 10.20.193.28:0/3448813132 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562031739c80 0x5620316d7eb0 secure :-1 s=READY pgs=473 gs=1 cs=0 l=1 c_cookie=11847672757720796764 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99d0003a50 tx=0x7f99d0003f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a46b6399fb054e5c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:22.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.116+0000 7f999f7fe640 1 -- 10.20.193.28:0/3448813132 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f99d0014b70 con 0x562031739c80 2026-02-24T09:21:22.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.116+0000 7f999f7fe640 1 -- 10.20.193.28:0/3448813132 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f99d0014cd0 con 0x562031739c80 2026-02-24T09:21:22.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.116+0000 7f999f7fe640 1 -- 10.20.193.28:0/3448813132 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f99d00117e0 con 0x562031739c80 2026-02-24T09:21:22.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.117+0000 7f99e47dde00 1 -- 10.20.193.28:0/3448813132 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562031739c80 msgr2=0x5620316d7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:22.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.117+0000 7f99e47dde00 1 --2- 10.20.193.28:0/3448813132 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562031739c80 0x5620316d7eb0 secure :-1 s=READY pgs=473 gs=1 cs=0 l=1 c_cookie=11847672757720796764 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99d0003a50 tx=0x7f99d0003f20 comp rx=0 tx=0).stop 2026-02-24T09:21:22.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.117+0000 7f99e47dde00 1 -- 10.20.193.28:0/3448813132 shutdown_connections 2026-02-24T09:21:22.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.117+0000 7f99e47dde00 1 --2- 10.20.193.28:0/3448813132 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562031739c80 0x5620316d7eb0 unknown :-1 s=CLOSED pgs=473 gs=1 cs=0 l=1 c_cookie=11847672757720796764 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.117+0000 7f99e47dde00 1 --2- 10.20.193.28:0/3448813132 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5620316f5150 0x5620316d7970 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.117+0000 7f99e47dde00 1 --2- 10.20.193.28:0/3448813132 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x56203160aa60 0x5620316df220 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.117+0000 7f99e47dde00 1 -- 10.20.193.28:0/3448813132 >> 10.20.193.28:0/3448813132 conn(0x562031686490 msgr2=0x5620316deb10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:22.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.117+0000 7f99e47dde00 1 -- 10.20.193.28:0/3448813132 shutdown_connections 2026-02-24T09:21:22.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.117+0000 7f99e47dde00 1 -- 10.20.193.28:0/3448813132 wait complete. 2026-02-24T09:21:22.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.117+0000 7f99e47dde00 1 -- start start 2026-02-24T09:21:22.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.117+0000 7f99e47dde00 1 Processor -- start 2026-02-24T09:21:22.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.117+0000 7f99e47dde00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x56203160aa60 0x5620317ab2a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:22.123 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.117+0000 7f99e47dde00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5620316f5150 0x5620317a8880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:22.123 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.117+0000 7f99e47dde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562031739c80 0x5620317a8dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:22.123 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.117+0000 7f99e47dde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5620315fdc40 con 0x562031739c80 2026-02-24T09:21:22.123 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.118+0000 7f99e47dde00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x562031674200 con 0x56203160aa60 2026-02-24T09:21:22.123 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.118+0000 7f99e47dde00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x562031735f00 con 0x5620316f5150 2026-02-24T09:21:22.123 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.118+0000 7f99dbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562031739c80 0x5620317a8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:22.123 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.118+0000 7f99dbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562031739c80 0x5620317a8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33520/0 (socket says 10.20.193.28:33520) 2026-02-24T09:21:22.123 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.118+0000 7f99dbfff640 1 -- 10.20.193.28:0/3639860975 learned_addr learned my addr 10.20.193.28:0/3639860975 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:21:22.123 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.118+0000 7f99daffd640 1 --2- 10.20.193.28:0/3639860975 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5620316f5150 0x5620317a8880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:22.123 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.118+0000 7f99db7fe640 1 --2- 10.20.193.28:0/3639860975 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x56203160aa60 0x5620317ab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:22.123 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.118+0000 7f99dbfff640 1 -- 10.20.193.28:0/3639860975 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5620316f5150 msgr2=0x5620317a8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:22.123 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.118+0000 7f99dbfff640 1 --2- 10.20.193.28:0/3639860975 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5620316f5150 0x5620317a8880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.124 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.118+0000 7f99dbfff640 1 -- 10.20.193.28:0/3639860975 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x56203160aa60 msgr2=0x5620317ab2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:22.124 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.118+0000 7f99dbfff640 1 --2- 10.20.193.28:0/3639860975 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x56203160aa60 0x5620317ab2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.124 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.118+0000 7f99dbfff640 1 -- 10.20.193.28:0/3639860975 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56203157c010 con 0x562031739c80 2026-02-24T09:21:22.124 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.118+0000 7f99dbfff640 1 --2- 10.20.193.28:0/3639860975 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562031739c80 0x5620317a8dc0 secure :-1 s=READY pgs=474 gs=1 cs=0 l=1 c_cookie=12136826364315897393 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99d0012d80 tx=0x7f99d0011770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a86eab4651a50e31 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:22.124 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.118+0000 7f999d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:21:22.124 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.119+0000 7f999d7fa640 1 -- 10.20.193.28:0/3639860975 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f99d0022070 con 0x562031739c80 2026-02-24T09:21:22.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.119+0000 7f999d7fa640 1 -- 10.20.193.28:0/3639860975 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f99d0012de0 con 0x562031739c80 2026-02-24T09:21:22.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.119+0000 7f999d7fa640 1 -- 10.20.193.28:0/3639860975 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f99d0012470 con 0x562031739c80 2026-02-24T09:21:22.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.119+0000 7f99e47dde00 1 -- 10.20.193.28:0/3639860975 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99d0005570 con 0x562031739c80 2026-02-24T09:21:22.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.119+0000 7f99e47dde00 10 client.15831 _ll_register_callbacks cb 0x562031582980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:21:22.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.119+0000 7f99e47dde00 1 -- 10.20.193.28:0/3639860975 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562031628d30 con 0x562031739c80 2026-02-24T09:21:22.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.119+0000 7f999d7fa640 1 -- 10.20.193.28:0/3639860975 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7f99d0014e40 con 0x562031739c80 2026-02-24T09:21:22.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.119+0000 7f999d7fa640 1 -- 10.20.193.28:0/3639860975 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f99d0005800 con 0x562031739c80 2026-02-24T09:21:22.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.119+0000 7f99e47dde00 10 client.15831 fetch_fsmap learned FSMap version 23 2026-02-24T09:21:22.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.119+0000 7f99e47dde00 1 -- 10.20.193.28:0/3639860975 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x56203158d810 con 0x562031739c80 2026-02-24T09:21:22.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.119+0000 7f999d7fa640 1 -- 10.20.193.28:0/3639860975 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f99d0005960 con 0x562031739c80 2026-02-24T09:21:22.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.119+0000 7f99e47dde00 10 client.15831 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:21:22.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.119+0000 7f99e47dde00 10 client.15831 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:21:22.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.119+0000 7f99e47dde00 20 client.15831 populate_metadata read hostname 'trial028' 2026-02-24T09:21:22.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.119+0000 7f99e47dde00 1 --2- 10.20.193.28:0/3639860975 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5620316e5dc0 0x5620316e6260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:22.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.119+0000 7f99e47dde00 4 client.15831 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-24T09:21:22.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.119+0000 7f99e47dde00 1 -- 10.20.193.28:0/3639860975 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5620312db640 con 0x5620316e5dc0 2026-02-24T09:21:22.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.120+0000 7f99db7fe640 1 --2- 10.20.193.28:0/3639860975 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5620316e5dc0 0x5620316e6260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:22.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.121+0000 7f99db7fe640 1 --2- 10.20.193.28:0/3639860975 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5620316e5dc0 0x5620316e6260 crc :-1 s=READY pgs=59 gs=4 cs=0 l=0 c_cookie=12821138005243502095 s_cookie=10062885506935753009 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1edd51622cc9e0f server_cookie=8ba68d0d98550931 in_seq=0 out_seq=0 2026-02-24T09:21:22.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.121+0000 7f999d7fa640 10 client.15831 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:21:22.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.126+0000 7f999d7fa640 1 -- 10.20.193.28:0/3639860975 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5620312db640 con 0x5620316e5dc0 2026-02-24T09:21:22.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.126+0000 7f999d7fa640 10 client.15831 handle_command_reply: tid=0 2026-02-24T09:21:22.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.126+0000 7f99e47dde00 1 client.15831 shutdown 2026-02-24T09:21:22.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.126+0000 7f99e47dde00 1 -- 10.20.193.28:0/3639860975 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562031739c80 msgr2=0x5620317a8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:22.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.126+0000 7f99e47dde00 1 --2- 10.20.193.28:0/3639860975 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562031739c80 0x5620317a8dc0 secure :-1 s=READY pgs=474 gs=1 cs=0 l=1 c_cookie=12136826364315897393 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99d0012d80 tx=0x7f99d0011770 comp rx=0 tx=0).stop 2026-02-24T09:21:22.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.126+0000 7f99e47dde00 1 -- 10.20.193.28:0/3639860975 shutdown_connections 2026-02-24T09:21:22.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.126+0000 7f99e47dde00 1 --2- 10.20.193.28:0/3639860975 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5620316e5dc0 0x5620316e6260 crc :-1 s=READY pgs=59 gs=4 cs=0 l=0 c_cookie=12821138005243502095 s_cookie=10062885506935753009 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.126+0000 7f99e47dde00 1 --2- 10.20.193.28:0/3639860975 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562031739c80 0x5620317a8dc0 unknown :-1 s=CLOSED pgs=474 gs=1 cs=0 l=1 c_cookie=12136826364315897393 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.126+0000 7f99e47dde00 1 --2- 10.20.193.28:0/3639860975 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5620316f5150 0x5620317a8880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.126+0000 7f99e47dde00 1 --2- 10.20.193.28:0/3639860975 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x56203160aa60 0x5620317ab2a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.126+0000 7f99e47dde00 1 -- 10.20.193.28:0/3639860975 >> 10.20.193.28:0/3639860975 conn(0x562031686490 msgr2=0x5620316df300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:22.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.126+0000 7f999d7fa640 0 client.15831 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:21:22.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.126+0000 7f99e47dde00 1 -- 10.20.193.28:0/3639860975 shutdown_connections 2026-02-24T09:21:22.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.126+0000 7f99e47dde00 1 -- 10.20.193.28:0/3639860975 wait complete. 2026-02-24T09:21:22.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.126+0000 7f99e47dde00 20 client.15831 trim_cache size 0 max 16384 2026-02-24T09:21:22.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-24T09:21:22.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-24T09:21:22.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-24T09:21:22.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-24T09:21:22.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.127+0000 7f99e0e83640 1 -- 10.20.193.28:0/4273818742 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f99b00b58d0 msgr2=0x7f99b00d5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:22.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.127+0000 7f99e0e83640 1 --2- 10.20.193.28:0/4273818742 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f99b00b58d0 0x7f99b00d5d80 secure :-1 s=READY pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99cc005970 tx=0x7f99cc005900 comp rx=0 tx=0).stop 2026-02-24T09:21:22.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.127+0000 7f99e0e83640 1 -- 10.20.193.28:0/4273818742 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f99dc0607e0 msgr2=0x7f99dc1620a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:22.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.127+0000 7f99e0e83640 1 --2- 10.20.193.28:0/4273818742 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f99dc0607e0 0x7f99dc1620a0 secure :-1 s=READY pgs=470 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99c80098a0 tx=0x7f99c80028d0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.127+0000 7f99e0e83640 1 -- 10.20.193.28:0/4273818742 shutdown_connections 2026-02-24T09:21:22.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.127+0000 7f99e0e83640 1 --2- 10.20.193.28:0/4273818742 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f99b00b58d0 0x7f99b00d5d80 unknown :-1 s=CLOSED pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.127+0000 7f99e0e83640 1 --2- 10.20.193.28:0/4273818742 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f99dc1558f0 0x7f99dc1679b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.127+0000 7f99e0e83640 1 --2- 10.20.193.28:0/4273818742 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f99dc0610f0 0x7f99dc1625e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.127+0000 7f99e0e83640 1 --2- 10.20.193.28:0/4273818742 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f99dc0607e0 0x7f99dc1620a0 unknown :-1 s=CLOSED pgs=470 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.127+0000 7f99e0e83640 1 -- 10.20.193.28:0/4273818742 >> 10.20.193.28:0/4273818742 conn(0x7f99dc0eaaa0 msgr2=0x7f99dc10ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:22.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.127+0000 7f99e0e83640 1 -- 10.20.193.28:0/4273818742 shutdown_connections 2026-02-24T09:21:22.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:22.127+0000 7f99e0e83640 1 -- 10.20.193.28:0/4273818742 wait complete. 2026-02-24T09:21:22.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:22 trial159 ceph-mon[44242]: pgmap v315: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 863 KiB/s rd, 216 MiB/s wr, 277 op/s 2026-02-24T09:21:22.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:22 trial028 ceph-mon[40371]: pgmap v315: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 863 KiB/s rd, 216 MiB/s wr, 277 op/s 2026-02-24T09:21:22.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:22 trial074 ceph-mon[44412]: pgmap v315: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 863 KiB/s rd, 216 MiB/s wr, 277 op/s 2026-02-24T09:21:24.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:24 trial159 ceph-mon[44242]: pgmap v316: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 1.4 MiB/s rd, 184 MiB/s wr, 238 op/s 2026-02-24T09:21:24.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:24 trial028 ceph-mon[40371]: pgmap v316: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 1.4 MiB/s rd, 184 MiB/s wr, 238 op/s 2026-02-24T09:21:24.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:24 trial074 ceph-mon[44412]: pgmap v316: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 1.4 MiB/s rd, 184 MiB/s wr, 238 op/s 2026-02-24T09:21:26.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:26 trial159 ceph-mon[44242]: pgmap v317: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 13 MiB/s rd, 139 MiB/s wr, 183 op/s 2026-02-24T09:21:26.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:26 trial028 ceph-mon[40371]: pgmap v317: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 13 MiB/s rd, 139 MiB/s wr, 183 op/s 2026-02-24T09:21:26.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:26 trial074 ceph-mon[44412]: pgmap v317: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 13 MiB/s rd, 139 MiB/s wr, 183 op/s 2026-02-24T09:21:28.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:28 trial159 ceph-mon[44242]: pgmap v318: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 50 MiB/s rd, 108 MiB/s wr, 155 op/s 2026-02-24T09:21:28.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:28 trial028 ceph-mon[40371]: pgmap v318: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 50 MiB/s rd, 108 MiB/s wr, 155 op/s 2026-02-24T09:21:28.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:28 trial074 ceph-mon[44412]: pgmap v318: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 50 MiB/s rd, 108 MiB/s wr, 155 op/s 2026-02-24T09:21:30.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:30 trial159 ceph-mon[44242]: pgmap v319: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 99 MiB/s rd, 47 MiB/s wr, 90 op/s 2026-02-24T09:21:30.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:30 trial028 ceph-mon[40371]: pgmap v319: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 99 MiB/s rd, 47 MiB/s wr, 90 op/s 2026-02-24T09:21:30.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:30 trial074 ceph-mon[44412]: pgmap v319: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 99 MiB/s rd, 47 MiB/s wr, 90 op/s 2026-02-24T09:21:32.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:32 trial159 ceph-mon[44242]: pgmap v320: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 139 MiB/s rd, 11 MiB/s wr, 58 op/s 2026-02-24T09:21:32.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:32 trial028 ceph-mon[40371]: pgmap v320: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 139 MiB/s rd, 11 MiB/s wr, 58 op/s 2026-02-24T09:21:32.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:32 trial074 ceph-mon[44412]: pgmap v320: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 139 MiB/s rd, 11 MiB/s wr, 58 op/s 2026-02-24T09:21:34.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:34 trial159 ceph-mon[44242]: pgmap v321: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 186 MiB/s rd, 347 KiB/s wr, 55 op/s 2026-02-24T09:21:34.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:34 trial028 ceph-mon[40371]: pgmap v321: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 186 MiB/s rd, 347 KiB/s wr, 55 op/s 2026-02-24T09:21:34.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:34 trial074 ceph-mon[44412]: pgmap v321: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 186 MiB/s rd, 347 KiB/s wr, 55 op/s 2026-02-24T09:21:35.205 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.202+0000 7fd064a43640 1 -- 10.20.193.28:0/4161705126 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd0601155b0 msgr2=0x7fd060175f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:35.205 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.202+0000 7fd064a43640 1 --2- 10.20.193.28:0/4161705126 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd0601155b0 0x7fd060175f80 secure :-1 s=READY pgs=475 gs=1 cs=0 l=1 c_cookie=6160135462709243700 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd05400aa30 tx=0x7fd054030270 comp rx=0 tx=0).stop 2026-02-24T09:21:35.205 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.202+0000 7fd064a43640 1 -- 10.20.193.28:0/4161705126 shutdown_connections 2026-02-24T09:21:35.205 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.202+0000 7fd064a43640 1 --2- 10.20.193.28:0/4161705126 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd0601155b0 0x7fd060175f80 unknown :-1 s=CLOSED pgs=475 gs=1 cs=0 l=1 c_cookie=6160135462709243700 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:35.205 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.202+0000 7fd064a43640 1 --2- 10.20.193.28:0/4161705126 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fd06010fdb0 0x7fd060114e00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:35.206 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.202+0000 7fd064a43640 1 --2- 10.20.193.28:0/4161705126 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fd06010f3c0 0x7fd06010f790 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:35.206 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.202+0000 7fd064a43640 1 -- 10.20.193.28:0/4161705126 >> 10.20.193.28:0/4161705126 conn(0x7fd0600ecc70 msgr2=0x7fd06010d080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:35.206 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.203+0000 7fd064a43640 1 -- 10.20.193.28:0/4161705126 shutdown_connections 2026-02-24T09:21:35.206 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.203+0000 7fd064a43640 1 -- 10.20.193.28:0/4161705126 wait complete. 2026-02-24T09:21:35.206 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.203+0000 7fd064a43640 1 Processor -- start 2026-02-24T09:21:35.209 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.203+0000 7fd064a43640 1 -- start start 2026-02-24T09:21:35.209 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.203+0000 7fd064a43640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fd06010f3c0 0x7fd06011d450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:35.209 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.203+0000 7fd064a43640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fd06010fdb0 0x7fd06011d990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:35.209 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.204+0000 7fd064a43640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd0601155b0 0x7fd060122d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:35.209 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.204+0000 7fd064a43640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd060123380 con 0x7fd0601155b0 2026-02-24T09:21:35.209 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.204+0000 7fd064a43640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fd0601234f0 con 0x7fd06010fdb0 2026-02-24T09:21:35.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.204+0000 7fd064a43640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd0601236b0 con 0x7fd06010f3c0 2026-02-24T09:21:35.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.204+0000 7fd05ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd0601155b0 0x7fd060122d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:35.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.204+0000 7fd05ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd0601155b0 0x7fd060122d60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41998/0 (socket says 10.20.193.28:41998) 2026-02-24T09:21:35.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.204+0000 7fd05ffff640 1 -- 10.20.193.28:0/3365340477 learned_addr learned my addr 10.20.193.28:0/3365340477 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:21:35.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.204+0000 7fd05f7fe640 1 --2- 10.20.193.28:0/3365340477 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fd06010f3c0 0x7fd06011d450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:35.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.204+0000 7fd05effd640 1 --2- 10.20.193.28:0/3365340477 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fd06010fdb0 0x7fd06011d990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:35.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.204+0000 7fd05ffff640 1 -- 10.20.193.28:0/3365340477 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fd06010f3c0 msgr2=0x7fd06011d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:35.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.204+0000 7fd05ffff640 1 --2- 10.20.193.28:0/3365340477 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fd06010f3c0 0x7fd06011d450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:35.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.204+0000 7fd05ffff640 1 -- 10.20.193.28:0/3365340477 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fd06010fdb0 msgr2=0x7fd06011d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:35.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.204+0000 7fd05ffff640 1 --2- 10.20.193.28:0/3365340477 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fd06010fdb0 0x7fd06011d990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:35.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.204+0000 7fd05ffff640 1 -- 10.20.193.28:0/3365340477 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd05400a650 con 0x7fd0601155b0 2026-02-24T09:21:35.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.204+0000 7fd05effd640 1 --2- 10.20.193.28:0/3365340477 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fd06010fdb0 0x7fd06011d990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:21:35.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.204+0000 7fd05ffff640 1 --2- 10.20.193.28:0/3365340477 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd0601155b0 0x7fd060122d60 secure :-1 s=READY pgs=476 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd054006a50 tx=0x7fd054030ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:35.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.204+0000 7fd05cff9640 1 -- 10.20.193.28:0/3365340477 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd05403e070 con 0x7fd0601155b0 2026-02-24T09:21:35.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.204+0000 7fd05cff9640 1 -- 10.20.193.28:0/3365340477 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd054039de0 con 0x7fd0601155b0 2026-02-24T09:21:35.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.204+0000 7fd05cff9640 1 -- 10.20.193.28:0/3365340477 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd054042820 con 0x7fd0601155b0 2026-02-24T09:21:35.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.204+0000 7fd064a43640 1 -- 10.20.193.28:0/3365340477 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd060123930 con 0x7fd0601155b0 2026-02-24T09:21:35.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.205+0000 7fd064a43640 1 -- 10.20.193.28:0/3365340477 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd060175300 con 0x7fd0601155b0 2026-02-24T09:21:35.216 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.207+0000 7fd05cff9640 1 -- 10.20.193.28:0/3365340477 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7fd054039920 con 0x7fd0601155b0 2026-02-24T09:21:35.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.209+0000 7fd05cff9640 1 --2- 10.20.193.28:0/3365340477 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fd0340b58d0 0x7fd0340d5d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:35.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.209+0000 7fd05cff9640 1 -- 10.20.193.28:0/3365340477 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7fd05410c830 con 0x7fd0601155b0 2026-02-24T09:21:35.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.209+0000 7fd05f7fe640 1 --2- 10.20.193.28:0/3365340477 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fd0340b58d0 0x7fd0340d5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:35.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.209+0000 7fd0682c8e00 1 Processor -- start 2026-02-24T09:21:35.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.209+0000 7fd0682c8e00 1 -- start start 2026-02-24T09:21:35.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.210+0000 7fd0682c8e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5594e2ecfa60 0x5594e2fb1200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:35.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.210+0000 7fd0682c8e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5594e2fb1740 0x5594e2fb1b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:35.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.210+0000 7fd0682c8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5594e2ff6270 0x5594e3016650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:35.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.210+0000 7fd0682c8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5594e2ec6f10 con 0x5594e2ff6270 2026-02-24T09:21:35.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.210+0000 7fd0682c8e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x5594e2ec2c40 con 0x5594e2fb1740 2026-02-24T09:21:35.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.210+0000 7fd0682c8e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x5594e2ebcda0 con 0x5594e2ecfa60 2026-02-24T09:21:35.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.210+0000 7fd05f7fe640 1 --2- 10.20.193.28:0/3365340477 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fd0340b58d0 0x7fd0340d5d80 secure :-1 s=READY pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd04c004740 tx=0x7fd04c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:35.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.210+0000 7fd05ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5594e2ff6270 0x5594e3016650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:35.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.210+0000 7fd05ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5594e2ff6270 0x5594e3016650 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42006/0 (socket says 10.20.193.28:42006) 2026-02-24T09:21:35.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.210+0000 7fd05ffff640 1 -- 10.20.193.28:0/3446743016 learned_addr learned my addr 10.20.193.28:0/3446743016 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:21:35.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.210+0000 7fd05effd640 1 --2- 10.20.193.28:0/3446743016 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5594e2fb1740 0x5594e2fb1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:35.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.210+0000 7fd05ffff640 1 -- 10.20.193.28:0/3446743016 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5594e2ecfa60 msgr2=0x5594e2fb1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:35.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.210+0000 7fd05ffff640 1 --2- 10.20.193.28:0/3446743016 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5594e2ecfa60 0x5594e2fb1200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:35.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.210+0000 7fd05ffff640 1 -- 10.20.193.28:0/3446743016 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5594e2fb1740 msgr2=0x5594e2fb1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:35.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.210+0000 7fd05ffff640 1 --2- 10.20.193.28:0/3446743016 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5594e2fb1740 0x5594e2fb1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:35.219 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.210+0000 7fd05ffff640 1 -- 10.20.193.28:0/3446743016 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594e2e68340 con 0x5594e2ff6270 2026-02-24T09:21:35.219 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.210+0000 7fd05ffff640 1 --2- 10.20.193.28:0/3446743016 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5594e2ff6270 0x5594e3016650 secure :-1 s=READY pgs=477 gs=1 cs=0 l=1 c_cookie=8766470733806819908 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd05410a120 tx=0x7fd0540d2b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a8c2af8669da44 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:35.219 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.210+0000 7fd02b7fe640 1 -- 10.20.193.28:0/3446743016 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0540d33c0 con 0x5594e2ff6270 2026-02-24T09:21:35.219 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.210+0000 7fd02b7fe640 1 -- 10.20.193.28:0/3446743016 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd0540d86e0 con 0x5594e2ff6270 2026-02-24T09:21:35.219 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.210+0000 7fd02b7fe640 1 -- 10.20.193.28:0/3446743016 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0540d3650 con 0x5594e2ff6270 2026-02-24T09:21:35.219 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.211+0000 7fd0682c8e00 1 -- 10.20.193.28:0/3446743016 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5594e2ff6270 msgr2=0x5594e3016650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:35.219 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.211+0000 7fd0682c8e00 1 --2- 10.20.193.28:0/3446743016 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5594e2ff6270 0x5594e3016650 secure :-1 s=READY pgs=477 gs=1 cs=0 l=1 c_cookie=8766470733806819908 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd05410a120 tx=0x7fd0540d2b40 comp rx=0 tx=0).stop 2026-02-24T09:21:35.220 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.211+0000 7fd0682c8e00 1 -- 10.20.193.28:0/3446743016 shutdown_connections 2026-02-24T09:21:35.220 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.211+0000 7fd0682c8e00 1 --2- 10.20.193.28:0/3446743016 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5594e2ff6270 0x5594e3016650 unknown :-1 s=CLOSED pgs=477 gs=1 cs=0 l=1 c_cookie=8766470733806819908 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:35.220 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.211+0000 7fd0682c8e00 1 --2- 10.20.193.28:0/3446743016 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5594e2fb1740 0x5594e2fb1b90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:35.220 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.211+0000 7fd0682c8e00 1 --2- 10.20.193.28:0/3446743016 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5594e2ecfa60 0x5594e2fb1200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:35.220 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.211+0000 7fd0682c8e00 1 -- 10.20.193.28:0/3446743016 >> 10.20.193.28:0/3446743016 conn(0x5594e2f4b490 msgr2=0x5594e2fafae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:35.220 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.211+0000 7fd0682c8e00 1 -- 10.20.193.28:0/3446743016 shutdown_connections 2026-02-24T09:21:35.220 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.211+0000 7fd0682c8e00 1 -- 10.20.193.28:0/3446743016 wait complete. 2026-02-24T09:21:35.220 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.212+0000 7fd0682c8e00 1 -- start start 2026-02-24T09:21:35.220 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.212+0000 7fd0682c8e00 1 Processor -- start 2026-02-24T09:21:35.220 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.212+0000 7fd0682c8e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5594e2ecfa60 0x5594e300d860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:35.220 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.212+0000 7fd0682c8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5594e2fb1740 0x5594e300dda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:35.221 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.212+0000 7fd0682c8e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5594e2ff6270 0x5594e3012d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:35.221 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.212+0000 7fd0682c8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5594e30132d0 con 0x5594e2fb1740 2026-02-24T09:21:35.221 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.212+0000 7fd0682c8e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x5594e3013440 con 0x5594e2ecfa60 2026-02-24T09:21:35.221 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.212+0000 7fd0682c8e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x5594e3013600 con 0x5594e2ff6270 2026-02-24T09:21:35.221 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.213+0000 7fd05effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5594e2fb1740 0x5594e300dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:35.221 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.213+0000 7fd05effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5594e2fb1740 0x5594e300dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42022/0 (socket says 10.20.193.28:42022) 2026-02-24T09:21:35.221 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.213+0000 7fd05effd640 1 -- 10.20.193.28:0/227073374 learned_addr learned my addr 10.20.193.28:0/227073374 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:21:35.221 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.213+0000 7fd05f7fe640 1 --2- 10.20.193.28:0/227073374 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5594e2ecfa60 0x5594e300d860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:35.221 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.213+0000 7fd05ffff640 1 --2- 10.20.193.28:0/227073374 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5594e2ff6270 0x5594e3012d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:35.221 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.213+0000 7fd05effd640 1 -- 10.20.193.28:0/227073374 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5594e2ff6270 msgr2=0x5594e3012d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:35.221 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.213+0000 7fd05effd640 1 --2- 10.20.193.28:0/227073374 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5594e2ff6270 0x5594e3012d90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:35.222 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.213+0000 7fd05effd640 1 -- 10.20.193.28:0/227073374 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5594e2ecfa60 msgr2=0x5594e300d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:35.222 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.213+0000 7fd05effd640 1 --2- 10.20.193.28:0/227073374 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5594e2ecfa60 0x5594e300d860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:35.222 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.213+0000 7fd05effd640 1 -- 10.20.193.28:0/227073374 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594e2e40ce0 con 0x5594e2fb1740 2026-02-24T09:21:35.222 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.213+0000 7fd05f7fe640 1 --2- 10.20.193.28:0/227073374 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5594e2ecfa60 0x5594e300d860 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:21:35.222 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.213+0000 7fd05effd640 1 --2- 10.20.193.28:0/227073374 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5594e2fb1740 0x5594e300dda0 secure :-1 s=READY pgs=478 gs=2 cs=0 l=1 c_cookie=11848911743074719167 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd050002b70 tx=0x7fd050009a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a46fca73bcec55bf server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:35.222 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.213+0000 7fd028ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:21:35.222 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.213+0000 7fd028ff9640 1 -- 10.20.193.28:0/227073374 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd050011650 con 0x5594e2fb1740 2026-02-24T09:21:35.222 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.213+0000 7fd028ff9640 1 -- 10.20.193.28:0/227073374 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd050011c70 con 0x5594e2fb1740 2026-02-24T09:21:35.222 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.213+0000 7fd028ff9640 1 -- 10.20.193.28:0/227073374 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd05001bdc0 con 0x5594e2fb1740 2026-02-24T09:21:35.222 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.213+0000 7fd0682c8e00 1 -- 10.20.193.28:0/227073374 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd060175300 con 0x5594e2fb1740 2026-02-24T09:21:35.222 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.214+0000 7fd028ff9640 1 -- 10.20.193.28:0/227073374 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7fd0500117b0 con 0x5594e2fb1740 2026-02-24T09:21:35.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.214+0000 7fd0682c8e00 10 client.15843 _ll_register_callbacks cb 0x5594e2e47980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:21:35.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.214+0000 7fd0682c8e00 1 -- 10.20.193.28:0/227073374 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5594e2b5c520 con 0x5594e2fb1740 2026-02-24T09:21:35.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.214+0000 7fd028ff9640 1 -- 10.20.193.28:0/227073374 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fd050011de0 con 0x5594e2fb1740 2026-02-24T09:21:35.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.214+0000 7fd0682c8e00 10 client.15843 fetch_fsmap learned FSMap version 23 2026-02-24T09:21:35.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.214+0000 7fd0682c8e00 1 -- 10.20.193.28:0/227073374 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x5594e2e525b0 con 0x5594e2fb1740 2026-02-24T09:21:35.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.214+0000 7fd028ff9640 1 -- 10.20.193.28:0/227073374 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fd050011970 con 0x5594e2fb1740 2026-02-24T09:21:35.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.214+0000 7fd0682c8e00 10 client.15843 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:21:35.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.214+0000 7fd0682c8e00 10 client.15843 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:21:35.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.214+0000 7fd0682c8e00 20 client.15843 populate_metadata read hostname 'trial028' 2026-02-24T09:21:35.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.214+0000 7fd0682c8e00 1 --2- 10.20.193.28:0/227073374 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5594e2ff3720 0x5594e2ff3bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:35.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.214+0000 7fd0682c8e00 4 client.15843 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:21:35.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.214+0000 7fd0682c8e00 1 -- 10.20.193.28:0/227073374 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5594e2e8e9d0 con 0x5594e2ff3720 2026-02-24T09:21:35.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.215+0000 7fd05f7fe640 1 --2- 10.20.193.28:0/227073374 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5594e2ff3720 0x5594e2ff3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:35.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.215+0000 7fd05f7fe640 1 --2- 10.20.193.28:0/227073374 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5594e2ff3720 0x5594e2ff3bc0 crc :-1 s=READY pgs=60 gs=4 cs=0 l=0 c_cookie=7534308849963044621 s_cookie=2855649295401396062 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=688f3dfb06210f0d server_cookie=27a14de77f7ea75e in_seq=0 out_seq=0 2026-02-24T09:21:35.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.215+0000 7fd028ff9640 10 client.15843 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:21:35.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.216+0000 7fd028ff9640 1 -- 10.20.193.28:0/227073374 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5594e2e8e9d0 con 0x5594e2ff3720 2026-02-24T09:21:35.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.216+0000 7fd028ff9640 10 client.15843 handle_command_reply: tid=0 2026-02-24T09:21:35.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.216+0000 7fd0682c8e00 1 client.15843 shutdown 2026-02-24T09:21:35.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.217+0000 7fd0682c8e00 1 -- 10.20.193.28:0/227073374 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5594e2fb1740 msgr2=0x5594e300dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:35.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.217+0000 7fd0682c8e00 1 --2- 10.20.193.28:0/227073374 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5594e2fb1740 0x5594e300dda0 secure :-1 s=READY pgs=478 gs=2 cs=0 l=1 c_cookie=11848911743074719167 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd050002b70 tx=0x7fd050009a00 comp rx=0 tx=0).stop 2026-02-24T09:21:35.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.217+0000 7fd0682c8e00 1 -- 10.20.193.28:0/227073374 shutdown_connections 2026-02-24T09:21:35.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.217+0000 7fd0682c8e00 1 --2- 10.20.193.28:0/227073374 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5594e2ff3720 0x5594e2ff3bc0 crc :-1 s=READY pgs=60 gs=4 cs=0 l=0 c_cookie=7534308849963044621 s_cookie=2855649295401396062 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:35.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.217+0000 7fd0682c8e00 1 --2- 10.20.193.28:0/227073374 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5594e2ff6270 0x5594e3012d90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:35.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.217+0000 7fd0682c8e00 1 --2- 10.20.193.28:0/227073374 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5594e2fb1740 0x5594e300dda0 unknown :-1 s=CLOSED pgs=478 gs=2 cs=0 l=1 c_cookie=11848911743074719167 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:35.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.217+0000 7fd0682c8e00 1 --2- 10.20.193.28:0/227073374 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5594e2ecfa60 0x5594e300d860 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:35.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.217+0000 7fd0682c8e00 1 -- 10.20.193.28:0/227073374 >> 10.20.193.28:0/227073374 conn(0x5594e2f4b490 msgr2=0x5594e2faf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:35.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.217+0000 7fd028ff9640 0 client.15843 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:21:35.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.217+0000 7fd0682c8e00 1 -- 10.20.193.28:0/227073374 shutdown_connections 2026-02-24T09:21:35.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.217+0000 7fd0682c8e00 1 -- 10.20.193.28:0/227073374 wait complete. 2026-02-24T09:21:35.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.217+0000 7fd0682c8e00 20 client.15843 trim_cache size 0 max 16384 2026-02-24T09:21:35.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.227+0000 7fd0682c8e00 1 Processor -- start 2026-02-24T09:21:35.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.227+0000 7fd0682c8e00 1 -- start start 2026-02-24T09:21:35.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.227+0000 7fd0682c8e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5594e2ecfa60 0x5594e2ff5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:35.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.227+0000 7fd0682c8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5594e2fb1740 0x5594e2ff0400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:35.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.227+0000 7fd0682c8e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5594e2ff6270 0x5594e2ff0940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:35.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.227+0000 7fd0682c8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5594e2eba9d0 con 0x5594e2fb1740 2026-02-24T09:21:35.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.227+0000 7fd0682c8e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x5594e2bfbf10 con 0x5594e2ecfa60 2026-02-24T09:21:35.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.227+0000 7fd0682c8e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x5594e2f39200 con 0x5594e2ff6270 2026-02-24T09:21:35.231 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.228+0000 7fd05f7fe640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5594e2ecfa60 0x5594e2ff5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:35.231 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.228+0000 7fd05effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5594e2fb1740 0x5594e2ff0400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:35.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.228+0000 7fd05effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5594e2fb1740 0x5594e2ff0400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42030/0 (socket says 10.20.193.28:42030) 2026-02-24T09:21:35.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.228+0000 7fd05f7fe640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5594e2ecfa60 0x5594e2ff5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:44240/0 (socket says 10.20.193.28:44240) 2026-02-24T09:21:35.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.228+0000 7fd05effd640 1 -- 10.20.193.28:0/2984038807 learned_addr learned my addr 10.20.193.28:0/2984038807 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:21:35.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.228+0000 7fd05effd640 1 -- 10.20.193.28:0/2984038807 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5594e2ff6270 msgr2=0x5594e2ff0940 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:21:35.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.228+0000 7fd05effd640 1 --2- 10.20.193.28:0/2984038807 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5594e2ff6270 0x5594e2ff0940 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:35.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.228+0000 7fd05effd640 1 -- 10.20.193.28:0/2984038807 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5594e2ecfa60 msgr2=0x5594e2ff5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:35.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.228+0000 7fd05effd640 1 --2- 10.20.193.28:0/2984038807 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5594e2ecfa60 0x5594e2ff5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:35.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.228+0000 7fd05effd640 1 -- 10.20.193.28:0/2984038807 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594e2fffdd0 con 0x5594e2fb1740 2026-02-24T09:21:35.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.228+0000 7fd05effd640 1 --2- 10.20.193.28:0/2984038807 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5594e2fb1740 0x5594e2ff0400 secure :-1 s=READY pgs=479 gs=2 cs=0 l=1 c_cookie=2201753283216618136 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd050011fd0 tx=0x7fd05001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e8e32f2192d3298 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:35.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.228+0000 7fd02affd640 1 -- 10.20.193.28:0/2984038807 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd050002870 con 0x5594e2fb1740 2026-02-24T09:21:35.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.228+0000 7fd02affd640 1 -- 10.20.193.28:0/2984038807 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x5594e2b5c520 con 0x5594e2fb1740 2026-02-24T09:21:35.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.228+0000 7fd02affd640 1 -- 10.20.193.28:0/2984038807 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd050004740 con 0x5594e2fb1740 2026-02-24T09:21:35.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.229+0000 7fd0682c8e00 1 -- 10.20.193.28:0/2984038807 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5594e2fb1740 msgr2=0x5594e2ff0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:35.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.229+0000 7fd0682c8e00 1 --2- 10.20.193.28:0/2984038807 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5594e2fb1740 0x5594e2ff0400 secure :-1 s=READY pgs=479 gs=2 cs=0 l=1 c_cookie=2201753283216618136 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd050011fd0 tx=0x7fd05001f000 comp rx=0 tx=0).stop 2026-02-24T09:21:35.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.229+0000 7fd0682c8e00 1 -- 10.20.193.28:0/2984038807 shutdown_connections 2026-02-24T09:21:35.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.229+0000 7fd0682c8e00 1 --2- 10.20.193.28:0/2984038807 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5594e2ff6270 0x5594e2ff0940 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:35.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.229+0000 7fd0682c8e00 1 --2- 10.20.193.28:0/2984038807 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5594e2fb1740 0x5594e2ff0400 unknown :-1 s=CLOSED pgs=479 gs=2 cs=0 l=1 c_cookie=2201753283216618136 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:35.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.229+0000 7fd0682c8e00 1 --2- 10.20.193.28:0/2984038807 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5594e2ecfa60 0x5594e2ff5bc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:35.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.229+0000 7fd0682c8e00 1 -- 10.20.193.28:0/2984038807 >> 10.20.193.28:0/2984038807 conn(0x5594e2f4b490 msgr2=0x5594e2ff44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:35.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.229+0000 7fd0682c8e00 1 -- 10.20.193.28:0/2984038807 shutdown_connections 2026-02-24T09:21:35.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.229+0000 7fd0682c8e00 1 -- 10.20.193.28:0/2984038807 wait complete. 2026-02-24T09:21:35.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.229+0000 7fd0682c8e00 1 -- start start 2026-02-24T09:21:35.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.229+0000 7fd0682c8e00 1 Processor -- start 2026-02-24T09:21:35.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.230+0000 7fd0682c8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5594e2ecfa60 0x5594e2f93fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:35.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.230+0000 7fd0682c8e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5594e2fb1740 0x5594e2f944f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:35.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.230+0000 7fd0682c8e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5594e2ff6270 0x5594e3044960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:35.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.230+0000 7fd0682c8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5594e3012ea0 con 0x5594e2ecfa60 2026-02-24T09:21:35.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.230+0000 7fd0682c8e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x5594e2ec2c40 con 0x5594e2fb1740 2026-02-24T09:21:35.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.230+0000 7fd0682c8e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x5594e2f94d40 con 0x5594e2ff6270 2026-02-24T09:21:35.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.230+0000 7fd05f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5594e2ecfa60 0x5594e2f93fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:35.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.230+0000 7fd05f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5594e2ecfa60 0x5594e2f93fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42038/0 (socket says 10.20.193.28:42038) 2026-02-24T09:21:35.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.230+0000 7fd05f7fe640 1 -- 10.20.193.28:0/1919977154 learned_addr learned my addr 10.20.193.28:0/1919977154 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:21:35.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.230+0000 7fd05effd640 1 --2- 10.20.193.28:0/1919977154 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5594e2fb1740 0x5594e2f944f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:35.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.230+0000 7fd05f7fe640 1 -- 10.20.193.28:0/1919977154 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5594e2ff6270 msgr2=0x5594e3044960 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:21:35.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.230+0000 7fd05f7fe640 1 --2- 10.20.193.28:0/1919977154 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5594e2ff6270 0x5594e3044960 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:35.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.230+0000 7fd05f7fe640 1 -- 10.20.193.28:0/1919977154 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5594e2fb1740 msgr2=0x5594e2f944f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:35.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.230+0000 7fd05f7fe640 1 --2- 10.20.193.28:0/1919977154 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5594e2fb1740 0x5594e2f944f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:35.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.230+0000 7fd05f7fe640 1 -- 10.20.193.28:0/1919977154 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594e2e4d030 con 0x5594e2ecfa60 2026-02-24T09:21:35.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.230+0000 7fd05f7fe640 1 --2- 10.20.193.28:0/1919977154 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5594e2ecfa60 0x5594e2f93fb0 secure :-1 s=READY pgs=480 gs=2 cs=0 l=1 c_cookie=17403641803223393215 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x5594e2ff4440 tx=0x7fd04c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1862802f744e3bf server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:35.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.230+0000 7fd028ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:21:35.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.231+0000 7fd028ff9640 1 -- 10.20.193.28:0/1919977154 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd04c021070 con 0x5594e2ecfa60 2026-02-24T09:21:35.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.231+0000 7fd028ff9640 1 -- 10.20.193.28:0/1919977154 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd04c022040 con 0x5594e2ecfa60 2026-02-24T09:21:35.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.231+0000 7fd028ff9640 1 -- 10.20.193.28:0/1919977154 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd04c027320 con 0x5594e2ecfa60 2026-02-24T09:21:35.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.231+0000 7fd0682c8e00 1 -- 10.20.193.28:0/1919977154 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594e2e525b0 con 0x5594e2ecfa60 2026-02-24T09:21:35.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.231+0000 7fd0682c8e00 10 client.15849 _ll_register_callbacks cb 0x5594e2e47980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:21:35.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.231+0000 7fd0682c8e00 1 -- 10.20.193.28:0/1919977154 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5594e2eedd30 con 0x5594e2ecfa60 2026-02-24T09:21:35.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.231+0000 7fd028ff9640 1 -- 10.20.193.28:0/1919977154 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7fd04c027ad0 con 0x5594e2ecfa60 2026-02-24T09:21:35.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.231+0000 7fd028ff9640 1 -- 10.20.193.28:0/1919977154 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fd04c027480 con 0x5594e2ecfa60 2026-02-24T09:21:35.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.231+0000 7fd0682c8e00 10 client.15849 fetch_fsmap learned FSMap version 23 2026-02-24T09:21:35.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.231+0000 7fd0682c8e00 1 -- 10.20.193.28:0/1919977154 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x5594e2e41010 con 0x5594e2ecfa60 2026-02-24T09:21:35.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.232+0000 7fd028ff9640 1 -- 10.20.193.28:0/1919977154 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fd04c02e070 con 0x5594e2ecfa60 2026-02-24T09:21:35.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.232+0000 7fd0682c8e00 10 client.15849 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:21:35.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.232+0000 7fd0682c8e00 10 client.15849 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:21:35.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.232+0000 7fd0682c8e00 20 client.15849 populate_metadata read hostname 'trial028' 2026-02-24T09:21:35.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.232+0000 7fd0682c8e00 1 --2- 10.20.193.28:0/1919977154 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5594e3046a50 0x5594e3046ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:35.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.232+0000 7fd0682c8e00 4 client.15849 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-24T09:21:35.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.232+0000 7fd0682c8e00 1 -- 10.20.193.28:0/1919977154 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5594e2ba0640 con 0x5594e3046a50 2026-02-24T09:21:35.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.232+0000 7fd05effd640 1 --2- 10.20.193.28:0/1919977154 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5594e3046a50 0x5594e3046ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:35.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.233+0000 7fd05effd640 1 --2- 10.20.193.28:0/1919977154 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5594e3046a50 0x5594e3046ef0 crc :-1 s=READY pgs=61 gs=3 cs=0 l=0 c_cookie=1409612116194034397 s_cookie=3979098096301261839 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=138ff2c050d502dd server_cookie=373898a2ec78440f in_seq=0 out_seq=0 2026-02-24T09:21:35.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.233+0000 7fd028ff9640 10 client.15849 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:21:35.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.237+0000 7fd028ff9640 1 -- 10.20.193.28:0/1919977154 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5594e2ba0640 con 0x5594e3046a50 2026-02-24T09:21:35.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.237+0000 7fd028ff9640 10 client.15849 handle_command_reply: tid=0 2026-02-24T09:21:35.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.237+0000 7fd0682c8e00 1 client.15849 shutdown 2026-02-24T09:21:35.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.237+0000 7fd0682c8e00 1 -- 10.20.193.28:0/1919977154 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5594e2ecfa60 msgr2=0x5594e2f93fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:35.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.237+0000 7fd0682c8e00 1 --2- 10.20.193.28:0/1919977154 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5594e2ecfa60 0x5594e2f93fb0 secure :-1 s=READY pgs=480 gs=2 cs=0 l=1 c_cookie=17403641803223393215 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x5594e2ff4440 tx=0x7fd04c004770 comp rx=0 tx=0).stop 2026-02-24T09:21:35.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.237+0000 7fd0682c8e00 1 -- 10.20.193.28:0/1919977154 shutdown_connections 2026-02-24T09:21:35.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.237+0000 7fd0682c8e00 1 --2- 10.20.193.28:0/1919977154 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5594e3046a50 0x5594e3046ef0 crc :-1 s=READY pgs=61 gs=3 cs=0 l=0 c_cookie=1409612116194034397 s_cookie=3979098096301261839 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:35.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.237+0000 7fd0682c8e00 1 --2- 10.20.193.28:0/1919977154 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5594e2ff6270 0x5594e3044960 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:35.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.237+0000 7fd0682c8e00 1 --2- 10.20.193.28:0/1919977154 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5594e2fb1740 0x5594e2f944f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:35.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.237+0000 7fd0682c8e00 1 --2- 10.20.193.28:0/1919977154 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5594e2ecfa60 0x5594e2f93fb0 unknown :-1 s=CLOSED pgs=480 gs=2 cs=0 l=1 c_cookie=17403641803223393215 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:35.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.237+0000 7fd028ff9640 0 client.15849 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:21:35.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.237+0000 7fd0682c8e00 1 -- 10.20.193.28:0/1919977154 >> 10.20.193.28:0/1919977154 conn(0x5594e2f4b490 msgr2=0x5594e2ff4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:35.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.237+0000 7fd0682c8e00 1 -- 10.20.193.28:0/1919977154 shutdown_connections 2026-02-24T09:21:35.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.237+0000 7fd0682c8e00 1 -- 10.20.193.28:0/1919977154 wait complete. 2026-02-24T09:21:35.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.237+0000 7fd0682c8e00 20 client.15849 trim_cache size 0 max 16384 2026-02-24T09:21:35.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-24T09:21:35.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-24T09:21:35.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-24T09:21:35.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-24T09:21:35.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.238+0000 7fd064a43640 1 -- 10.20.193.28:0/3365340477 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fd0340b58d0 msgr2=0x7fd0340d5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:35.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.238+0000 7fd064a43640 1 --2- 10.20.193.28:0/3365340477 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fd0340b58d0 0x7fd0340d5d80 secure :-1 s=READY pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd04c004740 tx=0x7fd04c005f90 comp rx=0 tx=0).stop 2026-02-24T09:21:35.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.238+0000 7fd064a43640 1 -- 10.20.193.28:0/3365340477 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd0601155b0 msgr2=0x7fd060122d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:35.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.238+0000 7fd064a43640 1 --2- 10.20.193.28:0/3365340477 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd0601155b0 0x7fd060122d60 secure :-1 s=READY pgs=476 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd054006a50 tx=0x7fd054030ce0 comp rx=0 tx=0).stop 2026-02-24T09:21:35.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.238+0000 7fd064a43640 1 -- 10.20.193.28:0/3365340477 shutdown_connections 2026-02-24T09:21:35.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.238+0000 7fd064a43640 1 --2- 10.20.193.28:0/3365340477 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fd0340b58d0 0x7fd0340d5d80 unknown :-1 s=CLOSED pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:35.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.238+0000 7fd064a43640 1 --2- 10.20.193.28:0/3365340477 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd0601155b0 0x7fd060122d60 unknown :-1 s=CLOSED pgs=476 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:35.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.238+0000 7fd064a43640 1 --2- 10.20.193.28:0/3365340477 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fd06010fdb0 0x7fd06011d990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:35.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.238+0000 7fd064a43640 1 --2- 10.20.193.28:0/3365340477 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fd06010f3c0 0x7fd06011d450 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:35.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.238+0000 7fd064a43640 1 -- 10.20.193.28:0/3365340477 >> 10.20.193.28:0/3365340477 conn(0x7fd0600ecc70 msgr2=0x7fd06010d050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:35.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.238+0000 7fd064a43640 1 -- 10.20.193.28:0/3365340477 shutdown_connections 2026-02-24T09:21:35.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:35.238+0000 7fd064a43640 1 -- 10.20.193.28:0/3365340477 wait complete. 2026-02-24T09:21:36.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:36 trial159 ceph-mon[44242]: pgmap v322: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 221 MiB/s rd, 4.6 KiB/s wr, 62 op/s 2026-02-24T09:21:36.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:36 trial028 ceph-mon[40371]: pgmap v322: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 221 MiB/s rd, 4.6 KiB/s wr, 62 op/s 2026-02-24T09:21:36.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:36 trial074 ceph-mon[44412]: pgmap v322: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 221 MiB/s rd, 4.6 KiB/s wr, 62 op/s 2026-02-24T09:21:38.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:38 trial028 ceph-mon[40371]: pgmap v323: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 267 MiB/s rd, 4.0 KiB/s wr, 74 op/s 2026-02-24T09:21:38.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:38 trial074 ceph-mon[44412]: pgmap v323: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 267 MiB/s rd, 4.0 KiB/s wr, 74 op/s 2026-02-24T09:21:39.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:38 trial159 ceph-mon[44242]: pgmap v323: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 267 MiB/s rd, 4.0 KiB/s wr, 74 op/s 2026-02-24T09:21:40.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:40 trial028 ceph-mon[40371]: pgmap v324: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 274 MiB/s rd, 255 B/s wr, 74 op/s 2026-02-24T09:21:40.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:40 trial074 ceph-mon[44412]: pgmap v324: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 274 MiB/s rd, 255 B/s wr, 74 op/s 2026-02-24T09:21:41.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:40 trial159 ceph-mon[44242]: pgmap v324: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 274 MiB/s rd, 255 B/s wr, 74 op/s 2026-02-24T09:21:42.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:42 trial028 ceph-mon[40371]: pgmap v325: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 266 MiB/s rd, 170 B/s wr, 73 op/s 2026-02-24T09:21:42.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:42 trial074 ceph-mon[44412]: pgmap v325: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 266 MiB/s rd, 170 B/s wr, 73 op/s 2026-02-24T09:21:43.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:42 trial159 ceph-mon[44242]: pgmap v325: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 266 MiB/s rd, 170 B/s wr, 73 op/s 2026-02-24T09:21:44.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:44 trial028 ceph-mon[40371]: pgmap v326: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 270 MiB/s rd, 170 B/s wr, 73 op/s 2026-02-24T09:21:44.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:44 trial074 ceph-mon[44412]: pgmap v326: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 270 MiB/s rd, 170 B/s wr, 73 op/s 2026-02-24T09:21:45.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:44 trial159 ceph-mon[44242]: pgmap v326: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 270 MiB/s rd, 170 B/s wr, 73 op/s 2026-02-24T09:21:46.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:46 trial028 ceph-mon[40371]: pgmap v327: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 254 MiB/s rd, 170 B/s wr, 69 op/s 2026-02-24T09:21:46.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:46 trial074 ceph-mon[44412]: pgmap v327: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 254 MiB/s rd, 170 B/s wr, 69 op/s 2026-02-24T09:21:47.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:46 trial159 ceph-mon[44242]: pgmap v327: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 254 MiB/s rd, 170 B/s wr, 69 op/s 2026-02-24T09:21:48.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.310+0000 7f590e2cc640 1 -- 10.20.193.28:0/1183946206 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5908063070 msgr2=0x7f5908063480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:48.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.310+0000 7f590e2cc640 1 --2- 10.20.193.28:0/1183946206 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5908063070 0x7f5908063480 secure :-1 s=READY pgs=481 gs=1 cs=0 l=1 c_cookie=11945147096760783857 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58f8009950 tx=0x7f58f802f1b0 comp rx=0 tx=0).stop 2026-02-24T09:21:48.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.311+0000 7f590e2cc640 1 -- 10.20.193.28:0/1183946206 shutdown_connections 2026-02-24T09:21:48.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.311+0000 7f590e2cc640 1 --2- 10.20.193.28:0/1183946206 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5908159e00 0x7f590817a290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:48.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.311+0000 7f590e2cc640 1 --2- 10.20.193.28:0/1183946206 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5908063070 0x7f5908063480 unknown :-1 s=CLOSED pgs=481 gs=1 cs=0 l=1 c_cookie=11945147096760783857 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:48.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.311+0000 7f590e2cc640 1 --2- 10.20.193.28:0/1183946206 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5908066a30 0x7f5908062a50 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:48.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.311+0000 7f590e2cc640 1 -- 10.20.193.28:0/1183946206 >> 10.20.193.28:0/1183946206 conn(0x7f59080ecea0 msgr2=0x7f590810d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:48.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.311+0000 7f590e2cc640 1 -- 10.20.193.28:0/1183946206 shutdown_connections 2026-02-24T09:21:48.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.311+0000 7f590e2cc640 1 -- 10.20.193.28:0/1183946206 wait complete. 2026-02-24T09:21:48.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.312+0000 7f590e2cc640 1 Processor -- start 2026-02-24T09:21:48.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.312+0000 7f590e2cc640 1 -- start start 2026-02-24T09:21:48.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.312+0000 7f590e2cc640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5908063070 0x7f5908164190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:48.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.312+0000 7f590e2cc640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5908066a30 0x7f59081646d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:48.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.312+0000 7f590e2cc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5908159e00 0x7f5908169aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:48.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.312+0000 7f590e2cc640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f590816a030 con 0x7f5908159e00 2026-02-24T09:21:48.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.312+0000 7f590e2cc640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f590816a1a0 con 0x7f5908063070 2026-02-24T09:21:48.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.312+0000 7f590e2cc640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f590816a360 con 0x7f5908066a30 2026-02-24T09:21:48.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.312+0000 7f59077fe640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5908066a30 0x7f59081646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:48.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.312+0000 7f590c842640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5908159e00 0x7f5908169aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:48.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.312+0000 7f59077fe640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5908066a30 0x7f59081646d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:41638/0 (socket says 10.20.193.28:41638) 2026-02-24T09:21:48.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.312+0000 7f59077fe640 1 -- 10.20.193.28:0/1911612549 learned_addr learned my addr 10.20.193.28:0/1911612549 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:21:48.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.313+0000 7f590c842640 1 -- 10.20.193.28:0/1911612549 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5908066a30 msgr2=0x7f59081646d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:48.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.313+0000 7f590c842640 1 --2- 10.20.193.28:0/1911612549 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5908066a30 0x7f59081646d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:48.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.313+0000 7f590c842640 1 -- 10.20.193.28:0/1911612549 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5908063070 msgr2=0x7f5908164190 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:21:48.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.313+0000 7f590c842640 1 --2- 10.20.193.28:0/1911612549 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5908063070 0x7f5908164190 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:48.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.313+0000 7f590c842640 1 -- 10.20.193.28:0/1911612549 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58f8009570 con 0x7f5908159e00 2026-02-24T09:21:48.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.313+0000 7f59077fe640 1 --2- 10.20.193.28:0/1911612549 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5908066a30 0x7f59081646d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:21:48.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.313+0000 7f590c842640 1 --2- 10.20.193.28:0/1911612549 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5908159e00 0x7f5908169aa0 secure :-1 s=READY pgs=482 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58fc00d940 tx=0x7f58fc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:48.314 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.313+0000 7f59057fa640 1 -- 10.20.193.28:0/1911612549 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f58fc0054a0 con 0x7f5908159e00 2026-02-24T09:21:48.314 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.313+0000 7f59057fa640 1 -- 10.20.193.28:0/1911612549 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f58fc005600 con 0x7f5908159e00 2026-02-24T09:21:48.314 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.313+0000 7f59057fa640 1 -- 10.20.193.28:0/1911612549 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f58fc0106d0 con 0x7f5908159e00 2026-02-24T09:21:48.314 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.313+0000 7f590e2cc640 1 -- 10.20.193.28:0/1911612549 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f590816a640 con 0x7f5908159e00 2026-02-24T09:21:48.314 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.314+0000 7f590e2cc640 1 -- 10.20.193.28:0/1911612549 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f590816a920 con 0x7f5908159e00 2026-02-24T09:21:48.318 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.318+0000 7f59057fa640 1 -- 10.20.193.28:0/1911612549 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7f58fc008800 con 0x7f5908159e00 2026-02-24T09:21:48.320 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.319+0000 7f59057fa640 1 --2- 10.20.193.28:0/1911612549 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f58dc0b5950 0x7f58dc0d5e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:48.320 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.319+0000 7f59057fa640 1 -- 10.20.193.28:0/1911612549 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7f58fc0e76b0 con 0x7f5908159e00 2026-02-24T09:21:48.320 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.319+0000 7f5907fff640 1 --2- 10.20.193.28:0/1911612549 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f58dc0b5950 0x7f58dc0d5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:48.320 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.320+0000 7f5907fff640 1 --2- 10.20.193.28:0/1911612549 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f58dc0b5950 0x7f58dc0d5e00 secure :-1 s=READY pgs=242 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58f4004760 tx=0x7f58f4006c80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:48.323 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.321+0000 7f59108cde00 1 Processor -- start 2026-02-24T09:21:48.323 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.321+0000 7f59108cde00 1 -- start start 2026-02-24T09:21:48.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.322+0000 7f59108cde00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55dba92a6f10 0x55dba92a72e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:48.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.322+0000 7f59108cde00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55dba92a7820 0x55dba92ebf80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:48.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.322+0000 7f59108cde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba92ec4c0 0x55dba930c8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:48.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.322+0000 7f59108cde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dba91bcf10 con 0x55dba92ec4c0 2026-02-24T09:21:48.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.322+0000 7f59108cde00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55dba91b8c40 con 0x55dba92a6f10 2026-02-24T09:21:48.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.322+0000 7f59108cde00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55dba91b2da0 con 0x55dba92a7820 2026-02-24T09:21:48.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.322+0000 7f590c842640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba92ec4c0 0x55dba930c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:48.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.322+0000 7f590c842640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba92ec4c0 0x55dba930c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38346/0 (socket says 10.20.193.28:38346) 2026-02-24T09:21:48.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.322+0000 7f590c842640 1 -- 10.20.193.28:0/3449881436 learned_addr learned my addr 10.20.193.28:0/3449881436 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:21:48.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.322+0000 7f59077fe640 1 --2- 10.20.193.28:0/3449881436 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55dba92a7820 0x55dba92ebf80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:48.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.322+0000 7f590c842640 1 -- 10.20.193.28:0/3449881436 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55dba92a7820 msgr2=0x55dba92ebf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:48.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.322+0000 7f590c842640 1 --2- 10.20.193.28:0/3449881436 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55dba92a7820 0x55dba92ebf80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:48.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.322+0000 7f590c842640 1 -- 10.20.193.28:0/3449881436 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55dba92a6f10 msgr2=0x55dba92a72e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:21:48.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.322+0000 7f590c842640 1 --2- 10.20.193.28:0/3449881436 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55dba92a6f10 0x55dba92a72e0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:48.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.322+0000 7f590c842640 1 -- 10.20.193.28:0/3449881436 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dba915e340 con 0x55dba92ec4c0 2026-02-24T09:21:48.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.322+0000 7f590c842640 1 --2- 10.20.193.28:0/3449881436 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba92ec4c0 0x55dba930c8a0 secure :-1 s=READY pgs=483 gs=1 cs=0 l=1 c_cookie=12540938451180233177 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58fc0e4e50 tx=0x7f58fc0a9590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae0a5d139ca2a1d9 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:48.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.323+0000 7f58cbfff640 1 -- 10.20.193.28:0/3449881436 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f58fc0e52f0 con 0x55dba92ec4c0 2026-02-24T09:21:48.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.323+0000 7f58cbfff640 1 -- 10.20.193.28:0/3449881436 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f58fc0acef0 con 0x55dba92ec4c0 2026-02-24T09:21:48.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.323+0000 7f58cbfff640 1 -- 10.20.193.28:0/3449881436 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f58fc0ae600 con 0x55dba92ec4c0 2026-02-24T09:21:48.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.323+0000 7f59108cde00 1 -- 10.20.193.28:0/3449881436 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba92ec4c0 msgr2=0x55dba930c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:48.327 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.323+0000 7f59108cde00 1 --2- 10.20.193.28:0/3449881436 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba92ec4c0 0x55dba930c8a0 secure :-1 s=READY pgs=483 gs=1 cs=0 l=1 c_cookie=12540938451180233177 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58fc0e4e50 tx=0x7f58fc0a9590 comp rx=0 tx=0).stop 2026-02-24T09:21:48.327 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.323+0000 7f59108cde00 1 -- 10.20.193.28:0/3449881436 shutdown_connections 2026-02-24T09:21:48.327 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.323+0000 7f59108cde00 1 --2- 10.20.193.28:0/3449881436 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba92ec4c0 0x55dba930c8a0 unknown :-1 s=CLOSED pgs=483 gs=1 cs=0 l=1 c_cookie=12540938451180233177 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:48.327 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.323+0000 7f59108cde00 1 --2- 10.20.193.28:0/3449881436 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55dba92a7820 0x55dba92ebf80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:48.327 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.323+0000 7f59108cde00 1 --2- 10.20.193.28:0/3449881436 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55dba92a6f10 0x55dba92a72e0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:48.327 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.323+0000 7f59108cde00 1 -- 10.20.193.28:0/3449881436 >> 10.20.193.28:0/3449881436 conn(0x55dba91c5a60 msgr2=0x55dba92a57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:48.327 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.324+0000 7f59108cde00 1 -- 10.20.193.28:0/3449881436 shutdown_connections 2026-02-24T09:21:48.327 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.324+0000 7f59108cde00 1 -- 10.20.193.28:0/3449881436 wait complete. 2026-02-24T09:21:48.327 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.325+0000 7f59108cde00 1 -- start start 2026-02-24T09:21:48.327 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.325+0000 7f59108cde00 1 Processor -- start 2026-02-24T09:21:48.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.326+0000 7f59108cde00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55dba92a6f10 0x55dba9303ec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:48.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.326+0000 7f59108cde00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55dba92a7820 0x55dba9304400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:48.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.326+0000 7f59108cde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba92ec4c0 0x55dba93093f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:48.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.326+0000 7f59108cde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dba9309930 con 0x55dba92ec4c0 2026-02-24T09:21:48.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.326+0000 7f59108cde00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55dba9309aa0 con 0x55dba92a6f10 2026-02-24T09:21:48.331 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.326+0000 7f59108cde00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55dba9309c60 con 0x55dba92a7820 2026-02-24T09:21:48.332 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.326+0000 7f590c842640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba92ec4c0 0x55dba93093f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:48.332 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.326+0000 7f590c842640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba92ec4c0 0x55dba93093f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38352/0 (socket says 10.20.193.28:38352) 2026-02-24T09:21:48.332 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.326+0000 7f590c842640 1 -- 10.20.193.28:0/1919332299 learned_addr learned my addr 10.20.193.28:0/1919332299 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:21:48.332 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.326+0000 7f59077fe640 1 --2- 10.20.193.28:0/1919332299 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55dba92a7820 0x55dba9304400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:48.332 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.326+0000 7f590c842640 1 -- 10.20.193.28:0/1919332299 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55dba92a7820 msgr2=0x55dba9304400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:48.332 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.326+0000 7f590c842640 1 --2- 10.20.193.28:0/1919332299 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55dba92a7820 0x55dba9304400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:48.332 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.326+0000 7f590c842640 1 -- 10.20.193.28:0/1919332299 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55dba92a6f10 msgr2=0x55dba9303ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:48.332 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.326+0000 7f590c842640 1 --2- 10.20.193.28:0/1919332299 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55dba92a6f10 0x55dba9303ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:48.332 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.326+0000 7f590c842640 1 -- 10.20.193.28:0/1919332299 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dba9136ce0 con 0x55dba92ec4c0 2026-02-24T09:21:48.332 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.326+0000 7f590c842640 1 --2- 10.20.193.28:0/1919332299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba92ec4c0 0x55dba93093f0 secure :-1 s=READY pgs=484 gs=1 cs=0 l=1 c_cookie=17639759402882680520 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58fc008590 tx=0x7f58fc003470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4cd03b7ac2dc6c8 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:48.332 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.326+0000 7f58c97fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:21:48.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.327+0000 7f58c97fa640 1 -- 10.20.193.28:0/1919332299 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f58fc008d00 con 0x55dba92ec4c0 2026-02-24T09:21:48.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.327+0000 7f58c97fa640 1 -- 10.20.193.28:0/1919332299 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f58fc070070 con 0x55dba92ec4c0 2026-02-24T09:21:48.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.327+0000 7f58c97fa640 1 -- 10.20.193.28:0/1919332299 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f58fc0ae5a0 con 0x55dba92ec4c0 2026-02-24T09:21:48.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.327+0000 7f59108cde00 1 -- 10.20.193.28:0/1919332299 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f590816a920 con 0x55dba92ec4c0 2026-02-24T09:21:48.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.327+0000 7f59108cde00 10 client.15861 _ll_register_callbacks cb 0x55dba913d980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:21:48.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.327+0000 7f58c97fa640 1 -- 10.20.193.28:0/1919332299 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7f58fc0b31c0 con 0x55dba92ec4c0 2026-02-24T09:21:48.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.327+0000 7f59108cde00 1 -- 10.20.193.28:0/1919332299 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dba8e52520 con 0x55dba92ec4c0 2026-02-24T09:21:48.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.327+0000 7f58c97fa640 1 -- 10.20.193.28:0/1919332299 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f58fc015260 con 0x55dba92ec4c0 2026-02-24T09:21:48.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.327+0000 7f59108cde00 10 client.15861 fetch_fsmap learned FSMap version 23 2026-02-24T09:21:48.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.327+0000 7f59108cde00 1 -- 10.20.193.28:0/1919332299 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x55dba91485b0 con 0x55dba92ec4c0 2026-02-24T09:21:48.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.327+0000 7f58c97fa640 1 -- 10.20.193.28:0/1919332299 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f58fc0ab6d0 con 0x55dba92ec4c0 2026-02-24T09:21:48.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.328+0000 7f59108cde00 10 client.15861 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:21:48.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.328+0000 7f59108cde00 10 client.15861 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:21:48.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.328+0000 7f59108cde00 20 client.15861 populate_metadata read hostname 'trial028' 2026-02-24T09:21:48.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.328+0000 7f59108cde00 1 --2- 10.20.193.28:0/1919332299 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55dba92e9360 0x55dba92e9800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:48.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.328+0000 7f59108cde00 4 client.15861 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:21:48.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.328+0000 7f59108cde00 1 -- 10.20.193.28:0/1919332299 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dba91849d0 con 0x55dba92e9360 2026-02-24T09:21:48.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.328+0000 7f5907fff640 1 --2- 10.20.193.28:0/1919332299 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55dba92e9360 0x55dba92e9800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:48.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.329+0000 7f58c97fa640 10 client.15861 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:21:48.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.329+0000 7f5907fff640 1 --2- 10.20.193.28:0/1919332299 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55dba92e9360 0x55dba92e9800 crc :-1 s=READY pgs=62 gs=4 cs=0 l=0 c_cookie=17705650289548446301 s_cookie=15887928677606615765 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5b71b2139d3ca5d server_cookie=dc7d42f4557bead5 in_seq=0 out_seq=0 2026-02-24T09:21:48.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.329+0000 7f58c97fa640 1 -- 10.20.193.28:0/1919332299 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55dba91849d0 con 0x55dba92e9360 2026-02-24T09:21:48.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.329+0000 7f58c97fa640 10 client.15861 handle_command_reply: tid=0 2026-02-24T09:21:48.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.329+0000 7f59108cde00 1 client.15861 shutdown 2026-02-24T09:21:48.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.330+0000 7f59108cde00 1 -- 10.20.193.28:0/1919332299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba92ec4c0 msgr2=0x55dba93093f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:48.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.330+0000 7f59108cde00 1 --2- 10.20.193.28:0/1919332299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba92ec4c0 0x55dba93093f0 secure :-1 s=READY pgs=484 gs=1 cs=0 l=1 c_cookie=17639759402882680520 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58fc008590 tx=0x7f58fc003470 comp rx=0 tx=0).stop 2026-02-24T09:21:48.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.330+0000 7f59108cde00 1 -- 10.20.193.28:0/1919332299 shutdown_connections 2026-02-24T09:21:48.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.330+0000 7f59108cde00 1 --2- 10.20.193.28:0/1919332299 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55dba92e9360 0x55dba92e9800 crc :-1 s=READY pgs=62 gs=4 cs=0 l=0 c_cookie=17705650289548446301 s_cookie=15887928677606615765 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:48.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.330+0000 7f58c97fa640 0 client.15861 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:21:48.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.330+0000 7f59108cde00 1 --2- 10.20.193.28:0/1919332299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba92ec4c0 0x55dba93093f0 unknown :-1 s=CLOSED pgs=484 gs=1 cs=0 l=1 c_cookie=17639759402882680520 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:48.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.330+0000 7f59108cde00 1 --2- 10.20.193.28:0/1919332299 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55dba92a7820 0x55dba9304400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:48.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.330+0000 7f59108cde00 1 --2- 10.20.193.28:0/1919332299 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55dba92a6f10 0x55dba9303ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:48.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.330+0000 7f59108cde00 1 -- 10.20.193.28:0/1919332299 >> 10.20.193.28:0/1919332299 conn(0x55dba91c5a60 msgr2=0x55dba92a5000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:48.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.330+0000 7f59108cde00 1 -- 10.20.193.28:0/1919332299 shutdown_connections 2026-02-24T09:21:48.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.330+0000 7f59108cde00 1 -- 10.20.193.28:0/1919332299 wait complete. 2026-02-24T09:21:48.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.330+0000 7f59108cde00 20 client.15861 trim_cache size 0 max 16384 2026-02-24T09:21:48.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.338+0000 7f59108cde00 1 Processor -- start 2026-02-24T09:21:48.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.338+0000 7f59108cde00 1 -- start start 2026-02-24T09:21:48.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.338+0000 7f59108cde00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55dba92a6f10 0x55dba9308960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:48.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.338+0000 7f59108cde00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55dba92a7820 0x55dba92e7060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:48.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.338+0000 7f59108cde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba92e9360 0x55dba92e75a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:48.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.338+0000 7f59108cde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dba91b09d0 con 0x55dba92e9360 2026-02-24T09:21:48.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.338+0000 7f59108cde00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55dba8ef1f10 con 0x55dba92a7820 2026-02-24T09:21:48.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.338+0000 7f59108cde00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55dba9216580 con 0x55dba92a6f10 2026-02-24T09:21:48.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.338+0000 7f590c842640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba92e9360 0x55dba92e75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:48.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.338+0000 7f5907fff640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55dba92a6f10 0x55dba9308960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:48.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.338+0000 7f59077fe640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55dba92a7820 0x55dba92e7060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:48.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.339+0000 7f59077fe640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55dba92a7820 0x55dba92e7060 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:56344/0 (socket says 10.20.193.28:56344) 2026-02-24T09:21:48.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.339+0000 7f59077fe640 1 -- 10.20.193.28:0/3546777387 learned_addr learned my addr 10.20.193.28:0/3546777387 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:21:48.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.339+0000 7f590c842640 1 -- 10.20.193.28:0/3546777387 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55dba92a6f10 msgr2=0x55dba9308960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:48.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.339+0000 7f590c842640 1 --2- 10.20.193.28:0/3546777387 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55dba92a6f10 0x55dba9308960 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:48.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.339+0000 7f590c842640 1 -- 10.20.193.28:0/3546777387 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55dba92a7820 msgr2=0x55dba92e7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:48.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.339+0000 7f590c842640 1 --2- 10.20.193.28:0/3546777387 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55dba92a7820 0x55dba92e7060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:48.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.339+0000 7f590c842640 1 -- 10.20.193.28:0/3546777387 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dba92f6410 con 0x55dba92e9360 2026-02-24T09:21:48.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.339+0000 7f590c842640 1 --2- 10.20.193.28:0/3546777387 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba92e9360 0x55dba92e75a0 secure :-1 s=READY pgs=485 gs=3 cs=0 l=1 c_cookie=6110297193470655345 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58fc0b4810 tx=0x7f58fc0cc000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54cc22ec78e27b71 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:48.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.339+0000 7f58cb7fe640 1 -- 10.20.193.28:0/3546777387 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f58fc0afa10 con 0x55dba92e9360 2026-02-24T09:21:48.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.339+0000 7f58cb7fe640 1 -- 10.20.193.28:0/3546777387 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f58fc070040 con 0x55dba92e9360 2026-02-24T09:21:48.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.339+0000 7f58cb7fe640 1 -- 10.20.193.28:0/3546777387 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f58fc0b8830 con 0x55dba92e9360 2026-02-24T09:21:48.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.339+0000 7f59108cde00 1 -- 10.20.193.28:0/3546777387 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba92e9360 msgr2=0x55dba92e75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:48.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.339+0000 7f59108cde00 1 --2- 10.20.193.28:0/3546777387 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba92e9360 0x55dba92e75a0 secure :-1 s=READY pgs=485 gs=3 cs=0 l=1 c_cookie=6110297193470655345 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58fc0b4810 tx=0x7f58fc0cc000 comp rx=0 tx=0).stop 2026-02-24T09:21:48.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.339+0000 7f59108cde00 1 -- 10.20.193.28:0/3546777387 shutdown_connections 2026-02-24T09:21:48.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.339+0000 7f59108cde00 1 --2- 10.20.193.28:0/3546777387 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba92e9360 0x55dba92e75a0 unknown :-1 s=CLOSED pgs=485 gs=3 cs=0 l=1 c_cookie=6110297193470655345 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:48.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.339+0000 7f59108cde00 1 --2- 10.20.193.28:0/3546777387 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55dba92a7820 0x55dba92e7060 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:48.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.339+0000 7f59108cde00 1 --2- 10.20.193.28:0/3546777387 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55dba92a6f10 0x55dba9308960 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:48.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.339+0000 7f59108cde00 1 -- 10.20.193.28:0/3546777387 >> 10.20.193.28:0/3546777387 conn(0x55dba91c5a60 msgr2=0x55dba9308250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:48.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.339+0000 7f59108cde00 1 -- 10.20.193.28:0/3546777387 shutdown_connections 2026-02-24T09:21:48.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.339+0000 7f59108cde00 1 -- 10.20.193.28:0/3546777387 wait complete. 2026-02-24T09:21:48.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.340+0000 7f59108cde00 1 -- start start 2026-02-24T09:21:48.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.340+0000 7f59108cde00 1 Processor -- start 2026-02-24T09:21:48.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.340+0000 7f59108cde00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55dba92a6f10 0x55dba92e7210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:48.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.340+0000 7f59108cde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba92a7820 0x55dba92e7750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:48.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.340+0000 7f59108cde00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55dba92e9360 0x55dba9284ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:48.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.340+0000 7f59108cde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dba91b09d0 con 0x55dba92a7820 2026-02-24T09:21:48.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.340+0000 7f59108cde00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55dba8ef1f10 con 0x55dba92e9360 2026-02-24T09:21:48.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.340+0000 7f59108cde00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55dba9353110 con 0x55dba92a6f10 2026-02-24T09:21:48.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.341+0000 7f59077fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba92a7820 0x55dba92e7750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:48.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.341+0000 7f5907fff640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55dba92a6f10 0x55dba92e7210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:48.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.341+0000 7f5907fff640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55dba92a6f10 0x55dba92e7210 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:41690/0 (socket says 10.20.193.28:41690) 2026-02-24T09:21:48.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.341+0000 7f5907fff640 1 -- 10.20.193.28:0/2509351610 learned_addr learned my addr 10.20.193.28:0/2509351610 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:21:48.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.341+0000 7f590c842640 1 --2- 10.20.193.28:0/2509351610 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55dba92e9360 0x55dba9284ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:48.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.341+0000 7f5907fff640 1 -- 10.20.193.28:0/2509351610 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55dba92e9360 msgr2=0x55dba9284ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:48.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.341+0000 7f5907fff640 1 --2- 10.20.193.28:0/2509351610 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55dba92e9360 0x55dba9284ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:48.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.341+0000 7f5907fff640 1 -- 10.20.193.28:0/2509351610 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba92a7820 msgr2=0x55dba92e7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:48.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.341+0000 7f5907fff640 1 --2- 10.20.193.28:0/2509351610 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba92a7820 0x55dba92e7750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:48.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.341+0000 7f5907fff640 1 -- 10.20.193.28:0/2509351610 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dba9143030 con 0x55dba92a6f10 2026-02-24T09:21:48.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.341+0000 7f590c842640 1 --2- 10.20.193.28:0/2509351610 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55dba92e9360 0x55dba9284ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:21:48.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.341+0000 7f5907fff640 1 --2- 10.20.193.28:0/2509351610 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55dba92a6f10 0x55dba92e7210 secure :-1 s=READY pgs=116 gs=1 cs=0 l=1 c_cookie=14370071536929939086 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58f400b4b0 tx=0x7f58f40044a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c76cbfed4ba91e8e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:48.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.341+0000 7f58c97fa640 10 client.0 ms_handle_connect on v2:10.20.193.159:3300/0 2026-02-24T09:21:48.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.341+0000 7f58c97fa640 1 -- 10.20.193.28:0/2509351610 <== mon.1 v2:10.20.193.159:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f58f401a070 con 0x55dba92a6f10 2026-02-24T09:21:48.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.341+0000 7f59108cde00 1 -- 10.20.193.28:0/2509351610 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dba91485b0 con 0x55dba92a6f10 2026-02-24T09:21:48.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.342+0000 7f59108cde00 10 client.25483 _ll_register_callbacks cb 0x55dba913d980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:21:48.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.342+0000 7f59108cde00 1 -- 10.20.193.28:0/2509351610 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dba91e3d30 con 0x55dba92a6f10 2026-02-24T09:21:48.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.342+0000 7f58c97fa640 1 -- 10.20.193.28:0/2509351610 <== mon.1 v2:10.20.193.159:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f58f401b040 con 0x55dba92a6f10 2026-02-24T09:21:48.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.342+0000 7f58c97fa640 1 -- 10.20.193.28:0/2509351610 <== mon.1 v2:10.20.193.159:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f58f4020320 con 0x55dba92a6f10 2026-02-24T09:21:48.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.342+0000 7f58c97fa640 1 -- 10.20.193.28:0/2509351610 <== mon.1 v2:10.20.193.159:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7f58f4020c10 con 0x55dba92a6f10 2026-02-24T09:21:48.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.342+0000 7f58c97fa640 1 -- 10.20.193.28:0/2509351610 <== mon.1 v2:10.20.193.159:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f58f4020dd0 con 0x55dba92a6f10 2026-02-24T09:21:48.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.342+0000 7f59108cde00 10 client.25483 fetch_fsmap learned FSMap version 23 2026-02-24T09:21:48.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.342+0000 7f59108cde00 1 -- 10.20.193.28:0/2509351610 --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_subscribe({fsmap=23}) -- 0x55dba9137010 con 0x55dba92a6f10 2026-02-24T09:21:48.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.342+0000 7f58c97fa640 1 -- 10.20.193.28:0/2509351610 <== mon.1 v2:10.20.193.159:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f58f400b980 con 0x55dba92a6f10 2026-02-24T09:21:48.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.342+0000 7f59108cde00 10 client.25483 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:21:48.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.342+0000 7f59108cde00 10 client.25483 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:21:48.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.342+0000 7f59108cde00 20 client.25483 populate_metadata read hostname 'trial028' 2026-02-24T09:21:48.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.342+0000 7f59108cde00 1 --2- 10.20.193.28:0/2509351610 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55dba92ec4c0 0x55dba93b96d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:48.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.342+0000 7f59108cde00 4 client.25483 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-24T09:21:48.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.342+0000 7f59108cde00 1 -- 10.20.193.28:0/2509351610 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dba8e96640 con 0x55dba92ec4c0 2026-02-24T09:21:48.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.343+0000 7f59077fe640 1 --2- 10.20.193.28:0/2509351610 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55dba92ec4c0 0x55dba93b96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:48.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.343+0000 7f59077fe640 1 --2- 10.20.193.28:0/2509351610 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55dba92ec4c0 0x55dba93b96d0 crc :-1 s=READY pgs=63 gs=4 cs=0 l=0 c_cookie=4427875594115188871 s_cookie=11971199515687953551 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d72f96498db8887 server_cookie=a6223e888be8a48f in_seq=0 out_seq=0 2026-02-24T09:21:48.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.343+0000 7f58c97fa640 10 client.25483 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:21:48.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.347+0000 7f58c97fa640 1 -- 10.20.193.28:0/2509351610 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dba8e96640 con 0x55dba92ec4c0 2026-02-24T09:21:48.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.347+0000 7f58c97fa640 10 client.25483 handle_command_reply: tid=0 2026-02-24T09:21:48.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.347+0000 7f59108cde00 1 client.25483 shutdown 2026-02-24T09:21:48.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.347+0000 7f59108cde00 1 -- 10.20.193.28:0/2509351610 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55dba92a6f10 msgr2=0x55dba92e7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:48.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.347+0000 7f59108cde00 1 --2- 10.20.193.28:0/2509351610 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55dba92a6f10 0x55dba92e7210 secure :-1 s=READY pgs=116 gs=1 cs=0 l=1 c_cookie=14370071536929939086 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58f400b4b0 tx=0x7f58f40044a0 comp rx=0 tx=0).stop 2026-02-24T09:21:48.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.347+0000 7f59108cde00 1 -- 10.20.193.28:0/2509351610 shutdown_connections 2026-02-24T09:21:48.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.347+0000 7f59108cde00 1 --2- 10.20.193.28:0/2509351610 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x55dba92ec4c0 0x55dba93b96d0 crc :-1 s=READY pgs=63 gs=4 cs=0 l=0 c_cookie=4427875594115188871 s_cookie=11971199515687953551 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:48.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.347+0000 7f59108cde00 1 --2- 10.20.193.28:0/2509351610 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55dba92e9360 0x55dba9284ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:48.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.347+0000 7f59108cde00 1 --2- 10.20.193.28:0/2509351610 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dba92a7820 0x55dba92e7750 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:48.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.347+0000 7f59108cde00 1 --2- 10.20.193.28:0/2509351610 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55dba92a6f10 0x55dba92e7210 unknown :-1 s=CLOSED pgs=116 gs=1 cs=0 l=1 c_cookie=14370071536929939086 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:48.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.347+0000 7f58c97fa640 0 client.25483 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:21:48.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.347+0000 7f59108cde00 1 -- 10.20.193.28:0/2509351610 >> 10.20.193.28:0/2509351610 conn(0x55dba91c5a60 msgr2=0x55dba93008b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:48.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.347+0000 7f59108cde00 1 -- 10.20.193.28:0/2509351610 shutdown_connections 2026-02-24T09:21:48.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.347+0000 7f59108cde00 1 -- 10.20.193.28:0/2509351610 wait complete. 2026-02-24T09:21:48.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.347+0000 7f59108cde00 20 client.25483 trim_cache size 0 max 16384 2026-02-24T09:21:48.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-24T09:21:48.352 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-24T09:21:48.352 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-24T09:21:48.352 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-24T09:21:48.352 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.348+0000 7f590e2cc640 1 -- 10.20.193.28:0/1911612549 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f58dc0b5950 msgr2=0x7f58dc0d5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:48.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.348+0000 7f590e2cc640 1 --2- 10.20.193.28:0/1911612549 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f58dc0b5950 0x7f58dc0d5e00 secure :-1 s=READY pgs=242 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58f4004760 tx=0x7f58f4006c80 comp rx=0 tx=0).stop 2026-02-24T09:21:48.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.348+0000 7f590e2cc640 1 -- 10.20.193.28:0/1911612549 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5908159e00 msgr2=0x7f5908169aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:48.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.348+0000 7f590e2cc640 1 --2- 10.20.193.28:0/1911612549 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5908159e00 0x7f5908169aa0 secure :-1 s=READY pgs=482 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58fc00d940 tx=0x7f58fc00de10 comp rx=0 tx=0).stop 2026-02-24T09:21:48.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.348+0000 7f590e2cc640 1 -- 10.20.193.28:0/1911612549 shutdown_connections 2026-02-24T09:21:48.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.348+0000 7f590e2cc640 1 --2- 10.20.193.28:0/1911612549 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f58dc0b5950 0x7f58dc0d5e00 unknown :-1 s=CLOSED pgs=242 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:48.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.348+0000 7f590e2cc640 1 --2- 10.20.193.28:0/1911612549 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5908159e00 0x7f5908169aa0 unknown :-1 s=CLOSED pgs=482 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:48.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.348+0000 7f590e2cc640 1 --2- 10.20.193.28:0/1911612549 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f5908066a30 0x7f59081646d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:48.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.348+0000 7f590e2cc640 1 --2- 10.20.193.28:0/1911612549 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f5908063070 0x7f5908164190 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:48.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.348+0000 7f590e2cc640 1 -- 10.20.193.28:0/1911612549 >> 10.20.193.28:0/1911612549 conn(0x7f59080ecea0 msgr2=0x7f590810d280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:48.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.348+0000 7f590e2cc640 1 -- 10.20.193.28:0/1911612549 shutdown_connections 2026-02-24T09:21:48.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:21:48.348+0000 7f590e2cc640 1 -- 10.20.193.28:0/1911612549 wait complete. 2026-02-24T09:21:48.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:48 trial028 ceph-mon[40371]: pgmap v328: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 276 MiB/s rd, 170 B/s wr, 75 op/s 2026-02-24T09:21:48.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:48 trial074 ceph-mon[44412]: pgmap v328: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 276 MiB/s rd, 170 B/s wr, 75 op/s 2026-02-24T09:21:49.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:48 trial159 ceph-mon[44242]: pgmap v328: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 276 MiB/s rd, 170 B/s wr, 75 op/s 2026-02-24T09:21:49.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:49 trial028 ceph-mon[40371]: pgmap v329: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 270 MiB/s rd, 0 B/s wr, 72 op/s 2026-02-24T09:21:49.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:49 trial074 ceph-mon[44412]: pgmap v329: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 270 MiB/s rd, 0 B/s wr, 72 op/s 2026-02-24T09:21:50.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:49 trial159 ceph-mon[44242]: pgmap v329: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 270 MiB/s rd, 0 B/s wr, 72 op/s 2026-02-24T09:21:52.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:52 trial159 ceph-mon[44242]: pgmap v330: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 261 MiB/s rd, 170 B/s wr, 72 op/s 2026-02-24T09:21:52.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:52 trial028 ceph-mon[40371]: pgmap v330: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 261 MiB/s rd, 170 B/s wr, 72 op/s 2026-02-24T09:21:52.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:52 trial074 ceph-mon[44412]: pgmap v330: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 261 MiB/s rd, 170 B/s wr, 72 op/s 2026-02-24T09:21:54.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:54 trial159 ceph-mon[44242]: pgmap v331: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 259 MiB/s rd, 170 B/s wr, 70 op/s 2026-02-24T09:21:54.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:54 trial028 ceph-mon[40371]: pgmap v331: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 259 MiB/s rd, 170 B/s wr, 70 op/s 2026-02-24T09:21:54.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:54 trial074 ceph-mon[44412]: pgmap v331: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 259 MiB/s rd, 170 B/s wr, 70 op/s 2026-02-24T09:21:56.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:56 trial159 ceph-mon[44242]: pgmap v332: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 253 MiB/s rd, 170 B/s wr, 69 op/s 2026-02-24T09:21:56.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:56 trial028 ceph-mon[40371]: pgmap v332: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 253 MiB/s rd, 170 B/s wr, 69 op/s 2026-02-24T09:21:56.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:56 trial074 ceph-mon[44412]: pgmap v332: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 253 MiB/s rd, 170 B/s wr, 69 op/s 2026-02-24T09:21:58.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:21:58 trial159 ceph-mon[44242]: pgmap v333: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 278 MiB/s rd, 170 B/s wr, 76 op/s 2026-02-24T09:21:58.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:21:58 trial028 ceph-mon[40371]: pgmap v333: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 278 MiB/s rd, 170 B/s wr, 76 op/s 2026-02-24T09:21:58.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:21:58 trial074 ceph-mon[44412]: pgmap v333: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 278 MiB/s rd, 170 B/s wr, 76 op/s 2026-02-24T09:22:00.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:00 trial159 ceph-mon[44242]: pgmap v334: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 269 MiB/s rd, 170 B/s wr, 73 op/s 2026-02-24T09:22:00.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:00 trial028 ceph-mon[40371]: pgmap v334: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 269 MiB/s rd, 170 B/s wr, 73 op/s 2026-02-24T09:22:00.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:00 trial074 ceph-mon[44412]: pgmap v334: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 269 MiB/s rd, 170 B/s wr, 73 op/s 2026-02-24T09:22:00.951 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-24T09:22:00.951 INFO:tasks.workunit.client.0.trial028.stdout: Children see throughput for 1 readers = 272594.00 kB/sec 2026-02-24T09:22:00.951 INFO:tasks.workunit.client.0.trial028.stdout: Parent sees throughput for 1 readers = 272588.60 kB/sec 2026-02-24T09:22:00.951 INFO:tasks.workunit.client.0.trial028.stdout: Min throughput per process = 272594.00 kB/sec 2026-02-24T09:22:00.951 INFO:tasks.workunit.client.0.trial028.stdout: Max throughput per process = 272594.00 kB/sec 2026-02-24T09:22:00.951 INFO:tasks.workunit.client.0.trial028.stdout: Avg throughput per process = 272594.00 kB/sec 2026-02-24T09:22:00.951 INFO:tasks.workunit.client.0.trial028.stdout: Min xfer = 10485760.00 kB 2026-02-24T09:22:01.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.420+0000 7fb16b114640 1 -- 10.20.193.28:0/1824246482 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb1641559f0 msgr2=0x7fb164175dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:22:01.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.420+0000 7fb16b114640 1 --2- 10.20.193.28:0/1824246482 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb1641559f0 0x7fb164175dd0 secure :-1 s=READY pgs=486 gs=1 cs=0 l=1 c_cookie=16407473874552823305 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb16000aa30 tx=0x7fb160030270 comp rx=0 tx=0).stop 2026-02-24T09:22:01.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.420+0000 7fb16b114640 1 -- 10.20.193.28:0/1824246482 shutdown_connections 2026-02-24T09:22:01.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.420+0000 7fb16b114640 1 --2- 10.20.193.28:0/1824246482 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb1641559f0 0x7fb164175dd0 unknown :-1 s=CLOSED pgs=486 gs=1 cs=0 l=1 c_cookie=16407473874552823305 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:22:01.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.420+0000 7fb16b114640 1 --2- 10.20.193.28:0/1824246482 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb16410c5d0 0x7fb1641554b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:22:01.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.420+0000 7fb16b114640 1 --2- 10.20.193.28:0/1824246482 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb16410bcc0 0x7fb16410c090 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:22:01.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.420+0000 7fb16b114640 1 -- 10.20.193.28:0/1824246482 >> 10.20.193.28:0/1824246482 conn(0x7fb1640e99a0 msgr2=0x7fb164109db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:22:01.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.420+0000 7fb16b114640 1 -- 10.20.193.28:0/1824246482 shutdown_connections 2026-02-24T09:22:01.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.420+0000 7fb16b114640 1 -- 10.20.193.28:0/1824246482 wait complete. 2026-02-24T09:22:01.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.421+0000 7fb16b114640 1 Processor -- start 2026-02-24T09:22:01.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.421+0000 7fb16b114640 1 -- start start 2026-02-24T09:22:01.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.421+0000 7fb16b114640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb16410bcc0 0x7fb164161100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:22:01.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.421+0000 7fb16b114640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb16410c5d0 0x7fb164161640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:22:01.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.421+0000 7fb16b114640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb1641559f0 0x7fb164166a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:22:01.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.421+0000 7fb16b114640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb164166fa0 con 0x7fb16410c5d0 2026-02-24T09:22:01.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.421+0000 7fb16b114640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fb164167110 con 0x7fb16410bcc0 2026-02-24T09:22:01.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.421+0000 7fb16b114640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb1641672d0 con 0x7fb1641559f0 2026-02-24T09:22:01.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.421+0000 7fb169911640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb16410c5d0 0x7fb164161640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:22:01.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.421+0000 7fb169911640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb16410c5d0 0x7fb164161640 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39886/0 (socket says 10.20.193.28:39886) 2026-02-24T09:22:01.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.421+0000 7fb169911640 1 -- 10.20.193.28:0/1091939635 learned_addr learned my addr 10.20.193.28:0/1091939635 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:22:01.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.421+0000 7fb16a112640 1 --2- 10.20.193.28:0/1091939635 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb16410bcc0 0x7fb164161100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:22:01.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.421+0000 7fb16a913640 1 --2- 10.20.193.28:0/1091939635 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb1641559f0 0x7fb164166a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:22:01.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.422+0000 7fb169911640 1 -- 10.20.193.28:0/1091939635 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb1641559f0 msgr2=0x7fb164166a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:22:01.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.422+0000 7fb169911640 1 --2- 10.20.193.28:0/1091939635 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb1641559f0 0x7fb164166a10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:22:01.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.422+0000 7fb169911640 1 -- 10.20.193.28:0/1091939635 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb16410bcc0 msgr2=0x7fb164161100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:22:01.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.422+0000 7fb169911640 1 --2- 10.20.193.28:0/1091939635 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb16410bcc0 0x7fb164161100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:22:01.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.422+0000 7fb169911640 1 -- 10.20.193.28:0/1091939635 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb16000a650 con 0x7fb16410c5d0 2026-02-24T09:22:01.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.422+0000 7fb16a913640 1 --2- 10.20.193.28:0/1091939635 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb1641559f0 0x7fb164166a10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:22:01.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.422+0000 7fb169911640 1 --2- 10.20.193.28:0/1091939635 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb16410c5d0 0x7fb164161640 secure :-1 s=READY pgs=487 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb15800c9b0 tx=0x7fb15800ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:22:01.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.422+0000 7fb14b7fe640 1 -- 10.20.193.28:0/1091939635 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb1580044a0 con 0x7fb16410c5d0 2026-02-24T09:22:01.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.422+0000 7fb14b7fe640 1 -- 10.20.193.28:0/1091939635 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb158007d80 con 0x7fb16410c5d0 2026-02-24T09:22:01.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.422+0000 7fb14b7fe640 1 -- 10.20.193.28:0/1091939635 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb15800f6d0 con 0x7fb16410c5d0 2026-02-24T09:22:01.425 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.422+0000 7fb16b114640 1 -- 10.20.193.28:0/1091939635 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1641675b0 con 0x7fb16410c5d0 2026-02-24T09:22:01.425 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.422+0000 7fb16b114640 1 -- 10.20.193.28:0/1091939635 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb164167890 con 0x7fb16410c5d0 2026-02-24T09:22:01.426 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.425+0000 7fb14b7fe640 1 -- 10.20.193.28:0/1091939635 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7fb1580078c0 con 0x7fb16410c5d0 2026-02-24T09:22:01.428 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.426+0000 7fb14b7fe640 1 --2- 10.20.193.28:0/1091939635 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb1400b58d0 0x7fb1400d5d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:22:01.428 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.426+0000 7fb14b7fe640 1 -- 10.20.193.28:0/1091939635 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7fb1580e6dd0 con 0x7fb16410c5d0 2026-02-24T09:22:01.428 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.427+0000 7fb16a112640 1 --2- 10.20.193.28:0/1091939635 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb1400b58d0 0x7fb1400d5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:22:01.428 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.427+0000 7fb16ea5fe00 1 Processor -- start 2026-02-24T09:22:01.429 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.427+0000 7fb16ea5fe00 1 -- start start 2026-02-24T09:22:01.429 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.427+0000 7fb16a112640 1 --2- 10.20.193.28:0/1091939635 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb1400b58d0 0x7fb1400d5d80 secure :-1 s=READY pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb154004740 tx=0x7fb15400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:22:01.429 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.427+0000 7fb16ea5fe00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5604acb12a60 0x5604acbf4200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:22:01.429 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.427+0000 7fb16ea5fe00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5604acbf4740 0x5604acbf4b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:22:01.429 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.427+0000 7fb16ea5fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604acc39270 0x5604acc59650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:22:01.429 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.427+0000 7fb16ea5fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5604acb09f10 con 0x5604acc39270 2026-02-24T09:22:01.429 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.427+0000 7fb16ea5fe00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x5604acb05c40 con 0x5604acb12a60 2026-02-24T09:22:01.429 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.427+0000 7fb16ea5fe00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x5604acaffda0 con 0x5604acbf4740 2026-02-24T09:22:01.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.428+0000 7fb16a913640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604acc39270 0x5604acc59650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:22:01.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.428+0000 7fb16a913640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604acc39270 0x5604acc59650 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39892/0 (socket says 10.20.193.28:39892) 2026-02-24T09:22:01.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.428+0000 7fb16a913640 1 -- 10.20.193.28:0/274788350 learned_addr learned my addr 10.20.193.28:0/274788350 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:22:01.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.428+0000 7fb16a112640 1 --2- 10.20.193.28:0/274788350 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5604acb12a60 0x5604acbf4200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:22:01.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.428+0000 7fb169911640 1 --2- 10.20.193.28:0/274788350 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5604acbf4740 0x5604acbf4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:22:01.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.428+0000 7fb16a913640 1 -- 10.20.193.28:0/274788350 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5604acbf4740 msgr2=0x5604acbf4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:22:01.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.428+0000 7fb16a913640 1 --2- 10.20.193.28:0/274788350 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5604acbf4740 0x5604acbf4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:22:01.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.428+0000 7fb16a913640 1 -- 10.20.193.28:0/274788350 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5604acb12a60 msgr2=0x5604acbf4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:22:01.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.428+0000 7fb16a913640 1 --2- 10.20.193.28:0/274788350 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5604acb12a60 0x5604acbf4200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:22:01.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.428+0000 7fb16a913640 1 -- 10.20.193.28:0/274788350 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604acaab340 con 0x5604acc39270 2026-02-24T09:22:01.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.428+0000 7fb16a913640 1 --2- 10.20.193.28:0/274788350 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604acc39270 0x5604acc59650 secure :-1 s=READY pgs=488 gs=1 cs=0 l=1 c_cookie=7324038024587514118 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb160006c10 tx=0x7fb160006f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65a435c768fe1106 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:22:01.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.428+0000 7fb1323ff640 1 -- 10.20.193.28:0/274788350 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb16003e040 con 0x5604acc39270 2026-02-24T09:22:01.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.428+0000 7fb1323ff640 1 -- 10.20.193.28:0/274788350 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb160039470 con 0x5604acc39270 2026-02-24T09:22:01.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.428+0000 7fb1323ff640 1 -- 10.20.193.28:0/274788350 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb1600050c0 con 0x5604acc39270 2026-02-24T09:22:01.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.428+0000 7fb16ea5fe00 1 -- 10.20.193.28:0/274788350 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604acc39270 msgr2=0x5604acc59650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:22:01.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.428+0000 7fb16ea5fe00 1 --2- 10.20.193.28:0/274788350 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604acc39270 0x5604acc59650 secure :-1 s=READY pgs=488 gs=1 cs=0 l=1 c_cookie=7324038024587514118 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb160006c10 tx=0x7fb160006f80 comp rx=0 tx=0).stop 2026-02-24T09:22:01.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.429+0000 7fb16ea5fe00 1 -- 10.20.193.28:0/274788350 shutdown_connections 2026-02-24T09:22:01.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.429+0000 7fb16ea5fe00 1 --2- 10.20.193.28:0/274788350 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604acc39270 0x5604acc59650 unknown :-1 s=CLOSED pgs=488 gs=1 cs=0 l=1 c_cookie=7324038024587514118 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:22:01.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.429+0000 7fb16ea5fe00 1 --2- 10.20.193.28:0/274788350 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5604acbf4740 0x5604acbf4b90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:22:01.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.429+0000 7fb16ea5fe00 1 --2- 10.20.193.28:0/274788350 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5604acb12a60 0x5604acbf4200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:22:01.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.429+0000 7fb16ea5fe00 1 -- 10.20.193.28:0/274788350 >> 10.20.193.28:0/274788350 conn(0x5604acb8e490 msgr2=0x5604acbf2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:22:01.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.429+0000 7fb16ea5fe00 1 -- 10.20.193.28:0/274788350 shutdown_connections 2026-02-24T09:22:01.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.429+0000 7fb16ea5fe00 1 -- 10.20.193.28:0/274788350 wait complete. 2026-02-24T09:22:01.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.430+0000 7fb16ea5fe00 1 -- start start 2026-02-24T09:22:01.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.430+0000 7fb16ea5fe00 1 Processor -- start 2026-02-24T09:22:01.432 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.430+0000 7fb16ea5fe00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5604acb12a60 0x5604acc507d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:22:01.432 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.430+0000 7fb16ea5fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604acbf4740 0x5604acc50d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:22:01.432 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.430+0000 7fb16ea5fe00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5604acc39270 0x5604acc55d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:22:01.432 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.430+0000 7fb16ea5fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5604acc56240 con 0x5604acbf4740 2026-02-24T09:22:01.432 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.430+0000 7fb16ea5fe00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x5604acc563b0 con 0x5604acb12a60 2026-02-24T09:22:01.432 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.430+0000 7fb16ea5fe00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x5604acc56570 con 0x5604acc39270 2026-02-24T09:22:01.432 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.431+0000 7fb169911640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604acbf4740 0x5604acc50d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:22:01.432 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.431+0000 7fb16a112640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5604acb12a60 0x5604acc507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:22:01.432 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.431+0000 7fb169911640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604acbf4740 0x5604acc50d10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39896/0 (socket says 10.20.193.28:39896) 2026-02-24T09:22:01.432 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.431+0000 7fb169911640 1 -- 10.20.193.28:0/4255424042 learned_addr learned my addr 10.20.193.28:0/4255424042 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:22:01.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.431+0000 7fb16a913640 1 --2- 10.20.193.28:0/4255424042 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5604acc39270 0x5604acc55d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:22:01.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.431+0000 7fb169911640 1 -- 10.20.193.28:0/4255424042 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5604acc39270 msgr2=0x5604acc55d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:22:01.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.431+0000 7fb169911640 1 --2- 10.20.193.28:0/4255424042 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5604acc39270 0x5604acc55d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:22:01.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.431+0000 7fb169911640 1 -- 10.20.193.28:0/4255424042 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5604acb12a60 msgr2=0x5604acc507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:22:01.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.431+0000 7fb169911640 1 --2- 10.20.193.28:0/4255424042 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5604acb12a60 0x5604acc507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:22:01.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.431+0000 7fb169911640 1 -- 10.20.193.28:0/4255424042 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604aca83ce0 con 0x5604acbf4740 2026-02-24T09:22:01.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.431+0000 7fb169911640 1 --2- 10.20.193.28:0/4255424042 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604acbf4740 0x5604acc50d10 secure :-1 s=READY pgs=489 gs=2 cs=0 l=1 c_cookie=7723455727001317072 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1580e4570 tx=0x7fb1580ac7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b2f3a10265eaed0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:22:01.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.431+0000 7fb11f7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:22:01.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.431+0000 7fb11f7fe640 1 -- 10.20.193.28:0/4255424042 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb1580b0070 con 0x5604acbf4740 2026-02-24T09:22:01.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.431+0000 7fb11f7fe640 1 -- 10.20.193.28:0/4255424042 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb1580026a0 con 0x5604acbf4740 2026-02-24T09:22:01.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.431+0000 7fb11f7fe640 1 -- 10.20.193.28:0/4255424042 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb1580b51a0 con 0x5604acbf4740 2026-02-24T09:22:01.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.431+0000 7fb16ea5fe00 1 -- 10.20.193.28:0/4255424042 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb164176860 con 0x5604acbf4740 2026-02-24T09:22:01.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.432+0000 7fb11f7fe640 1 -- 10.20.193.28:0/4255424042 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7fb1580b7f50 con 0x5604acbf4740 2026-02-24T09:22:01.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.432+0000 7fb11f7fe640 10 client.15879 inactive, discarding osd_map(96..96 src has 1..96) 2026-02-24T09:22:01.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.432+0000 7fb16ea5fe00 10 client.15879 _ll_register_callbacks cb 0x5604aca8a980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:22:01.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.432+0000 7fb16ea5fe00 1 -- 10.20.193.28:0/4255424042 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5604ac79f520 con 0x5604acbf4740 2026-02-24T09:22:01.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.432+0000 7fb11f7fe640 1 -- 10.20.193.28:0/4255424042 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fb158007ba0 con 0x5604acbf4740 2026-02-24T09:22:01.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.432+0000 7fb16ea5fe00 10 client.15879 fetch_fsmap learned FSMap version 23 2026-02-24T09:22:01.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.432+0000 7fb16ea5fe00 1 -- 10.20.193.28:0/4255424042 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x5604aca955b0 con 0x5604acbf4740 2026-02-24T09:22:01.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.432+0000 7fb11f7fe640 1 -- 10.20.193.28:0/4255424042 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fb1580adaa0 con 0x5604acbf4740 2026-02-24T09:22:01.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.432+0000 7fb16ea5fe00 10 client.15879 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:22:01.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.432+0000 7fb16ea5fe00 10 client.15879 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:22:01.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.432+0000 7fb16ea5fe00 20 client.15879 populate_metadata read hostname 'trial028' 2026-02-24T09:22:01.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.432+0000 7fb16ea5fe00 1 --2- 10.20.193.28:0/4255424042 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5604acc36640 0x5604acc36ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:22:01.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.432+0000 7fb16ea5fe00 4 client.15879 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:22:01.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.432+0000 7fb16ea5fe00 1 -- 10.20.193.28:0/4255424042 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604acad19d0 con 0x5604acc36640 2026-02-24T09:22:01.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.432+0000 7fb16a112640 1 --2- 10.20.193.28:0/4255424042 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5604acc36640 0x5604acc36ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:22:01.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.433+0000 7fb16a112640 1 --2- 10.20.193.28:0/4255424042 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5604acc36640 0x5604acc36ae0 crc :-1 s=READY pgs=64 gs=4 cs=0 l=0 c_cookie=8084054622809181452 s_cookie=8720375482695529982 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=703054d929654d0c server_cookie=7904ff4c8a17b5fe in_seq=0 out_seq=0 2026-02-24T09:22:01.435 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.433+0000 7fb11f7fe640 10 client.15879 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:22:01.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.434+0000 7fb11f7fe640 1 -- 10.20.193.28:0/4255424042 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5604acad19d0 con 0x5604acc36640 2026-02-24T09:22:01.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.434+0000 7fb11f7fe640 10 client.15879 handle_command_reply: tid=0 2026-02-24T09:22:01.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.434+0000 7fb16ea5fe00 1 client.15879 shutdown 2026-02-24T09:22:01.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.434+0000 7fb16ea5fe00 1 -- 10.20.193.28:0/4255424042 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604acbf4740 msgr2=0x5604acc50d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:22:01.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.434+0000 7fb16ea5fe00 1 --2- 10.20.193.28:0/4255424042 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604acbf4740 0x5604acc50d10 secure :-1 s=READY pgs=489 gs=2 cs=0 l=1 c_cookie=7723455727001317072 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1580e4570 tx=0x7fb1580ac7f0 comp rx=0 tx=0).stop 2026-02-24T09:22:01.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.434+0000 7fb16ea5fe00 1 -- 10.20.193.28:0/4255424042 shutdown_connections 2026-02-24T09:22:01.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.434+0000 7fb16ea5fe00 1 --2- 10.20.193.28:0/4255424042 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5604acc36640 0x5604acc36ae0 crc :-1 s=READY pgs=64 gs=4 cs=0 l=0 c_cookie=8084054622809181452 s_cookie=8720375482695529982 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:22:01.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.434+0000 7fb16ea5fe00 1 --2- 10.20.193.28:0/4255424042 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5604acc39270 0x5604acc55d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:22:01.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.434+0000 7fb16ea5fe00 1 --2- 10.20.193.28:0/4255424042 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604acbf4740 0x5604acc50d10 unknown :-1 s=CLOSED pgs=489 gs=2 cs=0 l=1 c_cookie=7723455727001317072 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:22:01.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.434+0000 7fb16ea5fe00 1 --2- 10.20.193.28:0/4255424042 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5604acb12a60 0x5604acc507d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:22:01.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.434+0000 7fb11f7fe640 0 client.15879 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:22:01.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.434+0000 7fb16ea5fe00 1 -- 10.20.193.28:0/4255424042 >> 10.20.193.28:0/4255424042 conn(0x5604acb8e490 msgr2=0x5604acbf22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:22:01.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.434+0000 7fb16ea5fe00 1 -- 10.20.193.28:0/4255424042 shutdown_connections 2026-02-24T09:22:01.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.434+0000 7fb16ea5fe00 1 -- 10.20.193.28:0/4255424042 wait complete. 2026-02-24T09:22:01.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.434+0000 7fb16ea5fe00 20 client.15879 trim_cache size 0 max 16384 2026-02-24T09:22:01.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.442+0000 7fb16ea5fe00 1 Processor -- start 2026-02-24T09:22:01.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.442+0000 7fb16ea5fe00 1 -- start start 2026-02-24T09:22:01.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.442+0000 7fb16ea5fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604acb12a60 0x5604acc34410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:22:01.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.442+0000 7fb16ea5fe00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5604acbf4740 0x5604acc34950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:22:01.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.442+0000 7fb16ea5fe00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5604acc39270 0x5604acc4d8d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:22:01.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.442+0000 7fb16ea5fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5604acafd9d0 con 0x5604acb12a60 2026-02-24T09:22:01.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.442+0000 7fb16ea5fe00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x5604ac83ef10 con 0x5604acc39270 2026-02-24T09:22:01.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.442+0000 7fb16ea5fe00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x5604acb7c200 con 0x5604acbf4740 2026-02-24T09:22:01.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.442+0000 7fb16a112640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604acb12a60 0x5604acc34410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:22:01.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.442+0000 7fb16a112640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604acb12a60 0x5604acc34410 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39910/0 (socket says 10.20.193.28:39910) 2026-02-24T09:22:01.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.442+0000 7fb16a112640 1 -- 10.20.193.28:0/664601787 learned_addr learned my addr 10.20.193.28:0/664601787 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:22:01.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.442+0000 7fb16a913640 1 --2- 10.20.193.28:0/664601787 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5604acc39270 0x5604acc4d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:22:01.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.442+0000 7fb16a112640 1 -- 10.20.193.28:0/664601787 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5604acbf4740 msgr2=0x5604acc34950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:22:01.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.442+0000 7fb16a112640 1 --2- 10.20.193.28:0/664601787 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5604acbf4740 0x5604acc34950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:22:01.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.442+0000 7fb16a112640 1 -- 10.20.193.28:0/664601787 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5604acc39270 msgr2=0x5604acc4d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:22:01.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.442+0000 7fb16a112640 1 --2- 10.20.193.28:0/664601787 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5604acc39270 0x5604acc4d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:22:01.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.442+0000 7fb16a112640 1 -- 10.20.193.28:0/664601787 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604aca90030 con 0x5604acb12a60 2026-02-24T09:22:01.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.443+0000 7fb16a112640 1 --2- 10.20.193.28:0/664601787 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604acb12a60 0x5604acc34410 secure :-1 s=READY pgs=490 gs=1 cs=0 l=1 c_cookie=7330394606601293385 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb154010c40 tx=0x7fb154013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65bacb0e7de8ce49 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:22:01.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.443+0000 7fb131bfe640 1 -- 10.20.193.28:0/664601787 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb154024040 con 0x5604acb12a60 2026-02-24T09:22:01.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.443+0000 7fb131bfe640 1 -- 10.20.193.28:0/664601787 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb154015070 con 0x5604acb12a60 2026-02-24T09:22:01.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.443+0000 7fb131bfe640 1 -- 10.20.193.28:0/664601787 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb15401f7b0 con 0x5604acb12a60 2026-02-24T09:22:01.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.443+0000 7fb16ea5fe00 1 -- 10.20.193.28:0/664601787 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604acb12a60 msgr2=0x5604acc34410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:22:01.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.443+0000 7fb16ea5fe00 1 --2- 10.20.193.28:0/664601787 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604acb12a60 0x5604acc34410 secure :-1 s=READY pgs=490 gs=1 cs=0 l=1 c_cookie=7330394606601293385 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb154010c40 tx=0x7fb154013000 comp rx=0 tx=0).stop 2026-02-24T09:22:01.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.443+0000 7fb16ea5fe00 1 -- 10.20.193.28:0/664601787 shutdown_connections 2026-02-24T09:22:01.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.443+0000 7fb16ea5fe00 1 --2- 10.20.193.28:0/664601787 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5604acc39270 0x5604acc4d8d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:22:01.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.443+0000 7fb16ea5fe00 1 --2- 10.20.193.28:0/664601787 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5604acbf4740 0x5604acc34950 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:22:01.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.443+0000 7fb16ea5fe00 1 --2- 10.20.193.28:0/664601787 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604acb12a60 0x5604acc34410 unknown :-1 s=CLOSED pgs=490 gs=1 cs=0 l=1 c_cookie=7330394606601293385 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:22:01.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.443+0000 7fb16ea5fe00 1 -- 10.20.193.28:0/664601787 >> 10.20.193.28:0/664601787 conn(0x5604acb8e490 msgr2=0x5604acc4d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:22:01.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.443+0000 7fb16ea5fe00 1 -- 10.20.193.28:0/664601787 shutdown_connections 2026-02-24T09:22:01.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.443+0000 7fb16ea5fe00 1 -- 10.20.193.28:0/664601787 wait complete. 2026-02-24T09:22:01.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.444+0000 7fb16ea5fe00 1 -- start start 2026-02-24T09:22:01.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.444+0000 7fb16ea5fe00 1 Processor -- start 2026-02-24T09:22:01.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.444+0000 7fb16ea5fe00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5604acb12a60 0x5604acbd7bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:22:01.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.444+0000 7fb16ea5fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604acbf4740 0x5604acbd4200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:22:01.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.444+0000 7fb16ea5fe00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5604acc39270 0x5604acbd4740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:22:01.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.444+0000 7fb16ea5fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5604acc483f0 con 0x5604acbf4740 2026-02-24T09:22:01.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.444+0000 7fb16ea5fe00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x5604acc50ea0 con 0x5604acb12a60 2026-02-24T09:22:01.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.444+0000 7fb16ea5fe00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x5604acbf4f70 con 0x5604acc39270 2026-02-24T09:22:01.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.444+0000 7fb169911640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604acbf4740 0x5604acbd4200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:22:01.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.444+0000 7fb169911640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604acbf4740 0x5604acbd4200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39922/0 (socket says 10.20.193.28:39922) 2026-02-24T09:22:01.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.444+0000 7fb169911640 1 -- 10.20.193.28:0/1527952977 learned_addr learned my addr 10.20.193.28:0/1527952977 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:22:01.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.444+0000 7fb16a112640 1 --2- 10.20.193.28:0/1527952977 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5604acb12a60 0x5604acbd7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:22:01.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.444+0000 7fb169911640 1 -- 10.20.193.28:0/1527952977 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5604acc39270 msgr2=0x5604acbd4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:22:01.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.444+0000 7fb169911640 1 --2- 10.20.193.28:0/1527952977 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5604acc39270 0x5604acbd4740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:22:01.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.444+0000 7fb169911640 1 -- 10.20.193.28:0/1527952977 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5604acb12a60 msgr2=0x5604acbd7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:22:01.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.444+0000 7fb169911640 1 --2- 10.20.193.28:0/1527952977 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5604acb12a60 0x5604acbd7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:22:01.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.444+0000 7fb169911640 1 -- 10.20.193.28:0/1527952977 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604aca84010 con 0x5604acbf4740 2026-02-24T09:22:01.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.444+0000 7fb16a112640 1 --2- 10.20.193.28:0/1527952977 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5604acb12a60 0x5604acbd7bd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:22:01.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.445+0000 7fb169911640 1 --2- 10.20.193.28:0/1527952977 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604acbf4740 0x5604acbd4200 secure :-1 s=READY pgs=491 gs=1 cs=0 l=1 c_cookie=17167776255692274520 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1580d0e70 tx=0x7fb1580ac7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee40318bb7ec7b58 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:22:01.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.445+0000 7fb11f7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:22:01.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.445+0000 7fb11f7fe640 1 -- 10.20.193.28:0/1527952977 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb1580b0070 con 0x5604acbf4740 2026-02-24T09:22:01.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.445+0000 7fb11f7fe640 1 -- 10.20.193.28:0/1527952977 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x5604ac79f520 con 0x5604acbf4740 2026-02-24T09:22:01.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.445+0000 7fb11f7fe640 1 -- 10.20.193.28:0/1527952977 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb1580ad880 con 0x5604acbf4740 2026-02-24T09:22:01.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.445+0000 7fb16ea5fe00 1 -- 10.20.193.28:0/1527952977 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb15400bdf0 con 0x5604acbf4740 2026-02-24T09:22:01.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.445+0000 7fb11f7fe640 1 -- 10.20.193.28:0/1527952977 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 8469+0+0 (secure 0 0 0) 0x7fb158007ba0 con 0x5604acbf4740 2026-02-24T09:22:01.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.445+0000 7fb16ea5fe00 10 client.15885 _ll_register_callbacks cb 0x5604aca8a980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:22:01.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.445+0000 7fb16ea5fe00 1 -- 10.20.193.28:0/1527952977 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5604acb30d30 con 0x5604acbf4740 2026-02-24T09:22:01.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.445+0000 7fb11f7fe640 1 -- 10.20.193.28:0/1527952977 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fb1580b5110 con 0x5604acbf4740 2026-02-24T09:22:01.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.445+0000 7fb16ea5fe00 10 client.15885 fetch_fsmap learned FSMap version 23 2026-02-24T09:22:01.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.445+0000 7fb16ea5fe00 1 -- 10.20.193.28:0/1527952977 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x5604aca95810 con 0x5604acbf4740 2026-02-24T09:22:01.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.445+0000 7fb11f7fe640 1 -- 10.20.193.28:0/1527952977 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fb1580aadf0 con 0x5604acbf4740 2026-02-24T09:22:01.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.445+0000 7fb16ea5fe00 10 client.15885 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:22:01.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.445+0000 7fb16ea5fe00 10 client.15885 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-24T09:22:01.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.445+0000 7fb16ea5fe00 20 client.15885 populate_metadata read hostname 'trial028' 2026-02-24T09:22:01.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.445+0000 7fb16ea5fe00 1 --2- 10.20.193.28:0/1527952977 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5604acce7340 0x5604acd077f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:22:01.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.445+0000 7fb16ea5fe00 4 client.15885 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-24T09:22:01.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.445+0000 7fb16ea5fe00 1 -- 10.20.193.28:0/1527952977 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5604ac7e3640 con 0x5604acce7340 2026-02-24T09:22:01.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.446+0000 7fb16a112640 1 --2- 10.20.193.28:0/1527952977 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5604acce7340 0x5604acd077f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:22:01.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.446+0000 7fb16a112640 1 --2- 10.20.193.28:0/1527952977 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5604acce7340 0x5604acd077f0 crc :-1 s=READY pgs=65 gs=4 cs=0 l=0 c_cookie=5221929108143786300 s_cookie=4472560268143826723 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=487804db5d2ec93c server_cookie=3e11b9de033d1723 in_seq=0 out_seq=0 2026-02-24T09:22:01.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:01.446+0000 7fb11f7fe640 10 client.15885 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:22:02.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:02 trial159 ceph-mon[44242]: pgmap v335: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 255 MiB/s rd, 597 B/s wr, 71 op/s 2026-02-24T09:22:02.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:02 trial028 ceph-mon[40371]: pgmap v335: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 255 MiB/s rd, 597 B/s wr, 71 op/s 2026-02-24T09:22:02.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:02 trial074 ceph-mon[44412]: pgmap v335: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 255 MiB/s rd, 597 B/s wr, 71 op/s 2026-02-24T09:22:03.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:03 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:22:03.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:03 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:22:03.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:03 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:22:04.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:04.154+0000 7fb11f7fe640 1 -- 10.20.193.28:0/1527952977 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5604ac7e3640 con 0x5604acce7340 2026-02-24T09:22:04.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:04.154+0000 7fb11f7fe640 10 client.15885 handle_command_reply: tid=0 2026-02-24T09:22:04.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:04.154+0000 7fb16ea5fe00 1 client.15885 shutdown 2026-02-24T09:22:04.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:04.154+0000 7fb16ea5fe00 1 -- 10.20.193.28:0/1527952977 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604acbf4740 msgr2=0x5604acbd4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:22:04.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:04.154+0000 7fb16ea5fe00 1 --2- 10.20.193.28:0/1527952977 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604acbf4740 0x5604acbd4200 secure :-1 s=READY pgs=491 gs=1 cs=0 l=1 c_cookie=17167776255692274520 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1580d0e70 tx=0x7fb1580ac7f0 comp rx=0 tx=0).stop 2026-02-24T09:22:04.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:04.154+0000 7fb16ea5fe00 1 -- 10.20.193.28:0/1527952977 shutdown_connections 2026-02-24T09:22:04.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:04.154+0000 7fb16ea5fe00 1 --2- 10.20.193.28:0/1527952977 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5604acce7340 0x5604acd077f0 crc :-1 s=READY pgs=65 gs=4 cs=0 l=0 c_cookie=5221929108143786300 s_cookie=4472560268143826723 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:22:04.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:04.154+0000 7fb16ea5fe00 1 --2- 10.20.193.28:0/1527952977 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5604acc39270 0x5604acbd4740 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:22:04.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:04.154+0000 7fb16ea5fe00 1 --2- 10.20.193.28:0/1527952977 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604acbf4740 0x5604acbd4200 unknown :-1 s=CLOSED pgs=491 gs=1 cs=0 l=1 c_cookie=17167776255692274520 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:22:04.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:04.154+0000 7fb16ea5fe00 1 --2- 10.20.193.28:0/1527952977 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x5604acb12a60 0x5604acbd7bd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:22:04.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:04.154+0000 7fb11f7fe640 0 client.15885 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:22:04.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:04.154+0000 7fb16ea5fe00 1 -- 10.20.193.28:0/1527952977 >> 10.20.193.28:0/1527952977 conn(0x5604acb8e490 msgr2=0x5604acc4d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:22:04.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:04.154+0000 7fb16ea5fe00 1 -- 10.20.193.28:0/1527952977 shutdown_connections 2026-02-24T09:22:04.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:04.154+0000 7fb16ea5fe00 1 -- 10.20.193.28:0/1527952977 wait complete. 2026-02-24T09:22:04.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:04.155+0000 7fb16ea5fe00 20 client.15885 trim_cache size 0 max 16384 2026-02-24T09:22:04.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-24T09:22:04.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-24T09:22:04.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-24T09:22:04.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-24T09:22:04.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:04.155+0000 7fb16b114640 1 -- 10.20.193.28:0/1091939635 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb1400b58d0 msgr2=0x7fb1400d5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:22:04.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:04.155+0000 7fb16b114640 1 --2- 10.20.193.28:0/1091939635 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb1400b58d0 0x7fb1400d5d80 secure :-1 s=READY pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb154004740 tx=0x7fb15400b410 comp rx=0 tx=0).stop 2026-02-24T09:22:04.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:04.155+0000 7fb16b114640 1 -- 10.20.193.28:0/1091939635 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb16410c5d0 msgr2=0x7fb164161640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:22:04.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:04.155+0000 7fb16b114640 1 --2- 10.20.193.28:0/1091939635 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb16410c5d0 0x7fb164161640 secure :-1 s=READY pgs=487 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb15800c9b0 tx=0x7fb15800ce80 comp rx=0 tx=0).stop 2026-02-24T09:22:04.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:04.155+0000 7fb16b114640 1 -- 10.20.193.28:0/1091939635 shutdown_connections 2026-02-24T09:22:04.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:04.155+0000 7fb16b114640 1 --2- 10.20.193.28:0/1091939635 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fb1400b58d0 0x7fb1400d5d80 unknown :-1 s=CLOSED pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:22:04.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:04.155+0000 7fb16b114640 1 --2- 10.20.193.28:0/1091939635 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fb1641559f0 0x7fb164166a10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:22:04.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:04.155+0000 7fb16b114640 1 --2- 10.20.193.28:0/1091939635 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb16410c5d0 0x7fb164161640 unknown :-1 s=CLOSED pgs=487 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:22:04.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:04.155+0000 7fb16b114640 1 --2- 10.20.193.28:0/1091939635 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fb16410bcc0 0x7fb164161100 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:22:04.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:04.155+0000 7fb16b114640 1 -- 10.20.193.28:0/1091939635 >> 10.20.193.28:0/1091939635 conn(0x7fb1640e99a0 msgr2=0x7fb164109d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:22:04.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:04.155+0000 7fb16b114640 1 -- 10.20.193.28:0/1091939635 shutdown_connections 2026-02-24T09:22:04.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-24T09:22:04.155+0000 7fb16b114640 1 -- 10.20.193.28:0/1091939635 wait complete. 2026-02-24T09:22:04.775 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:04 trial074 ceph-mon[44412]: pgmap v336: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 255 MiB/s rd, 22 KiB/s wr, 84 op/s 2026-02-24T09:22:04.776 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:04 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:22:04.776 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:04 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:22:04.776 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:04 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:22:04.776 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:04 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:22:04.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:04 trial159 ceph-mon[44242]: pgmap v336: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 255 MiB/s rd, 22 KiB/s wr, 84 op/s 2026-02-24T09:22:04.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:04 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:22:04.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:04 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:22:04.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:04 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:22:04.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:04 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:22:04.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:04 trial028 ceph-mon[40371]: pgmap v336: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 255 MiB/s rd, 22 KiB/s wr, 84 op/s 2026-02-24T09:22:04.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:04 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:22:04.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:04 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:22:04.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:04 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:22:04.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:04 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:22:06.557 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-24T09:22:06.557 INFO:tasks.workunit.client.0.trial028.stdout: Children see throughput for 1 re-readers = 2976704.50 kB/sec 2026-02-24T09:22:06.558 INFO:tasks.workunit.client.0.trial028.stdout: Parent sees throughput for 1 re-readers = 2976078.40 kB/sec 2026-02-24T09:22:06.558 INFO:tasks.workunit.client.0.trial028.stdout: Min throughput per process = 2976704.50 kB/sec 2026-02-24T09:22:06.558 INFO:tasks.workunit.client.0.trial028.stdout: Max throughput per process = 2976704.50 kB/sec 2026-02-24T09:22:06.558 INFO:tasks.workunit.client.0.trial028.stdout: Avg throughput per process = 2976704.50 kB/sec 2026-02-24T09:22:06.558 INFO:tasks.workunit.client.0.trial028.stdout: Min xfer = 10485760.00 kB 2026-02-24T09:22:06.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:06 trial159 ceph-mon[44242]: pgmap v337: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 227 MiB/s rd, 22 KiB/s wr, 77 op/s 2026-02-24T09:22:06.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:06 trial028 ceph-mon[40371]: pgmap v337: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 227 MiB/s rd, 22 KiB/s wr, 77 op/s 2026-02-24T09:22:06.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:06 trial074 ceph-mon[44412]: pgmap v337: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 227 MiB/s rd, 22 KiB/s wr, 77 op/s 2026-02-24T09:22:08.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:08 trial159 ceph-mon[44242]: pgmap v338: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 190 MiB/s rd, 23 KiB/s wr, 69 op/s 2026-02-24T09:22:08.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:08 trial028 ceph-mon[40371]: pgmap v338: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 190 MiB/s rd, 23 KiB/s wr, 69 op/s 2026-02-24T09:22:08.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:08 trial074 ceph-mon[44412]: pgmap v338: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 190 MiB/s rd, 23 KiB/s wr, 69 op/s 2026-02-24T09:22:10.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:10 trial159 ceph-mon[44242]: pgmap v339: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 136 MiB/s rd, 23 KiB/s wr, 54 op/s 2026-02-24T09:22:10.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:10 trial028 ceph-mon[40371]: pgmap v339: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 136 MiB/s rd, 23 KiB/s wr, 54 op/s 2026-02-24T09:22:10.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:10 trial074 ceph-mon[44412]: pgmap v339: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 136 MiB/s rd, 23 KiB/s wr, 54 op/s 2026-02-24T09:22:12.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:12 trial159 ceph-mon[44242]: pgmap v340: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 87 MiB/s rd, 23 KiB/s wr, 43 op/s 2026-02-24T09:22:12.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:12 trial028 ceph-mon[40371]: pgmap v340: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 87 MiB/s rd, 23 KiB/s wr, 43 op/s 2026-02-24T09:22:12.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:12 trial074 ceph-mon[44412]: pgmap v340: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 87 MiB/s rd, 23 KiB/s wr, 43 op/s 2026-02-24T09:22:14.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:14 trial159 ceph-mon[44242]: pgmap v341: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 49 MiB/s rd, 23 KiB/s wr, 33 op/s 2026-02-24T09:22:14.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:14 trial028 ceph-mon[40371]: pgmap v341: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 49 MiB/s rd, 23 KiB/s wr, 33 op/s 2026-02-24T09:22:14.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:14 trial074 ceph-mon[44412]: pgmap v341: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 49 MiB/s rd, 23 KiB/s wr, 33 op/s 2026-02-24T09:22:15.064 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-24T09:22:15.064 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-24T09:22:15.068 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-24T09:22:15.068 INFO:tasks.workunit.client.0.trial028.stdout:iozone test complete. 2026-02-24T09:22:15.073 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-24T09:22:15.073 DEBUG:teuthology.orchestra.run.trial028:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-24T09:22:15.180 INFO:tasks.workunit:Stopping ['suites/iozone.sh'] on client.0... 2026-02-24T09:22:15.180 DEBUG:teuthology.orchestra.run.trial028:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-24T09:22:16.269 DEBUG:teuthology.parallel:result is None 2026-02-24T09:22:16.270 DEBUG:teuthology.orchestra.run.trial028:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-24T09:22:16.335 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-24T09:22:16.336 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2026-02-24T09:22:16.352 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@trial028.front.sepia.ceph.com 2026-02-24T09:22:16.362 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2026-02-24T09:22:16.374 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2026-02-24T09:22:16.374 INFO:teuthology.task.exec:Executing custom commands... 2026-02-24T09:22:16.374 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@trial028.front.sepia.ceph.com 2026-02-24T09:22:16.374 DEBUG:teuthology.orchestra.run.trial028:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2026-02-24T09:22:16.464 DEBUG:teuthology.orchestra.run.trial028:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((800-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2026-02-24T09:22:16.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:16 trial028 ceph-mon[40371]: pgmap v342: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 15 MiB/s rd, 682 B/s wr, 9 op/s 2026-02-24T09:22:16.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:16 trial159 ceph-mon[44242]: pgmap v342: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 15 MiB/s rd, 682 B/s wr, 9 op/s 2026-02-24T09:22:16.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:16 trial074 ceph-mon[44412]: pgmap v342: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 15 MiB/s rd, 682 B/s wr, 9 op/s 2026-02-24T09:22:18.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:18 trial159 ceph-mon[44242]: pgmap v343: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.7 MiB/s rd, 3.0 KiB/s wr, 17 op/s 2026-02-24T09:22:18.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:18 trial028 ceph-mon[40371]: pgmap v343: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.7 MiB/s rd, 3.0 KiB/s wr, 17 op/s 2026-02-24T09:22:18.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:18 trial074 ceph-mon[44412]: pgmap v343: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.7 MiB/s rd, 3.0 KiB/s wr, 17 op/s 2026-02-24T09:22:20.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:20 trial159 ceph-mon[44242]: pgmap v344: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 2.7 KiB/s wr, 101 op/s 2026-02-24T09:22:20.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:20 trial028 ceph-mon[40371]: pgmap v344: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 2.7 KiB/s wr, 101 op/s 2026-02-24T09:22:20.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:20 trial074 ceph-mon[44412]: pgmap v344: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 2.7 KiB/s wr, 101 op/s 2026-02-24T09:22:22.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:22 trial159 ceph-mon[44242]: pgmap v345: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 9.9 KiB/s rd, 6.8 KiB/s wr, 177 op/s 2026-02-24T09:22:22.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:22 trial028 ceph-mon[40371]: pgmap v345: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 9.9 KiB/s rd, 6.8 KiB/s wr, 177 op/s 2026-02-24T09:22:22.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:22 trial074 ceph-mon[44412]: pgmap v345: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 9.9 KiB/s rd, 6.8 KiB/s wr, 177 op/s 2026-02-24T09:22:24.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:24 trial159 ceph-mon[44242]: pgmap v346: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 9.5 KiB/s rd, 7.0 KiB/s wr, 221 op/s 2026-02-24T09:22:24.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:24 trial028 ceph-mon[40371]: pgmap v346: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 9.5 KiB/s rd, 7.0 KiB/s wr, 221 op/s 2026-02-24T09:22:24.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:24 trial074 ceph-mon[44412]: pgmap v346: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 9.5 KiB/s rd, 7.0 KiB/s wr, 221 op/s 2026-02-24T09:22:26.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:26 trial159 ceph-mon[44242]: pgmap v347: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 9.1 KiB/s rd, 7.0 KiB/s wr, 220 op/s 2026-02-24T09:22:26.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:26 trial028 ceph-mon[40371]: pgmap v347: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 9.1 KiB/s rd, 7.0 KiB/s wr, 220 op/s 2026-02-24T09:22:26.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:26 trial074 ceph-mon[44412]: pgmap v347: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 9.1 KiB/s rd, 7.0 KiB/s wr, 220 op/s 2026-02-24T09:22:28.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:28 trial159 ceph-mon[44242]: pgmap v348: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 7.0 KiB/s wr, 221 op/s 2026-02-24T09:22:28.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:28 trial028 ceph-mon[40371]: pgmap v348: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 7.0 KiB/s wr, 221 op/s 2026-02-24T09:22:28.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:28 trial074 ceph-mon[44412]: pgmap v348: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 7.0 KiB/s wr, 221 op/s 2026-02-24T09:22:30.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:30 trial159 ceph-mon[44242]: pgmap v349: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 6.7 KiB/s rd, 4.6 KiB/s wr, 211 op/s 2026-02-24T09:22:30.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:30 trial028 ceph-mon[40371]: pgmap v349: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 6.7 KiB/s rd, 4.6 KiB/s wr, 211 op/s 2026-02-24T09:22:30.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:30 trial074 ceph-mon[44412]: pgmap v349: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 6.7 KiB/s rd, 4.6 KiB/s wr, 211 op/s 2026-02-24T09:22:32.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:32 trial159 ceph-mon[44242]: pgmap v350: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 7.5 KiB/s rd, 4.3 KiB/s wr, 125 op/s 2026-02-24T09:22:32.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:32 trial028 ceph-mon[40371]: pgmap v350: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 7.5 KiB/s rd, 4.3 KiB/s wr, 125 op/s 2026-02-24T09:22:32.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:32 trial074 ceph-mon[44412]: pgmap v350: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 7.5 KiB/s rd, 4.3 KiB/s wr, 125 op/s 2026-02-24T09:22:34.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:34 trial159 ceph-mon[44242]: pgmap v351: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 50 op/s 2026-02-24T09:22:34.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:34 trial028 ceph-mon[40371]: pgmap v351: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 50 op/s 2026-02-24T09:22:34.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:34 trial074 ceph-mon[44412]: pgmap v351: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 50 op/s 2026-02-24T09:22:36.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:36 trial159 ceph-mon[44242]: pgmap v352: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:22:36.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:36 trial028 ceph-mon[40371]: pgmap v352: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:22:36.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:36 trial074 ceph-mon[44412]: pgmap v352: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:22:38.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:38 trial159 ceph-mon[44242]: pgmap v353: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:22:38.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:38 trial028 ceph-mon[40371]: pgmap v353: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:22:38.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:38 trial074 ceph-mon[44412]: pgmap v353: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:22:40.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:40 trial159 ceph-mon[44242]: pgmap v354: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.4 KiB/s rd, 5 op/s 2026-02-24T09:22:40.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:40 trial028 ceph-mon[40371]: pgmap v354: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.4 KiB/s rd, 5 op/s 2026-02-24T09:22:40.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:40 trial074 ceph-mon[44412]: pgmap v354: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.4 KiB/s rd, 5 op/s 2026-02-24T09:22:42.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:42 trial159 ceph-mon[44242]: pgmap v355: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-24T09:22:42.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:42 trial028 ceph-mon[40371]: pgmap v355: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-24T09:22:42.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:42 trial074 ceph-mon[44412]: pgmap v355: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-24T09:22:44.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:44 trial159 ceph-mon[44242]: pgmap v356: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-24T09:22:44.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:44 trial028 ceph-mon[40371]: pgmap v356: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-24T09:22:44.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:44 trial074 ceph-mon[44412]: pgmap v356: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-24T09:22:46.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:46 trial159 ceph-mon[44242]: pgmap v357: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.4 KiB/s rd, 5 op/s 2026-02-24T09:22:46.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:46 trial028 ceph-mon[40371]: pgmap v357: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.4 KiB/s rd, 5 op/s 2026-02-24T09:22:46.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:46 trial074 ceph-mon[44412]: pgmap v357: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.4 KiB/s rd, 5 op/s 2026-02-24T09:22:48.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:48 trial159 ceph-mon[44242]: pgmap v358: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:22:48.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:48 trial028 ceph-mon[40371]: pgmap v358: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:22:48.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:48 trial074 ceph-mon[44412]: pgmap v358: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:22:50.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:50 trial159 ceph-mon[44242]: pgmap v359: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:22:50.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:50 trial028 ceph-mon[40371]: pgmap v359: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:22:50.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:50 trial074 ceph-mon[44412]: pgmap v359: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:22:52.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:52 trial159 ceph-mon[44242]: pgmap v360: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:22:52.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:52 trial028 ceph-mon[40371]: pgmap v360: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:22:52.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:52 trial074 ceph-mon[44412]: pgmap v360: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:22:54.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:54 trial159 ceph-mon[44242]: pgmap v361: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:22:54.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:54 trial028 ceph-mon[40371]: pgmap v361: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:22:54.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:54 trial074 ceph-mon[44412]: pgmap v361: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:22:56.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:56 trial159 ceph-mon[44242]: pgmap v362: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:22:56.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:56 trial028 ceph-mon[40371]: pgmap v362: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:22:56.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:56 trial074 ceph-mon[44412]: pgmap v362: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:22:58.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:22:58 trial159 ceph-mon[44242]: pgmap v363: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:22:58.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:22:58 trial028 ceph-mon[40371]: pgmap v363: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:22:58.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:22:58 trial074 ceph-mon[44412]: pgmap v363: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:23:00.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:00 trial159 ceph-mon[44242]: pgmap v364: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:23:00.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:00 trial028 ceph-mon[40371]: pgmap v364: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:23:00.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:00 trial074 ceph-mon[44412]: pgmap v364: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:23:02.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:02 trial159 ceph-mon[44242]: pgmap v365: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 511 B/s wr, 6 op/s 2026-02-24T09:23:02.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:02 trial028 ceph-mon[40371]: pgmap v365: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 511 B/s wr, 6 op/s 2026-02-24T09:23:02.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:02 trial074 ceph-mon[44412]: pgmap v365: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 511 B/s wr, 6 op/s 2026-02-24T09:23:04.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:04 trial159 ceph-mon[44242]: pgmap v366: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2026-02-24T09:23:04.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:04 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:23:04.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:04 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:23:04.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:04 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:23:04.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:04 trial028 ceph-mon[40371]: pgmap v366: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2026-02-24T09:23:04.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:04 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:23:04.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:04 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:23:04.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:04 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:23:04.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:04 trial074 ceph-mon[44412]: pgmap v366: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2026-02-24T09:23:04.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:04 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:23:04.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:04 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:23:04.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:04 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:23:05.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:05 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:23:05.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:05 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:23:05.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:05 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:23:05.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:05 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:23:05.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:05 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:23:05.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:05 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:23:05.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:05 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:23:05.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:05 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:23:05.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:05 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:23:05.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:05 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:23:05.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:05 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:23:05.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:05 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:23:06.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:06 trial159 ceph-mon[44242]: pgmap v367: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2026-02-24T09:23:06.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:06 trial028 ceph-mon[40371]: pgmap v367: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2026-02-24T09:23:06.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:06 trial074 ceph-mon[44412]: pgmap v367: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2026-02-24T09:23:08.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:08 trial159 ceph-mon[44242]: pgmap v368: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2026-02-24T09:23:08.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:08 trial028 ceph-mon[40371]: pgmap v368: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2026-02-24T09:23:08.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:08 trial074 ceph-mon[44412]: pgmap v368: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2026-02-24T09:23:10.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:10 trial159 ceph-mon[44242]: pgmap v369: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2026-02-24T09:23:10.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:10 trial028 ceph-mon[40371]: pgmap v369: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2026-02-24T09:23:10.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:10 trial074 ceph-mon[44412]: pgmap v369: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2026-02-24T09:23:12.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:12 trial159 ceph-mon[44242]: pgmap v370: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2026-02-24T09:23:12.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:12 trial028 ceph-mon[40371]: pgmap v370: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2026-02-24T09:23:12.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:12 trial074 ceph-mon[44412]: pgmap v370: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2026-02-24T09:23:14.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:14 trial159 ceph-mon[44242]: pgmap v371: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2026-02-24T09:23:14.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:14 trial028 ceph-mon[40371]: pgmap v371: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2026-02-24T09:23:14.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:14 trial074 ceph-mon[44412]: pgmap v371: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2026-02-24T09:23:16.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:16 trial159 ceph-mon[44242]: pgmap v372: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2026-02-24T09:23:16.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:16 trial028 ceph-mon[40371]: pgmap v372: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2026-02-24T09:23:16.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:16 trial074 ceph-mon[44412]: pgmap v372: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2026-02-24T09:23:18.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:18 trial159 ceph-mon[44242]: pgmap v373: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 7 op/s 2026-02-24T09:23:18.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:18 trial028 ceph-mon[40371]: pgmap v373: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 7 op/s 2026-02-24T09:23:18.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:18 trial074 ceph-mon[44412]: pgmap v373: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 7 op/s 2026-02-24T09:23:20.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:20 trial159 ceph-mon[44242]: pgmap v374: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2026-02-24T09:23:20.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:20 trial028 ceph-mon[40371]: pgmap v374: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2026-02-24T09:23:20.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:20 trial074 ceph-mon[44412]: pgmap v374: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2026-02-24T09:23:22.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:22 trial159 ceph-mon[44242]: pgmap v375: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2026-02-24T09:23:22.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:22 trial028 ceph-mon[40371]: pgmap v375: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2026-02-24T09:23:22.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:22 trial074 ceph-mon[44412]: pgmap v375: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2026-02-24T09:23:24.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:24 trial159 ceph-mon[44242]: pgmap v376: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:23:24.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:24 trial028 ceph-mon[40371]: pgmap v376: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:23:24.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:24 trial074 ceph-mon[44412]: pgmap v376: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:23:26.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:26 trial159 ceph-mon[44242]: pgmap v377: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:23:26.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:26 trial028 ceph-mon[40371]: pgmap v377: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:23:26.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:26 trial074 ceph-mon[44412]: pgmap v377: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:23:28.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:28 trial159 ceph-mon[44242]: pgmap v378: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:23:28.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:28 trial028 ceph-mon[40371]: pgmap v378: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:23:28.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:28 trial074 ceph-mon[44412]: pgmap v378: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:23:30.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:30 trial159 ceph-mon[44242]: pgmap v379: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:23:30.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:30 trial028 ceph-mon[40371]: pgmap v379: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:23:30.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:30 trial074 ceph-mon[44412]: pgmap v379: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:23:32.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:32 trial159 ceph-mon[44242]: pgmap v380: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:23:32.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:32 trial028 ceph-mon[40371]: pgmap v380: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:23:32.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:32 trial074 ceph-mon[44412]: pgmap v380: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:23:34.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:34 trial159 ceph-mon[44242]: pgmap v381: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:23:34.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:34 trial028 ceph-mon[40371]: pgmap v381: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:23:34.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:34 trial074 ceph-mon[44412]: pgmap v381: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:23:36.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:36 trial159 ceph-mon[44242]: pgmap v382: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:23:36.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:36 trial028 ceph-mon[40371]: pgmap v382: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:23:36.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:36 trial074 ceph-mon[44412]: pgmap v382: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:23:38.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:38 trial159 ceph-mon[44242]: pgmap v383: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:23:38.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:38 trial028 ceph-mon[40371]: pgmap v383: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:23:38.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:38 trial074 ceph-mon[44412]: pgmap v383: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:23:40.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:40 trial159 ceph-mon[44242]: pgmap v384: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:23:40.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:40 trial028 ceph-mon[40371]: pgmap v384: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:23:40.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:40 trial074 ceph-mon[44412]: pgmap v384: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:23:42.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:42 trial159 ceph-mon[44242]: pgmap v385: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:23:42.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:42 trial028 ceph-mon[40371]: pgmap v385: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:23:42.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:42 trial074 ceph-mon[44412]: pgmap v385: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:23:44.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:44 trial159 ceph-mon[44242]: pgmap v386: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:23:44.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:44 trial028 ceph-mon[40371]: pgmap v386: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:23:44.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:44 trial074 ceph-mon[44412]: pgmap v386: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:23:46.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:46 trial159 ceph-mon[44242]: pgmap v387: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:23:46.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:46 trial028 ceph-mon[40371]: pgmap v387: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:23:46.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:46 trial074 ceph-mon[44412]: pgmap v387: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:23:48.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:48 trial159 ceph-mon[44242]: pgmap v388: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:23:48.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:48 trial028 ceph-mon[40371]: pgmap v388: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:23:48.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:48 trial074 ceph-mon[44412]: pgmap v388: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:23:50.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:50 trial159 ceph-mon[44242]: pgmap v389: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:23:50.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:50 trial028 ceph-mon[40371]: pgmap v389: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:23:50.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:50 trial074 ceph-mon[44412]: pgmap v389: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:23:52.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:52 trial159 ceph-mon[44242]: pgmap v390: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-24T09:23:52.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:52 trial028 ceph-mon[40371]: pgmap v390: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-24T09:23:52.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:52 trial074 ceph-mon[44412]: pgmap v390: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-24T09:23:54.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:54 trial028 ceph-mon[40371]: pgmap v391: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-24T09:23:54.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:54 trial074 ceph-mon[44412]: pgmap v391: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-24T09:23:55.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:54 trial159 ceph-mon[44242]: pgmap v391: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-24T09:23:56.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:56 trial028 ceph-mon[40371]: pgmap v392: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.4 KiB/s rd, 5 op/s 2026-02-24T09:23:56.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:56 trial074 ceph-mon[44412]: pgmap v392: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.4 KiB/s rd, 5 op/s 2026-02-24T09:23:57.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:56 trial159 ceph-mon[44242]: pgmap v392: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.4 KiB/s rd, 5 op/s 2026-02-24T09:23:58.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:23:58 trial028 ceph-mon[40371]: pgmap v393: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:23:58.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:23:58 trial074 ceph-mon[44412]: pgmap v393: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:23:59.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:23:58 trial159 ceph-mon[44242]: pgmap v393: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:24:00.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:00 trial028 ceph-mon[40371]: pgmap v394: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.4 KiB/s rd, 5 op/s 2026-02-24T09:24:00.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:00 trial074 ceph-mon[44412]: pgmap v394: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.4 KiB/s rd, 5 op/s 2026-02-24T09:24:01.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:00 trial159 ceph-mon[44242]: pgmap v394: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.4 KiB/s rd, 5 op/s 2026-02-24T09:24:02.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:02 trial028 ceph-mon[40371]: pgmap v395: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 6 op/s 2026-02-24T09:24:02.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:02 trial074 ceph-mon[44412]: pgmap v395: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 6 op/s 2026-02-24T09:24:03.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:02 trial159 ceph-mon[44242]: pgmap v395: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 6 op/s 2026-02-24T09:24:04.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:04 trial028 ceph-mon[40371]: pgmap v396: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2026-02-24T09:24:04.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:04 trial074 ceph-mon[44412]: pgmap v396: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2026-02-24T09:24:05.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:04 trial159 ceph-mon[44242]: pgmap v396: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2026-02-24T09:24:05.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:05 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:24:05.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:05 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:24:05.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:05 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:24:05.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:05 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:24:05.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:05 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:24:05.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:05 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:24:05.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:05 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:24:05.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:05 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:24:05.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:05 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:24:05.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:05 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:24:06.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:05 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:24:06.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:05 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:24:06.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:05 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:24:06.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:05 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:24:06.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:05 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:24:06.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:06 trial028 ceph-mon[40371]: pgmap v397: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 22 op/s 2026-02-24T09:24:06.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:06 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:24:06.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:06 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:24:06.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:06 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:24:06.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:06 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:24:06.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:06 trial074 ceph-mon[44412]: pgmap v397: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 22 op/s 2026-02-24T09:24:06.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:06 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:24:06.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:06 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:24:06.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:06 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:24:06.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:06 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:24:06.931 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:06 trial159 ceph-mon[44242]: pgmap v397: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 22 op/s 2026-02-24T09:24:06.931 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:06 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:24:06.932 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:06 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:24:06.932 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:06 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:24:06.932 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:06 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:24:08.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:08 trial028 ceph-mon[40371]: pgmap v398: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2026-02-24T09:24:08.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:08 trial074 ceph-mon[44412]: pgmap v398: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2026-02-24T09:24:09.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:08 trial159 ceph-mon[44242]: pgmap v398: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2026-02-24T09:24:10.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:10 trial028 ceph-mon[40371]: pgmap v399: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2026-02-24T09:24:10.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:10 trial028 ceph-mon[40371]: osdmap e97: 12 total, 12 up, 12 in 2026-02-24T09:24:10.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:10 trial074 ceph-mon[44412]: pgmap v399: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2026-02-24T09:24:10.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:10 trial074 ceph-mon[44412]: osdmap e97: 12 total, 12 up, 12 in 2026-02-24T09:24:11.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:10 trial159 ceph-mon[44242]: pgmap v399: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2026-02-24T09:24:11.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:10 trial159 ceph-mon[44242]: osdmap e97: 12 total, 12 up, 12 in 2026-02-24T09:24:12.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:12 trial028 ceph-mon[40371]: pgmap v401: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2026-02-24T09:24:12.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:12 trial074 ceph-mon[44412]: pgmap v401: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2026-02-24T09:24:13.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:12 trial159 ceph-mon[44242]: pgmap v401: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2026-02-24T09:24:14.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:14 trial028 ceph-mon[40371]: pgmap v402: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:24:14.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:14 trial074 ceph-mon[44412]: pgmap v402: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:24:15.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:14 trial159 ceph-mon[44242]: pgmap v402: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:24:16.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:16 trial028 ceph-mon[40371]: pgmap v403: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:24:16.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:16 trial028 ceph-mon[40371]: osdmap e98: 12 total, 12 up, 12 in 2026-02-24T09:24:16.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:16 trial074 ceph-mon[44412]: pgmap v403: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:24:16.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:16 trial074 ceph-mon[44412]: osdmap e98: 12 total, 12 up, 12 in 2026-02-24T09:24:17.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:16 trial159 ceph-mon[44242]: pgmap v403: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:24:17.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:16 trial159 ceph-mon[44242]: osdmap e98: 12 total, 12 up, 12 in 2026-02-24T09:24:18.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:18 trial028 ceph-mon[40371]: pgmap v405: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2026-02-24T09:24:18.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:18 trial074 ceph-mon[44412]: pgmap v405: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2026-02-24T09:24:19.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:18 trial159 ceph-mon[44242]: pgmap v405: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2026-02-24T09:24:20.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:20 trial028 ceph-mon[40371]: pgmap v406: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 208 B/s wr, 6 op/s 2026-02-24T09:24:20.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:20 trial074 ceph-mon[44412]: pgmap v406: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 208 B/s wr, 6 op/s 2026-02-24T09:24:21.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:20 trial159 ceph-mon[44242]: pgmap v406: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 208 B/s wr, 6 op/s 2026-02-24T09:24:22.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:22 trial028 ceph-mon[40371]: pgmap v407: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:24:22.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:22 trial074 ceph-mon[44412]: pgmap v407: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:24:23.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:22 trial159 ceph-mon[44242]: pgmap v407: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:24:24.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:24 trial028 ceph-mon[40371]: pgmap v408: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:24:24.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:24 trial074 ceph-mon[44412]: pgmap v408: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:24:25.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:24 trial159 ceph-mon[44242]: pgmap v408: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:24:26.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:26 trial028 ceph-mon[40371]: pgmap v409: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:24:26.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:26 trial074 ceph-mon[44412]: pgmap v409: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:24:27.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:26 trial159 ceph-mon[44242]: pgmap v409: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:24:27.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:27 trial074 ceph-mon[44412]: pgmap v410: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 87 B/s wr, 6 op/s 2026-02-24T09:24:28.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:27 trial159 ceph-mon[44242]: pgmap v410: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 87 B/s wr, 6 op/s 2026-02-24T09:24:28.110 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:27 trial028 ceph-mon[40371]: pgmap v410: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 87 B/s wr, 6 op/s 2026-02-24T09:24:30.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:30 trial159 ceph-mon[44242]: pgmap v411: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:24:30.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:30 trial028 ceph-mon[40371]: pgmap v411: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:24:30.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:30 trial074 ceph-mon[44412]: pgmap v411: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:24:32.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:32 trial159 ceph-mon[44242]: pgmap v412: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:24:32.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:32 trial028 ceph-mon[40371]: pgmap v412: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:24:32.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:32 trial074 ceph-mon[44412]: pgmap v412: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:24:34.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:34 trial159 ceph-mon[44242]: pgmap v413: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:24:34.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:34 trial028 ceph-mon[40371]: pgmap v413: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:24:34.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:34 trial074 ceph-mon[44412]: pgmap v413: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:24:36.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:36 trial159 ceph-mon[44242]: pgmap v414: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:24:36.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:36 trial028 ceph-mon[40371]: pgmap v414: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:24:36.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:36 trial074 ceph-mon[44412]: pgmap v414: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:24:38.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:38 trial159 ceph-mon[44242]: pgmap v415: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:24:38.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:38 trial028 ceph-mon[40371]: pgmap v415: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:24:38.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:38 trial074 ceph-mon[44412]: pgmap v415: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:24:40.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:40 trial159 ceph-mon[44242]: pgmap v416: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:24:40.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:40 trial028 ceph-mon[40371]: pgmap v416: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:24:40.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:40 trial074 ceph-mon[44412]: pgmap v416: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:24:42.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:42 trial159 ceph-mon[44242]: pgmap v417: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:24:42.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:42 trial028 ceph-mon[40371]: pgmap v417: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:24:42.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:42 trial074 ceph-mon[44412]: pgmap v417: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:24:44.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:44 trial159 ceph-mon[44242]: pgmap v418: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:24:44.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:44 trial028 ceph-mon[40371]: pgmap v418: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:24:44.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:44 trial074 ceph-mon[44412]: pgmap v418: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:24:46.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:46 trial159 ceph-mon[44242]: pgmap v419: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:24:46.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:46 trial028 ceph-mon[40371]: pgmap v419: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:24:46.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:46 trial074 ceph-mon[44412]: pgmap v419: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:24:48.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:48 trial159 ceph-mon[44242]: pgmap v420: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:24:48.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:48 trial028 ceph-mon[40371]: pgmap v420: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:24:48.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:48 trial074 ceph-mon[44412]: pgmap v420: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:24:50.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:50 trial159 ceph-mon[44242]: pgmap v421: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:24:50.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:50 trial028 ceph-mon[40371]: pgmap v421: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:24:50.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:50 trial074 ceph-mon[44412]: pgmap v421: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:24:52.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:52 trial159 ceph-mon[44242]: pgmap v422: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:24:52.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:52 trial028 ceph-mon[40371]: pgmap v422: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:24:52.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:52 trial074 ceph-mon[44412]: pgmap v422: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:24:54.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:54 trial159 ceph-mon[44242]: pgmap v423: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:24:54.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:54 trial028 ceph-mon[40371]: pgmap v423: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:24:54.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:54 trial074 ceph-mon[44412]: pgmap v423: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:24:56.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:56 trial159 ceph-mon[44242]: pgmap v424: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:24:56.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:56 trial028 ceph-mon[40371]: pgmap v424: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:24:56.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:56 trial074 ceph-mon[44412]: pgmap v424: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:24:58.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:24:58 trial159 ceph-mon[44242]: pgmap v425: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:24:58.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:24:58 trial028 ceph-mon[40371]: pgmap v425: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:24:58.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:24:58 trial074 ceph-mon[44412]: pgmap v425: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:25:00.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:00 trial159 ceph-mon[44242]: pgmap v426: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:25:00.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:00 trial028 ceph-mon[40371]: pgmap v426: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:25:00.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:00 trial074 ceph-mon[44412]: pgmap v426: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:25:02.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:02 trial159 ceph-mon[44242]: pgmap v427: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 938 B/s wr, 7 op/s 2026-02-24T09:25:02.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:02 trial028 ceph-mon[40371]: pgmap v427: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 938 B/s wr, 7 op/s 2026-02-24T09:25:02.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:02 trial074 ceph-mon[44412]: pgmap v427: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 938 B/s wr, 7 op/s 2026-02-24T09:25:04.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:04 trial159 ceph-mon[44242]: pgmap v428: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2026-02-24T09:25:04.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:04 trial028 ceph-mon[40371]: pgmap v428: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2026-02-24T09:25:04.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:04 trial074 ceph-mon[44412]: pgmap v428: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2026-02-24T09:25:06.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:06 trial159 ceph-mon[44242]: pgmap v429: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 22 op/s 2026-02-24T09:25:06.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:06 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:25:06.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:06 trial028 ceph-mon[40371]: pgmap v429: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 22 op/s 2026-02-24T09:25:06.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:06 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:25:06.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:06 trial074 ceph-mon[44412]: pgmap v429: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 22 op/s 2026-02-24T09:25:06.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:06 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:25:07.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:07 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:25:07.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:07 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:25:07.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:07 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:25:07.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:07 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:25:07.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:07 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:25:07.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:07 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:25:07.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:07 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:25:07.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:07 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:25:07.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:07 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:25:07.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:07 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:25:07.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:07 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:25:07.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:07 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:25:08.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:08 trial159 ceph-mon[44242]: pgmap v430: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2026-02-24T09:25:08.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:08 trial028 ceph-mon[40371]: pgmap v430: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2026-02-24T09:25:08.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:08 trial074 ceph-mon[44412]: pgmap v430: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2026-02-24T09:25:10.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:10 trial159 ceph-mon[44242]: pgmap v431: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2026-02-24T09:25:10.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:10 trial159 ceph-mon[44242]: osdmap e99: 12 total, 12 up, 12 in 2026-02-24T09:25:10.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:10 trial028 ceph-mon[40371]: pgmap v431: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2026-02-24T09:25:10.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:10 trial028 ceph-mon[40371]: osdmap e99: 12 total, 12 up, 12 in 2026-02-24T09:25:10.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:10 trial074 ceph-mon[44412]: pgmap v431: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2026-02-24T09:25:10.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:10 trial074 ceph-mon[44412]: osdmap e99: 12 total, 12 up, 12 in 2026-02-24T09:25:12.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:12 trial159 ceph-mon[44242]: pgmap v433: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2026-02-24T09:25:12.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:12 trial028 ceph-mon[40371]: pgmap v433: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2026-02-24T09:25:12.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:12 trial074 ceph-mon[44412]: pgmap v433: 97 pgs: 97 active+clean; 16 GiB data, 49 GiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2026-02-24T09:25:14.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:14 trial159 ceph-mon[44242]: pgmap v434: 97 pgs: 97 active+clean; 15 GiB data, 47 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:25:14.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:14 trial028 ceph-mon[40371]: pgmap v434: 97 pgs: 97 active+clean; 15 GiB data, 47 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:25:14.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:14 trial074 ceph-mon[44412]: pgmap v434: 97 pgs: 97 active+clean; 15 GiB data, 47 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:25:16.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:16 trial159 ceph-mon[44242]: pgmap v435: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:25:16.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:16 trial159 ceph-mon[44242]: osdmap e100: 12 total, 12 up, 12 in 2026-02-24T09:25:16.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:16 trial028 ceph-mon[40371]: pgmap v435: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:25:16.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:16 trial028 ceph-mon[40371]: osdmap e100: 12 total, 12 up, 12 in 2026-02-24T09:25:16.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:16 trial074 ceph-mon[44412]: pgmap v435: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:25:16.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:16 trial074 ceph-mon[44412]: osdmap e100: 12 total, 12 up, 12 in 2026-02-24T09:25:18.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:18 trial159 ceph-mon[44242]: pgmap v437: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2026-02-24T09:25:18.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:18 trial028 ceph-mon[40371]: pgmap v437: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2026-02-24T09:25:18.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:18 trial074 ceph-mon[44412]: pgmap v437: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2026-02-24T09:25:20.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:20 trial159 ceph-mon[44242]: pgmap v438: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 206 B/s wr, 6 op/s 2026-02-24T09:25:20.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:20 trial028 ceph-mon[40371]: pgmap v438: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 206 B/s wr, 6 op/s 2026-02-24T09:25:20.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:20 trial074 ceph-mon[44412]: pgmap v438: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 206 B/s wr, 6 op/s 2026-02-24T09:25:22.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:22 trial159 ceph-mon[44242]: pgmap v439: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:25:22.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:22 trial028 ceph-mon[40371]: pgmap v439: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:25:22.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:22 trial074 ceph-mon[44412]: pgmap v439: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:25:24.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:24 trial159 ceph-mon[44242]: pgmap v440: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:25:24.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:24 trial028 ceph-mon[40371]: pgmap v440: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:25:24.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:24 trial074 ceph-mon[44412]: pgmap v440: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:25:26.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:26 trial159 ceph-mon[44242]: pgmap v441: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:25:26.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:26 trial028 ceph-mon[40371]: pgmap v441: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:25:26.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:26 trial074 ceph-mon[44412]: pgmap v441: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:25:28.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:28 trial159 ceph-mon[44242]: pgmap v442: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 87 B/s wr, 6 op/s 2026-02-24T09:25:28.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:28 trial028 ceph-mon[40371]: pgmap v442: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 87 B/s wr, 6 op/s 2026-02-24T09:25:28.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:28 trial074 ceph-mon[44412]: pgmap v442: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 87 B/s wr, 6 op/s 2026-02-24T09:25:30.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:30 trial159 ceph-mon[44242]: pgmap v443: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:25:30.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:30 trial028 ceph-mon[40371]: pgmap v443: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:25:30.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:30 trial074 ceph-mon[44412]: pgmap v443: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:25:32.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:32 trial159 ceph-mon[44242]: pgmap v444: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:25:32.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:32 trial028 ceph-mon[40371]: pgmap v444: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:25:32.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:32 trial074 ceph-mon[44412]: pgmap v444: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:25:34.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:34 trial159 ceph-mon[44242]: pgmap v445: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:25:34.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:34 trial028 ceph-mon[40371]: pgmap v445: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:25:34.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:34 trial074 ceph-mon[44412]: pgmap v445: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:25:36.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:36 trial159 ceph-mon[44242]: pgmap v446: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:25:36.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:36 trial028 ceph-mon[40371]: pgmap v446: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:25:36.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:36 trial074 ceph-mon[44412]: pgmap v446: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:25:38.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:38 trial159 ceph-mon[44242]: pgmap v447: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:25:38.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:38 trial028 ceph-mon[40371]: pgmap v447: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:25:38.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:38 trial074 ceph-mon[44412]: pgmap v447: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:25:40.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:40 trial159 ceph-mon[44242]: pgmap v448: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:25:40.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:40 trial028 ceph-mon[40371]: pgmap v448: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:25:40.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:40 trial074 ceph-mon[44412]: pgmap v448: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:25:42.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:42 trial159 ceph-mon[44242]: pgmap v449: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:25:42.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:42 trial028 ceph-mon[40371]: pgmap v449: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:25:42.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:42 trial074 ceph-mon[44412]: pgmap v449: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:25:44.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:44 trial159 ceph-mon[44242]: pgmap v450: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:25:44.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:44 trial028 ceph-mon[40371]: pgmap v450: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:25:44.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:44 trial074 ceph-mon[44412]: pgmap v450: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:25:46.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:46 trial159 ceph-mon[44242]: pgmap v451: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:25:46.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:46 trial028 ceph-mon[40371]: pgmap v451: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:25:46.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:46 trial074 ceph-mon[44412]: pgmap v451: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:25:48.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:48 trial159 ceph-mon[44242]: pgmap v452: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:25:48.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:48 trial028 ceph-mon[40371]: pgmap v452: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:25:48.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:48 trial074 ceph-mon[44412]: pgmap v452: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:25:50.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:50 trial159 ceph-mon[44242]: pgmap v453: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:25:50.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:50 trial028 ceph-mon[40371]: pgmap v453: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:25:50.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:50 trial074 ceph-mon[44412]: pgmap v453: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:25:52.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:52 trial159 ceph-mon[44242]: pgmap v454: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:25:52.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:52 trial028 ceph-mon[40371]: pgmap v454: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:25:52.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:52 trial074 ceph-mon[44412]: pgmap v454: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:25:54.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:54 trial028 ceph-mon[40371]: pgmap v455: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:25:54.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:54 trial074 ceph-mon[44412]: pgmap v455: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:25:55.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:54 trial159 ceph-mon[44242]: pgmap v455: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:25:56.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:56 trial028 ceph-mon[40371]: pgmap v456: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:25:56.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:56 trial074 ceph-mon[44412]: pgmap v456: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:25:57.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:56 trial159 ceph-mon[44242]: pgmap v456: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:25:58.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:25:58 trial028 ceph-mon[40371]: pgmap v457: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:25:58.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:25:58 trial074 ceph-mon[44412]: pgmap v457: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:25:59.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:25:58 trial159 ceph-mon[44242]: pgmap v457: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:26:00.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:00 trial028 ceph-mon[40371]: pgmap v458: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:26:00.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:00 trial074 ceph-mon[44412]: pgmap v458: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:26:01.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:00 trial159 ceph-mon[44242]: pgmap v458: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:26:02.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:02 trial028 ceph-mon[40371]: pgmap v459: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 767 B/s wr, 7 op/s 2026-02-24T09:26:02.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:02 trial074 ceph-mon[44412]: pgmap v459: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 767 B/s wr, 7 op/s 2026-02-24T09:26:03.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:02 trial159 ceph-mon[44242]: pgmap v459: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 767 B/s wr, 7 op/s 2026-02-24T09:26:04.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:04 trial028 ceph-mon[40371]: pgmap v460: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:26:04.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:04 trial074 ceph-mon[44412]: pgmap v460: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:26:05.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:04 trial159 ceph-mon[44242]: pgmap v460: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:26:06.832 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:06 trial159 ceph-mon[44242]: pgmap v461: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:26:06.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:06 trial028 ceph-mon[40371]: pgmap v461: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:26:06.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:06 trial074 ceph-mon[44412]: pgmap v461: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:26:07.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:07 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:26:07.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:07 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:26:07.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:07 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:26:07.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:07 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:26:07.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:07 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:26:07.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:07 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:26:07.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:07 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:26:07.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:07 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:26:07.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:07 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:26:07.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:07 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:26:08.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:07 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:26:08.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:07 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:26:08.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:07 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:26:08.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:07 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:26:08.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:07 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:26:08.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:08 trial028 ceph-mon[40371]: pgmap v462: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2026-02-24T09:26:08.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:08 trial074 ceph-mon[44412]: pgmap v462: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2026-02-24T09:26:09.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:08 trial159 ceph-mon[44242]: pgmap v462: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2026-02-24T09:26:10.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:10 trial028 ceph-mon[40371]: pgmap v463: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:26:10.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:10 trial028 ceph-mon[40371]: osdmap e101: 12 total, 12 up, 12 in 2026-02-24T09:26:10.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:10 trial074 ceph-mon[44412]: pgmap v463: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:26:10.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:10 trial074 ceph-mon[44412]: osdmap e101: 12 total, 12 up, 12 in 2026-02-24T09:26:11.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:10 trial159 ceph-mon[44242]: pgmap v463: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:26:11.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:10 trial159 ceph-mon[44242]: osdmap e101: 12 total, 12 up, 12 in 2026-02-24T09:26:12.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:12 trial028 ceph-mon[40371]: pgmap v465: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2026-02-24T09:26:12.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:12 trial074 ceph-mon[44412]: pgmap v465: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2026-02-24T09:26:13.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:12 trial159 ceph-mon[44242]: pgmap v465: 97 pgs: 97 active+clean; 15 GiB data, 46 GiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2026-02-24T09:26:14.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:14 trial028 ceph-mon[40371]: pgmap v466: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 8.2 TiB / 8.2 TiB avail; 3.8 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:26:14.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:14 trial074 ceph-mon[44412]: pgmap v466: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 8.2 TiB / 8.2 TiB avail; 3.8 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:26:15.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:14 trial159 ceph-mon[44242]: pgmap v466: 97 pgs: 97 active+clean; 14 GiB data, 44 GiB used, 8.2 TiB / 8.2 TiB avail; 3.8 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:26:16.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:16 trial028 ceph-mon[40371]: pgmap v467: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.8 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:26:16.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:16 trial028 ceph-mon[40371]: osdmap e102: 12 total, 12 up, 12 in 2026-02-24T09:26:16.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:16 trial074 ceph-mon[44412]: pgmap v467: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.8 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:26:16.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:16 trial074 ceph-mon[44412]: osdmap e102: 12 total, 12 up, 12 in 2026-02-24T09:26:17.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:16 trial159 ceph-mon[44242]: pgmap v467: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.8 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:26:17.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:16 trial159 ceph-mon[44242]: osdmap e102: 12 total, 12 up, 12 in 2026-02-24T09:26:18.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:18 trial028 ceph-mon[40371]: pgmap v469: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2026-02-24T09:26:18.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:18 trial074 ceph-mon[44412]: pgmap v469: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2026-02-24T09:26:19.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:18 trial159 ceph-mon[44242]: pgmap v469: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2026-02-24T09:26:20.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:20 trial028 ceph-mon[40371]: pgmap v470: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 208 B/s wr, 6 op/s 2026-02-24T09:26:20.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:20 trial074 ceph-mon[44412]: pgmap v470: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 208 B/s wr, 6 op/s 2026-02-24T09:26:21.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:20 trial159 ceph-mon[44242]: pgmap v470: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 208 B/s wr, 6 op/s 2026-02-24T09:26:22.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:22 trial028 ceph-mon[40371]: pgmap v471: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:26:22.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:22 trial074 ceph-mon[44412]: pgmap v471: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:26:23.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:22 trial159 ceph-mon[44242]: pgmap v471: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:26:24.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:24 trial028 ceph-mon[40371]: pgmap v472: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:26:24.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:24 trial074 ceph-mon[44412]: pgmap v472: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:26:25.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:24 trial159 ceph-mon[44242]: pgmap v472: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:26:26.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:26 trial028 ceph-mon[40371]: pgmap v473: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:26:26.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:26 trial074 ceph-mon[44412]: pgmap v473: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:26:27.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:26 trial159 ceph-mon[44242]: pgmap v473: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:26:28.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:28 trial028 ceph-mon[40371]: pgmap v474: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 87 B/s wr, 6 op/s 2026-02-24T09:26:28.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:28 trial074 ceph-mon[44412]: pgmap v474: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 87 B/s wr, 6 op/s 2026-02-24T09:26:29.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:28 trial159 ceph-mon[44242]: pgmap v474: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 87 B/s wr, 6 op/s 2026-02-24T09:26:30.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:30 trial028 ceph-mon[40371]: pgmap v475: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:26:30.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:30 trial074 ceph-mon[44412]: pgmap v475: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:26:31.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:30 trial159 ceph-mon[44242]: pgmap v475: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:26:32.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:32 trial028 ceph-mon[40371]: pgmap v476: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:26:32.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:32 trial074 ceph-mon[44412]: pgmap v476: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:26:33.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:32 trial159 ceph-mon[44242]: pgmap v476: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:26:34.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:34 trial028 ceph-mon[40371]: pgmap v477: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-24T09:26:34.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:34 trial074 ceph-mon[44412]: pgmap v477: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-24T09:26:35.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:34 trial159 ceph-mon[44242]: pgmap v477: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-24T09:26:36.832 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:36 trial159 ceph-mon[44242]: pgmap v478: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 2.4 KiB/s rd, 5 op/s 2026-02-24T09:26:36.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:36 trial028 ceph-mon[40371]: pgmap v478: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 2.4 KiB/s rd, 5 op/s 2026-02-24T09:26:36.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:36 trial074 ceph-mon[44412]: pgmap v478: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 2.4 KiB/s rd, 5 op/s 2026-02-24T09:26:38.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:38 trial028 ceph-mon[40371]: pgmap v479: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:26:38.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:38 trial074 ceph-mon[44412]: pgmap v479: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:26:39.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:38 trial159 ceph-mon[44242]: pgmap v479: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:26:39.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:39 trial028 ceph-mon[40371]: pgmap v480: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 2.4 KiB/s rd, 5 op/s 2026-02-24T09:26:39.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:39 trial074 ceph-mon[44412]: pgmap v480: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 2.4 KiB/s rd, 5 op/s 2026-02-24T09:26:40.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:39 trial159 ceph-mon[44242]: pgmap v480: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 2.4 KiB/s rd, 5 op/s 2026-02-24T09:26:42.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:42 trial159 ceph-mon[44242]: pgmap v481: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-24T09:26:42.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:42 trial028 ceph-mon[40371]: pgmap v481: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-24T09:26:42.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:42 trial074 ceph-mon[44412]: pgmap v481: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-24T09:26:44.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:44 trial159 ceph-mon[44242]: pgmap v482: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-24T09:26:44.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:44 trial028 ceph-mon[40371]: pgmap v482: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-24T09:26:44.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:44 trial074 ceph-mon[44412]: pgmap v482: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-24T09:26:46.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:46 trial159 ceph-mon[44242]: pgmap v483: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:26:46.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:46 trial028 ceph-mon[40371]: pgmap v483: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:26:46.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:46 trial074 ceph-mon[44412]: pgmap v483: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:26:48.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:48 trial159 ceph-mon[44242]: pgmap v484: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:26:48.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:48 trial028 ceph-mon[40371]: pgmap v484: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:26:48.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:48 trial074 ceph-mon[44412]: pgmap v484: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:26:50.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:50 trial159 ceph-mon[44242]: pgmap v485: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:26:50.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:50 trial028 ceph-mon[40371]: pgmap v485: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:26:50.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:50 trial074 ceph-mon[44412]: pgmap v485: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:26:52.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:52 trial159 ceph-mon[44242]: pgmap v486: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:26:52.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:52 trial028 ceph-mon[40371]: pgmap v486: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:26:52.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:52 trial074 ceph-mon[44412]: pgmap v486: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:26:54.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:54 trial159 ceph-mon[44242]: pgmap v487: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:26:54.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:54 trial028 ceph-mon[40371]: pgmap v487: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:26:54.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:54 trial074 ceph-mon[44412]: pgmap v487: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:26:56.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:56 trial159 ceph-mon[44242]: pgmap v488: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:26:56.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:56 trial028 ceph-mon[40371]: pgmap v488: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:26:56.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:56 trial074 ceph-mon[44412]: pgmap v488: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:26:58.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:26:58 trial159 ceph-mon[44242]: pgmap v489: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:26:58.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:26:58 trial028 ceph-mon[40371]: pgmap v489: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:26:58.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:26:58 trial074 ceph-mon[44412]: pgmap v489: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:27:00.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:00 trial159 ceph-mon[44242]: pgmap v490: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:27:00.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:00 trial028 ceph-mon[40371]: pgmap v490: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:27:00.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:00 trial074 ceph-mon[44412]: pgmap v490: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:27:02.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:02 trial159 ceph-mon[44242]: pgmap v491: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 767 B/s wr, 7 op/s 2026-02-24T09:27:02.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:02 trial028 ceph-mon[40371]: pgmap v491: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 767 B/s wr, 7 op/s 2026-02-24T09:27:02.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:02 trial074 ceph-mon[44412]: pgmap v491: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 767 B/s wr, 7 op/s 2026-02-24T09:27:04.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:04 trial159 ceph-mon[44242]: pgmap v492: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:27:04.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:04 trial028 ceph-mon[40371]: pgmap v492: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:27:04.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:04 trial074 ceph-mon[44412]: pgmap v492: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:27:06.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:06 trial159 ceph-mon[44242]: pgmap v493: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:27:06.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:06 trial028 ceph-mon[40371]: pgmap v493: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:27:06.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:06 trial074 ceph-mon[44412]: pgmap v493: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:27:07.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:07 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:27:07.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:07 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:27:07.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:07 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:27:08.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:08 trial159 ceph-mon[44242]: pgmap v494: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2026-02-24T09:27:08.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:08 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:08 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:08 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:08 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:08 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:08 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:08 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:08 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:08 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:27:08.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:08 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:27:08.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:08 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:08 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:08 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:08 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:08 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:27:08.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:08 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:27:08.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:08 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:27:08.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:08 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:27:08.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:08 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:27:08.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:08 trial028 ceph-mon[40371]: pgmap v494: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2026-02-24T09:27:08.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:08 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:08 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:08 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:08 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:08 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:08 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:08 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:08 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:08 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:27:08.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:08 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:27:08.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:08 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:08 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:08 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:08 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:08 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:27:08.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:08 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:27:08.862 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:08 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:27:08.863 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:08 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:27:08.863 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:08 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:27:08.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:08 trial074 ceph-mon[44412]: pgmap v494: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2026-02-24T09:27:08.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:08 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:08 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:08 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:08 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:08 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:08 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:08 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:08 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:08 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:27:08.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:08 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:27:08.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:08 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:08 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:08 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:08 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-24T09:27:08.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:08 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:27:08.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:08 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:27:08.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:08 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:27:08.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:08 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:27:08.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:08 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:27:09.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:09 trial159 ceph-mon[44242]: Adjusting osd_memory_target on trial074 to 16917M 2026-02-24T09:27:09.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:09 trial159 ceph-mon[44242]: Adjusting osd_memory_target on trial159 to 16917M 2026-02-24T09:27:09.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:09 trial159 ceph-mon[44242]: Adjusting osd_memory_target on trial028 to 16917M 2026-02-24T09:27:09.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:09 trial028 ceph-mon[40371]: Adjusting osd_memory_target on trial074 to 16917M 2026-02-24T09:27:09.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:09 trial028 ceph-mon[40371]: Adjusting osd_memory_target on trial159 to 16917M 2026-02-24T09:27:09.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:09 trial028 ceph-mon[40371]: Adjusting osd_memory_target on trial028 to 16917M 2026-02-24T09:27:09.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:09 trial074 ceph-mon[44412]: Adjusting osd_memory_target on trial074 to 16917M 2026-02-24T09:27:09.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:09 trial074 ceph-mon[44412]: Adjusting osd_memory_target on trial159 to 16917M 2026-02-24T09:27:09.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:09 trial074 ceph-mon[44412]: Adjusting osd_memory_target on trial028 to 16917M 2026-02-24T09:27:10.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:10 trial159 ceph-mon[44242]: pgmap v495: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:27:10.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:10 trial159 ceph-mon[44242]: osdmap e103: 12 total, 12 up, 12 in 2026-02-24T09:27:10.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:10 trial028 ceph-mon[40371]: pgmap v495: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:27:10.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:10 trial028 ceph-mon[40371]: osdmap e103: 12 total, 12 up, 12 in 2026-02-24T09:27:10.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:10 trial074 ceph-mon[44412]: pgmap v495: 97 pgs: 97 active+clean; 14 GiB data, 43 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:27:10.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:10 trial074 ceph-mon[44412]: osdmap e103: 12 total, 12 up, 12 in 2026-02-24T09:27:12.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:12 trial159 ceph-mon[44242]: pgmap v497: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2026-02-24T09:27:12.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:12 trial028 ceph-mon[40371]: pgmap v497: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2026-02-24T09:27:12.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:12 trial074 ceph-mon[44412]: pgmap v497: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2026-02-24T09:27:14.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:14 trial159 ceph-mon[44242]: pgmap v498: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:27:14.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:14 trial028 ceph-mon[40371]: pgmap v498: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:27:14.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:14 trial074 ceph-mon[44412]: pgmap v498: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:27:16.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:16 trial159 ceph-mon[44242]: pgmap v499: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:27:16.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:16 trial159 ceph-mon[44242]: osdmap e104: 12 total, 12 up, 12 in 2026-02-24T09:27:16.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:16 trial028 ceph-mon[40371]: pgmap v499: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:27:16.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:16 trial028 ceph-mon[40371]: osdmap e104: 12 total, 12 up, 12 in 2026-02-24T09:27:16.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:16 trial074 ceph-mon[44412]: pgmap v499: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:27:16.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:16 trial074 ceph-mon[44412]: osdmap e104: 12 total, 12 up, 12 in 2026-02-24T09:27:18.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:18 trial159 ceph-mon[44242]: pgmap v501: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2026-02-24T09:27:18.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:18 trial028 ceph-mon[40371]: pgmap v501: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2026-02-24T09:27:18.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:18 trial074 ceph-mon[44412]: pgmap v501: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2026-02-24T09:27:20.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:20 trial159 ceph-mon[44242]: pgmap v502: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 206 B/s wr, 6 op/s 2026-02-24T09:27:20.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:20 trial028 ceph-mon[40371]: pgmap v502: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 206 B/s wr, 6 op/s 2026-02-24T09:27:20.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:20 trial074 ceph-mon[44412]: pgmap v502: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 206 B/s wr, 6 op/s 2026-02-24T09:27:22.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:22 trial159 ceph-mon[44242]: pgmap v503: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:27:22.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:22 trial028 ceph-mon[40371]: pgmap v503: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:27:22.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:22 trial074 ceph-mon[44412]: pgmap v503: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:27:24.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:24 trial159 ceph-mon[44242]: pgmap v504: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:27:24.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:24 trial028 ceph-mon[40371]: pgmap v504: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:27:24.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:24 trial074 ceph-mon[44412]: pgmap v504: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:27:26.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:26 trial159 ceph-mon[44242]: pgmap v505: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:27:26.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:26 trial028 ceph-mon[40371]: pgmap v505: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:27:26.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:26 trial074 ceph-mon[44412]: pgmap v505: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:27:28.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:28 trial159 ceph-mon[44242]: pgmap v506: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 87 B/s wr, 6 op/s 2026-02-24T09:27:28.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:28 trial028 ceph-mon[40371]: pgmap v506: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 87 B/s wr, 6 op/s 2026-02-24T09:27:28.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:28 trial074 ceph-mon[44412]: pgmap v506: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 87 B/s wr, 6 op/s 2026-02-24T09:27:30.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:30 trial159 ceph-mon[44242]: pgmap v507: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:27:30.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:30 trial028 ceph-mon[40371]: pgmap v507: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:27:30.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:30 trial074 ceph-mon[44412]: pgmap v507: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:27:32.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:32 trial159 ceph-mon[44242]: pgmap v508: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:27:32.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:32 trial028 ceph-mon[40371]: pgmap v508: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:27:32.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:32 trial074 ceph-mon[44412]: pgmap v508: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:27:34.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:34 trial159 ceph-mon[44242]: pgmap v509: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:27:34.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:34 trial028 ceph-mon[40371]: pgmap v509: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:27:34.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:34 trial074 ceph-mon[44412]: pgmap v509: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:27:36.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:36 trial159 ceph-mon[44242]: pgmap v510: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:27:36.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:36 trial028 ceph-mon[40371]: pgmap v510: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:27:36.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:36 trial074 ceph-mon[44412]: pgmap v510: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:27:38.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:38 trial159 ceph-mon[44242]: pgmap v511: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:27:38.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:38 trial028 ceph-mon[40371]: pgmap v511: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:27:38.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:38 trial074 ceph-mon[44412]: pgmap v511: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:27:40.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:40 trial159 ceph-mon[44242]: pgmap v512: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:27:40.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:40 trial028 ceph-mon[40371]: pgmap v512: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:27:40.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:40 trial074 ceph-mon[44412]: pgmap v512: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:27:42.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:42 trial159 ceph-mon[44242]: pgmap v513: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:27:42.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:42 trial028 ceph-mon[40371]: pgmap v513: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:27:42.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:42 trial074 ceph-mon[44412]: pgmap v513: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:27:44.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:44 trial159 ceph-mon[44242]: pgmap v514: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:27:44.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:44 trial028 ceph-mon[40371]: pgmap v514: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:27:44.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:44 trial074 ceph-mon[44412]: pgmap v514: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:27:46.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:46 trial159 ceph-mon[44242]: pgmap v515: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:27:46.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:46 trial028 ceph-mon[40371]: pgmap v515: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:27:46.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:46 trial074 ceph-mon[44412]: pgmap v515: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:27:48.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:48 trial159 ceph-mon[44242]: pgmap v516: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:27:48.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:48 trial028 ceph-mon[40371]: pgmap v516: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:27:48.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:48 trial074 ceph-mon[44412]: pgmap v516: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:27:50.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:50 trial159 ceph-mon[44242]: pgmap v517: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:27:50.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:50 trial028 ceph-mon[40371]: pgmap v517: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:27:50.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:50 trial074 ceph-mon[44412]: pgmap v517: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:27:52.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:52 trial159 ceph-mon[44242]: pgmap v518: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:27:52.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:52 trial028 ceph-mon[40371]: pgmap v518: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:27:52.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:52 trial074 ceph-mon[44412]: pgmap v518: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:27:54.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:54 trial028 ceph-mon[40371]: pgmap v519: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:27:54.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:54 trial074 ceph-mon[44412]: pgmap v519: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:27:55.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:54 trial159 ceph-mon[44242]: pgmap v519: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:27:56.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:56 trial028 ceph-mon[40371]: pgmap v520: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:27:56.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:56 trial074 ceph-mon[44412]: pgmap v520: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:27:57.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:56 trial159 ceph-mon[44242]: pgmap v520: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:27:58.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:27:58 trial028 ceph-mon[40371]: pgmap v521: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:27:58.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:27:58 trial074 ceph-mon[44412]: pgmap v521: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:27:59.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:27:58 trial159 ceph-mon[44242]: pgmap v521: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:28:00.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:00 trial028 ceph-mon[40371]: pgmap v522: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:28:00.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:00 trial074 ceph-mon[44412]: pgmap v522: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:28:01.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:00 trial159 ceph-mon[44242]: pgmap v522: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:28:02.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:02 trial028 ceph-mon[40371]: pgmap v523: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 597 B/s wr, 7 op/s 2026-02-24T09:28:02.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:02 trial074 ceph-mon[44412]: pgmap v523: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 597 B/s wr, 7 op/s 2026-02-24T09:28:03.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:02 trial159 ceph-mon[44242]: pgmap v523: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 597 B/s wr, 7 op/s 2026-02-24T09:28:04.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:04 trial028 ceph-mon[40371]: pgmap v524: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:28:04.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:04 trial074 ceph-mon[44412]: pgmap v524: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:28:05.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:04 trial159 ceph-mon[44242]: pgmap v524: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:28:06.831 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:06 trial159 ceph-mon[44242]: pgmap v525: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:28:06.859 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:06 trial028 ceph-mon[40371]: pgmap v525: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:28:06.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:06 trial074 ceph-mon[44412]: pgmap v525: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:28:08.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:08 trial028 ceph-mon[40371]: pgmap v526: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2026-02-24T09:28:08.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:08 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:28:08.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:08 trial074 ceph-mon[44412]: pgmap v526: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2026-02-24T09:28:08.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:08 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:28:09.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:08 trial159 ceph-mon[44242]: pgmap v526: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2026-02-24T09:28:09.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:08 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:28:09.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:09 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:28:09.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:09 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:28:09.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:09 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:28:09.861 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:09 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:28:09.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:09 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:28:09.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:09 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:28:09.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:09 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:28:09.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:09 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:28:10.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:09 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:28:10.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:09 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:28:10.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:09 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:28:10.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:09 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:28:10.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:10 trial028 ceph-mon[40371]: pgmap v527: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:28:10.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:10 trial028 ceph-mon[40371]: osdmap e105: 12 total, 12 up, 12 in 2026-02-24T09:28:10.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:10 trial074 ceph-mon[44412]: pgmap v527: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:28:10.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:10 trial074 ceph-mon[44412]: osdmap e105: 12 total, 12 up, 12 in 2026-02-24T09:28:11.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:10 trial159 ceph-mon[44242]: pgmap v527: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:28:11.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:10 trial159 ceph-mon[44242]: osdmap e105: 12 total, 12 up, 12 in 2026-02-24T09:28:12.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:12 trial028 ceph-mon[40371]: pgmap v529: 97 pgs: 2 active+clean+snaptrim, 95 active+clean; 6.7 GiB data, 26 GiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2026-02-24T09:28:12.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:12 trial074 ceph-mon[44412]: pgmap v529: 97 pgs: 2 active+clean+snaptrim, 95 active+clean; 6.7 GiB data, 26 GiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2026-02-24T09:28:13.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:12 trial159 ceph-mon[44242]: pgmap v529: 97 pgs: 2 active+clean+snaptrim, 95 active+clean; 6.7 GiB data, 26 GiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2026-02-24T09:28:14.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:14 trial028 ceph-mon[40371]: pgmap v530: 97 pgs: 2 active+clean+snaptrim, 95 active+clean; 2.8 GiB data, 14 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:28:14.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:14 trial074 ceph-mon[44412]: pgmap v530: 97 pgs: 2 active+clean+snaptrim, 95 active+clean; 2.8 GiB data, 14 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:28:15.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:14 trial159 ceph-mon[44242]: pgmap v530: 97 pgs: 2 active+clean+snaptrim, 95 active+clean; 2.8 GiB data, 14 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:28:16.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:16 trial028 ceph-mon[40371]: pgmap v531: 97 pgs: 97 active+clean; 2.2 MiB data, 3.5 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:28:16.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:16 trial028 ceph-mon[40371]: osdmap e106: 12 total, 12 up, 12 in 2026-02-24T09:28:16.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:16 trial074 ceph-mon[44412]: pgmap v531: 97 pgs: 97 active+clean; 2.2 MiB data, 3.5 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:28:16.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:16 trial074 ceph-mon[44412]: osdmap e106: 12 total, 12 up, 12 in 2026-02-24T09:28:17.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:16 trial159 ceph-mon[44242]: pgmap v531: 97 pgs: 97 active+clean; 2.2 MiB data, 3.5 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:28:17.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:16 trial159 ceph-mon[44242]: osdmap e106: 12 total, 12 up, 12 in 2026-02-24T09:28:18.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:18 trial028 ceph-mon[40371]: pgmap v533: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2026-02-24T09:28:18.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:18 trial074 ceph-mon[44412]: pgmap v533: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2026-02-24T09:28:19.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:18 trial159 ceph-mon[44242]: pgmap v533: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2026-02-24T09:28:20.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:20 trial028 ceph-mon[40371]: pgmap v534: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 213 B/s wr, 6 op/s 2026-02-24T09:28:20.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:20 trial074 ceph-mon[44412]: pgmap v534: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 213 B/s wr, 6 op/s 2026-02-24T09:28:21.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:20 trial159 ceph-mon[44242]: pgmap v534: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 213 B/s wr, 6 op/s 2026-02-24T09:28:22.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:22 trial028 ceph-mon[40371]: pgmap v535: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:28:22.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:22 trial074 ceph-mon[44412]: pgmap v535: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:28:23.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:22 trial159 ceph-mon[44242]: pgmap v535: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:28:24.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:24 trial028 ceph-mon[40371]: pgmap v536: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:28:24.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:24 trial074 ceph-mon[44412]: pgmap v536: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:28:25.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:24 trial159 ceph-mon[44242]: pgmap v536: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:28:26.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:26 trial028 ceph-mon[40371]: pgmap v537: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:28:26.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:26 trial074 ceph-mon[44412]: pgmap v537: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:28:27.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:26 trial159 ceph-mon[44242]: pgmap v537: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:28:28.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:28 trial028 ceph-mon[40371]: pgmap v538: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 87 B/s wr, 6 op/s 2026-02-24T09:28:28.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:28 trial074 ceph-mon[44412]: pgmap v538: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 87 B/s wr, 6 op/s 2026-02-24T09:28:29.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:28 trial159 ceph-mon[44242]: pgmap v538: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 87 B/s wr, 6 op/s 2026-02-24T09:28:30.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:30 trial028 ceph-mon[40371]: pgmap v539: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:28:30.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:30 trial074 ceph-mon[44412]: pgmap v539: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:28:31.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:30 trial159 ceph-mon[44242]: pgmap v539: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:28:32.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:32 trial028 ceph-mon[40371]: pgmap v540: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:28:32.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:32 trial074 ceph-mon[44412]: pgmap v540: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:28:33.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:32 trial159 ceph-mon[44242]: pgmap v540: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:28:34.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:34 trial028 ceph-mon[40371]: pgmap v541: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:28:34.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:34 trial074 ceph-mon[44412]: pgmap v541: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:28:35.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:34 trial159 ceph-mon[44242]: pgmap v541: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:28:36.832 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:36 trial159 ceph-mon[44242]: pgmap v542: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:28:36.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:36 trial028 ceph-mon[40371]: pgmap v542: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:28:36.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:36 trial074 ceph-mon[44412]: pgmap v542: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:28:38.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:38 trial028 ceph-mon[40371]: pgmap v543: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:28:38.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:38 trial074 ceph-mon[44412]: pgmap v543: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:28:39.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:38 trial159 ceph-mon[44242]: pgmap v543: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:28:40.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:40 trial028 ceph-mon[40371]: pgmap v544: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:28:40.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:40 trial074 ceph-mon[44412]: pgmap v544: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:28:41.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:40 trial159 ceph-mon[44242]: pgmap v544: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:28:42.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:42 trial028 ceph-mon[40371]: pgmap v545: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:28:42.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:42 trial074 ceph-mon[44412]: pgmap v545: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:28:43.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:42 trial159 ceph-mon[44242]: pgmap v545: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:28:44.859 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:44 trial028 ceph-mon[40371]: pgmap v546: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:28:44.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:44 trial074 ceph-mon[44412]: pgmap v546: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:28:45.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:44 trial159 ceph-mon[44242]: pgmap v546: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:28:46.859 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:46 trial028 ceph-mon[40371]: pgmap v547: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:28:46.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:46 trial074 ceph-mon[44412]: pgmap v547: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:28:47.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:46 trial159 ceph-mon[44242]: pgmap v547: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:28:48.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:48 trial028 ceph-mon[40371]: pgmap v548: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:28:48.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:48 trial074 ceph-mon[44412]: pgmap v548: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:28:49.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:48 trial159 ceph-mon[44242]: pgmap v548: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:28:49.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:49 trial028 ceph-mon[40371]: pgmap v549: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:28:49.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:49 trial074 ceph-mon[44412]: pgmap v549: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:28:50.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:49 trial159 ceph-mon[44242]: pgmap v549: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:28:52.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:52 trial159 ceph-mon[44242]: pgmap v550: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:28:52.859 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:52 trial028 ceph-mon[40371]: pgmap v550: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:28:52.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:52 trial074 ceph-mon[44412]: pgmap v550: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:28:54.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:54 trial159 ceph-mon[44242]: pgmap v551: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:28:54.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:54 trial028 ceph-mon[40371]: pgmap v551: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:28:54.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:54 trial074 ceph-mon[44412]: pgmap v551: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:28:56.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:56 trial159 ceph-mon[44242]: pgmap v552: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:28:56.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:56 trial028 ceph-mon[40371]: pgmap v552: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:28:56.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:56 trial074 ceph-mon[44412]: pgmap v552: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:28:58.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:28:58 trial159 ceph-mon[44242]: pgmap v553: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:28:58.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:28:58 trial028 ceph-mon[40371]: pgmap v553: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:28:58.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:28:58 trial074 ceph-mon[44412]: pgmap v553: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:29:00.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:00 trial159 ceph-mon[44242]: pgmap v554: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:29:00.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:00 trial028 ceph-mon[40371]: pgmap v554: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:29:00.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:00 trial074 ceph-mon[44412]: pgmap v554: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:29:02.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:02 trial159 ceph-mon[44242]: pgmap v555: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 597 B/s wr, 7 op/s 2026-02-24T09:29:02.859 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:02 trial028 ceph-mon[40371]: pgmap v555: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 597 B/s wr, 7 op/s 2026-02-24T09:29:02.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:02 trial074 ceph-mon[44412]: pgmap v555: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 597 B/s wr, 7 op/s 2026-02-24T09:29:04.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:04 trial159 ceph-mon[44242]: pgmap v556: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:29:04.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:04 trial028 ceph-mon[40371]: pgmap v556: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:29:04.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:04 trial074 ceph-mon[44412]: pgmap v556: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:29:06.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:06 trial159 ceph-mon[44242]: pgmap v557: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:29:06.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:06 trial028 ceph-mon[40371]: pgmap v557: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:29:06.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:06 trial074 ceph-mon[44412]: pgmap v557: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:29:08.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:08 trial159 ceph-mon[44242]: pgmap v558: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2026-02-24T09:29:08.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:08 trial028 ceph-mon[40371]: pgmap v558: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2026-02-24T09:29:08.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:08 trial074 ceph-mon[44412]: pgmap v558: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2026-02-24T09:29:09.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:09 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:29:09.624 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:09 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:29:09.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:09 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:29:10.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:10 trial159 ceph-mon[44242]: pgmap v559: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:29:10.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:10 trial159 ceph-mon[44242]: osdmap e107: 12 total, 12 up, 12 in 2026-02-24T09:29:10.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:10 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:29:10.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:10 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:29:10.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:10 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:29:10.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:10 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:29:10.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:10 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:29:10.781 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:10 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:29:10.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:10 trial028 ceph-mon[40371]: pgmap v559: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:29:10.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:10 trial028 ceph-mon[40371]: osdmap e107: 12 total, 12 up, 12 in 2026-02-24T09:29:10.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:10 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:29:10.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:10 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:29:10.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:10 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:29:10.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:10 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:29:10.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:10 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:29:10.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:10 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:29:10.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:10 trial074 ceph-mon[44412]: pgmap v559: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:29:10.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:10 trial074 ceph-mon[44412]: osdmap e107: 12 total, 12 up, 12 in 2026-02-24T09:29:10.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:10 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:29:10.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:10 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:29:10.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:10 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:29:10.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:10 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:29:10.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:10 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:29:10.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:10 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:29:11.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:11 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:29:11.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:11 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:29:11.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:11 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:29:11.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:11 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:29:11.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:11 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:29:11.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:11 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:29:11.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:11 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:29:11.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:11 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:29:11.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:11 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:29:11.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:11 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:29:11.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:11 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:29:11.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:11 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:29:12.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:12 trial159 ceph-mon[44242]: pgmap v561: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2026-02-24T09:29:12.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:12 trial028 ceph-mon[40371]: pgmap v561: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2026-02-24T09:29:12.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:12 trial074 ceph-mon[44412]: pgmap v561: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2026-02-24T09:29:14.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:14 trial159 ceph-mon[44242]: pgmap v562: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:29:14.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:14 trial028 ceph-mon[40371]: pgmap v562: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:29:14.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:14 trial074 ceph-mon[44412]: pgmap v562: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:29:16.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:16 trial159 ceph-mon[44242]: pgmap v563: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:29:16.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:16 trial159 ceph-mon[44242]: osdmap e108: 12 total, 12 up, 12 in 2026-02-24T09:29:16.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:16 trial028 ceph-mon[40371]: pgmap v563: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:29:16.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:16 trial028 ceph-mon[40371]: osdmap e108: 12 total, 12 up, 12 in 2026-02-24T09:29:16.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:16 trial074 ceph-mon[44412]: pgmap v563: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:29:16.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:16 trial074 ceph-mon[44412]: osdmap e108: 12 total, 12 up, 12 in 2026-02-24T09:29:18.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:18 trial159 ceph-mon[44242]: pgmap v565: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2026-02-24T09:29:18.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:18 trial028 ceph-mon[40371]: pgmap v565: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2026-02-24T09:29:18.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:18 trial074 ceph-mon[44412]: pgmap v565: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2026-02-24T09:29:20.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:20 trial159 ceph-mon[44242]: pgmap v566: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 206 B/s wr, 6 op/s 2026-02-24T09:29:20.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:20 trial028 ceph-mon[40371]: pgmap v566: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 206 B/s wr, 6 op/s 2026-02-24T09:29:20.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:20 trial074 ceph-mon[44412]: pgmap v566: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 206 B/s wr, 6 op/s 2026-02-24T09:29:22.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:22 trial159 ceph-mon[44242]: pgmap v567: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:29:22.859 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:22 trial028 ceph-mon[40371]: pgmap v567: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:29:22.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:22 trial074 ceph-mon[44412]: pgmap v567: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:29:24.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:24 trial159 ceph-mon[44242]: pgmap v568: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:29:24.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:24 trial028 ceph-mon[40371]: pgmap v568: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:29:24.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:24 trial074 ceph-mon[44412]: pgmap v568: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:29:26.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:26 trial159 ceph-mon[44242]: pgmap v569: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:29:26.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:26 trial028 ceph-mon[40371]: pgmap v569: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:29:26.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:26 trial074 ceph-mon[44412]: pgmap v569: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:29:28.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:28 trial159 ceph-mon[44242]: pgmap v570: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 87 B/s wr, 6 op/s 2026-02-24T09:29:28.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:28 trial028 ceph-mon[40371]: pgmap v570: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 87 B/s wr, 6 op/s 2026-02-24T09:29:28.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:28 trial074 ceph-mon[44412]: pgmap v570: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 87 B/s wr, 6 op/s 2026-02-24T09:29:30.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:30 trial159 ceph-mon[44242]: pgmap v571: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:29:30.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:30 trial028 ceph-mon[40371]: pgmap v571: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:29:30.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:30 trial074 ceph-mon[44412]: pgmap v571: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:29:32.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:32 trial159 ceph-mon[44242]: pgmap v572: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:29:32.859 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:32 trial028 ceph-mon[40371]: pgmap v572: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:29:32.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:32 trial074 ceph-mon[44412]: pgmap v572: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:29:34.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:34 trial159 ceph-mon[44242]: pgmap v573: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:29:34.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:34 trial028 ceph-mon[40371]: pgmap v573: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:29:34.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:34 trial074 ceph-mon[44412]: pgmap v573: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:29:36.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:36 trial159 ceph-mon[44242]: pgmap v574: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:29:36.859 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:36 trial028 ceph-mon[40371]: pgmap v574: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:29:36.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:36 trial074 ceph-mon[44412]: pgmap v574: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:29:38.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:38 trial159 ceph-mon[44242]: pgmap v575: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:29:38.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:38 trial028 ceph-mon[40371]: pgmap v575: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:29:38.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:38 trial074 ceph-mon[44412]: pgmap v575: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:29:40.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:40 trial028 ceph-mon[40371]: pgmap v576: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:29:40.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:40 trial074 ceph-mon[44412]: pgmap v576: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:29:41.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:40 trial159 ceph-mon[44242]: pgmap v576: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:29:42.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:42 trial028 ceph-mon[40371]: pgmap v577: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:29:42.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:42 trial074 ceph-mon[44412]: pgmap v577: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:29:43.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:42 trial159 ceph-mon[44242]: pgmap v577: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:29:44.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:44 trial028 ceph-mon[40371]: pgmap v578: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:29:44.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:44 trial074 ceph-mon[44412]: pgmap v578: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:29:45.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:44 trial159 ceph-mon[44242]: pgmap v578: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:29:46.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:46 trial028 ceph-mon[40371]: pgmap v579: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:29:46.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:46 trial074 ceph-mon[44412]: pgmap v579: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:29:47.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:46 trial159 ceph-mon[44242]: pgmap v579: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:29:48.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:48 trial028 ceph-mon[40371]: pgmap v580: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:29:48.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:48 trial074 ceph-mon[44412]: pgmap v580: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:29:49.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:48 trial159 ceph-mon[44242]: pgmap v580: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:29:50.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:50 trial028 ceph-mon[40371]: pgmap v581: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:29:50.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:50 trial074 ceph-mon[44412]: pgmap v581: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:29:51.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:50 trial159 ceph-mon[44242]: pgmap v581: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:29:52.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:52 trial028 ceph-mon[40371]: pgmap v582: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:29:52.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:52 trial074 ceph-mon[44412]: pgmap v582: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:29:53.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:52 trial159 ceph-mon[44242]: pgmap v582: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:29:54.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:54 trial028 ceph-mon[40371]: pgmap v583: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:29:54.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:54 trial074 ceph-mon[44412]: pgmap v583: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:29:55.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:54 trial159 ceph-mon[44242]: pgmap v583: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:29:56.859 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:56 trial028 ceph-mon[40371]: pgmap v584: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:29:56.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:56 trial074 ceph-mon[44412]: pgmap v584: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:29:57.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:56 trial159 ceph-mon[44242]: pgmap v584: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:29:58.859 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:29:58 trial028 ceph-mon[40371]: pgmap v585: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:29:58.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:29:58 trial074 ceph-mon[44412]: pgmap v585: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:29:59.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:29:58 trial159 ceph-mon[44242]: pgmap v585: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:30:00.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:00 trial028 ceph-mon[40371]: pgmap v586: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:30:00.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:00 trial028 ceph-mon[40371]: overall HEALTH_OK 2026-02-24T09:30:00.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:00 trial074 ceph-mon[44412]: pgmap v586: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:30:00.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:00 trial074 ceph-mon[44412]: overall HEALTH_OK 2026-02-24T09:30:01.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:00 trial159 ceph-mon[44242]: pgmap v586: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:30:01.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:00 trial159 ceph-mon[44242]: overall HEALTH_OK 2026-02-24T09:30:02.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:02 trial028 ceph-mon[40371]: pgmap v587: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 597 B/s wr, 7 op/s 2026-02-24T09:30:02.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:02 trial074 ceph-mon[44412]: pgmap v587: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 597 B/s wr, 7 op/s 2026-02-24T09:30:03.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:02 trial159 ceph-mon[44242]: pgmap v587: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 597 B/s wr, 7 op/s 2026-02-24T09:30:04.859 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:04 trial028 ceph-mon[40371]: pgmap v588: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:30:04.874 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:04 trial074 ceph-mon[44412]: pgmap v588: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:30:05.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:04 trial159 ceph-mon[44242]: pgmap v588: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:30:06.831 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:06 trial159 ceph-mon[44242]: pgmap v589: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:30:06.859 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:06 trial028 ceph-mon[40371]: pgmap v589: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:30:06.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:06 trial074 ceph-mon[44412]: pgmap v589: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:30:08.859 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:08 trial028 ceph-mon[40371]: pgmap v590: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2026-02-24T09:30:08.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:08 trial074 ceph-mon[44412]: pgmap v590: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2026-02-24T09:30:09.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:08 trial159 ceph-mon[44242]: pgmap v590: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2026-02-24T09:30:10.859 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:10 trial028 ceph-mon[40371]: pgmap v591: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:30:10.859 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:10 trial028 ceph-mon[40371]: osdmap e109: 12 total, 12 up, 12 in 2026-02-24T09:30:10.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:10 trial074 ceph-mon[44412]: pgmap v591: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:30:10.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:10 trial074 ceph-mon[44412]: osdmap e109: 12 total, 12 up, 12 in 2026-02-24T09:30:11.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:10 trial159 ceph-mon[44242]: pgmap v591: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2026-02-24T09:30:11.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:10 trial159 ceph-mon[44242]: osdmap e109: 12 total, 12 up, 12 in 2026-02-24T09:30:11.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:11 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:30:11.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:11 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:30:11.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:11 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:30:11.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:11 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:30:11.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:11 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:30:11.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:11 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:30:11.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:11 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:30:11.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:11 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:30:11.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:11 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:30:11.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:11 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:30:12.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:11 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:30:12.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:11 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:30:12.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:11 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:30:12.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:11 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:30:12.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:11 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:30:12.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:12 trial028 ceph-mon[40371]: pgmap v593: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2026-02-24T09:30:12.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:12 trial074 ceph-mon[44412]: pgmap v593: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2026-02-24T09:30:13.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:12 trial159 ceph-mon[44242]: pgmap v593: 97 pgs: 97 active+clean; 2.2 MiB data, 546 MiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2026-02-24T09:30:14.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:14 trial028 ceph-mon[40371]: pgmap v594: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:30:14.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:14 trial074 ceph-mon[44412]: pgmap v594: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:30:15.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:14 trial159 ceph-mon[44242]: pgmap v594: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:30:16.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:16 trial028 ceph-mon[40371]: pgmap v595: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:30:16.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:16 trial028 ceph-mon[40371]: osdmap e110: 12 total, 12 up, 12 in 2026-02-24T09:30:16.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:16 trial074 ceph-mon[44412]: pgmap v595: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:30:16.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:16 trial074 ceph-mon[44412]: osdmap e110: 12 total, 12 up, 12 in 2026-02-24T09:30:17.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:16 trial159 ceph-mon[44242]: pgmap v595: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 204 B/s wr, 6 op/s 2026-02-24T09:30:17.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:16 trial159 ceph-mon[44242]: osdmap e110: 12 total, 12 up, 12 in 2026-02-24T09:30:18.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:18 trial028 ceph-mon[40371]: pgmap v597: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2026-02-24T09:30:18.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:18 trial074 ceph-mon[44412]: pgmap v597: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2026-02-24T09:30:19.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:18 trial159 ceph-mon[44242]: pgmap v597: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2026-02-24T09:30:20.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:20 trial028 ceph-mon[40371]: pgmap v598: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 207 B/s wr, 6 op/s 2026-02-24T09:30:20.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:20 trial074 ceph-mon[44412]: pgmap v598: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 207 B/s wr, 6 op/s 2026-02-24T09:30:21.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:20 trial159 ceph-mon[44242]: pgmap v598: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 207 B/s wr, 6 op/s 2026-02-24T09:30:22.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:22 trial028 ceph-mon[40371]: pgmap v599: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:30:22.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:22 trial074 ceph-mon[44412]: pgmap v599: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:30:23.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:22 trial159 ceph-mon[44242]: pgmap v599: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:30:24.859 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:24 trial028 ceph-mon[40371]: pgmap v600: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:30:24.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:24 trial074 ceph-mon[44412]: pgmap v600: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:30:25.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:24 trial159 ceph-mon[44242]: pgmap v600: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:30:26.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:26 trial028 ceph-mon[40371]: pgmap v601: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:30:26.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:26 trial074 ceph-mon[44412]: pgmap v601: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:30:27.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:26 trial159 ceph-mon[44242]: pgmap v601: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2026-02-24T09:30:28.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:28 trial028 ceph-mon[40371]: pgmap v602: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 87 B/s wr, 6 op/s 2026-02-24T09:30:28.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:28 trial074 ceph-mon[44412]: pgmap v602: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 87 B/s wr, 6 op/s 2026-02-24T09:30:29.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:28 trial159 ceph-mon[44242]: pgmap v602: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 87 B/s wr, 6 op/s 2026-02-24T09:30:30.859 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:30 trial028 ceph-mon[40371]: pgmap v603: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:30:30.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:30 trial074 ceph-mon[44412]: pgmap v603: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:30:31.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:30 trial159 ceph-mon[44242]: pgmap v603: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:30:32.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:32 trial028 ceph-mon[40371]: pgmap v604: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:30:32.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:32 trial074 ceph-mon[44412]: pgmap v604: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:30:33.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:32 trial159 ceph-mon[44242]: pgmap v604: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:30:34.859 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:34 trial028 ceph-mon[40371]: pgmap v605: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:30:34.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:34 trial074 ceph-mon[44412]: pgmap v605: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:30:35.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:34 trial159 ceph-mon[44242]: pgmap v605: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:30:36.859 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:36 trial028 ceph-mon[40371]: pgmap v606: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:30:36.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:36 trial074 ceph-mon[44412]: pgmap v606: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:30:37.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:36 trial159 ceph-mon[44242]: pgmap v606: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:30:38.859 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:38 trial028 ceph-mon[40371]: pgmap v607: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:30:38.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:38 trial074 ceph-mon[44412]: pgmap v607: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:30:39.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:38 trial159 ceph-mon[44242]: pgmap v607: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:30:40.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:40 trial028 ceph-mon[40371]: pgmap v608: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:30:40.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:40 trial074 ceph-mon[44412]: pgmap v608: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:30:41.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:40 trial159 ceph-mon[44242]: pgmap v608: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:30:41.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:41 trial028 ceph-mon[40371]: pgmap v609: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:30:41.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:41 trial074 ceph-mon[44412]: pgmap v609: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:30:42.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:41 trial159 ceph-mon[44242]: pgmap v609: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:30:44.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:44 trial159 ceph-mon[44242]: pgmap v610: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:30:44.859 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:44 trial028 ceph-mon[40371]: pgmap v610: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:30:44.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:44 trial074 ceph-mon[44412]: pgmap v610: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:30:46.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:46 trial159 ceph-mon[44242]: pgmap v611: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:30:46.859 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:46 trial028 ceph-mon[40371]: pgmap v611: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:30:46.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:46 trial074 ceph-mon[44412]: pgmap v611: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:30:48.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:48 trial159 ceph-mon[44242]: pgmap v612: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:30:48.859 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:48 trial028 ceph-mon[40371]: pgmap v612: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:30:48.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:48 trial074 ceph-mon[44412]: pgmap v612: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:30:50.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:50 trial159 ceph-mon[44242]: pgmap v613: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:30:50.859 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:50 trial028 ceph-mon[40371]: pgmap v613: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:30:50.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:50 trial074 ceph-mon[44412]: pgmap v613: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:30:52.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:52 trial159 ceph-mon[44242]: pgmap v614: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:30:52.859 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:52 trial028 ceph-mon[40371]: pgmap v614: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:30:52.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:52 trial074 ceph-mon[44412]: pgmap v614: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-24T09:30:54.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:54 trial159 ceph-mon[44242]: pgmap v615: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:30:54.859 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:54 trial028 ceph-mon[40371]: pgmap v615: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:30:54.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:54 trial074 ceph-mon[44412]: pgmap v615: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:30:56.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:56 trial159 ceph-mon[44242]: pgmap v616: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:30:56.859 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:56 trial028 ceph-mon[40371]: pgmap v616: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:30:56.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:56 trial074 ceph-mon[44412]: pgmap v616: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:30:58.528 DEBUG:teuthology.orchestra.run.trial028:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2026-02-24T09:30:58.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.646+0000 7f7336483640 1 -- 10.20.193.28:0/9451844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7330113950 msgr2=0x7f7330113d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:30:58.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.646+0000 7f7336483640 1 --2- 10.20.193.28:0/9451844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7330113950 0x7f7330113d20 secure :-1 s=READY pgs=492 gs=1 cs=0 l=1 c_cookie=3322774624766777314 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7320009950 tx=0x7f732002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:30:58.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.647+0000 7f7336483640 1 -- 10.20.193.28:0/9451844 shutdown_connections 2026-02-24T09:30:58.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.647+0000 7f7336483640 1 --2- 10.20.193.28:0/9451844 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7330119b40 0x7f733017a510 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:58.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.647+0000 7f7336483640 1 --2- 10.20.193.28:0/9451844 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7330114340 0x7f7330119390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:58.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.647+0000 7f7336483640 1 --2- 10.20.193.28:0/9451844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7330113950 0x7f7330113d20 unknown :-1 s=CLOSED pgs=492 gs=1 cs=0 l=1 c_cookie=3322774624766777314 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:58.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.647+0000 7f7336483640 1 -- 10.20.193.28:0/9451844 >> 10.20.193.28:0/9451844 conn(0x7f73300619a0 msgr2=0x7f7330061da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:30:58.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.647+0000 7f7336483640 1 -- 10.20.193.28:0/9451844 shutdown_connections 2026-02-24T09:30:58.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.647+0000 7f7336483640 1 -- 10.20.193.28:0/9451844 wait complete. 2026-02-24T09:30:58.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.647+0000 7f7336483640 1 Processor -- start 2026-02-24T09:30:58.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.647+0000 7f7336483640 1 -- start start 2026-02-24T09:30:58.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.648+0000 7f7336483640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7330113950 0x7f73301223c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:30:58.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.648+0000 7f7336483640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7330114340 0x7f7330122900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:30:58.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.648+0000 7f7336483640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7330119b40 0x7f7330127c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:30:58.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.648+0000 7f7336483640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f73301282a0 con 0x7f7330113950 2026-02-24T09:30:58.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.648+0000 7f7336483640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f7330128410 con 0x7f7330114340 2026-02-24T09:30:58.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.648+0000 7f7336483640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f73301285d0 con 0x7f7330119b40 2026-02-24T09:30:58.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.648+0000 7f7335481640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7330113950 0x7f73301223c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:30:58.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.648+0000 7f7335481640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7330113950 0x7f73301223c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39626/0 (socket says 10.20.193.28:39626) 2026-02-24T09:30:58.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.648+0000 7f7335481640 1 -- 10.20.193.28:0/2308338703 learned_addr learned my addr 10.20.193.28:0/2308338703 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:30:58.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.648+0000 7f7335c82640 1 --2- 10.20.193.28:0/2308338703 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7330119b40 0x7f7330127c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:30:58.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.648+0000 7f7335481640 1 -- 10.20.193.28:0/2308338703 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7330119b40 msgr2=0x7f7330127c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:30:58.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.648+0000 7f7334c80640 1 --2- 10.20.193.28:0/2308338703 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7330114340 0x7f7330122900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:30:58.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.648+0000 7f7335481640 1 --2- 10.20.193.28:0/2308338703 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7330119b40 0x7f7330127c80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:58.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.648+0000 7f7335481640 1 -- 10.20.193.28:0/2308338703 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7330114340 msgr2=0x7f7330122900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:30:58.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.648+0000 7f7335481640 1 --2- 10.20.193.28:0/2308338703 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7330114340 0x7f7330122900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:58.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.648+0000 7f7335481640 1 -- 10.20.193.28:0/2308338703 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7320009570 con 0x7f7330113950 2026-02-24T09:30:58.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.648+0000 7f7335c82640 1 --2- 10.20.193.28:0/2308338703 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7330119b40 0x7f7330127c80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:30:58.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.648+0000 7f7334c80640 1 --2- 10.20.193.28:0/2308338703 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7330114340 0x7f7330122900 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:30:58.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.648+0000 7f7335481640 1 --2- 10.20.193.28:0/2308338703 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7330113950 0x7f73301223c0 secure :-1 s=READY pgs=493 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73200098a0 tx=0x7f73200028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:30:58.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.649+0000 7f731e7fc640 1 -- 10.20.193.28:0/2308338703 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f732003d070 con 0x7f7330113950 2026-02-24T09:30:58.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.649+0000 7f731e7fc640 1 -- 10.20.193.28:0/2308338703 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7320002a70 con 0x7f7330113950 2026-02-24T09:30:58.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.649+0000 7f731e7fc640 1 -- 10.20.193.28:0/2308338703 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7320041890 con 0x7f7330113950 2026-02-24T09:30:58.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.649+0000 7f7336483640 1 -- 10.20.193.28:0/2308338703 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7330128850 con 0x7f7330113950 2026-02-24T09:30:58.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.649+0000 7f7336483640 1 -- 10.20.193.28:0/2308338703 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7330168e10 con 0x7f7330113950 2026-02-24T09:30:58.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.649+0000 7f72fffff640 1 -- 10.20.193.28:0/2308338703 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7330064e20 con 0x7f7330113950 2026-02-24T09:30:58.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.651+0000 7f731e7fc640 1 -- 10.20.193.28:0/2308338703 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7f7320041a20 con 0x7f7330113950 2026-02-24T09:30:58.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.653+0000 7f731e7fc640 1 --2- 10.20.193.28:0/2308338703 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f730c0b58d0 0x7f730c0d5d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:30:58.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.653+0000 7f731e7fc640 1 -- 10.20.193.28:0/2308338703 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 8513+0+0 (secure 0 0 0) 0x7f732010b7f0 con 0x7f7330113950 2026-02-24T09:30:58.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.653+0000 7f7334c80640 1 --2- 10.20.193.28:0/2308338703 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f730c0b58d0 0x7f730c0d5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:30:58.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.653+0000 7f731e7fc640 1 -- 10.20.193.28:0/2308338703 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f732010bc70 con 0x7f7330113950 2026-02-24T09:30:58.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.654+0000 7f7334c80640 1 --2- 10.20.193.28:0/2308338703 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f730c0b58d0 0x7f730c0d5d80 secure :-1 s=READY pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7330128d10 tx=0x7f7324005f00 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:30:58.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:58 trial159 ceph-mon[44242]: pgmap v617: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:30:58.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.784+0000 7f72fffff640 1 -- 10.20.193.28:0/2308338703 --> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f73301234d0 con 0x7f730c0b58d0 2026-02-24T09:30:58.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.789+0000 7f731e7fc640 1 -- 10.20.193.28:0/2308338703 <== mgr.14223 v2:10.20.193.28:6800/906910473 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f73301234d0 con 0x7f730c0b58d0 2026-02-24T09:30:58.791 INFO:teuthology.orchestra.run.trial028.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2026-02-24T00:00:00", "created": "2026-02-24T09:17:37", "first": "2026-02-24T09:18:00", "last": "2026-02-24T09:30:00", "last_pruned": "2026-02-24T09:30:00", "created_count": 13, "pruned_count": 7, "active": true} 2026-02-24T09:30:58.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.790+0000 7f72fffff640 1 -- 10.20.193.28:0/2308338703 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f730c0b58d0 msgr2=0x7f730c0d5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:30:58.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.790+0000 7f72fffff640 1 --2- 10.20.193.28:0/2308338703 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f730c0b58d0 0x7f730c0d5d80 secure :-1 s=READY pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7330128d10 tx=0x7f7324005f00 comp rx=0 tx=0).stop 2026-02-24T09:30:58.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.790+0000 7f72fffff640 1 -- 10.20.193.28:0/2308338703 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7330113950 msgr2=0x7f73301223c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:30:58.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.790+0000 7f72fffff640 1 --2- 10.20.193.28:0/2308338703 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7330113950 0x7f73301223c0 secure :-1 s=READY pgs=493 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73200098a0 tx=0x7f73200028d0 comp rx=0 tx=0).stop 2026-02-24T09:30:58.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.791+0000 7f72fffff640 1 -- 10.20.193.28:0/2308338703 shutdown_connections 2026-02-24T09:30:58.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.791+0000 7f72fffff640 1 --2- 10.20.193.28:0/2308338703 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f730c0b58d0 0x7f730c0d5d80 unknown :-1 s=CLOSED pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:58.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.791+0000 7f72fffff640 1 --2- 10.20.193.28:0/2308338703 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7330119b40 0x7f7330127c80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:58.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.791+0000 7f72fffff640 1 --2- 10.20.193.28:0/2308338703 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7330114340 0x7f7330122900 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:58.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.791+0000 7f72fffff640 1 --2- 10.20.193.28:0/2308338703 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7330113950 0x7f73301223c0 unknown :-1 s=CLOSED pgs=493 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:58.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.791+0000 7f72fffff640 1 -- 10.20.193.28:0/2308338703 >> 10.20.193.28:0/2308338703 conn(0x7f73300619a0 msgr2=0x7f7330062d40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:30:58.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.791+0000 7f72fffff640 1 -- 10.20.193.28:0/2308338703 shutdown_connections 2026-02-24T09:30:58.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.791+0000 7f72fffff640 1 -- 10.20.193.28:0/2308338703 wait complete. 2026-02-24T09:30:58.803 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:58 trial028 ceph-mon[40371]: pgmap v617: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:30:58.805 DEBUG:teuthology.orchestra.run.trial028:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2026-02-24T09:30:58.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:58 trial074 ceph-mon[44412]: pgmap v617: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-24T09:30:58.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.922+0000 7f205e083640 1 -- 10.20.193.28:0/2113391444 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f205810f3c0 msgr2=0x7f205810f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:30:58.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.922+0000 7f205e083640 1 --2- 10.20.193.28:0/2113391444 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f205810f3c0 0x7f205810f790 secure :-1 s=READY pgs=494 gs=1 cs=0 l=1 c_cookie=3052027734185552165 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2048009950 tx=0x7f204802f190 comp rx=0 tx=0).stop 2026-02-24T09:30:58.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.922+0000 7f205e083640 1 -- 10.20.193.28:0/2113391444 shutdown_connections 2026-02-24T09:30:58.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.922+0000 7f205e083640 1 --2- 10.20.193.28:0/2113391444 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f20581155b0 0x7f2058175f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:58.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.922+0000 7f205e083640 1 --2- 10.20.193.28:0/2113391444 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f205810fdb0 0x7f2058114e00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:58.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.922+0000 7f205e083640 1 --2- 10.20.193.28:0/2113391444 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f205810f3c0 0x7f205810f790 unknown :-1 s=CLOSED pgs=494 gs=1 cs=0 l=1 c_cookie=3052027734185552165 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:58.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.922+0000 7f205e083640 1 -- 10.20.193.28:0/2113391444 >> 10.20.193.28:0/2113391444 conn(0x7f20580ecc70 msgr2=0x7f205810d080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:30:58.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.922+0000 7f205e083640 1 -- 10.20.193.28:0/2113391444 shutdown_connections 2026-02-24T09:30:58.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.922+0000 7f205e083640 1 -- 10.20.193.28:0/2113391444 wait complete. 2026-02-24T09:30:58.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.923+0000 7f205e083640 1 Processor -- start 2026-02-24T09:30:58.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.923+0000 7f205e083640 1 -- start start 2026-02-24T09:30:58.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.923+0000 7f205e083640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f205810f3c0 0x7f205811d3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:30:58.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.923+0000 7f205e083640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f205810fdb0 0x7f205811d930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:30:58.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.923+0000 7f205e083640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f20581155b0 0x7f2058122d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:30:58.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.923+0000 7f205e083640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2058123320 con 0x7f205810fdb0 2026-02-24T09:30:58.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.923+0000 7f205e083640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f2058123490 con 0x7f205810f3c0 2026-02-24T09:30:58.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.923+0000 7f205e083640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2058123650 con 0x7f20581155b0 2026-02-24T09:30:58.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.923+0000 7f205c880640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f205810fdb0 0x7f205811d930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:30:58.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.923+0000 7f205c880640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f205810fdb0 0x7f205811d930 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39644/0 (socket says 10.20.193.28:39644) 2026-02-24T09:30:58.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.923+0000 7f205c880640 1 -- 10.20.193.28:0/3652935307 learned_addr learned my addr 10.20.193.28:0/3652935307 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:30:58.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.924+0000 7f205d882640 1 --2- 10.20.193.28:0/3652935307 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f20581155b0 0x7f2058122d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:30:58.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.924+0000 7f205d081640 1 --2- 10.20.193.28:0/3652935307 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f205810f3c0 0x7f205811d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:30:58.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.924+0000 7f205c880640 1 -- 10.20.193.28:0/3652935307 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f20581155b0 msgr2=0x7f2058122d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:30:58.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.924+0000 7f205c880640 1 --2- 10.20.193.28:0/3652935307 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f20581155b0 0x7f2058122d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:58.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.924+0000 7f205c880640 1 -- 10.20.193.28:0/3652935307 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f205810f3c0 msgr2=0x7f205811d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:30:58.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.924+0000 7f205c880640 1 --2- 10.20.193.28:0/3652935307 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f205810f3c0 0x7f205811d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:58.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.924+0000 7f205c880640 1 -- 10.20.193.28:0/3652935307 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2048009570 con 0x7f205810fdb0 2026-02-24T09:30:58.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.924+0000 7f205c880640 1 --2- 10.20.193.28:0/3652935307 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f205810fdb0 0x7f205811d930 secure :-1 s=READY pgs=495 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f204c005db0 tx=0x7f204c00ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:30:58.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.924+0000 7f20467fc640 1 -- 10.20.193.28:0/3652935307 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f204c004500 con 0x7f205810fdb0 2026-02-24T09:30:58.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.924+0000 7f20467fc640 1 -- 10.20.193.28:0/3652935307 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f204c004d10 con 0x7f205810fdb0 2026-02-24T09:30:58.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.924+0000 7f20467fc640 1 -- 10.20.193.28:0/3652935307 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f204c005280 con 0x7f205810fdb0 2026-02-24T09:30:58.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.924+0000 7f205e083640 1 -- 10.20.193.28:0/3652935307 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2058123930 con 0x7f205810fdb0 2026-02-24T09:30:58.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.924+0000 7f205e083640 1 -- 10.20.193.28:0/3652935307 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2058164030 con 0x7f205810fdb0 2026-02-24T09:30:58.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.925+0000 7f2027fff640 1 -- 10.20.193.28:0/3652935307 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2058123b50 con 0x7f205810fdb0 2026-02-24T09:30:58.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.927+0000 7f20467fc640 1 -- 10.20.193.28:0/3652935307 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7f204c005410 con 0x7f205810fdb0 2026-02-24T09:30:58.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.929+0000 7f20467fc640 1 --2- 10.20.193.28:0/3652935307 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f20340b5950 0x7f20340d5e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:30:58.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.929+0000 7f20467fc640 1 -- 10.20.193.28:0/3652935307 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 8513+0+0 (secure 0 0 0) 0x7f204c0e7470 con 0x7f205810fdb0 2026-02-24T09:30:58.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.929+0000 7f205d081640 1 --2- 10.20.193.28:0/3652935307 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f20340b5950 0x7f20340d5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:30:58.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.929+0000 7f20467fc640 1 -- 10.20.193.28:0/3652935307 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f204c0e7870 con 0x7f205810fdb0 2026-02-24T09:30:58.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:58.929+0000 7f205d081640 1 --2- 10.20.193.28:0/3652935307 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f20340b5950 0x7f20340d5e00 secure :-1 s=READY pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20480023d0 tx=0x7f2048031040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:30:59.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.063+0000 7f2027fff640 1 -- 10.20.193.28:0/3652935307 --> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f205811e550 con 0x7f20340b5950 2026-02-24T09:30:59.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.068+0000 7f20467fc640 1 -- 10.20.193.28:0/3652935307 <== mgr.14223 v2:10.20.193.28:6800/906910473 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f205811e550 con 0x7f20340b5950 2026-02-24T09:30:59.069 INFO:teuthology.orchestra.run.trial028.stdout:/ 1m 6m3h 2026-02-24T09:30:59.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.069+0000 7f2027fff640 1 -- 10.20.193.28:0/3652935307 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f20340b5950 msgr2=0x7f20340d5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:30:59.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.069+0000 7f2027fff640 1 --2- 10.20.193.28:0/3652935307 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f20340b5950 0x7f20340d5e00 secure :-1 s=READY pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20480023d0 tx=0x7f2048031040 comp rx=0 tx=0).stop 2026-02-24T09:30:59.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.069+0000 7f2027fff640 1 -- 10.20.193.28:0/3652935307 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f205810fdb0 msgr2=0x7f205811d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:30:59.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.069+0000 7f2027fff640 1 --2- 10.20.193.28:0/3652935307 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f205810fdb0 0x7f205811d930 secure :-1 s=READY pgs=495 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f204c005db0 tx=0x7f204c00ddf0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.069+0000 7f2027fff640 1 -- 10.20.193.28:0/3652935307 shutdown_connections 2026-02-24T09:30:59.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.069+0000 7f2027fff640 1 --2- 10.20.193.28:0/3652935307 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f20340b5950 0x7f20340d5e00 unknown :-1 s=CLOSED pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.069+0000 7f2027fff640 1 --2- 10.20.193.28:0/3652935307 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f20581155b0 0x7f2058122d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.069+0000 7f2027fff640 1 --2- 10.20.193.28:0/3652935307 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f205810fdb0 0x7f205811d930 unknown :-1 s=CLOSED pgs=495 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.069+0000 7f2027fff640 1 --2- 10.20.193.28:0/3652935307 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f205810f3c0 0x7f205811d3f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.069+0000 7f2027fff640 1 -- 10.20.193.28:0/3652935307 >> 10.20.193.28:0/3652935307 conn(0x7f20580ecc70 msgr2=0x7f205810d050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:30:59.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.069+0000 7f2027fff640 1 -- 10.20.193.28:0/3652935307 shutdown_connections 2026-02-24T09:30:59.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.069+0000 7f2027fff640 1 -- 10.20.193.28:0/3652935307 wait complete. 2026-02-24T09:30:59.083 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2026-02-24T09:30:59.097 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-24T09:30:59.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.214+0000 7fda4968c640 1 -- 10.20.193.28:0/990709071 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fda44113360 msgr2=0x7fda44173d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:30:59.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.214+0000 7fda4968c640 1 --2- 10.20.193.28:0/990709071 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fda44113360 0x7fda44173d30 secure :-1 s=READY pgs=496 gs=1 cs=0 l=1 c_cookie=9025406154998276646 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda3400aa30 tx=0x7fda34030270 comp rx=0 tx=0).stop 2026-02-24T09:30:59.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.214+0000 7fda4968c640 1 -- 10.20.193.28:0/990709071 shutdown_connections 2026-02-24T09:30:59.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.214+0000 7fda4968c640 1 --2- 10.20.193.28:0/990709071 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fda44113360 0x7fda44173d30 unknown :-1 s=CLOSED pgs=496 gs=1 cs=0 l=1 c_cookie=9025406154998276646 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.214+0000 7fda4968c640 1 --2- 10.20.193.28:0/990709071 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fda4410db60 0x7fda44112bb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.214+0000 7fda4968c640 1 --2- 10.20.193.28:0/990709071 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fda4410d170 0x7fda4410d540 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.214+0000 7fda4968c640 1 -- 10.20.193.28:0/990709071 >> 10.20.193.28:0/990709071 conn(0x7fda440eaa20 msgr2=0x7fda4410ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:30:59.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.214+0000 7fda4968c640 1 -- 10.20.193.28:0/990709071 shutdown_connections 2026-02-24T09:30:59.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.214+0000 7fda4968c640 1 -- 10.20.193.28:0/990709071 wait complete. 2026-02-24T09:30:59.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.215+0000 7fda4968c640 1 Processor -- start 2026-02-24T09:30:59.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.215+0000 7fda4968c640 1 -- start start 2026-02-24T09:30:59.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.215+0000 7fda4968c640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fda4410d170 0x7fda440f4ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:30:59.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.215+0000 7fda4968c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fda4410db60 0x7fda44173c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:30:59.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.215+0000 7fda4968c640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fda44113360 0x7fda440f5370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:30:59.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.215+0000 7fda4968c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fda440fa5f0 con 0x7fda4410db60 2026-02-24T09:30:59.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.215+0000 7fda4968c640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fda440fa760 con 0x7fda44113360 2026-02-24T09:30:59.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.215+0000 7fda4968c640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fda440fa8d0 con 0x7fda4410d170 2026-02-24T09:30:59.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.215+0000 7fda427fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fda4410db60 0x7fda44173c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:30:59.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.215+0000 7fda42ffd640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fda4410d170 0x7fda440f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:30:59.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.215+0000 7fda427fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fda4410db60 0x7fda44173c30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39650/0 (socket says 10.20.193.28:39650) 2026-02-24T09:30:59.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.215+0000 7fda427fc640 1 -- 10.20.193.28:0/2611388530 learned_addr learned my addr 10.20.193.28:0/2611388530 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:30:59.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.215+0000 7fda437fe640 1 --2- 10.20.193.28:0/2611388530 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fda44113360 0x7fda440f5370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:30:59.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.215+0000 7fda427fc640 1 -- 10.20.193.28:0/2611388530 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fda4410d170 msgr2=0x7fda440f4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:30:59.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.215+0000 7fda427fc640 1 --2- 10.20.193.28:0/2611388530 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fda4410d170 0x7fda440f4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.215+0000 7fda427fc640 1 -- 10.20.193.28:0/2611388530 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fda44113360 msgr2=0x7fda440f5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:30:59.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.215+0000 7fda427fc640 1 --2- 10.20.193.28:0/2611388530 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fda44113360 0x7fda440f5370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.215+0000 7fda427fc640 1 -- 10.20.193.28:0/2611388530 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda3400a650 con 0x7fda4410db60 2026-02-24T09:30:59.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.216+0000 7fda427fc640 1 --2- 10.20.193.28:0/2611388530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fda4410db60 0x7fda44173c30 secure :-1 s=READY pgs=497 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda2c00d950 tx=0x7fda2c00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:30:59.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.216+0000 7fda23fff640 1 -- 10.20.193.28:0/2611388530 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fda2c004540 con 0x7fda4410db60 2026-02-24T09:30:59.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.216+0000 7fda23fff640 1 -- 10.20.193.28:0/2611388530 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fda2c009ce0 con 0x7fda4410db60 2026-02-24T09:30:59.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.216+0000 7fda23fff640 1 -- 10.20.193.28:0/2611388530 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fda2c0106e0 con 0x7fda4410db60 2026-02-24T09:30:59.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.216+0000 7fda4968c640 1 -- 10.20.193.28:0/2611388530 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda440fabb0 con 0x7fda4410db60 2026-02-24T09:30:59.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.216+0000 7fda4968c640 1 -- 10.20.193.28:0/2611388530 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda440fb080 con 0x7fda4410db60 2026-02-24T09:30:59.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.217+0000 7fda21ffb640 1 -- 10.20.193.28:0/2611388530 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda4410e450 con 0x7fda4410db60 2026-02-24T09:30:59.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.219+0000 7fda23fff640 1 -- 10.20.193.28:0/2611388530 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7fda2c0097c0 con 0x7fda4410db60 2026-02-24T09:30:59.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.221+0000 7fda23fff640 1 --2- 10.20.193.28:0/2611388530 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fda180b5850 0x7fda180d5d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:30:59.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.221+0000 7fda23fff640 1 -- 10.20.193.28:0/2611388530 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 8513+0+0 (secure 0 0 0) 0x7fda2c0e71a0 con 0x7fda4410db60 2026-02-24T09:30:59.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.221+0000 7fda42ffd640 1 --2- 10.20.193.28:0/2611388530 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fda180b5850 0x7fda180d5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:30:59.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.221+0000 7fda23fff640 1 -- 10.20.193.28:0/2611388530 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fda2c0a9950 con 0x7fda4410db60 2026-02-24T09:30:59.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.221+0000 7fda42ffd640 1 --2- 10.20.193.28:0/2611388530 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fda180b5850 0x7fda180d5d00 secure :-1 s=READY pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda38004740 tx=0x7fda38005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:30:59.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.339+0000 7fda21ffb640 1 -- 10.20.193.28:0/2611388530 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fda4410d540 con 0x7fda4410db60 2026-02-24T09:30:59.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.340+0000 7fda23fff640 1 -- 10.20.193.28:0/2611388530 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) ==== 74+0+23241 (secure 0 0 0) 0x7fda2c0acb00 con 0x7fda4410db60 2026-02-24T09:30:59.341 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:30:59.342 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":110,"fsid":"e9ad50af-1160-11f1-800e-d404e6e7d460","created":"2026-02-24T09:12:33.966733+0000","modified":"2026-02-24T09:30:15.694102+0000","last_up_change":"2026-02-24T09:16:34.222008+0000","last_in_change":"2026-02-24T09:16:20.530109+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":38,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T09:14:33.468078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-24T09:16:57.259549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-24T09:16:58.835796+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":21,"snap_epoch":109,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7836f68-f25a-4aea-830a-3c2ce8ac79e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6803","nonce":2124354447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6805","nonce":2124354447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6809","nonce":2124354447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6807","nonce":2124354447}]},"public_addr":"10.20.193.28:6803/2124354447","cluster_addr":"10.20.193.28:6805/2124354447","heartbeat_back_addr":"10.20.193.28:6809/2124354447","heartbeat_front_addr":"10.20.193.28:6807/2124354447","state":["exists","up"]},{"osd":1,"uuid":"04273ff8-91e3-4e70-8041-cc8c205b9a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6800","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6801","nonce":267363486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6802","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6803","nonce":267363486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6806","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6807","nonce":267363486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6804","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6805","nonce":267363486}]},"public_addr":"10.20.193.74:6801/267363486","cluster_addr":"10.20.193.74:6803/267363486","heartbeat_back_addr":"10.20.193.74:6807/267363486","heartbeat_front_addr":"10.20.193.74:6805/267363486","state":["exists","up"]},{"osd":2,"uuid":"dea96db1-588b-4d08-8e52-52c4c995bdc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6800","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6801","nonce":3320466721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6802","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6803","nonce":3320466721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6806","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6807","nonce":3320466721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6804","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6805","nonce":3320466721}]},"public_addr":"10.20.193.159:6801/3320466721","cluster_addr":"10.20.193.159:6803/3320466721","heartbeat_back_addr":"10.20.193.159:6807/3320466721","heartbeat_front_addr":"10.20.193.159:6805/3320466721","state":["exists","up"]},{"osd":3,"uuid":"c785c244-eb3f-4af5-83c6-cd492459f75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6811","nonce":1790609615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6813","nonce":1790609615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6817","nonce":1790609615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6815","nonce":1790609615}]},"public_addr":"10.20.193.28:6811/1790609615","cluster_addr":"10.20.193.28:6813/1790609615","heartbeat_back_addr":"10.20.193.28:6817/1790609615","heartbeat_front_addr":"10.20.193.28:6815/1790609615","state":["exists","up"]},{"osd":4,"uuid":"041239c2-6187-4154-9557-b1b5846f9e0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6808","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6809","nonce":610990618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6810","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6811","nonce":610990618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6814","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6815","nonce":610990618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6812","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6813","nonce":610990618}]},"public_addr":"10.20.193.74:6809/610990618","cluster_addr":"10.20.193.74:6811/610990618","heartbeat_back_addr":"10.20.193.74:6815/610990618","heartbeat_front_addr":"10.20.193.74:6813/610990618","state":["exists","up"]},{"osd":5,"uuid":"ffeeb021-0924-4421-aecf-bac2e74364a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6808","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6809","nonce":1653417923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6810","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6811","nonce":1653417923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6814","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6815","nonce":1653417923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6812","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6813","nonce":1653417923}]},"public_addr":"10.20.193.159:6809/1653417923","cluster_addr":"10.20.193.159:6811/1653417923","heartbeat_back_addr":"10.20.193.159:6815/1653417923","heartbeat_front_addr":"10.20.193.159:6813/1653417923","state":["exists","up"]},{"osd":6,"uuid":"f3736156-4951-4901-9323-7930fb73b8dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6819","nonce":1891043856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6821","nonce":1891043856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6825","nonce":1891043856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6823","nonce":1891043856}]},"public_addr":"10.20.193.28:6819/1891043856","cluster_addr":"10.20.193.28:6821/1891043856","heartbeat_back_addr":"10.20.193.28:6825/1891043856","heartbeat_front_addr":"10.20.193.28:6823/1891043856","state":["exists","up"]},{"osd":7,"uuid":"214b27ee-75f9-4a54-a59b-e8bfbb895903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6816","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6817","nonce":2328869739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6818","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6819","nonce":2328869739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6822","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6823","nonce":2328869739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6820","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6821","nonce":2328869739}]},"public_addr":"10.20.193.74:6817/2328869739","cluster_addr":"10.20.193.74:6819/2328869739","heartbeat_back_addr":"10.20.193.74:6823/2328869739","heartbeat_front_addr":"10.20.193.74:6821/2328869739","state":["exists","up"]},{"osd":8,"uuid":"76599c26-6778-4fa2-b85d-feea8baac7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6816","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6817","nonce":3877834753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6818","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6819","nonce":3877834753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6822","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6823","nonce":3877834753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6820","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6821","nonce":3877834753}]},"public_addr":"10.20.193.159:6817/3877834753","cluster_addr":"10.20.193.159:6819/3877834753","heartbeat_back_addr":"10.20.193.159:6823/3877834753","heartbeat_front_addr":"10.20.193.159:6821/3877834753","state":["exists","up"]},{"osd":9,"uuid":"52b52b35-2d65-4e53-b7d8-fd7385d5ae88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6827","nonce":4207785690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6829","nonce":4207785690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6833","nonce":4207785690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6831","nonce":4207785690}]},"public_addr":"10.20.193.28:6827/4207785690","cluster_addr":"10.20.193.28:6829/4207785690","heartbeat_back_addr":"10.20.193.28:6833/4207785690","heartbeat_front_addr":"10.20.193.28:6831/4207785690","state":["exists","up"]},{"osd":10,"uuid":"65c8e576-a1c7-4c03-bbf6-57c775f2860f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6824","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6825","nonce":2590408209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6826","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6827","nonce":2590408209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6830","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6831","nonce":2590408209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6828","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6829","nonce":2590408209}]},"public_addr":"10.20.193.74:6825/2590408209","cluster_addr":"10.20.193.74:6827/2590408209","heartbeat_back_addr":"10.20.193.74:6831/2590408209","heartbeat_front_addr":"10.20.193.74:6829/2590408209","state":["exists","up"]},{"osd":11,"uuid":"e2305377-fadb-4cf0-8384-87387f116255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":87,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6824","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6825","nonce":709820718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6826","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6827","nonce":709820718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6830","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6831","nonce":709820718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6828","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6829","nonce":709820718}]},"public_addr":"10.20.193.159:6825/709820718","cluster_addr":"10.20.193.159:6827/709820718","heartbeat_back_addr":"10.20.193.159:6831/709820718","heartbeat_front_addr":"10.20.193.159:6829/709820718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:02.414561+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:16.784172+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:30.639920+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:44.510387+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:58.186053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:11.714819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:25.188981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:38.602303+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:51.899864+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:16:05.444224+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:16:18.900719+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:16:32.290361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.c","mappings":[{"from":3,"to":9},{"from":5,"to":8}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:0/3696280830":"2026-02-25T09:13:39.242729+0000","10.20.193.28:6801/3539300247":"2026-02-25T09:13:39.242729+0000","10.20.193.28:0/3799405177":"2026-02-25T09:12:46.171932+0000","10.20.193.28:0/1189576634":"2026-02-25T09:12:46.171932+0000","10.20.193.28:6800/1682009277":"2026-02-25T09:12:46.171932+0000","10.20.193.28:6800/3539300247":"2026-02-25T09:13:39.242729+0000","10.20.193.28:6801/1682009277":"2026-02-25T09:12:46.171932+0000","10.20.193.28:0/673213915":"2026-02-25T09:12:59.028609+0000","10.20.193.28:0/857248143":"2026-02-25T09:13:39.242729+0000","10.20.193.28:0/1541006046":"2026-02-25T09:12:46.171932+0000","10.20.193.28:0/264576041":"2026-02-25T09:12:59.028609+0000","10.20.193.28:6800/2303472235":"2026-02-25T09:12:59.028609+0000","10.20.193.28:6801/2303472235":"2026-02-25T09:12:59.028609+0000","10.20.193.28:0/2622827224":"2026-02-25T09:12:59.028609+0000","10.20.193.28:0/3614117448":"2026-02-25T09:13:39.242729+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":8,"length":1},{"begin":21,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T09:30:59.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.341+0000 7fda21ffb640 1 -- 10.20.193.28:0/2611388530 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fda180b5850 msgr2=0x7fda180d5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:30:59.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.341+0000 7fda21ffb640 1 --2- 10.20.193.28:0/2611388530 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fda180b5850 0x7fda180d5d00 secure :-1 s=READY pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda38004740 tx=0x7fda38005f90 comp rx=0 tx=0).stop 2026-02-24T09:30:59.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.341+0000 7fda21ffb640 1 -- 10.20.193.28:0/2611388530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fda4410db60 msgr2=0x7fda44173c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:30:59.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.341+0000 7fda21ffb640 1 --2- 10.20.193.28:0/2611388530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fda4410db60 0x7fda44173c30 secure :-1 s=READY pgs=497 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda2c00d950 tx=0x7fda2c00de20 comp rx=0 tx=0).stop 2026-02-24T09:30:59.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.341+0000 7fda21ffb640 1 -- 10.20.193.28:0/2611388530 shutdown_connections 2026-02-24T09:30:59.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.341+0000 7fda21ffb640 1 --2- 10.20.193.28:0/2611388530 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fda180b5850 0x7fda180d5d00 unknown :-1 s=CLOSED pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.341+0000 7fda21ffb640 1 --2- 10.20.193.28:0/2611388530 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fda44113360 0x7fda440f5370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.341+0000 7fda21ffb640 1 --2- 10.20.193.28:0/2611388530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fda4410db60 0x7fda44173c30 unknown :-1 s=CLOSED pgs=497 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.341+0000 7fda21ffb640 1 --2- 10.20.193.28:0/2611388530 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fda4410d170 0x7fda440f4ce0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.341+0000 7fda21ffb640 1 -- 10.20.193.28:0/2611388530 >> 10.20.193.28:0/2611388530 conn(0x7fda440eaa20 msgr2=0x7fda44111a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:30:59.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.341+0000 7fda21ffb640 1 -- 10.20.193.28:0/2611388530 shutdown_connections 2026-02-24T09:30:59.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.341+0000 7fda21ffb640 1 -- 10.20.193.28:0/2611388530 wait complete. 2026-02-24T09:30:59.356 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-24T09:14:33.468078+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2026-02-24T09:16:57.259549+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2026-02-24T09:16:58.835796+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 21, 'snap_epoch': 109, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-24T09:30:59.356 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2026-02-24T09:30:59.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.477+0000 7f7d65683640 1 -- 10.20.193.28:0/3643580568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7d601138c0 msgr2=0x7f7d60113c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:30:59.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.477+0000 7f7d65683640 1 --2- 10.20.193.28:0/3643580568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7d601138c0 0x7f7d60113c90 secure :-1 s=READY pgs=498 gs=1 cs=0 l=1 c_cookie=252612741767345789 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d4c009950 tx=0x7f7d4c02f190 comp rx=0 tx=0).stop 2026-02-24T09:30:59.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.478+0000 7f7d65683640 1 -- 10.20.193.28:0/3643580568 shutdown_connections 2026-02-24T09:30:59.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.478+0000 7f7d65683640 1 --2- 10.20.193.28:0/3643580568 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7d60119ab0 0x7f7d6017a480 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.478+0000 7f7d65683640 1 --2- 10.20.193.28:0/3643580568 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7d601142b0 0x7f7d60119300 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.478+0000 7f7d65683640 1 --2- 10.20.193.28:0/3643580568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7d601138c0 0x7f7d60113c90 unknown :-1 s=CLOSED pgs=498 gs=1 cs=0 l=1 c_cookie=252612741767345789 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.478+0000 7f7d65683640 1 -- 10.20.193.28:0/3643580568 >> 10.20.193.28:0/3643580568 conn(0x7f7d600628f0 msgr2=0x7f7d60062cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:30:59.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.478+0000 7f7d65683640 1 -- 10.20.193.28:0/3643580568 shutdown_connections 2026-02-24T09:30:59.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.478+0000 7f7d65683640 1 -- 10.20.193.28:0/3643580568 wait complete. 2026-02-24T09:30:59.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.478+0000 7f7d65683640 1 Processor -- start 2026-02-24T09:30:59.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.478+0000 7f7d65683640 1 -- start start 2026-02-24T09:30:59.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.479+0000 7f7d65683640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7d601138c0 0x7f7d600fab90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:30:59.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.479+0000 7f7d65683640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7d601142b0 0x7f7d6017a380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:30:59.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.479+0000 7f7d65683640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7d60119ab0 0x7f7d600fb290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:30:59.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.479+0000 7f7d65683640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7d601004a0 con 0x7f7d601138c0 2026-02-24T09:30:59.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.479+0000 7f7d65683640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f7d60100610 con 0x7f7d601142b0 2026-02-24T09:30:59.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.479+0000 7f7d65683640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7d601007d0 con 0x7f7d60119ab0 2026-02-24T09:30:59.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.479+0000 7f7d5ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7d601138c0 0x7f7d600fab90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:30:59.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.479+0000 7f7d5ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7d601138c0 0x7f7d600fab90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39660/0 (socket says 10.20.193.28:39660) 2026-02-24T09:30:59.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.479+0000 7f7d5ffff640 1 -- 10.20.193.28:0/4208935465 learned_addr learned my addr 10.20.193.28:0/4208935465 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:30:59.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.479+0000 7f7d5f7fe640 1 --2- 10.20.193.28:0/4208935465 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7d601142b0 0x7f7d6017a380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:30:59.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.479+0000 7f7d64e82640 1 --2- 10.20.193.28:0/4208935465 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7d60119ab0 0x7f7d600fb290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:30:59.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.479+0000 7f7d5ffff640 1 -- 10.20.193.28:0/4208935465 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7d60119ab0 msgr2=0x7f7d600fb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:30:59.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.479+0000 7f7d5ffff640 1 --2- 10.20.193.28:0/4208935465 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7d60119ab0 0x7f7d600fb290 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.479+0000 7f7d5ffff640 1 -- 10.20.193.28:0/4208935465 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7d601142b0 msgr2=0x7f7d6017a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:30:59.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.479+0000 7f7d5ffff640 1 --2- 10.20.193.28:0/4208935465 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7d601142b0 0x7f7d6017a380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.479+0000 7f7d5ffff640 1 -- 10.20.193.28:0/4208935465 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d4c009570 con 0x7f7d601138c0 2026-02-24T09:30:59.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.479+0000 7f7d5f7fe640 1 --2- 10.20.193.28:0/4208935465 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7d601142b0 0x7f7d6017a380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:30:59.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.479+0000 7f7d5ffff640 1 --2- 10.20.193.28:0/4208935465 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7d601138c0 0x7f7d600fab90 secure :-1 s=READY pgs=499 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d4c0098a0 tx=0x7f7d4c0028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:30:59.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.479+0000 7f7d5d7fa640 1 -- 10.20.193.28:0/4208935465 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7d4c03d070 con 0x7f7d601138c0 2026-02-24T09:30:59.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.479+0000 7f7d5d7fa640 1 -- 10.20.193.28:0/4208935465 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7d4c02fe20 con 0x7f7d601138c0 2026-02-24T09:30:59.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.479+0000 7f7d5d7fa640 1 -- 10.20.193.28:0/4208935465 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7d4c041890 con 0x7f7d601138c0 2026-02-24T09:30:59.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.479+0000 7f7d65683640 1 -- 10.20.193.28:0/4208935465 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d60100a50 con 0x7f7d601138c0 2026-02-24T09:30:59.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.480+0000 7f7d65683640 1 -- 10.20.193.28:0/4208935465 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d60100e70 con 0x7f7d601138c0 2026-02-24T09:30:59.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.480+0000 7f7d65683640 1 -- 10.20.193.28:0/4208935465 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d60065630 con 0x7f7d601138c0 2026-02-24T09:30:59.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.482+0000 7f7d5d7fa640 1 -- 10.20.193.28:0/4208935465 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7f7d4c041a20 con 0x7f7d601138c0 2026-02-24T09:30:59.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.484+0000 7f7d5d7fa640 1 --2- 10.20.193.28:0/4208935465 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f7d340b58c0 0x7f7d340d5d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:30:59.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.484+0000 7f7d5d7fa640 1 -- 10.20.193.28:0/4208935465 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 8513+0+0 (secure 0 0 0) 0x7f7d4c10bba0 con 0x7f7d601138c0 2026-02-24T09:30:59.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.484+0000 7f7d5d7fa640 1 -- 10.20.193.28:0/4208935465 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f7d4c144930 con 0x7f7d601138c0 2026-02-24T09:30:59.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.484+0000 7f7d5f7fe640 1 --2- 10.20.193.28:0/4208935465 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f7d340b58c0 0x7f7d340d5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:30:59.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.485+0000 7f7d5f7fe640 1 --2- 10.20.193.28:0/4208935465 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f7d340b58c0 0x7f7d340d5d70 secure :-1 s=READY pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d60101530 tx=0x7f7d50005f00 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:30:59.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.597+0000 7f7d65683640 1 -- 10.20.193.28:0/4208935465 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7d600fbcf0 con 0x7f7d601138c0 2026-02-24T09:30:59.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.597+0000 7f7d5d7fa640 1 -- 10.20.193.28:0/4208935465 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v110) ==== 93+0+10 (secure 0 0 0) 0x7f7d4c0ce310 con 0x7f7d601138c0 2026-02-24T09:30:59.599 INFO:teuthology.orchestra.run.trial028.stdout:pg_num: 1 2026-02-24T09:30:59.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.599+0000 7f7d65683640 1 -- 10.20.193.28:0/4208935465 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f7d340b58c0 msgr2=0x7f7d340d5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:30:59.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.599+0000 7f7d65683640 1 --2- 10.20.193.28:0/4208935465 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f7d340b58c0 0x7f7d340d5d70 secure :-1 s=READY pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d60101530 tx=0x7f7d50005f00 comp rx=0 tx=0).stop 2026-02-24T09:30:59.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.599+0000 7f7d65683640 1 -- 10.20.193.28:0/4208935465 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7d601138c0 msgr2=0x7f7d600fab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:30:59.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.599+0000 7f7d65683640 1 --2- 10.20.193.28:0/4208935465 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7d601138c0 0x7f7d600fab90 secure :-1 s=READY pgs=499 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d4c0098a0 tx=0x7f7d4c0028d0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.599+0000 7f7d65683640 1 -- 10.20.193.28:0/4208935465 shutdown_connections 2026-02-24T09:30:59.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.599+0000 7f7d65683640 1 --2- 10.20.193.28:0/4208935465 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f7d340b58c0 0x7f7d340d5d70 unknown :-1 s=CLOSED pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.599+0000 7f7d65683640 1 --2- 10.20.193.28:0/4208935465 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f7d60119ab0 0x7f7d600fb290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.599+0000 7f7d65683640 1 --2- 10.20.193.28:0/4208935465 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f7d601142b0 0x7f7d6017a380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.599+0000 7f7d65683640 1 --2- 10.20.193.28:0/4208935465 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7d601138c0 0x7f7d600fab90 unknown :-1 s=CLOSED pgs=499 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.599+0000 7f7d65683640 1 -- 10.20.193.28:0/4208935465 >> 10.20.193.28:0/4208935465 conn(0x7f7d600628f0 msgr2=0x7f7d60115090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:30:59.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.599+0000 7f7d65683640 1 -- 10.20.193.28:0/4208935465 shutdown_connections 2026-02-24T09:30:59.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.599+0000 7f7d65683640 1 -- 10.20.193.28:0/4208935465 wait complete. 2026-02-24T09:30:59.609 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:30:59 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/2611388530' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:30:59.614 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2026-02-24T09:30:59.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.734+0000 7f614ee83640 1 -- 10.20.193.28:0/3330191202 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f61481142b0 msgr2=0x7f6148119300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:30:59.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.734+0000 7f614ee83640 1 --2- 10.20.193.28:0/3330191202 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f61481142b0 0x7f6148119300 secure :-1 s=READY pgs=500 gs=1 cs=0 l=1 c_cookie=7711300640359048231 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f613c009950 tx=0x7f613c02f190 comp rx=0 tx=0).stop 2026-02-24T09:30:59.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.734+0000 7f614ee83640 1 -- 10.20.193.28:0/3330191202 shutdown_connections 2026-02-24T09:30:59.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.734+0000 7f614ee83640 1 --2- 10.20.193.28:0/3330191202 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f6148119ab0 0x7f614817a480 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.734+0000 7f614ee83640 1 --2- 10.20.193.28:0/3330191202 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f61481142b0 0x7f6148119300 unknown :-1 s=CLOSED pgs=500 gs=1 cs=0 l=1 c_cookie=7711300640359048231 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.734+0000 7f614ee83640 1 --2- 10.20.193.28:0/3330191202 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f61481138c0 0x7f6148113c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.734+0000 7f614ee83640 1 -- 10.20.193.28:0/3330191202 >> 10.20.193.28:0/3330191202 conn(0x7f61480628f0 msgr2=0x7f6148062cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:30:59.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.734+0000 7f614ee83640 1 -- 10.20.193.28:0/3330191202 shutdown_connections 2026-02-24T09:30:59.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.734+0000 7f614ee83640 1 -- 10.20.193.28:0/3330191202 wait complete. 2026-02-24T09:30:59.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.735+0000 7f614ee83640 1 Processor -- start 2026-02-24T09:30:59.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.735+0000 7f614ee83640 1 -- start start 2026-02-24T09:30:59.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.735+0000 7f614ee83640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f61481138c0 0x7f61480fac70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:30:59.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.735+0000 7f614ee83640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f61481142b0 0x7f614817a380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:30:59.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.735+0000 7f614ee83640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f6148119ab0 0x7f61480fb370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:30:59.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.735+0000 7f614ee83640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6148100530 con 0x7f61481138c0 2026-02-24T09:30:59.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.735+0000 7f614ee83640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f61481006a0 con 0x7f61481142b0 2026-02-24T09:30:59.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.735+0000 7f614ee83640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6148100860 con 0x7f6148119ab0 2026-02-24T09:30:59.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.735+0000 7f614de81640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f61481138c0 0x7f61480fac70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:30:59.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.736+0000 7f614de81640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f61481138c0 0x7f61480fac70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39678/0 (socket says 10.20.193.28:39678) 2026-02-24T09:30:59.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.736+0000 7f614de81640 1 -- 10.20.193.28:0/3322689269 learned_addr learned my addr 10.20.193.28:0/3322689269 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:30:59.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.736+0000 7f614e682640 1 --2- 10.20.193.28:0/3322689269 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f6148119ab0 0x7f61480fb370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:30:59.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.736+0000 7f614d680640 1 --2- 10.20.193.28:0/3322689269 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f61481142b0 0x7f614817a380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:30:59.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.736+0000 7f614de81640 1 -- 10.20.193.28:0/3322689269 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f6148119ab0 msgr2=0x7f61480fb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:30:59.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.736+0000 7f614de81640 1 --2- 10.20.193.28:0/3322689269 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f6148119ab0 0x7f61480fb370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.736+0000 7f614de81640 1 -- 10.20.193.28:0/3322689269 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f61481142b0 msgr2=0x7f614817a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:30:59.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.736+0000 7f614de81640 1 --2- 10.20.193.28:0/3322689269 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f61481142b0 0x7f614817a380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.736+0000 7f614de81640 1 -- 10.20.193.28:0/3322689269 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613c009570 con 0x7f61481138c0 2026-02-24T09:30:59.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.736+0000 7f614de81640 1 --2- 10.20.193.28:0/3322689269 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f61481138c0 0x7f61480fac70 secure :-1 s=READY pgs=501 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6138009480 tx=0x7f613800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:30:59.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.736+0000 7f6136ffd640 1 -- 10.20.193.28:0/3322689269 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f613800cd40 con 0x7f61481138c0 2026-02-24T09:30:59.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.736+0000 7f6136ffd640 1 -- 10.20.193.28:0/3322689269 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6138004d10 con 0x7f61481138c0 2026-02-24T09:30:59.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.736+0000 7f6136ffd640 1 -- 10.20.193.28:0/3322689269 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f61380106b0 con 0x7f61481138c0 2026-02-24T09:30:59.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.736+0000 7f614ee83640 1 -- 10.20.193.28:0/3322689269 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6148100b40 con 0x7f61481138c0 2026-02-24T09:30:59.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.736+0000 7f614ee83640 1 -- 10.20.193.28:0/3322689269 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6148100fc0 con 0x7f61481138c0 2026-02-24T09:30:59.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.737+0000 7f614ee83640 1 -- 10.20.193.28:0/3322689269 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6148065630 con 0x7f61481138c0 2026-02-24T09:30:59.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.739+0000 7f6136ffd640 1 -- 10.20.193.28:0/3322689269 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7f6138004770 con 0x7f61481138c0 2026-02-24T09:30:59.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.741+0000 7f6136ffd640 1 --2- 10.20.193.28:0/3322689269 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f61240b58c0 0x7f61240d5d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:30:59.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.741+0000 7f6136ffd640 1 -- 10.20.193.28:0/3322689269 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 8513+0+0 (secure 0 0 0) 0x7f6138014070 con 0x7f61481138c0 2026-02-24T09:30:59.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.741+0000 7f614d680640 1 --2- 10.20.193.28:0/3322689269 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f61240b58c0 0x7f61240d5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:30:59.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.741+0000 7f6136ffd640 1 -- 10.20.193.28:0/3322689269 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f61380e7910 con 0x7f61481138c0 2026-02-24T09:30:59.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.742+0000 7f614d680640 1 --2- 10.20.193.28:0/3322689269 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f61240b58c0 0x7f61240d5d70 secure :-1 s=READY pgs=258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f613c0023d0 tx=0x7f613c031040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:30:59.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:30:59 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/2611388530' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:30:59.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.854+0000 7f614ee83640 1 -- 10.20.193.28:0/3322689269 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f61480fbd80 con 0x7f61481138c0 2026-02-24T09:30:59.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.854+0000 7f6136ffd640 1 -- 10.20.193.28:0/3322689269 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v110) ==== 104+0+11 (secure 0 0 0) 0x7f61380a9cb0 con 0x7f61481138c0 2026-02-24T09:30:59.856 INFO:teuthology.orchestra.run.trial028.stdout:pg_num: 32 2026-02-24T09:30:59.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.855+0000 7f614ee83640 1 -- 10.20.193.28:0/3322689269 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f61240b58c0 msgr2=0x7f61240d5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:30:59.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.855+0000 7f614ee83640 1 --2- 10.20.193.28:0/3322689269 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f61240b58c0 0x7f61240d5d70 secure :-1 s=READY pgs=258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f613c0023d0 tx=0x7f613c031040 comp rx=0 tx=0).stop 2026-02-24T09:30:59.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.855+0000 7f614ee83640 1 -- 10.20.193.28:0/3322689269 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f61481138c0 msgr2=0x7f61480fac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:30:59.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.855+0000 7f614ee83640 1 --2- 10.20.193.28:0/3322689269 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f61481138c0 0x7f61480fac70 secure :-1 s=READY pgs=501 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6138009480 tx=0x7f613800ee60 comp rx=0 tx=0).stop 2026-02-24T09:30:59.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.855+0000 7f614ee83640 1 -- 10.20.193.28:0/3322689269 shutdown_connections 2026-02-24T09:30:59.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.855+0000 7f614ee83640 1 --2- 10.20.193.28:0/3322689269 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f61240b58c0 0x7f61240d5d70 unknown :-1 s=CLOSED pgs=258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.855+0000 7f614ee83640 1 --2- 10.20.193.28:0/3322689269 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f6148119ab0 0x7f61480fb370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.855+0000 7f614ee83640 1 --2- 10.20.193.28:0/3322689269 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f61481142b0 0x7f614817a380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.855+0000 7f614ee83640 1 --2- 10.20.193.28:0/3322689269 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f61481138c0 0x7f61480fac70 unknown :-1 s=CLOSED pgs=501 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.855+0000 7f614ee83640 1 -- 10.20.193.28:0/3322689269 >> 10.20.193.28:0/3322689269 conn(0x7f61480628f0 msgr2=0x7f6148118160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:30:59.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.855+0000 7f614ee83640 1 -- 10.20.193.28:0/3322689269 shutdown_connections 2026-02-24T09:30:59.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.855+0000 7f614ee83640 1 -- 10.20.193.28:0/3322689269 wait complete. 2026-02-24T09:30:59.871 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2026-02-24T09:30:59.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:30:59 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/2611388530' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:30:59.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.991+0000 7ff37ef0b640 1 -- 10.20.193.28:0/857220915 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff378119ab0 msgr2=0x7ff37817a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:30:59.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.991+0000 7ff37ef0b640 1 --2- 10.20.193.28:0/857220915 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff378119ab0 0x7ff37817a480 secure :-1 s=READY pgs=502 gs=1 cs=0 l=1 c_cookie=6592515596258254598 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff37400aa30 tx=0x7ff374030270 comp rx=0 tx=0).stop 2026-02-24T09:30:59.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.992+0000 7ff37ef0b640 1 -- 10.20.193.28:0/857220915 shutdown_connections 2026-02-24T09:30:59.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.992+0000 7ff37ef0b640 1 --2- 10.20.193.28:0/857220915 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff378119ab0 0x7ff37817a480 unknown :-1 s=CLOSED pgs=502 gs=1 cs=0 l=1 c_cookie=6592515596258254598 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.992+0000 7ff37ef0b640 1 --2- 10.20.193.28:0/857220915 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff3781142b0 0x7ff378119300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.992+0000 7ff37ef0b640 1 --2- 10.20.193.28:0/857220915 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff3781138c0 0x7ff378113c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.992+0000 7ff37ef0b640 1 -- 10.20.193.28:0/857220915 >> 10.20.193.28:0/857220915 conn(0x7ff3780628f0 msgr2=0x7ff378062cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:30:59.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.992+0000 7ff37ef0b640 1 -- 10.20.193.28:0/857220915 shutdown_connections 2026-02-24T09:30:59.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.992+0000 7ff37ef0b640 1 -- 10.20.193.28:0/857220915 wait complete. 2026-02-24T09:30:59.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.992+0000 7ff37ef0b640 1 Processor -- start 2026-02-24T09:30:59.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.993+0000 7ff37ef0b640 1 -- start start 2026-02-24T09:30:59.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.993+0000 7ff37ef0b640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff3781138c0 0x7ff3780fab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:30:59.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.993+0000 7ff37ef0b640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff3781142b0 0x7ff37817a380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:30:59.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.993+0000 7ff37ef0b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff378119ab0 0x7ff3780fb260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:30:59.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.993+0000 7ff37ef0b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff378100470 con 0x7ff378119ab0 2026-02-24T09:30:59.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.993+0000 7ff37ef0b640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7ff3781005e0 con 0x7ff3781138c0 2026-02-24T09:30:59.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.993+0000 7ff37ef0b640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff3781007a0 con 0x7ff3781142b0 2026-02-24T09:30:59.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.993+0000 7ff37e70a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff378119ab0 0x7ff3780fb260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:30:59.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.993+0000 7ff37e70a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff378119ab0 0x7ff3780fb260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39696/0 (socket says 10.20.193.28:39696) 2026-02-24T09:30:59.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.993+0000 7ff37e70a640 1 -- 10.20.193.28:0/2870791279 learned_addr learned my addr 10.20.193.28:0/2870791279 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:30:59.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.993+0000 7ff37d708640 1 --2- 10.20.193.28:0/2870791279 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff3781142b0 0x7ff37817a380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:30:59.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.993+0000 7ff37df09640 1 --2- 10.20.193.28:0/2870791279 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff3781138c0 0x7ff3780fab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:30:59.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.993+0000 7ff37e70a640 1 -- 10.20.193.28:0/2870791279 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff3781142b0 msgr2=0x7ff37817a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:30:59.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.993+0000 7ff37e70a640 1 --2- 10.20.193.28:0/2870791279 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff3781142b0 0x7ff37817a380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.993+0000 7ff37e70a640 1 -- 10.20.193.28:0/2870791279 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff3781138c0 msgr2=0x7ff3780fab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:30:59.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.993+0000 7ff37e70a640 1 --2- 10.20.193.28:0/2870791279 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff3781138c0 0x7ff3780fab60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:30:59.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.993+0000 7ff37e70a640 1 -- 10.20.193.28:0/2870791279 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff37400a650 con 0x7ff378119ab0 2026-02-24T09:30:59.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.993+0000 7ff37e70a640 1 --2- 10.20.193.28:0/2870791279 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff378119ab0 0x7ff3780fb260 secure :-1 s=READY pgs=503 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff374032fe0 tx=0x7ff3740039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:30:59.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.994+0000 7ff366ffd640 1 -- 10.20.193.28:0/2870791279 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff37403e070 con 0x7ff378119ab0 2026-02-24T09:30:59.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.994+0000 7ff366ffd640 1 -- 10.20.193.28:0/2870791279 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff374003e00 con 0x7ff378119ab0 2026-02-24T09:30:59.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.994+0000 7ff366ffd640 1 -- 10.20.193.28:0/2870791279 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff374042940 con 0x7ff378119ab0 2026-02-24T09:30:59.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.994+0000 7ff37ef0b640 1 -- 10.20.193.28:0/2870791279 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff378100a20 con 0x7ff378119ab0 2026-02-24T09:30:59.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.994+0000 7ff37ef0b640 1 -- 10.20.193.28:0/2870791279 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff378100e40 con 0x7ff378119ab0 2026-02-24T09:30:59.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.994+0000 7ff37ef0b640 1 -- 10.20.193.28:0/2870791279 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff378065630 con 0x7ff378119ab0 2026-02-24T09:31:00.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.997+0000 7ff366ffd640 1 -- 10.20.193.28:0/2870791279 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7ff374042ad0 con 0x7ff378119ab0 2026-02-24T09:31:00.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.998+0000 7ff366ffd640 1 --2- 10.20.193.28:0/2870791279 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff3540b58c0 0x7ff3540d5d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:00.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.998+0000 7ff366ffd640 1 -- 10.20.193.28:0/2870791279 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 8513+0+0 (secure 0 0 0) 0x7ff37410cd40 con 0x7ff378119ab0 2026-02-24T09:31:00.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.998+0000 7ff366ffd640 1 -- 10.20.193.28:0/2870791279 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7ff37410d1c0 con 0x7ff378119ab0 2026-02-24T09:31:00.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.998+0000 7ff37df09640 1 --2- 10.20.193.28:0/2870791279 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff3540b58c0 0x7ff3540d5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:00.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:30:59.999+0000 7ff37df09640 1 --2- 10.20.193.28:0/2870791279 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff3540b58c0 0x7ff3540d5d70 secure :-1 s=READY pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff368004740 tx=0x7ff368004420 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:00.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.112+0000 7ff37ef0b640 1 -- 10.20.193.28:0/2870791279 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff378113cf0 con 0x7ff378119ab0 2026-02-24T09:31:00.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.112+0000 7ff366ffd640 1 -- 10.20.193.28:0/2870791279 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v110) ==== 100+0+11 (secure 0 0 0) 0x7ff3740cf4b0 con 0x7ff378119ab0 2026-02-24T09:31:00.115 INFO:teuthology.orchestra.run.trial028.stdout:pg_num: 64 2026-02-24T09:31:00.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.113+0000 7ff37ef0b640 1 -- 10.20.193.28:0/2870791279 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff3540b58c0 msgr2=0x7ff3540d5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:00.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.113+0000 7ff37ef0b640 1 --2- 10.20.193.28:0/2870791279 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff3540b58c0 0x7ff3540d5d70 secure :-1 s=READY pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff368004740 tx=0x7ff368004420 comp rx=0 tx=0).stop 2026-02-24T09:31:00.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.113+0000 7ff37ef0b640 1 -- 10.20.193.28:0/2870791279 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff378119ab0 msgr2=0x7ff3780fb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:00.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.113+0000 7ff37ef0b640 1 --2- 10.20.193.28:0/2870791279 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff378119ab0 0x7ff3780fb260 secure :-1 s=READY pgs=503 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff374032fe0 tx=0x7ff3740039b0 comp rx=0 tx=0).stop 2026-02-24T09:31:00.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.114+0000 7ff37ef0b640 1 -- 10.20.193.28:0/2870791279 shutdown_connections 2026-02-24T09:31:00.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.114+0000 7ff37ef0b640 1 --2- 10.20.193.28:0/2870791279 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7ff3540b58c0 0x7ff3540d5d70 unknown :-1 s=CLOSED pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:00.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.114+0000 7ff37ef0b640 1 --2- 10.20.193.28:0/2870791279 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff378119ab0 0x7ff3780fb260 unknown :-1 s=CLOSED pgs=503 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:00.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.114+0000 7ff37ef0b640 1 --2- 10.20.193.28:0/2870791279 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7ff3781142b0 0x7ff37817a380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:00.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.114+0000 7ff37ef0b640 1 --2- 10.20.193.28:0/2870791279 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7ff3781138c0 0x7ff3780fab60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:00.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.114+0000 7ff37ef0b640 1 -- 10.20.193.28:0/2870791279 >> 10.20.193.28:0/2870791279 conn(0x7ff3780628f0 msgr2=0x7ff378118160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:00.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.114+0000 7ff37ef0b640 1 -- 10.20.193.28:0/2870791279 shutdown_connections 2026-02-24T09:31:00.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.114+0000 7ff37ef0b640 1 -- 10.20.193.28:0/2870791279 wait complete. 2026-02-24T09:31:00.127 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2026-02-24T09:31:00.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.246+0000 7fe2e8bd2640 1 -- 10.20.193.28:0/4267254879 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2e410db40 msgr2=0x7fe2e4112b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:00.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.246+0000 7fe2e8bd2640 1 --2- 10.20.193.28:0/4267254879 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2e410db40 0x7fe2e4112b90 secure :-1 s=READY pgs=504 gs=1 cs=0 l=1 c_cookie=5976124043092062102 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2d4009950 tx=0x7fe2d402f190 comp rx=0 tx=0).stop 2026-02-24T09:31:00.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.246+0000 7fe2e8bd2640 1 -- 10.20.193.28:0/4267254879 shutdown_connections 2026-02-24T09:31:00.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.246+0000 7fe2e8bd2640 1 --2- 10.20.193.28:0/4267254879 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fe2e4113340 0x7fe2e4173d10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:00.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.246+0000 7fe2e8bd2640 1 --2- 10.20.193.28:0/4267254879 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2e410db40 0x7fe2e4112b90 unknown :-1 s=CLOSED pgs=504 gs=1 cs=0 l=1 c_cookie=5976124043092062102 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:00.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.246+0000 7fe2e8bd2640 1 --2- 10.20.193.28:0/4267254879 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe2e410d150 0x7fe2e410d520 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:00.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.246+0000 7fe2e8bd2640 1 -- 10.20.193.28:0/4267254879 >> 10.20.193.28:0/4267254879 conn(0x7fe2e40eaa20 msgr2=0x7fe2e410ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:00.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.246+0000 7fe2e8bd2640 1 -- 10.20.193.28:0/4267254879 shutdown_connections 2026-02-24T09:31:00.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.246+0000 7fe2e8bd2640 1 -- 10.20.193.28:0/4267254879 wait complete. 2026-02-24T09:31:00.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.247+0000 7fe2e8bd2640 1 Processor -- start 2026-02-24T09:31:00.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.247+0000 7fe2e8bd2640 1 -- start start 2026-02-24T09:31:00.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.247+0000 7fe2e8bd2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2e410d150 0x7fe2e40f4db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:00.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.247+0000 7fe2e8bd2640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe2e410db40 0x7fe2e4173c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:00.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.247+0000 7fe2e8bd2640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fe2e4113340 0x7fe2e40f5440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:00.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.247+0000 7fe2e8bd2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e40fa6c0 con 0x7fe2e410d150 2026-02-24T09:31:00.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.247+0000 7fe2e8bd2640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e40fa830 con 0x7fe2e4113340 2026-02-24T09:31:00.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.247+0000 7fe2e8bd2640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e40fa9a0 con 0x7fe2e410db40 2026-02-24T09:31:00.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.248+0000 7fe2e37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2e410d150 0x7fe2e40f4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:00.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.248+0000 7fe2e37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2e410d150 0x7fe2e40f4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39716/0 (socket says 10.20.193.28:39716) 2026-02-24T09:31:00.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.248+0000 7fe2e37fe640 1 -- 10.20.193.28:0/1530514268 learned_addr learned my addr 10.20.193.28:0/1530514268 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:31:00.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.248+0000 7fe2e2ffd640 1 --2- 10.20.193.28:0/1530514268 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe2e410db40 0x7fe2e4173c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:00.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.248+0000 7fe2e3fff640 1 --2- 10.20.193.28:0/1530514268 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fe2e4113340 0x7fe2e40f5440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:00.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.248+0000 7fe2e37fe640 1 -- 10.20.193.28:0/1530514268 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe2e410db40 msgr2=0x7fe2e4173c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:00.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.248+0000 7fe2e37fe640 1 --2- 10.20.193.28:0/1530514268 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe2e410db40 0x7fe2e4173c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:00.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.248+0000 7fe2e37fe640 1 -- 10.20.193.28:0/1530514268 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fe2e4113340 msgr2=0x7fe2e40f5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:00.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.248+0000 7fe2e37fe640 1 --2- 10.20.193.28:0/1530514268 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fe2e4113340 0x7fe2e40f5440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:00.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.248+0000 7fe2e37fe640 1 -- 10.20.193.28:0/1530514268 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d4009570 con 0x7fe2e410d150 2026-02-24T09:31:00.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.248+0000 7fe2e37fe640 1 --2- 10.20.193.28:0/1530514268 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2e410d150 0x7fe2e40f4db0 secure :-1 s=READY pgs=505 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2d0009480 tx=0x7fe2d000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:00.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.248+0000 7fe2e0ff9640 1 -- 10.20.193.28:0/1530514268 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe2d000cd40 con 0x7fe2e410d150 2026-02-24T09:31:00.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.248+0000 7fe2e0ff9640 1 -- 10.20.193.28:0/1530514268 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fe2d0004d10 con 0x7fe2e410d150 2026-02-24T09:31:00.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.248+0000 7fe2e0ff9640 1 -- 10.20.193.28:0/1530514268 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe2d00106b0 con 0x7fe2e410d150 2026-02-24T09:31:00.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.248+0000 7fe2e8bd2640 1 -- 10.20.193.28:0/1530514268 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2e40fac80 con 0x7fe2e410d150 2026-02-24T09:31:00.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.248+0000 7fe2e8bd2640 1 -- 10.20.193.28:0/1530514268 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2e40fb150 con 0x7fe2e410d150 2026-02-24T09:31:00.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.249+0000 7fe2e8bd2640 1 -- 10.20.193.28:0/1530514268 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2e410e430 con 0x7fe2e410d150 2026-02-24T09:31:00.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.251+0000 7fe2e0ff9640 1 -- 10.20.193.28:0/1530514268 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7fe2d001f060 con 0x7fe2e410d150 2026-02-24T09:31:00.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.253+0000 7fe2e0ff9640 1 --2- 10.20.193.28:0/1530514268 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe2b80b58d0 0x7fe2b80d5d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:00.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.253+0000 7fe2e0ff9640 1 -- 10.20.193.28:0/1530514268 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 8513+0+0 (secure 0 0 0) 0x7fe2d0014070 con 0x7fe2e410d150 2026-02-24T09:31:00.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.253+0000 7fe2e2ffd640 1 --2- 10.20.193.28:0/1530514268 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe2b80b58d0 0x7fe2b80d5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:00.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.253+0000 7fe2e0ff9640 1 -- 10.20.193.28:0/1530514268 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fe2d00e7530 con 0x7fe2e410d150 2026-02-24T09:31:00.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.254+0000 7fe2e2ffd640 1 --2- 10.20.193.28:0/1530514268 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe2b80b58d0 0x7fe2b80d5d80 secure :-1 s=READY pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2e40fb750 tx=0x7fe2d403a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:00.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.396+0000 7fe2e8bd2640 1 -- 10.20.193.28:0/1530514268 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fe2e40f5f40 con 0x7fe2e410d150 2026-02-24T09:31:00.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.403+0000 7fe2e0ff9640 1 -- 10.20.193.28:0/1530514268 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v23) ==== 81+0+827653 (secure 0 0 0) 0x7fe2d00a98d0 con 0x7fe2e410d150 2026-02-24T09:31:00.413 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:31:00.413 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-24T09:31:00.413 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 23, 2026-02-24T09:31:00.413 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.413 INFO:teuthology.orchestra.run.trial028.stdout: "active_gid": 14223, 2026-02-24T09:31:00.413 INFO:teuthology.orchestra.run.trial028.stdout: "active_name": "x", 2026-02-24T09:31:00.413 INFO:teuthology.orchestra.run.trial028.stdout: "active_addrs": { 2026-02-24T09:31:00.414 INFO:teuthology.orchestra.run.trial028.stdout: "addrvec": [ 2026-02-24T09:31:00.414 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.414 INFO:teuthology.orchestra.run.trial028.stdout: "type": "v2", 2026-02-24T09:31:00.414 INFO:teuthology.orchestra.run.trial028.stdout: "addr": "10.20.193.28:6800", 2026-02-24T09:31:00.414 INFO:teuthology.orchestra.run.trial028.stdout: "nonce": 906910473 2026-02-24T09:31:00.414 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.414 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.414 INFO:teuthology.orchestra.run.trial028.stdout: "type": "v1", 2026-02-24T09:31:00.414 INFO:teuthology.orchestra.run.trial028.stdout: "addr": "10.20.193.28:6801", 2026-02-24T09:31:00.414 INFO:teuthology.orchestra.run.trial028.stdout: "nonce": 906910473 2026-02-24T09:31:00.414 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.414 INFO:teuthology.orchestra.run.trial028.stdout: ] 2026-02-24T09:31:00.415 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.415 INFO:teuthology.orchestra.run.trial028.stdout: "active_addr": "10.20.193.28:6801/906910473", 2026-02-24T09:31:00.415 INFO:teuthology.orchestra.run.trial028.stdout: "active_change": "2026-02-24T09:13:39.242818+0000", 2026-02-24T09:31:00.415 INFO:teuthology.orchestra.run.trial028.stdout: "active_mgr_features": 4544132024016699391, 2026-02-24T09:31:00.415 INFO:teuthology.orchestra.run.trial028.stdout: "available": true, 2026-02-24T09:31:00.415 INFO:teuthology.orchestra.run.trial028.stdout: "standbys": [ 2026-02-24T09:31:00.415 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.415 INFO:teuthology.orchestra.run.trial028.stdout: "gid": 24271, 2026-02-24T09:31:00.415 INFO:teuthology.orchestra.run.trial028.stdout: "name": "y", 2026-02-24T09:31:00.415 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_features": 4544132024016699391, 2026-02-24T09:31:00.415 INFO:teuthology.orchestra.run.trial028.stdout: "available_modules": [ 2026-02-24T09:31:00.415 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.416 INFO:teuthology.orchestra.run.trial028.stdout: "name": "alerts", 2026-02-24T09:31:00.416 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.416 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.416 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.416 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-24T09:31:00.416 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-24T09:31:00.416 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.416 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.416 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.416 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-24T09:31:00.416 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.416 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.417 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.417 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How frequently to reexamine health status", 2026-02-24T09:31:00.417 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.417 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.417 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.417 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.417 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.417 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.417 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.417 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.417 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.417 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.417 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.418 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.418 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.418 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.418 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.418 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.418 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.418 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.418 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.418 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.418 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.418 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.418 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.419 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.419 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.419 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.419 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.419 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.419 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.419 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.419 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.419 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.419 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.419 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.419 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.419 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.420 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.420 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.420 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.420 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.420 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.420 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.420 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.420 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.420 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.420 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.420 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.420 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.420 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.421 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.421 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.421 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.421 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.421 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.421 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.421 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.421 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.421 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.421 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.421 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.421 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.422 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.422 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.422 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.422 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.422 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.422 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.422 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.422 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.422 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.422 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.422 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.422 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.422 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.423 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_destination": { 2026-02-24T09:31:00.423 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_destination", 2026-02-24T09:31:00.423 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.423 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.423 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.423 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.423 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.423 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.423 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.423 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2026-02-24T09:31:00.423 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.423 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.424 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.424 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.424 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_from_name": { 2026-02-24T09:31:00.424 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_from_name", 2026-02-24T09:31:00.424 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.424 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.424 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.424 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "Ceph", 2026-02-24T09:31:00.424 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.424 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.424 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.424 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Email From: name", 2026-02-24T09:31:00.424 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.425 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.425 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.425 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.425 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_host": { 2026-02-24T09:31:00.425 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_host", 2026-02-24T09:31:00.425 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.425 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.425 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.425 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.425 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.425 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.425 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.425 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "SMTP server", 2026-02-24T09:31:00.425 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.426 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.426 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.426 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.426 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_password": { 2026-02-24T09:31:00.426 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_password", 2026-02-24T09:31:00.426 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.426 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.426 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.426 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.426 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.426 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.426 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.426 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Password to authenticate with", 2026-02-24T09:31:00.427 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.427 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.427 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.427 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.427 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_port": { 2026-02-24T09:31:00.427 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_port", 2026-02-24T09:31:00.427 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.427 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.427 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.427 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "465", 2026-02-24T09:31:00.427 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.427 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.428 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.428 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "SMTP port", 2026-02-24T09:31:00.428 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.428 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.428 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.428 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.428 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_sender": { 2026-02-24T09:31:00.428 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_sender", 2026-02-24T09:31:00.428 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.428 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.428 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.428 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.428 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.429 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.429 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.429 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "SMTP envelope sender", 2026-02-24T09:31:00.429 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.429 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.429 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.429 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.429 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_ssl": { 2026-02-24T09:31:00.429 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_ssl", 2026-02-24T09:31:00.429 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.429 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.430 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.430 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.430 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.430 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.430 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.430 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use SSL to connect to SMTP server", 2026-02-24T09:31:00.430 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.430 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.430 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.430 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.430 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_user": { 2026-02-24T09:31:00.430 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_user", 2026-02-24T09:31:00.430 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.431 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.431 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.431 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.431 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.431 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.431 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.431 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "User to authenticate as", 2026-02-24T09:31:00.431 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.431 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.431 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.431 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.431 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.432 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.432 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.432 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.432 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.432 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.432 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.432 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.432 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.432 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.432 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.432 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.432 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.432 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.433 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.433 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.433 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.433 INFO:teuthology.orchestra.run.trial028.stdout: "name": "balancer", 2026-02-24T09:31:00.433 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.433 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.433 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.433 INFO:teuthology.orchestra.run.trial028.stdout: "active": { 2026-02-24T09:31:00.433 INFO:teuthology.orchestra.run.trial028.stdout: "name": "active", 2026-02-24T09:31:00.433 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.433 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.433 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.433 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.434 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.434 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.434 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.434 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "automatically balance PGs across cluster", 2026-02-24T09:31:00.434 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.434 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.434 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.434 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.434 INFO:teuthology.orchestra.run.trial028.stdout: "begin_time": { 2026-02-24T09:31:00.434 INFO:teuthology.orchestra.run.trial028.stdout: "name": "begin_time", 2026-02-24T09:31:00.434 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.434 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.434 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.435 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0000", 2026-02-24T09:31:00.435 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.435 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.435 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.435 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "beginning time of day to automatically balance", 2026-02-24T09:31:00.435 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "This is a time of day in the format HHMM.", 2026-02-24T09:31:00.435 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.435 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.435 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.435 INFO:teuthology.orchestra.run.trial028.stdout: "begin_weekday": { 2026-02-24T09:31:00.435 INFO:teuthology.orchestra.run.trial028.stdout: "name": "begin_weekday", 2026-02-24T09:31:00.435 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-24T09:31:00.435 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.436 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.436 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.436 INFO:teuthology.orchestra.run.trial028.stdout: "min": "0", 2026-02-24T09:31:00.436 INFO:teuthology.orchestra.run.trial028.stdout: "max": "6", 2026-02-24T09:31:00.436 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.436 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2026-02-24T09:31:00.436 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2026-02-24T09:31:00.436 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.436 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.436 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.436 INFO:teuthology.orchestra.run.trial028.stdout: "crush_compat_max_iterations": { 2026-02-24T09:31:00.436 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crush_compat_max_iterations", 2026-02-24T09:31:00.436 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-24T09:31:00.436 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.436 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.437 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "25", 2026-02-24T09:31:00.437 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-24T09:31:00.437 INFO:teuthology.orchestra.run.trial028.stdout: "max": "250", 2026-02-24T09:31:00.437 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.437 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "maximum number of iterations to attempt optimization", 2026-02-24T09:31:00.437 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.437 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.437 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.437 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.437 INFO:teuthology.orchestra.run.trial028.stdout: "crush_compat_metrics": { 2026-02-24T09:31:00.437 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crush_compat_metrics", 2026-02-24T09:31:00.437 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.437 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.437 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.437 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "pgs,objects,bytes", 2026-02-24T09:31:00.438 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.438 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.438 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.438 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "metrics with which to calculate OSD utilization", 2026-02-24T09:31:00.438 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2026-02-24T09:31:00.438 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.438 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.438 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.438 INFO:teuthology.orchestra.run.trial028.stdout: "crush_compat_step": { 2026-02-24T09:31:00.438 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crush_compat_step", 2026-02-24T09:31:00.438 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-24T09:31:00.438 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.438 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.438 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0.5", 2026-02-24T09:31:00.439 INFO:teuthology.orchestra.run.trial028.stdout: "min": "0.001", 2026-02-24T09:31:00.439 INFO:teuthology.orchestra.run.trial028.stdout: "max": "0.999", 2026-02-24T09:31:00.439 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.439 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "aggressiveness of optimization", 2026-02-24T09:31:00.439 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2026-02-24T09:31:00.439 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.439 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.439 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.439 INFO:teuthology.orchestra.run.trial028.stdout: "end_time": { 2026-02-24T09:31:00.439 INFO:teuthology.orchestra.run.trial028.stdout: "name": "end_time", 2026-02-24T09:31:00.439 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.439 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.439 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.439 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "2359", 2026-02-24T09:31:00.439 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.440 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.440 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.440 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "ending time of day to automatically balance", 2026-02-24T09:31:00.440 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "This is a time of day in the format HHMM.", 2026-02-24T09:31:00.440 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.440 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.440 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.440 INFO:teuthology.orchestra.run.trial028.stdout: "end_weekday": { 2026-02-24T09:31:00.440 INFO:teuthology.orchestra.run.trial028.stdout: "name": "end_weekday", 2026-02-24T09:31:00.440 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-24T09:31:00.440 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.440 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.440 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.440 INFO:teuthology.orchestra.run.trial028.stdout: "min": "0", 2026-02-24T09:31:00.440 INFO:teuthology.orchestra.run.trial028.stdout: "max": "6", 2026-02-24T09:31:00.440 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.441 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2026-02-24T09:31:00.441 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2026-02-24T09:31:00.441 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.441 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.441 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.441 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.441 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.441 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.441 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.441 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.441 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.441 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.441 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.441 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.441 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.441 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.442 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.442 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.442 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.442 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.442 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.442 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.442 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.442 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.442 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.442 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.442 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.442 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.442 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.442 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.443 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.443 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.443 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.443 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.443 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.443 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.443 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.443 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.443 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.443 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.443 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.443 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.443 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.443 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.443 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.443 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.443 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.443 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.444 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.444 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.444 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.444 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.444 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.444 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.444 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.444 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.444 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.444 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.444 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.444 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.444 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.444 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.444 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.444 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.444 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.444 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.445 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.445 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.445 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.445 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.445 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.445 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.445 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.445 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.445 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.445 INFO:teuthology.orchestra.run.trial028.stdout: "min_score": { 2026-02-24T09:31:00.445 INFO:teuthology.orchestra.run.trial028.stdout: "name": "min_score", 2026-02-24T09:31:00.445 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-24T09:31:00.445 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.445 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.445 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.445 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.445 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.445 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.446 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "minimum score, below which no optimization is attempted", 2026-02-24T09:31:00.446 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.446 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.446 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.446 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.446 INFO:teuthology.orchestra.run.trial028.stdout: "mode": { 2026-02-24T09:31:00.446 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mode", 2026-02-24T09:31:00.446 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.446 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.446 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.446 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "upmap", 2026-02-24T09:31:00.446 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.446 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.446 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.446 INFO:teuthology.orchestra.run.trial028.stdout: "crush-compat", 2026-02-24T09:31:00.446 INFO:teuthology.orchestra.run.trial028.stdout: "none", 2026-02-24T09:31:00.446 INFO:teuthology.orchestra.run.trial028.stdout: "read", 2026-02-24T09:31:00.446 INFO:teuthology.orchestra.run.trial028.stdout: "upmap", 2026-02-24T09:31:00.446 INFO:teuthology.orchestra.run.trial028.stdout: "upmap-read" 2026-02-24T09:31:00.446 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.447 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Balancer mode", 2026-02-24T09:31:00.447 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.447 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.447 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.447 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.447 INFO:teuthology.orchestra.run.trial028.stdout: "pool_ids": { 2026-02-24T09:31:00.447 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pool_ids", 2026-02-24T09:31:00.447 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.447 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.447 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.447 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.447 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.447 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.447 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.447 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "pools which the automatic balancing will be limited to", 2026-02-24T09:31:00.447 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.447 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.447 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.447 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.447 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-24T09:31:00.448 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-24T09:31:00.448 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.448 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.448 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.448 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-24T09:31:00.448 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.448 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.448 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.448 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how frequently to wake up and attempt optimization", 2026-02-24T09:31:00.448 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.448 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.448 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.448 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.448 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.448 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.448 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.448 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.448 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.448 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.449 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.449 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.449 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.449 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.449 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.449 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.449 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.449 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.449 INFO:teuthology.orchestra.run.trial028.stdout: "update_pg_upmap_activity": { 2026-02-24T09:31:00.449 INFO:teuthology.orchestra.run.trial028.stdout: "name": "update_pg_upmap_activity", 2026-02-24T09:31:00.449 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.449 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.449 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.449 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.449 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.449 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.449 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.449 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Updates pg_upmap activity stats to be used in `balancer status detail`", 2026-02-24T09:31:00.449 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.449 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.449 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.450 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.450 INFO:teuthology.orchestra.run.trial028.stdout: "upmap_max_deviation": { 2026-02-24T09:31:00.450 INFO:teuthology.orchestra.run.trial028.stdout: "name": "upmap_max_deviation", 2026-02-24T09:31:00.450 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.450 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.450 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.450 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-24T09:31:00.450 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-24T09:31:00.450 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.450 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.450 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "deviation below which no optimization is attempted", 2026-02-24T09:31:00.450 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2026-02-24T09:31:00.450 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.450 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.450 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.450 INFO:teuthology.orchestra.run.trial028.stdout: "upmap_max_optimizations": { 2026-02-24T09:31:00.450 INFO:teuthology.orchestra.run.trial028.stdout: "name": "upmap_max_optimizations", 2026-02-24T09:31:00.450 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-24T09:31:00.450 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.450 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.450 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-24T09:31:00.451 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.451 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.451 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.451 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "maximum upmap optimizations to make per attempt", 2026-02-24T09:31:00.451 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.451 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.451 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.451 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.451 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.451 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.451 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.451 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cephadm", 2026-02-24T09:31:00.451 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.451 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.451 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.451 INFO:teuthology.orchestra.run.trial028.stdout: "agent_down_multiplier": { 2026-02-24T09:31:00.451 INFO:teuthology.orchestra.run.trial028.stdout: "name": "agent_down_multiplier", 2026-02-24T09:31:00.451 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-24T09:31:00.451 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.451 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.452 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3.0", 2026-02-24T09:31:00.452 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.452 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.452 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.452 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2026-02-24T09:31:00.452 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.452 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.452 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.452 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.452 INFO:teuthology.orchestra.run.trial028.stdout: "agent_refresh_rate": { 2026-02-24T09:31:00.452 INFO:teuthology.orchestra.run.trial028.stdout: "name": "agent_refresh_rate", 2026-02-24T09:31:00.452 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.452 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.452 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.452 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "20", 2026-02-24T09:31:00.452 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.452 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.452 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.452 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How often the agent on each host will gather and send metadata", 2026-02-24T09:31:00.452 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.452 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.453 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.453 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.453 INFO:teuthology.orchestra.run.trial028.stdout: "agent_starting_port": { 2026-02-24T09:31:00.453 INFO:teuthology.orchestra.run.trial028.stdout: "name": "agent_starting_port", 2026-02-24T09:31:00.453 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.453 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.453 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.453 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "4721", 2026-02-24T09:31:00.453 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.453 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.453 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.453 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound", 2026-02-24T09:31:00.453 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.453 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.453 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.453 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.453 INFO:teuthology.orchestra.run.trial028.stdout: "allow_ptrace": { 2026-02-24T09:31:00.453 INFO:teuthology.orchestra.run.trial028.stdout: "name": "allow_ptrace", 2026-02-24T09:31:00.453 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.453 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.453 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.454 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.454 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.454 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.454 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.454 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2026-02-24T09:31:00.454 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.", 2026-02-24T09:31:00.454 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.454 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.454 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.454 INFO:teuthology.orchestra.run.trial028.stdout: "autotune_interval": { 2026-02-24T09:31:00.454 INFO:teuthology.orchestra.run.trial028.stdout: "name": "autotune_interval", 2026-02-24T09:31:00.454 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.454 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.454 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.454 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-24T09:31:00.454 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.454 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.454 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.454 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How frequently to autotune daemon memory", 2026-02-24T09:31:00.454 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.454 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.454 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.455 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.455 INFO:teuthology.orchestra.run.trial028.stdout: "autotune_memory_target_ratio": { 2026-02-24T09:31:00.455 INFO:teuthology.orchestra.run.trial028.stdout: "name": "autotune_memory_target_ratio", 2026-02-24T09:31:00.455 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-24T09:31:00.455 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.455 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.455 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0.7", 2026-02-24T09:31:00.455 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.455 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.455 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.455 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized", 2026-02-24T09:31:00.455 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.455 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.455 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.455 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.455 INFO:teuthology.orchestra.run.trial028.stdout: "cephadm_log_destination": { 2026-02-24T09:31:00.455 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cephadm_log_destination", 2026-02-24T09:31:00.455 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.455 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.455 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.455 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.455 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.456 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.456 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.456 INFO:teuthology.orchestra.run.trial028.stdout: "file", 2026-02-24T09:31:00.456 INFO:teuthology.orchestra.run.trial028.stdout: "file,syslog", 2026-02-24T09:31:00.456 INFO:teuthology.orchestra.run.trial028.stdout: "syslog" 2026-02-24T09:31:00.456 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.456 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Destination for cephadm command persistent logging", 2026-02-24T09:31:00.456 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.456 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.456 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.456 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.456 INFO:teuthology.orchestra.run.trial028.stdout: "certificate_automated_rotation_enabled": { 2026-02-24T09:31:00.456 INFO:teuthology.orchestra.run.trial028.stdout: "name": "certificate_automated_rotation_enabled", 2026-02-24T09:31:00.456 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.456 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.456 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.456 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.456 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.456 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.456 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.456 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "This flag controls whether cephadm automatically rotates certificates upon expiration.", 2026-02-24T09:31:00.456 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.456 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.456 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.456 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.457 INFO:teuthology.orchestra.run.trial028.stdout: "certificate_check_debug_mode": { 2026-02-24T09:31:00.457 INFO:teuthology.orchestra.run.trial028.stdout: "name": "certificate_check_debug_mode", 2026-02-24T09:31:00.457 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.457 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.457 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.457 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.457 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.457 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.457 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.457 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.", 2026-02-24T09:31:00.457 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.457 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.457 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.457 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.457 INFO:teuthology.orchestra.run.trial028.stdout: "certificate_check_period": { 2026-02-24T09:31:00.457 INFO:teuthology.orchestra.run.trial028.stdout: "name": "certificate_check_period", 2026-02-24T09:31:00.457 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.457 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.457 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.457 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1", 2026-02-24T09:31:00.457 INFO:teuthology.orchestra.run.trial028.stdout: "min": "0", 2026-02-24T09:31:00.457 INFO:teuthology.orchestra.run.trial028.stdout: "max": "30", 2026-02-24T09:31:00.457 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.457 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Specifies how often (in days) the certificate should be checked for validity.", 2026-02-24T09:31:00.458 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.458 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.458 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.458 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.458 INFO:teuthology.orchestra.run.trial028.stdout: "certificate_duration_days": { 2026-02-24T09:31:00.458 INFO:teuthology.orchestra.run.trial028.stdout: "name": "certificate_duration_days", 2026-02-24T09:31:00.458 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.458 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.458 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.458 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1095", 2026-02-24T09:31:00.458 INFO:teuthology.orchestra.run.trial028.stdout: "min": "90", 2026-02-24T09:31:00.458 INFO:teuthology.orchestra.run.trial028.stdout: "max": "3650", 2026-02-24T09:31:00.458 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.458 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Specifies the duration of self-signed certificates generated and signed by the cephadm root CA", 2026-02-24T09:31:00.458 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.458 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.458 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.458 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.458 INFO:teuthology.orchestra.run.trial028.stdout: "certificate_renewal_threshold_days": { 2026-02-24T09:31:00.458 INFO:teuthology.orchestra.run.trial028.stdout: "name": "certificate_renewal_threshold_days", 2026-02-24T09:31:00.458 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.458 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.458 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.459 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "30", 2026-02-24T09:31:00.459 INFO:teuthology.orchestra.run.trial028.stdout: "min": "10", 2026-02-24T09:31:00.459 INFO:teuthology.orchestra.run.trial028.stdout: "max": "90", 2026-02-24T09:31:00.459 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.459 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Specifies the lead time in days to initiate certificate renewal before expiration.", 2026-02-24T09:31:00.459 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.459 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.459 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.459 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.459 INFO:teuthology.orchestra.run.trial028.stdout: "cgroups_split": { 2026-02-24T09:31:00.459 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cgroups_split", 2026-02-24T09:31:00.459 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.459 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.459 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.459 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.459 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.459 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.459 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.459 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently Podman only)", 2026-02-24T09:31:00.459 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.459 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.459 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.459 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.459 INFO:teuthology.orchestra.run.trial028.stdout: "config_checks_enabled": { 2026-02-24T09:31:00.459 INFO:teuthology.orchestra.run.trial028.stdout: "name": "config_checks_enabled", 2026-02-24T09:31:00.460 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.460 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.460 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.460 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.460 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.460 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.460 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.460 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Enable or disable cephadm configuration analysis", 2026-02-24T09:31:00.460 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.460 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.460 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.460 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.460 INFO:teuthology.orchestra.run.trial028.stdout: "config_dashboard": { 2026-02-24T09:31:00.460 INFO:teuthology.orchestra.run.trial028.stdout: "name": "config_dashboard", 2026-02-24T09:31:00.460 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.460 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.460 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.460 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.460 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.460 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.460 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.460 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Manage configs like API endpoints in Dashboard.", 2026-02-24T09:31:00.460 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.461 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.461 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.461 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.461 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_alertmanager": { 2026-02-24T09:31:00.461 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_alertmanager", 2026-02-24T09:31:00.461 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.461 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.461 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.461 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.28.1", 2026-02-24T09:31:00.461 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.461 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.461 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.461 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Alertmanager container image", 2026-02-24T09:31:00.461 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.461 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.461 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.461 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.461 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_alloy": { 2026-02-24T09:31:00.461 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_alloy", 2026-02-24T09:31:00.461 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.461 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.461 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.461 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "docker.io/grafana/alloy:latest", 2026-02-24T09:31:00.461 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.461 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.461 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.462 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Alloy container image", 2026-02-24T09:31:00.462 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.462 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.462 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.462 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.462 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_base": { 2026-02-24T09:31:00.462 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_base", 2026-02-24T09:31:00.462 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.462 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.462 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.462 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/ceph", 2026-02-24T09:31:00.462 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.462 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.462 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.462 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Container image name, without the tag", 2026-02-24T09:31:00.462 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.462 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.462 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.462 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.462 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_elasticsearch": { 2026-02-24T09:31:00.462 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_elasticsearch", 2026-02-24T09:31:00.462 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.462 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.462 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.462 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2026-02-24T09:31:00.462 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.463 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.463 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.463 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Elasticsearch container image", 2026-02-24T09:31:00.463 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.463 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.463 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.463 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.463 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_grafana": { 2026-02-24T09:31:00.463 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_grafana", 2026-02-24T09:31:00.463 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.463 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.463 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.463 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/grafana:12.3.1", 2026-02-24T09:31:00.463 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.463 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.463 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.463 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Grafana container image", 2026-02-24T09:31:00.463 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.463 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.463 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.463 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.463 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_haproxy": { 2026-02-24T09:31:00.463 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_haproxy", 2026-02-24T09:31:00.463 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.463 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.463 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.464 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2026-02-24T09:31:00.464 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.464 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.464 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.464 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Haproxy container image", 2026-02-24T09:31:00.464 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.464 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.464 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.464 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.464 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_jaeger_agent": { 2026-02-24T09:31:00.464 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_jaeger_agent", 2026-02-24T09:31:00.464 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.464 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.464 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.464 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2026-02-24T09:31:00.464 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.464 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.464 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.464 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Jaeger agent container image", 2026-02-24T09:31:00.464 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.464 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.464 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.464 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.464 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_jaeger_collector": { 2026-02-24T09:31:00.464 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_jaeger_collector", 2026-02-24T09:31:00.464 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.464 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.464 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.465 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2026-02-24T09:31:00.465 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.465 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.465 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.465 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Jaeger collector container image", 2026-02-24T09:31:00.465 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.465 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.465 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.465 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.465 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_jaeger_query": { 2026-02-24T09:31:00.465 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_jaeger_query", 2026-02-24T09:31:00.465 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.465 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.465 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.465 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2026-02-24T09:31:00.465 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.465 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.465 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.465 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Jaeger query container image", 2026-02-24T09:31:00.465 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.465 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.465 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.465 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.465 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_keepalived": { 2026-02-24T09:31:00.465 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_keepalived", 2026-02-24T09:31:00.465 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.465 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.466 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.466 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2026-02-24T09:31:00.466 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.466 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.466 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.466 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Keepalived container image", 2026-02-24T09:31:00.466 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.466 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.466 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.466 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.466 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_loki": { 2026-02-24T09:31:00.466 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_loki", 2026-02-24T09:31:00.466 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.466 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.466 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.466 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2026-02-24T09:31:00.466 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.466 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.466 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.466 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Loki container image", 2026-02-24T09:31:00.466 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.466 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.466 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.466 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.466 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_nginx": { 2026-02-24T09:31:00.466 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_nginx", 2026-02-24T09:31:00.466 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.466 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.466 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.467 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2026-02-24T09:31:00.467 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.467 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.467 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.467 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Nginx container image", 2026-02-24T09:31:00.467 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.467 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.467 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.467 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.467 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_node_exporter": { 2026-02-24T09:31:00.467 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_node_exporter", 2026-02-24T09:31:00.467 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.467 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.467 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.467 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.9.1", 2026-02-24T09:31:00.467 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.467 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.467 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.467 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Node exporter container image", 2026-02-24T09:31:00.467 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.467 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.467 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.467 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.467 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_nvmeof": { 2026-02-24T09:31:00.467 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_nvmeof", 2026-02-24T09:31:00.467 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.467 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.467 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.467 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/nvmeof:1.6", 2026-02-24T09:31:00.467 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.467 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.468 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.468 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Nvmeof container image", 2026-02-24T09:31:00.468 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.468 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.468 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.468 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.468 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_oauth2_proxy": { 2026-02-24T09:31:00.468 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_oauth2_proxy", 2026-02-24T09:31:00.468 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.468 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.468 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.468 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2026-02-24T09:31:00.468 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.468 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.468 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.468 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Oauth2 proxy container image", 2026-02-24T09:31:00.468 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.468 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.468 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.468 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.468 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_prometheus": { 2026-02-24T09:31:00.468 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_prometheus", 2026-02-24T09:31:00.468 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.468 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.468 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.468 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/prometheus/prometheus:v3.6.0", 2026-02-24T09:31:00.468 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.468 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.468 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.468 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Prometheus container image", 2026-02-24T09:31:00.468 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.469 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.469 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.469 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.469 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_promtail": { 2026-02-24T09:31:00.469 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_promtail", 2026-02-24T09:31:00.469 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.469 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.469 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.469 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2026-02-24T09:31:00.469 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.469 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.469 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.469 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Promtail container image", 2026-02-24T09:31:00.469 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.469 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.469 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.469 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.469 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_samba": { 2026-02-24T09:31:00.469 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_samba", 2026-02-24T09:31:00.469 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.469 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.469 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.469 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2026-02-24T09:31:00.469 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.469 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.469 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.469 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Samba container image", 2026-02-24T09:31:00.469 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.469 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.469 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.469 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.470 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_samba_metrics": { 2026-02-24T09:31:00.470 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_samba_metrics", 2026-02-24T09:31:00.470 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.470 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.470 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.470 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/samba.org/samba-metrics:devbuilds-centos-amd64", 2026-02-24T09:31:00.470 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.470 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.470 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.470 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Samba metrics container image", 2026-02-24T09:31:00.470 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.470 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.470 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.470 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.470 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_snmp_gateway": { 2026-02-24T09:31:00.470 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_snmp_gateway", 2026-02-24T09:31:00.470 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.470 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.470 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.470 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2026-02-24T09:31:00.470 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.470 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.470 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.470 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Snmp gateway container image", 2026-02-24T09:31:00.470 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.470 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.470 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.470 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.470 INFO:teuthology.orchestra.run.trial028.stdout: "container_init": { 2026-02-24T09:31:00.470 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_init", 2026-02-24T09:31:00.471 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.471 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.471 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.471 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.471 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.471 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.471 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.471 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Run podman/docker with `--init`", 2026-02-24T09:31:00.471 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.471 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.471 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.471 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.471 INFO:teuthology.orchestra.run.trial028.stdout: "daemon_cache_timeout": { 2026-02-24T09:31:00.471 INFO:teuthology.orchestra.run.trial028.stdout: "name": "daemon_cache_timeout", 2026-02-24T09:31:00.471 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.471 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.471 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.471 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-24T09:31:00.471 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.471 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.471 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.471 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Seconds for which to cache service (daemon) inventory", 2026-02-24T09:31:00.471 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.471 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.471 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.471 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.471 INFO:teuthology.orchestra.run.trial028.stdout: "default_cephadm_command_timeout": { 2026-02-24T09:31:00.471 INFO:teuthology.orchestra.run.trial028.stdout: "name": "default_cephadm_command_timeout", 2026-02-24T09:31:00.471 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.471 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.471 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.471 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "900", 2026-02-24T09:31:00.472 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.472 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.472 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.472 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2026-02-24T09:31:00.472 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.472 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.472 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.472 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.472 INFO:teuthology.orchestra.run.trial028.stdout: "default_registry": { 2026-02-24T09:31:00.472 INFO:teuthology.orchestra.run.trial028.stdout: "name": "default_registry", 2026-02-24T09:31:00.472 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.472 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.472 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.472 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io", 2026-02-24T09:31:00.472 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.472 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.472 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.472 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2026-02-24T09:31:00.472 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.472 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.472 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.472 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.472 INFO:teuthology.orchestra.run.trial028.stdout: "device_cache_timeout": { 2026-02-24T09:31:00.472 INFO:teuthology.orchestra.run.trial028.stdout: "name": "device_cache_timeout", 2026-02-24T09:31:00.472 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.472 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.472 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.472 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1800", 2026-02-24T09:31:00.472 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.472 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.472 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.472 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Seconds for which to cache device inventory", 2026-02-24T09:31:00.473 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.473 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.473 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.473 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.473 INFO:teuthology.orchestra.run.trial028.stdout: "device_enhanced_scan": { 2026-02-24T09:31:00.473 INFO:teuthology.orchestra.run.trial028.stdout: "name": "device_enhanced_scan", 2026-02-24T09:31:00.473 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.473 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.473 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.473 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.473 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.473 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.473 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.473 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use libstoragemgmt during device scans", 2026-02-24T09:31:00.473 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.473 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.473 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.473 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.473 INFO:teuthology.orchestra.run.trial028.stdout: "facts_cache_timeout": { 2026-02-24T09:31:00.473 INFO:teuthology.orchestra.run.trial028.stdout: "name": "facts_cache_timeout", 2026-02-24T09:31:00.473 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.473 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.473 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.473 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-24T09:31:00.473 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.473 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.473 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.473 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Seconds for which to cache host facts data", 2026-02-24T09:31:00.473 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.473 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.473 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.473 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.473 INFO:teuthology.orchestra.run.trial028.stdout: "grafana_dashboards_path": { 2026-02-24T09:31:00.474 INFO:teuthology.orchestra.run.trial028.stdout: "name": "grafana_dashboards_path", 2026-02-24T09:31:00.474 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.474 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.474 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.474 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2026-02-24T09:31:00.474 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.474 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.474 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.474 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Location of dashboards to include in Grafana", 2026-02-24T09:31:00.474 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.474 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.474 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.474 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.474 INFO:teuthology.orchestra.run.trial028.stdout: "host_check_interval": { 2026-02-24T09:31:00.474 INFO:teuthology.orchestra.run.trial028.stdout: "name": "host_check_interval", 2026-02-24T09:31:00.474 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.474 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.474 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.474 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-24T09:31:00.474 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.474 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.474 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.474 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How frequently to perform a host check", 2026-02-24T09:31:00.474 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.474 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.474 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.474 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.474 INFO:teuthology.orchestra.run.trial028.stdout: "hw_monitoring": { 2026-02-24T09:31:00.474 INFO:teuthology.orchestra.run.trial028.stdout: "name": "hw_monitoring", 2026-02-24T09:31:00.474 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.474 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Whether the hardware monitoring daemon be deployed on every host?", 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: "inventory_list_all": { 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: "name": "inventory_list_all", 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.475 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.476 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.476 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.476 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.476 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.476 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.476 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.476 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.476 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.476 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.476 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.476 INFO:teuthology.orchestra.run.trial028.stdout: "log_refresh_metadata": { 2026-02-24T09:31:00.476 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_refresh_metadata", 2026-02-24T09:31:00.476 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.476 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.476 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.476 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.476 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.476 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.476 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.476 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level", 2026-02-24T09:31:00.476 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.476 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.476 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.476 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.476 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.476 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.476 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.476 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.476 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.476 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.476 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.477 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.477 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.477 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Log to the \"cephadm\" cluster log channel\"", 2026-02-24T09:31:00.477 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.477 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.477 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.477 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.477 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.477 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.477 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.477 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.477 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.477 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.477 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.477 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.477 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.477 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.477 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.477 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.477 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.477 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.477 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.477 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.477 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.477 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.477 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.477 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.477 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.477 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.477 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.477 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.477 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.477 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.477 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: "manage_etc_ceph_ceph_conf": { 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: "name": "manage_etc_ceph_ceph_conf", 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on hosts.", 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "*", 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.478 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: "max_count_per_host": { 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_count_per_host", 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Max number of daemons per service per host: guard against mistakes and runaways", 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: "max_osd_draining_count": { 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_osd_draining_count", 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Max number of OSDs that will be drained simultaneously when OSDs are removed", 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: "max_parallel_osd_upgrades": { 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_parallel_osd_upgrades", 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.479 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "16", 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Maximum number of OSD daemons upgraded in parallel.", 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: "migration_current": { 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: "name": "migration_current", 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Internal - do not modify", 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: "mode": { 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mode", 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "root", 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: "cephadm-package", 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: "root" 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Mode for remote execution of cephadm", 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.480 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: "oob_default_addr": { 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: "name": "oob_default_addr", 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "169.254.1.1", 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Default IP address for RedFish API (OOB management).", 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: "prometheus_alerts_path": { 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: "name": "prometheus_alerts_path", 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Location of alerts to include in Prometheus Alertmanager", 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: "registry_insecure": { 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_insecure", 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.481 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "registry_password": { 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_password", 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "registry_url": { 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_url", 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Registry URL for login purposes. This is not the default registry.", 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "registry_username": { 2026-02-24T09:31:00.482 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_username", 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "secure_monitoring_stack": { 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "name": "secure_monitoring_stack", 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Enable TLS security for all monitoring stack daemons", 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "service_discovery_port": { 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "name": "service_discovery_port", 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8765", 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Cephadm service discovery port", 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.483 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "ssh_config_file": { 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssh_config_file", 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Customized SSH config file to distribute to managed hosts", 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "ssh_keepalive_count_max": { 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssh_keepalive_count_max", 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3", 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.484 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How many sequential SSH connection liveness check failures before the host is marked offline", 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "ssh_keepalive_interval": { 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssh_keepalive_interval", 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "7", 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How often SSH connections are checked for liveness", 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "stray_daemon_check_interval": { 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "name": "stray_daemon_check_interval", 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1800", 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How frequently cephadm should check for the presence of stray daemons", 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "use_agent": { 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "name": "use_agent", 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.485 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use the cephadm agent on each host to gather and send metadata", 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: "use_repo_digest": { 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: "name": "use_repo_digest", 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Automatically convert image tags to image digest to ensure that all daemons use the same image", 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: "warn_on_failed_host_check": { 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_on_failed_host_check", 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Raise a health warning if the host check fails", 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.486 INFO:teuthology.orchestra.run.trial028.stdout: "warn_on_stray_daemons": { 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_on_stray_daemons", 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Raise a health warning if daemons are detected that are not managed by cephadm", 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "warn_on_stray_hosts": { 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_on_stray_hosts", 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Raise a health warning if daemons are detected on a host that is not managed by cephadm", 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crash", 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.487 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.488 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "retain_interval": { 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "name": "retain_interval", 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "31536000", 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how long to retain crashes before pruning them", 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.489 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: "warn_recent_interval": { 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_recent_interval", 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1209600", 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "time interval in which to warn about recent crashes", 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: "name": "dashboard", 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: "ALERTMANAGER_API_HOST": { 2026-02-24T09:31:00.490 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ALERTMANAGER_API_HOST", 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "AUDIT_API_ENABLED": { 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "name": "AUDIT_API_ENABLED", 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "AUDIT_API_LOG_PAYLOAD": { 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.491 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "ENABLE_BROWSABLE_API": { 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ENABLE_BROWSABLE_API", 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_CEPHFS": { 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.492 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_ISCSI": { 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_MIRRORING": { 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_NFS": { 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_NFS", 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.493 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_RBD": { 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_RBD", 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_RGW": { 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_RGW", 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.494 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_PASSWORD": { 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_PASSWORD", 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "admin", 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_SSL_VERIFY": { 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_URL": { 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_URL", 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_USERNAME": { 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_USERNAME", 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.495 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "admin", 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_FRONTEND_API_URL": { 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "ISCSI_API_SSL_VERIFICATION": { 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.496 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "ISSUE_TRACKER_API_KEY": { 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ISSUE_TRACKER_API_KEY", 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "MANAGED_BY_CLUSTERS": { 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "name": "MANAGED_BY_CLUSTERS", 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "[]", 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "MULTICLUSTER_CONFIG": { 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "name": "MULTICLUSTER_CONFIG", 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "{}", 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "PROMETHEUS_API_HOST": { 2026-02-24T09:31:00.497 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PROMETHEUS_API_HOST", 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "PROM_ALERT_CREDENTIAL_CACHE_TTL": { 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PROM_ALERT_CREDENTIAL_CACHE_TTL", 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.498 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.499 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_ENABLED": { 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_ENABLED", 2026-02-24T09:31:00.500 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_MIN_LENGTH": { 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8", 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.501 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "REST_REQUESTS_TIMEOUT": { 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "name": "REST_REQUESTS_TIMEOUT", 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "45", 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_ACCESS_KEY": { 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_ACCESS_KEY", 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_ADMIN_RESOURCE": { 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "admin", 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.502 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_SECRET_KEY": { 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_SECRET_KEY", 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_SSL_VERIFY": { 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_SSL_VERIFY", 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_HOSTNAME_PER_DAEMON": { 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_HOSTNAME_PER_DAEMON", 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "UNSAFE_TLS_v1_2": { 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "name": "UNSAFE_TLS_v1_2", 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "USER_PWD_EXPIRATION_SPAN": { 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.504 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "cross_origin_url": { 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cross_origin_url", 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "crt_file": { 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crt_file", 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "crypto_caller": { 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crypto_caller", 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "debug": { 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "name": "debug", 2026-02-24T09:31:00.505 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Enable/disable debug options", 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "jwt_token_ttl": { 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "name": "jwt_token_ttl", 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "28800", 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "key_file": { 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "name": "key_file", 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.506 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.507 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "motd": { 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "name": "motd", 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "The message of the day", 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "redirect_resolve_ip_addr": { 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "name": "redirect_resolve_ip_addr", 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.508 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "server_addr": { 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_addr", 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "::", 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "server_port": { 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_port", 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8080", 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "ssl": { 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssl", 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.509 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "ssl_server_port": { 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssl_server_port", 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8443", 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "sso_oauth2": { 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sso_oauth2", 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "standby_behaviour": { 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_behaviour", 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "redirect", 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.510 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "redirect" 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "standby_error_status_code": { 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_error_status_code", 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "500", 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "min": "400", 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "max": "599", 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "url_prefix": { 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "name": "url_prefix", 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "name": "devicehealth", 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "enable_monitoring": { 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "name": "enable_monitoring", 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.511 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "monitor device health metrics", 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.512 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "mark_out_threshold": { 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mark_out_threshold", 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "2419200", 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "automatically mark OSD if it may fail before this long", 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.513 INFO:teuthology.orchestra.run.trial028.stdout: "pool_name": { 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pool_name", 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "device_health_metrics", 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "name of pool in which to store device health metrics", 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "retention_period": { 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "name": "retention_period", 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "15552000", 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how long to retain device health metrics", 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "scrape_frequency": { 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "name": "scrape_frequency", 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "86400", 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how frequently to scrape device health metrics", 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "self_heal": { 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "name": "self_heal", 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.514 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "preemptively heal cluster around devices that may fail", 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how frequently to wake up and check device health", 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "warn_threshold": { 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_threshold", 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "7257600", 2026-02-24T09:31:00.515 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "raise health warning if OSD may fail before this long", 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "name": "diskprediction_local", 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.516 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "predict_interval": { 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "name": "predict_interval", 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "86400", 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.517 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "predictor_model": { 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "name": "predictor_model", 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "prophetstor", 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.518 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "name": "influx", 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": false, 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "influxdb python module not found", 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "batch_size": { 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "name": "batch_size", 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5000", 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "database": { 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "name": "database", 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "ceph", 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "hostname": { 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "name": "hostname", 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "InfluxDB server hostname", 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.519 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "30", 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "min": "5", 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.520 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "password": { 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "name": "password", 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.521 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "password of InfluxDB server user", 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "port": { 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "name": "port", 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8086", 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "InfluxDB server port", 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "ssl": { 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssl", 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "false", 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.522 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "threads": { 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "name": "threads", 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "max": "32", 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "username": { 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "name": "username", 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "username of InfluxDB server user", 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "verify_ssl": { 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "name": "verify_ssl", 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "true", 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "name": "insights", 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.523 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.524 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "name": "iostat", 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.525 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.526 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "name": "k8sevents", 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_event_retention_days": { 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ceph_event_retention_days", 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.527 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "7", 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Days to hold ceph event information within local cache", 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "config_check_secs": { 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "name": "config_check_secs", 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "min": "10", 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.528 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.529 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "name": "localpool", 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "failure_domain": { 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "name": "failure_domain", 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "host", 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "failure domain for any created local pool", 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.530 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.531 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "min_size": { 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "name": "min_size", 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "default min_size for any created local pool", 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "num_rep": { 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "name": "num_rep", 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3", 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "default replica count for any created local pool", 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "pg_num": { 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pg_num", 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "128", 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.532 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "default pg_num for any created local pool", 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "prefix": { 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "name": "prefix", 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "name prefix for any created local pool", 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "subtree": { 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "name": "subtree", 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "rack", 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "CRUSH level for which to create a local pool", 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.533 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mds_autoscaler", 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.534 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.535 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mirroring", 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.536 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "name": "nfs", 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.537 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.538 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "name": "orchestrator", 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.539 INFO:teuthology.orchestra.run.trial028.stdout: "fail_fs": { 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "name": "fail_fs", 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.540 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "orchestrator": { 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "name": "orchestrator", 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "cephadm", 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "rook", 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: "test_orchestrator" 2026-02-24T09:31:00.541 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Orchestrator backend", 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "name": "osd_perf_query", 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.542 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.543 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "name": "osd_support", 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.544 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.545 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pg_autoscaler", 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.546 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.547 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "threshold": { 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "name": "threshold", 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3.0", 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1.0", 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "scaling threshold", 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "name": "progress", 2026-02-24T09:31:00.548 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "allow_pg_recovery_event": { 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "name": "allow_pg_recovery_event", 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "allow the module to show pg recovery progress", 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "enabled": { 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "name": "enabled", 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.549 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.550 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "max_completed_events": { 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_completed_events", 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "50", 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "number of past completed events to remember", 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how long the module is going to sleep", 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.551 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "name": "prometheus", 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "cache": { 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cache", 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "exclude_perf_counters": { 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "name": "exclude_perf_counters", 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Do not include perf-counters in the metrics output", 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "healthcheck_history_max_entries": { 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "name": "healthcheck_history_max_entries", 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1000", 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Maximum number of health check history entries to keep", 2026-02-24T09:31:00.552 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.553 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_stats_pools": { 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rbd_stats_pools", 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_stats_pools_refresh_interval": { 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rbd_stats_pools_refresh_interval", 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "300", 2026-02-24T09:31:00.554 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "scrape_interval": { 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "name": "scrape_interval", 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "15.0", 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "server_addr": { 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_addr", 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "::", 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "server_port": { 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_port", 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "9283", 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "the port on which the module listens for HTTP requests", 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.555 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "stale_cache_strategy": { 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "name": "stale_cache_strategy", 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "log", 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "standby_behaviour": { 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_behaviour", 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "default", 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "default", 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "error" 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.556 INFO:teuthology.orchestra.run.trial028.stdout: "standby_error_status_code": { 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_error_status_code", 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "500", 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "min": "400", 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "max": "599", 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rbd_support", 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.557 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "max_concurrent_snap_create": { 2026-02-24T09:31:00.558 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_concurrent_snap_create", 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "mirror_snapshot_schedule": { 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mirror_snapshot_schedule", 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "trash_purge_schedule": { 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "name": "trash_purge_schedule", 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.559 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rgw", 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.560 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "secondary_zone_period_retry_limit": { 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "name": "secondary_zone_period_retry_limit", 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.561 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "RGW module period update retry limit for secondary site", 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rook", 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.562 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.563 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "prometheus_tls_secret_name": { 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "name": "prometheus_tls_secret_name", 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "rook-ceph-prometheus-server-tls", 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "name of tls secret in k8s for prometheus", 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "secure_monitoring_stack": { 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "name": "secure_monitoring_stack", 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.564 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "storage_class": { 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "name": "storage_class", 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "local", 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "storage class name for LSO-discovered PVs", 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "name": "selftest", 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.565 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.566 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "roption1": { 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "name": "roption1", 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "roption2": { 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "name": "roption2", 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "xyz", 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption1": { 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption1", 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.567 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption2": { 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption2", 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption3": { 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption3", 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption4": { 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption4", 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption5": { 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption5", 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.568 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption6": { 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption6", 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption7": { 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption7", 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "max": "42", 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.569 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "testkey": { 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "name": "testkey", 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "testlkey": { 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "name": "testlkey", 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "testnewline": { 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "name": "testnewline", 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.570 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smb", 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "internal_store_backend": { 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "name": "internal_store_backend", 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "set internal store backend. for develoment and testing only", 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.571 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.572 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "update_orchestration": { 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "name": "update_orchestration", 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "automatically update orchestration when smb resources are changed", 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "name": "snap_schedule", 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "allow_m_granularity": { 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "name": "allow_m_granularity", 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "allow minute scheduled snapshots", 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "dump_on_update": { 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "name": "dump_on_update", 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.573 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "dump database to debug log on update", 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.574 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.575 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "name": "stats", 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.576 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.577 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "name": "status", 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.578 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "name": "telegraf", 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.579 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "address": { 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "name": "address", 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "15", 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.580 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.581 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "name": "telemetry", 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "channel_basic": { 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_basic", 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share basic cluster information (size, version)", 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "channel_crash": { 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_crash", 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.582 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "channel_device": { 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_device", 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "channel_ident": { 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_ident", 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "channel_perf": { 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_perf", 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share various performance metrics of a cluster", 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.583 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "contact": { 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "name": "contact", 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "description": { 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "name": "description", 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "device_url": { 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "name": "device_url", 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "https://telemetry.ceph.com/device", 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "enabled": { 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "name": "enabled", 2026-02-24T09:31:00.584 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "24", 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "min": "8", 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "last_opt_revision": { 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "name": "last_opt_revision", 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1", 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "leaderboard": { 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "name": "leaderboard", 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "leaderboard_description": { 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "name": "leaderboard_description", 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.586 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "organization": { 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "name": "organization", 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.587 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "proxy": { 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "name": "proxy", 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "url": { 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "name": "url", 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "https://telemetry.ceph.com/report", 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.588 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "name": "test_orchestrator", 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.589 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.590 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "name": "volumes", 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.591 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "max_concurrent_clones": { 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_concurrent_clones", 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "4", 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Number of asynchronous cloner threads", 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "pause_cloning": { 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pause_cloning", 2026-02-24T09:31:00.592 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Pause asynchronous cloner threads", 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "pause_purging": { 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pause_purging", 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Pause asynchronous subvolume purge threads", 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "periodic_async_work": { 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "name": "periodic_async_work", 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Periodically check for async work", 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "snapshot_clone_delay": { 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "name": "snapshot_clone_delay", 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.593 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "snapshot_clone_no_wait": { 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "name": "snapshot_clone_no_wait", 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: ] 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "gid": 24281, 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "name": "z", 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_features": 4544132024016699391, 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "available_modules": [ 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "name": "alerts", 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.594 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How frequently to reexamine health status", 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.595 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_destination": { 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_destination", 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.596 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_from_name": { 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_from_name", 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "Ceph", 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Email From: name", 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_host": { 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_host", 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "SMTP server", 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_password": { 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_password", 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Password to authenticate with", 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_port": { 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_port", 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.597 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "465", 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "SMTP port", 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_sender": { 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_sender", 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "SMTP envelope sender", 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_ssl": { 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_ssl", 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use SSL to connect to SMTP server", 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_user": { 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_user", 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.598 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "User to authenticate as", 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "name": "balancer", 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "active": { 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "name": "active", 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "automatically balance PGs across cluster", 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "begin_time": { 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "name": "begin_time", 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0000", 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.599 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "beginning time of day to automatically balance", 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "This is a time of day in the format HHMM.", 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "begin_weekday": { 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "name": "begin_weekday", 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "min": "0", 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "max": "6", 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "crush_compat_max_iterations": { 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crush_compat_max_iterations", 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "25", 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "max": "250", 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "maximum number of iterations to attempt optimization", 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "crush_compat_metrics": { 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crush_compat_metrics", 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "pgs,objects,bytes", 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "metrics with which to calculate OSD utilization", 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2026-02-24T09:31:00.600 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "crush_compat_step": { 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crush_compat_step", 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0.5", 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "min": "0.001", 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "max": "0.999", 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "aggressiveness of optimization", 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "end_time": { 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "name": "end_time", 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "2359", 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "ending time of day to automatically balance", 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "This is a time of day in the format HHMM.", 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "end_weekday": { 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "name": "end_weekday", 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "min": "0", 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "max": "6", 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.601 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.602 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "min_score": { 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "name": "min_score", 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "minimum score, below which no optimization is attempted", 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "mode": { 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mode", 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "upmap", 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "crush-compat", 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "none", 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "read", 2026-02-24T09:31:00.603 INFO:teuthology.orchestra.run.trial028.stdout: "upmap", 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "upmap-read" 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Balancer mode", 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "pool_ids": { 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pool_ids", 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "pools which the automatic balancing will be limited to", 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how frequently to wake up and attempt optimization", 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.604 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "update_pg_upmap_activity": { 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "name": "update_pg_upmap_activity", 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Updates pg_upmap activity stats to be used in `balancer status detail`", 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "upmap_max_deviation": { 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "name": "upmap_max_deviation", 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "deviation below which no optimization is attempted", 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "upmap_max_optimizations": { 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "name": "upmap_max_optimizations", 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "maximum upmap optimizations to make per attempt", 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.605 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cephadm", 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "agent_down_multiplier": { 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "name": "agent_down_multiplier", 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3.0", 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "agent_refresh_rate": { 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "name": "agent_refresh_rate", 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "20", 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How often the agent on each host will gather and send metadata", 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "agent_starting_port": { 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "name": "agent_starting_port", 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "4721", 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound", 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.606 INFO:teuthology.orchestra.run.trial028.stdout: "allow_ptrace": { 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "name": "allow_ptrace", 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.", 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "autotune_interval": { 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "name": "autotune_interval", 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How frequently to autotune daemon memory", 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "autotune_memory_target_ratio": { 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "name": "autotune_memory_target_ratio", 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0.7", 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized", 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "cephadm_log_destination": { 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cephadm_log_destination", 2026-02-24T09:31:00.607 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "file", 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "file,syslog", 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "syslog" 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Destination for cephadm command persistent logging", 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "certificate_automated_rotation_enabled": { 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "name": "certificate_automated_rotation_enabled", 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "This flag controls whether cephadm automatically rotates certificates upon expiration.", 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "certificate_check_debug_mode": { 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "name": "certificate_check_debug_mode", 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.", 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "certificate_check_period": { 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "name": "certificate_check_period", 2026-02-24T09:31:00.608 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1", 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "min": "0", 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "max": "30", 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Specifies how often (in days) the certificate should be checked for validity.", 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "certificate_duration_days": { 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "name": "certificate_duration_days", 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1095", 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "min": "90", 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "max": "3650", 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Specifies the duration of self-signed certificates generated and signed by the cephadm root CA", 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "certificate_renewal_threshold_days": { 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "name": "certificate_renewal_threshold_days", 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "30", 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "min": "10", 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "max": "90", 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Specifies the lead time in days to initiate certificate renewal before expiration.", 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "cgroups_split": { 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cgroups_split", 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.609 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently Podman only)", 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "config_checks_enabled": { 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "name": "config_checks_enabled", 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Enable or disable cephadm configuration analysis", 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "config_dashboard": { 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "name": "config_dashboard", 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Manage configs like API endpoints in Dashboard.", 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_alertmanager": { 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_alertmanager", 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.28.1", 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Alertmanager container image", 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.610 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_alloy": { 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_alloy", 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "docker.io/grafana/alloy:latest", 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Alloy container image", 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_base": { 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_base", 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/ceph", 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Container image name, without the tag", 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_elasticsearch": { 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_elasticsearch", 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Elasticsearch container image", 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_grafana": { 2026-02-24T09:31:00.611 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_grafana", 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/grafana:12.3.1", 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Grafana container image", 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_haproxy": { 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_haproxy", 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Haproxy container image", 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_jaeger_agent": { 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_jaeger_agent", 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Jaeger agent container image", 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_jaeger_collector": { 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_jaeger_collector", 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.612 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Jaeger collector container image", 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_jaeger_query": { 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_jaeger_query", 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Jaeger query container image", 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_keepalived": { 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_keepalived", 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Keepalived container image", 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_loki": { 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_loki", 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.613 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Loki container image", 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_nginx": { 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_nginx", 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Nginx container image", 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_node_exporter": { 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_node_exporter", 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.9.1", 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Node exporter container image", 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_nvmeof": { 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_nvmeof", 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/nvmeof:1.6", 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Nvmeof container image", 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.614 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_oauth2_proxy": { 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_oauth2_proxy", 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Oauth2 proxy container image", 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_prometheus": { 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_prometheus", 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/prometheus/prometheus:v3.6.0", 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Prometheus container image", 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_promtail": { 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_promtail", 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Promtail container image", 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_samba": { 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_samba", 2026-02-24T09:31:00.615 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Samba container image", 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_samba_metrics": { 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_samba_metrics", 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/samba.org/samba-metrics:devbuilds-centos-amd64", 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Samba metrics container image", 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_snmp_gateway": { 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_snmp_gateway", 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Snmp gateway container image", 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "container_init": { 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_init", 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.616 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Run podman/docker with `--init`", 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "daemon_cache_timeout": { 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "name": "daemon_cache_timeout", 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Seconds for which to cache service (daemon) inventory", 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "default_cephadm_command_timeout": { 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "name": "default_cephadm_command_timeout", 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "900", 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "default_registry": { 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "name": "default_registry", 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io", 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.617 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "device_cache_timeout": { 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "name": "device_cache_timeout", 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1800", 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Seconds for which to cache device inventory", 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "device_enhanced_scan": { 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "name": "device_enhanced_scan", 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use libstoragemgmt during device scans", 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "facts_cache_timeout": { 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "name": "facts_cache_timeout", 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Seconds for which to cache host facts data", 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.618 INFO:teuthology.orchestra.run.trial028.stdout: "grafana_dashboards_path": { 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "name": "grafana_dashboards_path", 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Location of dashboards to include in Grafana", 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "host_check_interval": { 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "name": "host_check_interval", 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How frequently to perform a host check", 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "hw_monitoring": { 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "name": "hw_monitoring", 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Whether the hardware monitoring daemon be deployed on every host?", 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "inventory_list_all": { 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "name": "inventory_list_all", 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.619 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "log_refresh_metadata": { 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_refresh_metadata", 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level", 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.620 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Log to the \"cephadm\" cluster log channel\"", 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.621 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "manage_etc_ceph_ceph_conf": { 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "name": "manage_etc_ceph_ceph_conf", 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on hosts.", 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "*", 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "max_count_per_host": { 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_count_per_host", 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Max number of daemons per service per host: guard against mistakes and runaways", 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "max_osd_draining_count": { 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_osd_draining_count", 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.622 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Max number of OSDs that will be drained simultaneously when OSDs are removed", 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "max_parallel_osd_upgrades": { 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_parallel_osd_upgrades", 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "16", 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Maximum number of OSD daemons upgraded in parallel.", 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "migration_current": { 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "name": "migration_current", 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Internal - do not modify", 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "mode": { 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mode", 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "root", 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.623 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "cephadm-package", 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "root" 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Mode for remote execution of cephadm", 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "oob_default_addr": { 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "name": "oob_default_addr", 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "169.254.1.1", 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Default IP address for RedFish API (OOB management).", 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "prometheus_alerts_path": { 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "name": "prometheus_alerts_path", 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Location of alerts to include in Prometheus Alertmanager", 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "registry_insecure": { 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_insecure", 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.624 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "registry_password": { 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_password", 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "registry_url": { 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_url", 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Registry URL for login purposes. This is not the default registry.", 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "registry_username": { 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_username", 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.625 INFO:teuthology.orchestra.run.trial028.stdout: "secure_monitoring_stack": { 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "name": "secure_monitoring_stack", 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Enable TLS security for all monitoring stack daemons", 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "service_discovery_port": { 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "name": "service_discovery_port", 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8765", 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Cephadm service discovery port", 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "ssh_config_file": { 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssh_config_file", 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.626 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Customized SSH config file to distribute to managed hosts", 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "ssh_keepalive_count_max": { 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssh_keepalive_count_max", 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3", 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How many sequential SSH connection liveness check failures before the host is marked offline", 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "ssh_keepalive_interval": { 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssh_keepalive_interval", 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "7", 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How often SSH connections are checked for liveness", 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "stray_daemon_check_interval": { 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "name": "stray_daemon_check_interval", 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1800", 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How frequently cephadm should check for the presence of stray daemons", 2026-02-24T09:31:00.627 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "use_agent": { 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "name": "use_agent", 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use the cephadm agent on each host to gather and send metadata", 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "use_repo_digest": { 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "name": "use_repo_digest", 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Automatically convert image tags to image digest to ensure that all daemons use the same image", 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "warn_on_failed_host_check": { 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_on_failed_host_check", 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Raise a health warning if the host check fails", 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "warn_on_stray_daemons": { 2026-02-24T09:31:00.628 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_on_stray_daemons", 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Raise a health warning if daemons are detected that are not managed by cephadm", 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "warn_on_stray_hosts": { 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_on_stray_hosts", 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Raise a health warning if daemons are detected on a host that is not managed by cephadm", 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crash", 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.629 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.630 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "retain_interval": { 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "name": "retain_interval", 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "31536000", 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how long to retain crashes before pruning them", 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "warn_recent_interval": { 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_recent_interval", 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1209600", 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.631 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "time interval in which to warn about recent crashes", 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "name": "dashboard", 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "ALERTMANAGER_API_HOST": { 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ALERTMANAGER_API_HOST", 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.632 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "AUDIT_API_ENABLED": { 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "name": "AUDIT_API_ENABLED", 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "AUDIT_API_LOG_PAYLOAD": { 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "ENABLE_BROWSABLE_API": { 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ENABLE_BROWSABLE_API", 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.633 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_CEPHFS": { 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_ISCSI": { 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_MIRRORING": { 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2026-02-24T09:31:00.634 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_NFS": { 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_NFS", 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_RBD": { 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_RBD", 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_RGW": { 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_RGW", 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.635 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_PASSWORD": { 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_PASSWORD", 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "admin", 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_SSL_VERIFY": { 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.636 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_URL": { 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_URL", 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_USERNAME": { 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_USERNAME", 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "admin", 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_FRONTEND_API_URL": { 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.637 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "ISCSI_API_SSL_VERIFICATION": { 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "ISSUE_TRACKER_API_KEY": { 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ISSUE_TRACKER_API_KEY", 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "MANAGED_BY_CLUSTERS": { 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "name": "MANAGED_BY_CLUSTERS", 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "[]", 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.638 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "MULTICLUSTER_CONFIG": { 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "name": "MULTICLUSTER_CONFIG", 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "{}", 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "PROMETHEUS_API_HOST": { 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PROMETHEUS_API_HOST", 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "PROM_ALERT_CREDENTIAL_CACHE_TTL": { 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PROM_ALERT_CREDENTIAL_CACHE_TTL", 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.639 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.640 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.641 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_ENABLED": { 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_ENABLED", 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.642 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_MIN_LENGTH": { 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8", 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "REST_REQUESTS_TIMEOUT": { 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "name": "REST_REQUESTS_TIMEOUT", 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "45", 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_ACCESS_KEY": { 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_ACCESS_KEY", 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.643 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_ADMIN_RESOURCE": { 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "admin", 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_SECRET_KEY": { 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_SECRET_KEY", 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_SSL_VERIFY": { 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_SSL_VERIFY", 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.644 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_HOSTNAME_PER_DAEMON": { 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_HOSTNAME_PER_DAEMON", 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "UNSAFE_TLS_v1_2": { 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "name": "UNSAFE_TLS_v1_2", 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "USER_PWD_EXPIRATION_SPAN": { 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.645 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "cross_origin_url": { 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cross_origin_url", 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "crt_file": { 2026-02-24T09:31:00.646 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crt_file", 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "crypto_caller": { 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crypto_caller", 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "debug": { 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "name": "debug", 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Enable/disable debug options", 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "jwt_token_ttl": { 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "name": "jwt_token_ttl", 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "28800", 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.647 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "key_file": { 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "name": "key_file", 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.648 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.649 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "motd": { 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "name": "motd", 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "The message of the day", 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "redirect_resolve_ip_addr": { 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "name": "redirect_resolve_ip_addr", 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "server_addr": { 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_addr", 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "::", 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.650 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "server_port": { 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_port", 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8080", 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "ssl": { 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssl", 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "ssl_server_port": { 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssl_server_port", 2026-02-24T09:31:00.651 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8443", 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "sso_oauth2": { 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sso_oauth2", 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "standby_behaviour": { 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_behaviour", 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "redirect", 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "redirect" 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "standby_error_status_code": { 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_error_status_code", 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.652 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "500", 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "min": "400", 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "max": "599", 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "url_prefix": { 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "name": "url_prefix", 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "name": "devicehealth", 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "enable_monitoring": { 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "name": "enable_monitoring", 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "monitor device health metrics", 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.653 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.654 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "mark_out_threshold": { 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mark_out_threshold", 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "2419200", 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "automatically mark OSD if it may fail before this long", 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "pool_name": { 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pool_name", 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "device_health_metrics", 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.655 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "name of pool in which to store device health metrics", 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "retention_period": { 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "name": "retention_period", 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "15552000", 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how long to retain device health metrics", 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "scrape_frequency": { 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "name": "scrape_frequency", 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "86400", 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how frequently to scrape device health metrics", 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "self_heal": { 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "name": "self_heal", 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "preemptively heal cluster around devices that may fail", 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.656 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how frequently to wake up and check device health", 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "warn_threshold": { 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_threshold", 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "7257600", 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "raise health warning if OSD may fail before this long", 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.657 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: "name": "diskprediction_local", 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.658 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.659 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "predict_interval": { 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "name": "predict_interval", 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "86400", 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "predictor_model": { 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "name": "predictor_model", 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "prophetstor", 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.660 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "name": "influx", 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": false, 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "influxdb python module not found", 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "batch_size": { 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "name": "batch_size", 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5000", 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "database": { 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "name": "database", 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "ceph", 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.661 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "hostname": { 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "name": "hostname", 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "InfluxDB server hostname", 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "30", 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "min": "5", 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.662 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.663 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "password": { 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "name": "password", 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "password of InfluxDB server user", 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "port": { 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "name": "port", 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8086", 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "InfluxDB server port", 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.664 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "ssl": { 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssl", 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "false", 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "threads": { 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "name": "threads", 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "max": "32", 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "username": { 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "name": "username", 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "username of InfluxDB server user", 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "verify_ssl": { 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "name": "verify_ssl", 2026-02-24T09:31:00.665 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "true", 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "name": "insights", 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.666 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.667 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "name": "iostat", 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.668 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.669 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "name": "k8sevents", 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_event_retention_days": { 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ceph_event_retention_days", 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "7", 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Days to hold ceph event information within local cache", 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "config_check_secs": { 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "name": "config_check_secs", 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "min": "10", 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.670 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.671 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "name": "localpool", 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "failure_domain": { 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "name": "failure_domain", 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.672 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "host", 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "failure domain for any created local pool", 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.673 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "min_size": { 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "name": "min_size", 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "default min_size for any created local pool", 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2026-02-24T09:31:00.674 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "num_rep": { 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "name": "num_rep", 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3", 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "default replica count for any created local pool", 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "pg_num": { 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pg_num", 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "128", 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "default pg_num for any created local pool", 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "prefix": { 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "name": "prefix", 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "name prefix for any created local pool", 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.675 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "subtree": { 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "name": "subtree", 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "rack", 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "CRUSH level for which to create a local pool", 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mds_autoscaler", 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.676 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.677 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mirroring", 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.678 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.679 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "name": "nfs", 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.680 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.681 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "name": "orchestrator", 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "fail_fs": { 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "name": "fail_fs", 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.682 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.683 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "orchestrator": { 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "name": "orchestrator", 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "cephadm", 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "rook", 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "test_orchestrator" 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Orchestrator backend", 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.684 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "name": "osd_perf_query", 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.685 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.686 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "name": "osd_support", 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.687 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.688 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pg_autoscaler", 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.689 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.690 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "threshold": { 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "name": "threshold", 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3.0", 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1.0", 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "scaling threshold", 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "name": "progress", 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "allow_pg_recovery_event": { 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "name": "allow_pg_recovery_event", 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "allow the module to show pg recovery progress", 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.691 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "enabled": { 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "name": "enabled", 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.692 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "max_completed_events": { 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_completed_events", 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "50", 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.693 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "number of past completed events to remember", 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how long the module is going to sleep", 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "name": "prometheus", 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "cache": { 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cache", 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.694 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "exclude_perf_counters": { 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "name": "exclude_perf_counters", 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Do not include perf-counters in the metrics output", 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "healthcheck_history_max_entries": { 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "name": "healthcheck_history_max_entries", 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1000", 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Maximum number of health check history entries to keep", 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.695 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.696 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_stats_pools": { 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rbd_stats_pools", 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_stats_pools_refresh_interval": { 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rbd_stats_pools_refresh_interval", 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "300", 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "scrape_interval": { 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "name": "scrape_interval", 2026-02-24T09:31:00.697 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "15.0", 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "server_addr": { 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_addr", 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "::", 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "server_port": { 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_port", 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "9283", 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "the port on which the module listens for HTTP requests", 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.698 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "stale_cache_strategy": { 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "name": "stale_cache_strategy", 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "log", 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "standby_behaviour": { 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_behaviour", 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "default", 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "default", 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "error" 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "standby_error_status_code": { 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_error_status_code", 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "500", 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "min": "400", 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "max": "599", 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.699 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rbd_support", 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.700 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "max_concurrent_snap_create": { 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_concurrent_snap_create", 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.701 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "mirror_snapshot_schedule": { 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mirror_snapshot_schedule", 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "trash_purge_schedule": { 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "name": "trash_purge_schedule", 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.702 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rgw", 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.703 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "secondary_zone_period_retry_limit": { 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "name": "secondary_zone_period_retry_limit", 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "RGW module period update retry limit for secondary site", 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.704 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rook", 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.705 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "prometheus_tls_secret_name": { 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "name": "prometheus_tls_secret_name", 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "rook-ceph-prometheus-server-tls", 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.706 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "name of tls secret in k8s for prometheus", 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "secure_monitoring_stack": { 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "name": "secure_monitoring_stack", 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "storage_class": { 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "name": "storage_class", 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "local", 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "storage class name for LSO-discovered PVs", 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.707 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "name": "selftest", 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.708 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "roption1": { 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "name": "roption1", 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.709 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "roption2": { 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "name": "roption2", 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "xyz", 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption1": { 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption1", 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption2": { 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption2", 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption3": { 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption3", 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-24T09:31:00.710 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption4": { 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption4", 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption5": { 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption5", 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption6": { 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption6", 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.711 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption7": { 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption7", 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "max": "42", 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "testkey": { 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "name": "testkey", 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.712 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "testlkey": { 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "name": "testlkey", 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "testnewline": { 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "name": "testnewline", 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smb", 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "internal_store_backend": { 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "name": "internal_store_backend", 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "set internal store backend. for develoment and testing only", 2026-02-24T09:31:00.713 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.714 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "update_orchestration": { 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "name": "update_orchestration", 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.715 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "automatically update orchestration when smb resources are changed", 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "name": "snap_schedule", 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "allow_m_granularity": { 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "name": "allow_m_granularity", 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "allow minute scheduled snapshots", 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "dump_on_update": { 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "name": "dump_on_update", 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "dump database to debug log on update", 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.716 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.717 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "name": "stats", 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.718 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.719 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "name": "status", 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.720 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.721 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "name": "telegraf", 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "address": { 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "name": "address", 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.722 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "15", 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.723 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.724 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "name": "telemetry", 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "channel_basic": { 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_basic", 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share basic cluster information (size, version)", 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "channel_crash": { 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_crash", 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "channel_device": { 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_device", 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.725 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "channel_ident": { 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_ident", 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "channel_perf": { 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_perf", 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share various performance metrics of a cluster", 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "contact": { 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "name": "contact", 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.726 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "description": { 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "name": "description", 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "device_url": { 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "name": "device_url", 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "https://telemetry.ceph.com/device", 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "enabled": { 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "name": "enabled", 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.727 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "24", 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "min": "8", 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "last_opt_revision": { 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "name": "last_opt_revision", 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1", 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "leaderboard": { 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "name": "leaderboard", 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "leaderboard_description": { 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "name": "leaderboard_description", 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.728 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.729 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "organization": { 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "name": "organization", 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "proxy": { 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "name": "proxy", 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.730 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "url": { 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "name": "url", 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "https://telemetry.ceph.com/report", 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "name": "test_orchestrator", 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.731 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.732 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "name": "volumes", 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.733 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.734 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "max_concurrent_clones": { 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_concurrent_clones", 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "4", 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Number of asynchronous cloner threads", 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "pause_cloning": { 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pause_cloning", 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Pause asynchronous cloner threads", 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "pause_purging": { 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pause_purging", 2026-02-24T09:31:00.735 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Pause asynchronous subvolume purge threads", 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "periodic_async_work": { 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "name": "periodic_async_work", 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Periodically check for async work", 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "snapshot_clone_delay": { 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "name": "snapshot_clone_delay", 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "snapshot_clone_no_wait": { 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "name": "snapshot_clone_no_wait", 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.736 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: ] 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "modules": [ 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "cephadm", 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "dashboard", 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "iostat", 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "nfs", 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "snap_schedule" 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "available_modules": [ 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "name": "alerts", 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.737 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How frequently to reexamine health status", 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.738 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_destination": { 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_destination", 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_from_name": { 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_from_name", 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.739 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "Ceph", 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Email From: name", 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_host": { 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_host", 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "SMTP server", 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_password": { 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_password", 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Password to authenticate with", 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_port": { 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_port", 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "465", 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.740 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "SMTP port", 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_sender": { 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_sender", 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "SMTP envelope sender", 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_ssl": { 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_ssl", 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use SSL to connect to SMTP server", 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_user": { 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_user", 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "User to authenticate as", 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.741 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "name": "balancer", 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "active": { 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "name": "active", 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "automatically balance PGs across cluster", 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "begin_time": { 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "name": "begin_time", 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0000", 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "beginning time of day to automatically balance", 2026-02-24T09:31:00.742 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "This is a time of day in the format HHMM.", 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "begin_weekday": { 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "name": "begin_weekday", 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "min": "0", 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "max": "6", 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "crush_compat_max_iterations": { 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crush_compat_max_iterations", 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "25", 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "max": "250", 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "maximum number of iterations to attempt optimization", 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "crush_compat_metrics": { 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crush_compat_metrics", 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "pgs,objects,bytes", 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "metrics with which to calculate OSD utilization", 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "crush_compat_step": { 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crush_compat_step", 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-24T09:31:00.743 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0.5", 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "min": "0.001", 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "max": "0.999", 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "aggressiveness of optimization", 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "end_time": { 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "name": "end_time", 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "2359", 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "ending time of day to automatically balance", 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "This is a time of day in the format HHMM.", 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "end_weekday": { 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "name": "end_weekday", 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "min": "0", 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "max": "6", 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.744 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.745 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "min_score": { 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "name": "min_score", 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "minimum score, below which no optimization is attempted", 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "mode": { 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mode", 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "upmap", 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "crush-compat", 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "none", 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "read", 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "upmap", 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "upmap-read" 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Balancer mode", 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.746 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "pool_ids": { 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pool_ids", 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "pools which the automatic balancing will be limited to", 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how frequently to wake up and attempt optimization", 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "update_pg_upmap_activity": { 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "name": "update_pg_upmap_activity", 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.747 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Updates pg_upmap activity stats to be used in `balancer status detail`", 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "upmap_max_deviation": { 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "name": "upmap_max_deviation", 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "deviation below which no optimization is attempted", 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "upmap_max_optimizations": { 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "name": "upmap_max_optimizations", 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "maximum upmap optimizations to make per attempt", 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cephadm", 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "agent_down_multiplier": { 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "name": "agent_down_multiplier", 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.748 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3.0", 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "agent_refresh_rate": { 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "name": "agent_refresh_rate", 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "20", 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How often the agent on each host will gather and send metadata", 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "agent_starting_port": { 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "name": "agent_starting_port", 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "4721", 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound", 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "allow_ptrace": { 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "name": "allow_ptrace", 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2026-02-24T09:31:00.749 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.", 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "autotune_interval": { 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "name": "autotune_interval", 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How frequently to autotune daemon memory", 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "autotune_memory_target_ratio": { 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "name": "autotune_memory_target_ratio", 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0.7", 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized", 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "cephadm_log_destination": { 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cephadm_log_destination", 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "file", 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "file,syslog", 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "syslog" 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Destination for cephadm command persistent logging", 2026-02-24T09:31:00.750 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "certificate_automated_rotation_enabled": { 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "name": "certificate_automated_rotation_enabled", 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "This flag controls whether cephadm automatically rotates certificates upon expiration.", 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "certificate_check_debug_mode": { 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "name": "certificate_check_debug_mode", 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.", 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "certificate_check_period": { 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "name": "certificate_check_period", 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1", 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "min": "0", 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "max": "30", 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Specifies how often (in days) the certificate should be checked for validity.", 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "certificate_duration_days": { 2026-02-24T09:31:00.751 INFO:teuthology.orchestra.run.trial028.stdout: "name": "certificate_duration_days", 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1095", 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "min": "90", 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "max": "3650", 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Specifies the duration of self-signed certificates generated and signed by the cephadm root CA", 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "certificate_renewal_threshold_days": { 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "name": "certificate_renewal_threshold_days", 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "30", 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "min": "10", 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "max": "90", 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Specifies the lead time in days to initiate certificate renewal before expiration.", 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "cgroups_split": { 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cgroups_split", 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently Podman only)", 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "config_checks_enabled": { 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "name": "config_checks_enabled", 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.752 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Enable or disable cephadm configuration analysis", 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "config_dashboard": { 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "name": "config_dashboard", 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Manage configs like API endpoints in Dashboard.", 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_alertmanager": { 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_alertmanager", 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.28.1", 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Alertmanager container image", 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_alloy": { 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_alloy", 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "docker.io/grafana/alloy:latest", 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Alloy container image", 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.753 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_base": { 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_base", 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/ceph", 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Container image name, without the tag", 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_elasticsearch": { 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_elasticsearch", 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Elasticsearch container image", 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_grafana": { 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_grafana", 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/grafana:12.3.1", 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Grafana container image", 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_haproxy": { 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_haproxy", 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.754 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Haproxy container image", 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_jaeger_agent": { 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_jaeger_agent", 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Jaeger agent container image", 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_jaeger_collector": { 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_jaeger_collector", 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Jaeger collector container image", 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_jaeger_query": { 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_jaeger_query", 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.755 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Jaeger query container image", 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_keepalived": { 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_keepalived", 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Keepalived container image", 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_loki": { 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_loki", 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Loki container image", 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_nginx": { 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_nginx", 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Nginx container image", 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.756 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_node_exporter": { 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_node_exporter", 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.9.1", 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Node exporter container image", 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_nvmeof": { 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_nvmeof", 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/nvmeof:1.6", 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Nvmeof container image", 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_oauth2_proxy": { 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_oauth2_proxy", 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Oauth2 proxy container image", 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_prometheus": { 2026-02-24T09:31:00.757 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_prometheus", 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/prometheus/prometheus:v3.6.0", 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Prometheus container image", 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_promtail": { 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_promtail", 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Promtail container image", 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_samba": { 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_samba", 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Samba container image", 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_samba_metrics": { 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_samba_metrics", 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.758 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/samba.org/samba-metrics:devbuilds-centos-amd64", 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Samba metrics container image", 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_snmp_gateway": { 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_snmp_gateway", 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Snmp gateway container image", 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "container_init": { 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_init", 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Run podman/docker with `--init`", 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "daemon_cache_timeout": { 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "name": "daemon_cache_timeout", 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Seconds for which to cache service (daemon) inventory", 2026-02-24T09:31:00.759 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "default_cephadm_command_timeout": { 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "name": "default_cephadm_command_timeout", 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "900", 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "default_registry": { 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "name": "default_registry", 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io", 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "device_cache_timeout": { 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "name": "device_cache_timeout", 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1800", 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Seconds for which to cache device inventory", 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "device_enhanced_scan": { 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "name": "device_enhanced_scan", 2026-02-24T09:31:00.760 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use libstoragemgmt during device scans", 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "facts_cache_timeout": { 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "name": "facts_cache_timeout", 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Seconds for which to cache host facts data", 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "grafana_dashboards_path": { 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "name": "grafana_dashboards_path", 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Location of dashboards to include in Grafana", 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "host_check_interval": { 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "name": "host_check_interval", 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.761 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How frequently to perform a host check", 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "hw_monitoring": { 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "name": "hw_monitoring", 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Whether the hardware monitoring daemon be deployed on every host?", 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "inventory_list_all": { 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "name": "inventory_list_all", 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.762 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "log_refresh_metadata": { 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_refresh_metadata", 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level", 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Log to the \"cephadm\" cluster log channel\"", 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.763 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "manage_etc_ceph_ceph_conf": { 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "name": "manage_etc_ceph_ceph_conf", 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on hosts.", 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "*", 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.764 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "max_count_per_host": { 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_count_per_host", 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Max number of daemons per service per host: guard against mistakes and runaways", 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "max_osd_draining_count": { 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_osd_draining_count", 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Max number of OSDs that will be drained simultaneously when OSDs are removed", 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "max_parallel_osd_upgrades": { 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_parallel_osd_upgrades", 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "16", 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Maximum number of OSD daemons upgraded in parallel.", 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "migration_current": { 2026-02-24T09:31:00.765 INFO:teuthology.orchestra.run.trial028.stdout: "name": "migration_current", 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Internal - do not modify", 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "mode": { 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mode", 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "root", 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "cephadm-package", 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "root" 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Mode for remote execution of cephadm", 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "oob_default_addr": { 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "name": "oob_default_addr", 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "169.254.1.1", 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Default IP address for RedFish API (OOB management).", 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "prometheus_alerts_path": { 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "name": "prometheus_alerts_path", 2026-02-24T09:31:00.766 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Location of alerts to include in Prometheus Alertmanager", 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "registry_insecure": { 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_insecure", 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "registry_password": { 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_password", 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "registry_url": { 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_url", 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.767 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Registry URL for login purposes. This is not the default registry.", 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "registry_username": { 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_username", 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "secure_monitoring_stack": { 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "name": "secure_monitoring_stack", 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Enable TLS security for all monitoring stack daemons", 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "service_discovery_port": { 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "name": "service_discovery_port", 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8765", 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Cephadm service discovery port", 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.768 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "ssh_config_file": { 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssh_config_file", 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Customized SSH config file to distribute to managed hosts", 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "ssh_keepalive_count_max": { 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssh_keepalive_count_max", 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3", 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How many sequential SSH connection liveness check failures before the host is marked offline", 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "ssh_keepalive_interval": { 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssh_keepalive_interval", 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.769 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "7", 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How often SSH connections are checked for liveness", 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "stray_daemon_check_interval": { 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "name": "stray_daemon_check_interval", 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1800", 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How frequently cephadm should check for the presence of stray daemons", 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "use_agent": { 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "name": "use_agent", 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use the cephadm agent on each host to gather and send metadata", 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "use_repo_digest": { 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "name": "use_repo_digest", 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Automatically convert image tags to image digest to ensure that all daemons use the same image", 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.770 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "warn_on_failed_host_check": { 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_on_failed_host_check", 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Raise a health warning if the host check fails", 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "warn_on_stray_daemons": { 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_on_stray_daemons", 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Raise a health warning if daemons are detected that are not managed by cephadm", 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "warn_on_stray_hosts": { 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_on_stray_hosts", 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Raise a health warning if daemons are detected on a host that is not managed by cephadm", 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.771 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crash", 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.772 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "retain_interval": { 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "name": "retain_interval", 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "31536000", 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how long to retain crashes before pruning them", 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.773 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "warn_recent_interval": { 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_recent_interval", 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1209600", 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "time interval in which to warn about recent crashes", 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "name": "dashboard", 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "ALERTMANAGER_API_HOST": { 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ALERTMANAGER_API_HOST", 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.774 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "AUDIT_API_ENABLED": { 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "name": "AUDIT_API_ENABLED", 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "AUDIT_API_LOG_PAYLOAD": { 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.775 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "ENABLE_BROWSABLE_API": { 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ENABLE_BROWSABLE_API", 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_CEPHFS": { 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_ISCSI": { 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.776 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_MIRRORING": { 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_NFS": { 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_NFS", 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_RBD": { 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_RBD", 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.777 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_RGW": { 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_RGW", 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_PASSWORD": { 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_PASSWORD", 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "admin", 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.778 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_SSL_VERIFY": { 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_URL": { 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_URL", 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_USERNAME": { 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_USERNAME", 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "admin", 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_FRONTEND_API_URL": { 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.779 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "ISCSI_API_SSL_VERIFICATION": { 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "ISSUE_TRACKER_API_KEY": { 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ISSUE_TRACKER_API_KEY", 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.780 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "MANAGED_BY_CLUSTERS": { 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "name": "MANAGED_BY_CLUSTERS", 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "[]", 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "MULTICLUSTER_CONFIG": { 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "name": "MULTICLUSTER_CONFIG", 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "{}", 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "PROMETHEUS_API_HOST": { 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PROMETHEUS_API_HOST", 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2026-02-24T09:31:00.781 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "PROM_ALERT_CREDENTIAL_CACHE_TTL": { 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PROM_ALERT_CREDENTIAL_CACHE_TTL", 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.782 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.783 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_ENABLED": { 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_ENABLED", 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2026-02-24T09:31:00.784 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_MIN_LENGTH": { 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8", 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "REST_REQUESTS_TIMEOUT": { 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "name": "REST_REQUESTS_TIMEOUT", 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "45", 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.785 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_ACCESS_KEY": { 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_ACCESS_KEY", 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_ADMIN_RESOURCE": { 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "admin", 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_SECRET_KEY": { 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_SECRET_KEY", 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_SSL_VERIFY": { 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_SSL_VERIFY", 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.786 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_HOSTNAME_PER_DAEMON": { 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_HOSTNAME_PER_DAEMON", 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "UNSAFE_TLS_v1_2": { 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "name": "UNSAFE_TLS_v1_2", 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "USER_PWD_EXPIRATION_SPAN": { 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.787 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "cross_origin_url": { 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cross_origin_url", 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "crt_file": { 2026-02-24T09:31:00.788 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crt_file", 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "crypto_caller": { 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crypto_caller", 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "debug": { 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "name": "debug", 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Enable/disable debug options", 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "jwt_token_ttl": { 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "name": "jwt_token_ttl", 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "28800", 2026-02-24T09:31:00.789 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "key_file": { 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "name": "key_file", 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.790 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "motd": { 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "name": "motd", 2026-02-24T09:31:00.791 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "The message of the day", 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "redirect_resolve_ip_addr": { 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "name": "redirect_resolve_ip_addr", 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "server_addr": { 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_addr", 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "::", 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "server_port": { 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_port", 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8080", 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.792 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "ssl": { 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssl", 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "ssl_server_port": { 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssl_server_port", 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8443", 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "sso_oauth2": { 2026-02-24T09:31:00.793 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sso_oauth2", 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "standby_behaviour": { 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_behaviour", 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "redirect", 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "redirect" 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "standby_error_status_code": { 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_error_status_code", 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "500", 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "min": "400", 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "max": "599", 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "url_prefix": { 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "name": "url_prefix", 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.794 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "name": "devicehealth", 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "enable_monitoring": { 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "name": "enable_monitoring", 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "monitor device health metrics", 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.795 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.796 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "mark_out_threshold": { 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mark_out_threshold", 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "2419200", 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "automatically mark OSD if it may fail before this long", 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "pool_name": { 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pool_name", 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "device_health_metrics", 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "name of pool in which to store device health metrics", 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "retention_period": { 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "name": "retention_period", 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "15552000", 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how long to retain device health metrics", 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.797 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "scrape_frequency": { 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "name": "scrape_frequency", 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "86400", 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how frequently to scrape device health metrics", 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "self_heal": { 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "name": "self_heal", 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "preemptively heal cluster around devices that may fail", 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how frequently to wake up and check device health", 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.798 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "warn_threshold": { 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_threshold", 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "7257600", 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "raise health warning if OSD may fail before this long", 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "name": "diskprediction_local", 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.799 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.800 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "predict_interval": { 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "name": "predict_interval", 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "86400", 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "predictor_model": { 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "name": "predictor_model", 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "prophetstor", 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.801 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "name": "influx", 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": false, 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "influxdb python module not found", 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "batch_size": { 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "name": "batch_size", 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5000", 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "database": { 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "name": "database", 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "ceph", 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2026-02-24T09:31:00.802 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "hostname": { 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "name": "hostname", 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "InfluxDB server hostname", 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "30", 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "min": "5", 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.803 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.804 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "password": { 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "name": "password", 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "password of InfluxDB server user", 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "port": { 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "name": "port", 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8086", 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "InfluxDB server port", 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.805 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "ssl": { 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssl", 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "false", 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "threads": { 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "name": "threads", 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "max": "32", 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "username": { 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "name": "username", 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "username of InfluxDB server user", 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "verify_ssl": { 2026-02-24T09:31:00.806 INFO:teuthology.orchestra.run.trial028.stdout: "name": "verify_ssl", 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "true", 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "name": "insights", 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.807 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.808 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "name": "iostat", 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.809 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.810 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "name": "k8sevents", 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_event_retention_days": { 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ceph_event_retention_days", 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "7", 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Days to hold ceph event information within local cache", 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "config_check_secs": { 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "name": "config_check_secs", 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "min": "10", 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.811 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.812 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "name": "localpool", 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "failure_domain": { 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "name": "failure_domain", 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "host", 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "failure domain for any created local pool", 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2026-02-24T09:31:00.813 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.814 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "min_size": { 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "name": "min_size", 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "default min_size for any created local pool", 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "num_rep": { 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "name": "num_rep", 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3", 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.815 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "default replica count for any created local pool", 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "pg_num": { 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pg_num", 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "128", 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "default pg_num for any created local pool", 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "prefix": { 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "name": "prefix", 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "name prefix for any created local pool", 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.816 INFO:teuthology.orchestra.run.trial028.stdout: "subtree": { 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "name": "subtree", 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "rack", 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "CRUSH level for which to create a local pool", 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mds_autoscaler", 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.817 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.818 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mirroring", 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.819 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.820 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "name": "nfs", 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.821 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.822 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "name": "orchestrator", 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "fail_fs": { 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "name": "fail_fs", 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.823 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "orchestrator": { 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "name": "orchestrator", 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.824 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "cephadm", 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "rook", 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "test_orchestrator" 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Orchestrator backend", 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "name": "osd_perf_query", 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.825 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.826 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "name": "osd_support", 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.827 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.828 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pg_autoscaler", 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.829 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-24T09:31:00.830 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "threshold": { 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "name": "threshold", 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3.0", 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1.0", 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "scaling threshold", 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "name": "progress", 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.831 INFO:teuthology.orchestra.run.trial028.stdout: "allow_pg_recovery_event": { 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "name": "allow_pg_recovery_event", 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "allow the module to show pg recovery progress", 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "enabled": { 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "name": "enabled", 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.832 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.833 INFO:teuthology.orchestra.run.trial028.stdout: "max_completed_events": { 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_completed_events", 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "50", 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "number of past completed events to remember", 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how long the module is going to sleep", 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "name": "prometheus", 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.834 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "cache": { 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cache", 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "exclude_perf_counters": { 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "name": "exclude_perf_counters", 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Do not include perf-counters in the metrics output", 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "healthcheck_history_max_entries": { 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "name": "healthcheck_history_max_entries", 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1000", 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Maximum number of health check history entries to keep", 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.835 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.836 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_stats_pools": { 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rbd_stats_pools", 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_stats_pools_refresh_interval": { 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rbd_stats_pools_refresh_interval", 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "300", 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "scrape_interval": { 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "name": "scrape_interval", 2026-02-24T09:31:00.837 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "15.0", 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "server_addr": { 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_addr", 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "::", 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "server_port": { 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_port", 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "9283", 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "the port on which the module listens for HTTP requests", 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.838 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "stale_cache_strategy": { 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "name": "stale_cache_strategy", 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "log", 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "standby_behaviour": { 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_behaviour", 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "default", 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "default", 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "error" 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "standby_error_status_code": { 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_error_status_code", 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "500", 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "min": "400", 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "max": "599", 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.839 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rbd_support", 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.840 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "max_concurrent_snap_create": { 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_concurrent_snap_create", 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.841 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "mirror_snapshot_schedule": { 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mirror_snapshot_schedule", 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "trash_purge_schedule": { 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "name": "trash_purge_schedule", 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rgw", 2026-02-24T09:31:00.842 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.843 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "secondary_zone_period_retry_limit": { 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "name": "secondary_zone_period_retry_limit", 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "RGW module period update retry limit for secondary site", 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.844 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rook", 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.845 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "prometheus_tls_secret_name": { 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "name": "prometheus_tls_secret_name", 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "rook-ceph-prometheus-server-tls", 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.846 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "name of tls secret in k8s for prometheus", 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "secure_monitoring_stack": { 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "name": "secure_monitoring_stack", 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "storage_class": { 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "name": "storage_class", 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "local", 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "storage class name for LSO-discovered PVs", 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.847 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "name": "selftest", 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.848 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "roption1": { 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "name": "roption1", 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "roption2": { 2026-02-24T09:31:00.849 INFO:teuthology.orchestra.run.trial028.stdout: "name": "roption2", 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "xyz", 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption1": { 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption1", 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption2": { 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption2", 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption3": { 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption3", 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.850 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption4": { 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption4", 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption5": { 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption5", 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption6": { 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption6", 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.851 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption7": { 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption7", 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "max": "42", 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "testkey": { 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "name": "testkey", 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "testlkey": { 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "name": "testlkey", 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.852 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "testnewline": { 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "name": "testnewline", 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smb", 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "internal_store_backend": { 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "name": "internal_store_backend", 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "set internal store backend. for develoment and testing only", 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.853 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.854 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "update_orchestration": { 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "name": "update_orchestration", 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "automatically update orchestration when smb resources are changed", 2026-02-24T09:31:00.855 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "name": "snap_schedule", 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "allow_m_granularity": { 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "name": "allow_m_granularity", 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "allow minute scheduled snapshots", 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "dump_on_update": { 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "name": "dump_on_update", 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "dump database to debug log on update", 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.856 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.857 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "name": "stats", 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.858 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.859 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "name": "status", 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.860 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.861 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "name": "telegraf", 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "address": { 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "name": "address", 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-24T09:31:00.862 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "15", 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.863 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.864 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "name": "telemetry", 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "channel_basic": { 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_basic", 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share basic cluster information (size, version)", 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "channel_crash": { 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_crash", 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "channel_device": { 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_device", 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.865 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "channel_ident": { 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_ident", 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "channel_perf": { 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_perf", 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share various performance metrics of a cluster", 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "contact": { 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "name": "contact", 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "description": { 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "name": "description", 2026-02-24T09:31:00.866 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "device_url": { 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "name": "device_url", 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "https://telemetry.ceph.com/device", 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "enabled": { 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "name": "enabled", 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "24", 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "min": "8", 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.867 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "last_opt_revision": { 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "name": "last_opt_revision", 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1", 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "leaderboard": { 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "name": "leaderboard", 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "leaderboard_description": { 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "name": "leaderboard_description", 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.868 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.869 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "organization": { 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "name": "organization", 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "proxy": { 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "name": "proxy", 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.870 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "url": { 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "name": "url", 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "https://telemetry.ceph.com/report", 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "name": "test_orchestrator", 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.871 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.872 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "name": "volumes", 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "max_concurrent_clones": { 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_concurrent_clones", 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "4", 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Number of asynchronous cloner threads", 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "pause_cloning": { 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pause_cloning", 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Pause asynchronous cloner threads", 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "pause_purging": { 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pause_purging", 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Pause asynchronous subvolume purge threads", 2026-02-24T09:31:00.875 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "periodic_async_work": { 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "name": "periodic_async_work", 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Periodically check for async work", 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "snapshot_clone_delay": { 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "name": "snapshot_clone_delay", 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "snapshot_clone_no_wait": { 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "name": "snapshot_clone_no_wait", 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-24T09:31:00.876 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "services": { 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "dashboard": "https://10.20.193.28:8443/" 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "always_on_modules": { 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "octopus": [ 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "balancer", 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "crash", 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "devicehealth", 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "orchestrator", 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "pg_autoscaler", 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "progress", 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_support", 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "status", 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "telemetry", 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "volumes" 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "pacific": [ 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "balancer", 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "crash", 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "devicehealth", 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "orchestrator", 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "pg_autoscaler", 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "progress", 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_support", 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "status", 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "telemetry", 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "volumes" 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "quincy": [ 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "balancer", 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "crash", 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "devicehealth", 2026-02-24T09:31:00.877 INFO:teuthology.orchestra.run.trial028.stdout: "orchestrator", 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "pg_autoscaler", 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "progress", 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_support", 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "status", 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "telemetry", 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "volumes" 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "reef": [ 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "balancer", 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "crash", 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "devicehealth", 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "orchestrator", 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "pg_autoscaler", 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "progress", 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_support", 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "status", 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "telemetry", 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "volumes" 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "squid": [ 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "balancer", 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "crash", 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "devicehealth", 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "orchestrator", 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "pg_autoscaler", 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "progress", 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_support", 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "status", 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "telemetry", 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "volumes" 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "tentacle": [ 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "balancer", 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "crash", 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "devicehealth", 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "orchestrator", 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "pg_autoscaler", 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "progress", 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_support", 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "status", 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "telemetry", 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "volumes" 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: ] 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "force_disabled_modules": {}, 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "last_failure_osd_epoch": 5, 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "active_clients": [ 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.878 INFO:teuthology.orchestra.run.trial028.stdout: "name": "devicehealth", 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: "addrvec": [ 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: "type": "v2", 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: "addr": "10.20.193.28:0", 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: "nonce": 72216770 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: ] 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: "name": "libcephsqlite", 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: "addrvec": [ 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: "type": "v2", 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: "addr": "10.20.193.28:0", 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: "nonce": 948036878 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: ] 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rbd_support", 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: "addrvec": [ 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: "type": "v2", 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: "addr": "10.20.193.28:0", 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: "nonce": 15788326 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: ] 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: "name": "snap_schedule", 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: "addrvec": [ 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: "type": "v2", 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: "addr": "10.20.193.28:0", 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: "nonce": 1679762850 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: ] 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: "name": "snap_schedule", 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: "addrvec": [ 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: "type": "v2", 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: "addr": "10.20.193.28:0", 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: "nonce": 3338877588 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: ] 2026-02-24T09:31:00.879 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:00.880 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.880 INFO:teuthology.orchestra.run.trial028.stdout: "name": "volumes", 2026-02-24T09:31:00.880 INFO:teuthology.orchestra.run.trial028.stdout: "addrvec": [ 2026-02-24T09:31:00.880 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-24T09:31:00.880 INFO:teuthology.orchestra.run.trial028.stdout: "type": "v2", 2026-02-24T09:31:00.880 INFO:teuthology.orchestra.run.trial028.stdout: "addr": "10.20.193.28:0", 2026-02-24T09:31:00.880 INFO:teuthology.orchestra.run.trial028.stdout: "nonce": 94081171 2026-02-24T09:31:00.880 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.880 INFO:teuthology.orchestra.run.trial028.stdout: ] 2026-02-24T09:31:00.880 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:00.880 INFO:teuthology.orchestra.run.trial028.stdout: ] 2026-02-24T09:31:00.880 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-24T09:31:00.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.409+0000 7fe2e8bd2640 1 -- 10.20.193.28:0/1530514268 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe2b80b58d0 msgr2=0x7fe2b80d5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:00.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.409+0000 7fe2e8bd2640 1 --2- 10.20.193.28:0/1530514268 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe2b80b58d0 0x7fe2b80d5d80 secure :-1 s=READY pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2e40fb750 tx=0x7fe2d403a040 comp rx=0 tx=0).stop 2026-02-24T09:31:00.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.409+0000 7fe2e8bd2640 1 -- 10.20.193.28:0/1530514268 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2e410d150 msgr2=0x7fe2e40f4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:00.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.409+0000 7fe2e8bd2640 1 --2- 10.20.193.28:0/1530514268 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2e410d150 0x7fe2e40f4db0 secure :-1 s=READY pgs=505 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2d0009480 tx=0x7fe2d000ee60 comp rx=0 tx=0).stop 2026-02-24T09:31:00.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.409+0000 7fe2e8bd2640 1 -- 10.20.193.28:0/1530514268 shutdown_connections 2026-02-24T09:31:00.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.409+0000 7fe2e8bd2640 1 --2- 10.20.193.28:0/1530514268 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe2b80b58d0 0x7fe2b80d5d80 unknown :-1 s=CLOSED pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:00.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.409+0000 7fe2e8bd2640 1 --2- 10.20.193.28:0/1530514268 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fe2e4113340 0x7fe2e40f5440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:00.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.409+0000 7fe2e8bd2640 1 --2- 10.20.193.28:0/1530514268 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fe2e410db40 0x7fe2e4173c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:00.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.409+0000 7fe2e8bd2640 1 --2- 10.20.193.28:0/1530514268 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2e410d150 0x7fe2e40f4db0 unknown :-1 s=CLOSED pgs=505 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:00.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.409+0000 7fe2e8bd2640 1 -- 10.20.193.28:0/1530514268 >> 10.20.193.28:0/1530514268 conn(0x7fe2e40eaa20 msgr2=0x7fe2e4111a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:00.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.409+0000 7fe2e8bd2640 1 -- 10.20.193.28:0/1530514268 shutdown_connections 2026-02-24T09:31:00.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:00.409+0000 7fe2e8bd2640 1 -- 10.20.193.28:0/1530514268 wait complete. 2026-02-24T09:31:00.885 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:31:00.885 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:00 trial028 ceph-mon[40371]: from='client.15891 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:31:00.885 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:00 trial028 ceph-mon[40371]: from='client.15897 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:31:00.885 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:00 trial028 ceph-mon[40371]: pgmap v618: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:31:00.885 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:00 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/4208935465' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-24T09:31:00.885 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:00 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/3322689269' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2026-02-24T09:31:00.885 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:00 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/2870791279' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2026-02-24T09:31:00.885 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:00 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/1530514268' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2026-02-24T09:31:00.885 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:00 trial074 ceph-mon[44412]: from='client.15891 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:31:00.885 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:00 trial074 ceph-mon[44412]: from='client.15897 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:31:00.885 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:00 trial074 ceph-mon[44412]: pgmap v618: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:31:00.885 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:00 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/4208935465' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-24T09:31:00.885 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:00 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/3322689269' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2026-02-24T09:31:00.885 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:00 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/2870791279' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2026-02-24T09:31:00.885 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:00 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/1530514268' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2026-02-24T09:31:00.885 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:00 trial159 ceph-mon[44242]: from='client.15891 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:31:00.885 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:00 trial159 ceph-mon[44242]: from='client.15897 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:31:00.886 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:00 trial159 ceph-mon[44242]: pgmap v618: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-24T09:31:00.886 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:00 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/4208935465' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-24T09:31:00.886 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:00 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/3322689269' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2026-02-24T09:31:00.886 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:00 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/2870791279' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2026-02-24T09:31:00.886 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:00 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/1530514268' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2026-02-24T09:31:01.067 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:31:01.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.245+0000 7f91726bd640 1 -- 10.20.193.28:0/588042785 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f916c1536d0 msgr2=0x7f916c173af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:01.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.245+0000 7f91726bd640 1 --2- 10.20.193.28:0/588042785 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f916c1536d0 0x7f916c173af0 secure :-1 s=READY pgs=506 gs=1 cs=0 l=1 c_cookie=6921577831579251277 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f916800aa30 tx=0x7f9168030270 comp rx=0 tx=0).stop 2026-02-24T09:31:01.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.245+0000 7f91726bd640 1 -- 10.20.193.28:0/588042785 shutdown_connections 2026-02-24T09:31:01.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.245+0000 7f91726bd640 1 --2- 10.20.193.28:0/588042785 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f916c1536d0 0x7f916c173af0 unknown :-1 s=CLOSED pgs=506 gs=1 cs=0 l=1 c_cookie=6921577831579251277 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.245+0000 7f91726bd640 1 --2- 10.20.193.28:0/588042785 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f916c10eb10 0x7f916c153190 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.245+0000 7f91726bd640 1 --2- 10.20.193.28:0/588042785 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f916c10e120 0x7f916c10e4f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.245+0000 7f91726bd640 1 -- 10.20.193.28:0/588042785 >> 10.20.193.28:0/588042785 conn(0x7f916c0e9b70 msgr2=0x7f916c109f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:01.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.245+0000 7f91726bd640 1 -- 10.20.193.28:0/588042785 shutdown_connections 2026-02-24T09:31:01.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.245+0000 7f91726bd640 1 -- 10.20.193.28:0/588042785 wait complete. 2026-02-24T09:31:01.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.245+0000 7f91726bd640 1 Processor -- start 2026-02-24T09:31:01.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.246+0000 7f91726bd640 1 -- start start 2026-02-24T09:31:01.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.246+0000 7f91726bd640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f916c10e120 0x7f916c162000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.246+0000 7f91726bd640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f916c10eb10 0x7f916c162540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.246+0000 7f91726bd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f916c1536d0 0x7f916c167910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.246+0000 7f91726bd640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f916c167ea0 con 0x7f916c1536d0 2026-02-24T09:31:01.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.246+0000 7f91726bd640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f916c168010 con 0x7f916c10eb10 2026-02-24T09:31:01.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.246+0000 7f91726bd640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f916c1681d0 con 0x7f916c10e120 2026-02-24T09:31:01.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.246+0000 7f9171ebc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f916c1536d0 0x7f916c167910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.246+0000 7f9171ebc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f916c1536d0 0x7f916c167910 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39732/0 (socket says 10.20.193.28:39732) 2026-02-24T09:31:01.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.246+0000 7f9171ebc640 1 -- 10.20.193.28:0/2676544253 learned_addr learned my addr 10.20.193.28:0/2676544253 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:31:01.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.246+0000 7f9170eba640 1 --2- 10.20.193.28:0/2676544253 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f916c10eb10 0x7f916c162540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.246+0000 7f9171ebc640 1 -- 10.20.193.28:0/2676544253 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f916c10e120 msgr2=0x7f916c162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:01.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.246+0000 7f9171ebc640 1 --2- 10.20.193.28:0/2676544253 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f916c10e120 0x7f916c162000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.246+0000 7f9171ebc640 1 -- 10.20.193.28:0/2676544253 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f916c10eb10 msgr2=0x7f916c162540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:01.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.246+0000 7f9171ebc640 1 --2- 10.20.193.28:0/2676544253 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f916c10eb10 0x7f916c162540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.246+0000 7f9171ebc640 1 -- 10.20.193.28:0/2676544253 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f916800a650 con 0x7f916c1536d0 2026-02-24T09:31:01.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.247+0000 7f9171ebc640 1 --2- 10.20.193.28:0/2676544253 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f916c1536d0 0x7f916c167910 secure :-1 s=READY pgs=507 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f916800a980 tx=0x7f91680039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:01.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.247+0000 7f915a7fc640 1 -- 10.20.193.28:0/2676544253 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f916803e070 con 0x7f916c1536d0 2026-02-24T09:31:01.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.247+0000 7f915a7fc640 1 -- 10.20.193.28:0/2676544253 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f9168003aa0 con 0x7f916c1536d0 2026-02-24T09:31:01.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.247+0000 7f915a7fc640 1 -- 10.20.193.28:0/2676544253 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9168042a60 con 0x7f916c1536d0 2026-02-24T09:31:01.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.247+0000 7f91726bd640 1 -- 10.20.193.28:0/2676544253 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f916c168450 con 0x7f916c1536d0 2026-02-24T09:31:01.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.247+0000 7f91726bd640 1 -- 10.20.193.28:0/2676544253 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f916c14f150 con 0x7f916c1536d0 2026-02-24T09:31:01.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.247+0000 7f91726bd640 1 -- 10.20.193.28:0/2676544253 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f916c060380 con 0x7f916c1536d0 2026-02-24T09:31:01.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.249+0000 7f915a7fc640 1 -- 10.20.193.28:0/2676544253 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7f91680050c0 con 0x7f916c1536d0 2026-02-24T09:31:01.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.251+0000 7f915a7fc640 1 --2- 10.20.193.28:0/2676544253 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f91480b58d0 0x7f91480d5d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.251+0000 7f915a7fc640 1 -- 10.20.193.28:0/2676544253 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 8513+0+0 (secure 0 0 0) 0x7f916810d370 con 0x7f916c1536d0 2026-02-24T09:31:01.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.251+0000 7f915a7fc640 1 -- 10.20.193.28:0/2676544253 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f91680d2e70 con 0x7f916c1536d0 2026-02-24T09:31:01.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.251+0000 7f91716bb640 1 --2- 10.20.193.28:0/2676544253 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f91480b58d0 0x7f91480d5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.252+0000 7f91716bb640 1 --2- 10.20.193.28:0/2676544253 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f91480b58d0 0x7f91480d5d80 secure :-1 s=READY pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f915c004740 tx=0x7f915c005d20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:01.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.391+0000 7f91726bd640 1 -- 10.20.193.28:0/2676544253 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f916c10e4f0 con 0x7f916c1536d0 2026-02-24T09:31:01.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.391+0000 7f915a7fc640 1 -- 10.20.193.28:0/2676544253 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11901 (secure 0 0 0) 0x7f91680d3060 con 0x7f916c1536d0 2026-02-24T09:31:01.393 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:31:01.394 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":23,"btime":"2026-02-24T09:17:37:340018+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14856,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/3473030842","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":3473030842},{"type":"v1","addr":"10.20.193.28:6835","nonce":3473030842}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14862,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/4120804601","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":4120804601},{"type":"v1","addr":"10.20.193.28:6837","nonce":4120804601}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14910,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/1354296520","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1354296520},{"type":"v1","addr":"10.20.193.28:6839","nonce":1354296520}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24691,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.159:6833/3049112106","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6832","nonce":3049112106},{"type":"v1","addr":"10.20.193.159:6833","nonce":3049112106}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24710,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.74:6833/1426135976","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6832","nonce":1426135976},{"type":"v1","addr":"10.20.193.74:6833","nonce":1426135976}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24721,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.159:6835/3999384392","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6834","nonce":3999384392},{"type":"v1","addr":"10.20.193.159:6835","nonce":3999384392}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:16:59.889500+0000","modified":"2026-02-24T09:17:36.673190+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24788,"mds_1":24761,"mds_2":24760},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24727":{"gid":24727,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.159:6837/2059577520","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6836","nonce":2059577520},{"type":"v1","addr":"10.20.193.159:6837","nonce":2059577520}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24734":{"gid":24734,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.74:6835/2067708838","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6834","nonce":2067708838},{"type":"v1","addr":"10.20.193.74:6835","nonce":2067708838}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24745":{"gid":24745,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.159:6839/533862317","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6838","nonce":533862317},{"type":"v1","addr":"10.20.193.159:6839","nonce":533862317}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24760":{"gid":24760,"name":"a","rank":2,"incarnation":20,"state":"up:active","state_seq":5,"addr":"10.20.193.28:6841/492586680","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":492586680},{"type":"v1","addr":"10.20.193.28:6841","nonce":492586680}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24761":{"gid":24761,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"10.20.193.74:6837/958749351","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6836","nonce":958749351},{"type":"v1","addr":"10.20.193.74:6837","nonce":958749351}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24788":{"gid":24788,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"10.20.193.74:6839/828566790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6838","nonce":828566790},{"type":"v1","addr":"10.20.193.74:6839","nonce":828566790}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24788,"qdb_cluster":[24760,24761,24788]},"id":1}]} 2026-02-24T09:31:01.394 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 23 2026-02-24T09:31:01.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.393+0000 7f91726bd640 1 -- 10.20.193.28:0/2676544253 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f91480b58d0 msgr2=0x7f91480d5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:01.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.393+0000 7f91726bd640 1 --2- 10.20.193.28:0/2676544253 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f91480b58d0 0x7f91480d5d80 secure :-1 s=READY pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f915c004740 tx=0x7f915c005d20 comp rx=0 tx=0).stop 2026-02-24T09:31:01.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.393+0000 7f91726bd640 1 -- 10.20.193.28:0/2676544253 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f916c1536d0 msgr2=0x7f916c167910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:01.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.393+0000 7f91726bd640 1 --2- 10.20.193.28:0/2676544253 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f916c1536d0 0x7f916c167910 secure :-1 s=READY pgs=507 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f916800a980 tx=0x7f91680039b0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.393+0000 7f91726bd640 1 -- 10.20.193.28:0/2676544253 shutdown_connections 2026-02-24T09:31:01.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.393+0000 7f91726bd640 1 --2- 10.20.193.28:0/2676544253 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f91480b58d0 0x7f91480d5d80 unknown :-1 s=CLOSED pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.393+0000 7f91726bd640 1 --2- 10.20.193.28:0/2676544253 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f916c1536d0 0x7f916c167910 unknown :-1 s=CLOSED pgs=507 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.393+0000 7f91726bd640 1 --2- 10.20.193.28:0/2676544253 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f916c10eb10 0x7f916c162540 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.393+0000 7f91726bd640 1 --2- 10.20.193.28:0/2676544253 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f916c10e120 0x7f916c162000 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.393+0000 7f91726bd640 1 -- 10.20.193.28:0/2676544253 >> 10.20.193.28:0/2676544253 conn(0x7f916c0e9b70 msgr2=0x7f916c109f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:01.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.393+0000 7f91726bd640 1 -- 10.20.193.28:0/2676544253 shutdown_connections 2026-02-24T09:31:01.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.393+0000 7f91726bd640 1 -- 10.20.193.28:0/2676544253 wait complete. 2026-02-24T09:31:01.495 DEBUG:tasks.check_counter:Getting stats from a 2026-02-24T09:31:01.495 DEBUG:tasks.check_counter:Getting stats from mds.24760 2026-02-24T09:31:01.495 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24760 perf dump --format=json-pretty 2026-02-24T09:31:01.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.619+0000 7f680ffff640 1 -- 10.20.193.28:0/400473041 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f681010f3c0 msgr2=0x7f681010f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:01.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.619+0000 7f680ffff640 1 --2- 10.20.193.28:0/400473041 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f681010f3c0 0x7f681010f790 secure :-1 s=READY pgs=508 gs=1 cs=0 l=1 c_cookie=8305267420411015684 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6804009950 tx=0x7f680402f190 comp rx=0 tx=0).stop 2026-02-24T09:31:01.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.619+0000 7f680ffff640 1 -- 10.20.193.28:0/400473041 shutdown_connections 2026-02-24T09:31:01.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.619+0000 7f680ffff640 1 --2- 10.20.193.28:0/400473041 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f68101155b0 0x7f6810175f80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.619+0000 7f680ffff640 1 --2- 10.20.193.28:0/400473041 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f681010fdb0 0x7f6810114e00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.619+0000 7f680ffff640 1 --2- 10.20.193.28:0/400473041 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f681010f3c0 0x7f681010f790 unknown :-1 s=CLOSED pgs=508 gs=1 cs=0 l=1 c_cookie=8305267420411015684 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.619+0000 7f680ffff640 1 -- 10.20.193.28:0/400473041 >> 10.20.193.28:0/400473041 conn(0x7f68100eccb0 msgr2=0x7f681010d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:01.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.619+0000 7f680ffff640 1 -- 10.20.193.28:0/400473041 shutdown_connections 2026-02-24T09:31:01.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.619+0000 7f680ffff640 1 -- 10.20.193.28:0/400473041 wait complete. 2026-02-24T09:31:01.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.619+0000 7f680ffff640 1 Processor -- start 2026-02-24T09:31:01.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.619+0000 7f680ffff640 1 -- start start 2026-02-24T09:31:01.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.620+0000 7f680ffff640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f681010f3c0 0x7f681011d420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.620+0000 7f680ffff640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f681010fdb0 0x7f681011d960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.620+0000 7f680ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f68101155b0 0x7f6810122d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.620+0000 7f680ffff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6810123350 con 0x7f68101155b0 2026-02-24T09:31:01.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.620+0000 7f680ffff640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f68101234c0 con 0x7f681010f3c0 2026-02-24T09:31:01.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.620+0000 7f680ffff640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6810123680 con 0x7f681010fdb0 2026-02-24T09:31:01.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.620+0000 7f680f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f68101155b0 0x7f6810122d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.620+0000 7f680f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f68101155b0 0x7f6810122d30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39756/0 (socket says 10.20.193.28:39756) 2026-02-24T09:31:01.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.620+0000 7f680f7fe640 1 -- 10.20.193.28:0/3429005771 learned_addr learned my addr 10.20.193.28:0/3429005771 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:31:01.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.620+0000 7f680effd640 1 --2- 10.20.193.28:0/3429005771 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f681010f3c0 0x7f681011d420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.620+0000 7f680e7fc640 1 --2- 10.20.193.28:0/3429005771 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f681010fdb0 0x7f681011d960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.620+0000 7f680f7fe640 1 -- 10.20.193.28:0/3429005771 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f681010fdb0 msgr2=0x7f681011d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:01.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.620+0000 7f680f7fe640 1 --2- 10.20.193.28:0/3429005771 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f681010fdb0 0x7f681011d960 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.620+0000 7f680f7fe640 1 -- 10.20.193.28:0/3429005771 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f681010f3c0 msgr2=0x7f681011d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:01.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.620+0000 7f680f7fe640 1 --2- 10.20.193.28:0/3429005771 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f681010f3c0 0x7f681011d420 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.620+0000 7f680f7fe640 1 -- 10.20.193.28:0/3429005771 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6804009570 con 0x7f68101155b0 2026-02-24T09:31:01.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.620+0000 7f680f7fe640 1 --2- 10.20.193.28:0/3429005771 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f68101155b0 0x7f6810122d30 secure :-1 s=READY pgs=509 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f680000e650 tx=0x7f680000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:01.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.620+0000 7f67effff640 1 -- 10.20.193.28:0/3429005771 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f680000aa20 con 0x7f68101155b0 2026-02-24T09:31:01.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.620+0000 7f67effff640 1 -- 10.20.193.28:0/3429005771 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f680000ab80 con 0x7f68101155b0 2026-02-24T09:31:01.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.620+0000 7f67effff640 1 -- 10.20.193.28:0/3429005771 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6800010640 con 0x7f68101155b0 2026-02-24T09:31:01.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.620+0000 7f680ffff640 1 -- 10.20.193.28:0/3429005771 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6810123960 con 0x7f68101155b0 2026-02-24T09:31:01.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.621+0000 7f680ffff640 1 -- 10.20.193.28:0/3429005771 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6810164060 con 0x7f68101155b0 2026-02-24T09:31:01.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.624+0000 7f67effff640 1 -- 10.20.193.28:0/3429005771 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7f6800011460 con 0x7f68101155b0 2026-02-24T09:31:01.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.625+0000 7f67effff640 1 --2- 10.20.193.28:0/3429005771 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f67e40b58d0 0x7f67e40d5d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.625+0000 7f6817e8fe00 1 Processor -- start 2026-02-24T09:31:01.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.625+0000 7f67effff640 1 -- 10.20.193.28:0/3429005771 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 8513+0+0 (secure 0 0 0) 0x7f68000e7cb0 con 0x7f68101155b0 2026-02-24T09:31:01.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.625+0000 7f6817e8fe00 1 -- start start 2026-02-24T09:31:01.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.626+0000 7f680effd640 1 --2- 10.20.193.28:0/3429005771 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f67e40b58d0 0x7f67e40d5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.626+0000 7f6817e8fe00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d79ec8b860 0x55d79ec8bc30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.626+0000 7f6817e8fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79ec8c170 0x55d79ecd08d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.626+0000 7f6817e8fe00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d79ecd0e10 0x55d79ecf11f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.626+0000 7f6817e8fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d79eba1e70 con 0x55d79ec8c170 2026-02-24T09:31:01.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.626+0000 7f6817e8fe00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55d79eb9dba0 con 0x55d79ec8b860 2026-02-24T09:31:01.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.626+0000 7f6817e8fe00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55d79eb97d00 con 0x55d79ecd0e10 2026-02-24T09:31:01.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.626+0000 7f680e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79ec8c170 0x55d79ecd08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.626+0000 7f680e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79ec8c170 0x55d79ecd08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39762/0 (socket says 10.20.193.28:39762) 2026-02-24T09:31:01.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.626+0000 7f680e7fc640 1 -- 10.20.193.28:0/671691052 learned_addr learned my addr 10.20.193.28:0/671691052 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:31:01.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.626+0000 7f680f7fe640 1 --2- 10.20.193.28:0/671691052 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d79ecd0e10 0x55d79ecf11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.626+0000 7f680e7fc640 1 -- 10.20.193.28:0/671691052 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d79ecd0e10 msgr2=0x55d79ecf11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:31:01.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.626+0000 7f680effd640 1 --2- 10.20.193.28:0/671691052 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d79ec8b860 0x55d79ec8bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.626+0000 7f680e7fc640 1 --2- 10.20.193.28:0/671691052 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d79ecd0e10 0x55d79ecf11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.626+0000 7f680e7fc640 1 -- 10.20.193.28:0/671691052 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d79ec8b860 msgr2=0x55d79ec8bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:31:01.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.626+0000 7f680e7fc640 1 --2- 10.20.193.28:0/671691052 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d79ec8b860 0x55d79ec8bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.626+0000 7f680e7fc640 1 -- 10.20.193.28:0/671691052 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d79eb431f0 con 0x55d79ec8c170 2026-02-24T09:31:01.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.626+0000 7f680f7fe640 1 --2- 10.20.193.28:0/671691052 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d79ecd0e10 0x55d79ecf11f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:31:01.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.626+0000 7f680effd640 1 --2- 10.20.193.28:0/671691052 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d79ec8b860 0x55d79ec8bc30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:31:01.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.626+0000 7f680e7fc640 1 --2- 10.20.193.28:0/671691052 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79ec8c170 0x55d79ecd08d0 secure :-1 s=READY pgs=510 gs=1 cs=0 l=1 c_cookie=9412476129241674395 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f67f8002b60 tx=0x7f67f800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829fd52b8c4b329b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:01.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.626+0000 7f680effd640 1 --2- 10.20.193.28:0/3429005771 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f67e40b58d0 0x7f67e40d5d80 secure :-1 s=READY pgs=262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68040098a0 tx=0x7f6804002390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:01.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.627+0000 7f67db7fe640 1 -- 10.20.193.28:0/671691052 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f67f8002e80 con 0x55d79ec8c170 2026-02-24T09:31:01.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.627+0000 7f67db7fe640 1 -- 10.20.193.28:0/671691052 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f67f800fe50 con 0x55d79ec8c170 2026-02-24T09:31:01.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.627+0000 7f67db7fe640 1 -- 10.20.193.28:0/671691052 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f67f8010920 con 0x55d79ec8c170 2026-02-24T09:31:01.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.627+0000 7f6817e8fe00 1 -- 10.20.193.28:0/671691052 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79ec8c170 msgr2=0x55d79ecd08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:01.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.627+0000 7f6817e8fe00 1 --2- 10.20.193.28:0/671691052 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79ec8c170 0x55d79ecd08d0 secure :-1 s=READY pgs=510 gs=1 cs=0 l=1 c_cookie=9412476129241674395 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f67f8002b60 tx=0x7f67f800f730 comp rx=0 tx=0).stop 2026-02-24T09:31:01.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.627+0000 7f6817e8fe00 1 -- 10.20.193.28:0/671691052 shutdown_connections 2026-02-24T09:31:01.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.627+0000 7f6817e8fe00 1 --2- 10.20.193.28:0/671691052 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d79ecd0e10 0x55d79ecf11f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.627+0000 7f6817e8fe00 1 --2- 10.20.193.28:0/671691052 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79ec8c170 0x55d79ecd08d0 unknown :-1 s=CLOSED pgs=510 gs=1 cs=0 l=1 c_cookie=9412476129241674395 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.627+0000 7f6817e8fe00 1 --2- 10.20.193.28:0/671691052 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d79ec8b860 0x55d79ec8bc30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.627+0000 7f6817e8fe00 1 -- 10.20.193.28:0/671691052 >> 10.20.193.28:0/671691052 conn(0x55d79ec69d60 msgr2=0x55d79ec8a140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:01.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.627+0000 7f6817e8fe00 1 -- 10.20.193.28:0/671691052 shutdown_connections 2026-02-24T09:31:01.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.627+0000 7f6817e8fe00 1 -- 10.20.193.28:0/671691052 wait complete. 2026-02-24T09:31:01.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.628+0000 7f6817e8fe00 1 -- start start 2026-02-24T09:31:01.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.629+0000 7f6817e8fe00 1 Processor -- start 2026-02-24T09:31:01.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.629+0000 7f6817e8fe00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d79ec8b860 0x55d79ec8ca20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.629+0000 7f6817e8fe00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d79ec8c170 0x55d79ec8cf60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.629+0000 7f6817e8fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79ecd0e10 0x55d79ec8e900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.629+0000 7f6817e8fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d79ec8ee70 con 0x55d79ecd0e10 2026-02-24T09:31:01.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.629+0000 7f6817e8fe00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55d79ec8efe0 con 0x55d79ec8b860 2026-02-24T09:31:01.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.629+0000 7f6817e8fe00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55d79ec8f1a0 con 0x55d79ec8c170 2026-02-24T09:31:01.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.629+0000 7f680f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79ecd0e10 0x55d79ec8e900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.629+0000 7f680f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79ecd0e10 0x55d79ec8e900 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39770/0 (socket says 10.20.193.28:39770) 2026-02-24T09:31:01.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.629+0000 7f680f7fe640 1 -- 10.20.193.28:0/4164210520 learned_addr learned my addr 10.20.193.28:0/4164210520 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:31:01.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.629+0000 7f680e7fc640 1 --2- 10.20.193.28:0/4164210520 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d79ec8c170 0x55d79ec8cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.629+0000 7f680effd640 1 --2- 10.20.193.28:0/4164210520 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d79ec8b860 0x55d79ec8ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.630+0000 7f680f7fe640 1 -- 10.20.193.28:0/4164210520 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d79ec8c170 msgr2=0x55d79ec8cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:31:01.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.630+0000 7f680f7fe640 1 --2- 10.20.193.28:0/4164210520 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d79ec8c170 0x55d79ec8cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.630+0000 7f680f7fe640 1 -- 10.20.193.28:0/4164210520 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d79ec8b860 msgr2=0x55d79ec8ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:31:01.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.630+0000 7f680f7fe640 1 --2- 10.20.193.28:0/4164210520 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d79ec8b860 0x55d79ec8ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.630+0000 7f680f7fe640 1 -- 10.20.193.28:0/4164210520 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d79eb1b5b0 con 0x55d79ecd0e10 2026-02-24T09:31:01.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.630+0000 7f680f7fe640 1 --2- 10.20.193.28:0/4164210520 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79ecd0e10 0x55d79ec8e900 secure :-1 s=READY pgs=511 gs=2 cs=0 l=1 c_cookie=9162081474119835905 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68000aaf30 tx=0x7f68000119f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f26408ed419a101 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:01.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.630+0000 7f67d8ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:31:01.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.630+0000 7f67d8ff9640 1 -- 10.20.193.28:0/4164210520 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68000ad6a0 con 0x55d79ecd0e10 2026-02-24T09:31:01.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.630+0000 7f67d8ff9640 1 -- 10.20.193.28:0/4164210520 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f68000ad4c0 con 0x55d79ecd0e10 2026-02-24T09:31:01.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.630+0000 7f67d8ff9640 1 -- 10.20.193.28:0/4164210520 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68000b8bf0 con 0x55d79ecd0e10 2026-02-24T09:31:01.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.630+0000 7f6817e8fe00 1 -- 10.20.193.28:0/4164210520 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67f8002780 con 0x55d79ecd0e10 2026-02-24T09:31:01.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.630+0000 7f67d8ff9640 1 -- 10.20.193.28:0/4164210520 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(110..110 src has 1..110) ==== 8513+0+0 (secure 0 0 0) 0x7f68000b8e00 con 0x55d79ecd0e10 2026-02-24T09:31:01.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.630+0000 7f67d8ff9640 10 client.15945 inactive, discarding osd_map(110..110 src has 1..110) 2026-02-24T09:31:01.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.630+0000 7f6817e8fe00 10 client.15945 _ll_register_callbacks cb 0x55d79eb18c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:31:01.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.630+0000 7f6817e8fe00 1 -- 10.20.193.28:0/4164210520 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d79e87a9e0 con 0x55d79ecd0e10 2026-02-24T09:31:01.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.630+0000 7f67d8ff9640 1 -- 10.20.193.28:0/4164210520 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f68000b39e0 con 0x55d79ecd0e10 2026-02-24T09:31:01.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.630+0000 7f6817e8fe00 10 client.15945 fetch_fsmap learned FSMap version 23 2026-02-24T09:31:01.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.630+0000 7f6817e8fe00 1 -- 10.20.193.28:0/4164210520 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x55d79eb2d700 con 0x55d79ecd0e10 2026-02-24T09:31:01.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.631+0000 7f67d8ff9640 1 -- 10.20.193.28:0/4164210520 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f68000ae950 con 0x55d79ecd0e10 2026-02-24T09:31:01.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.631+0000 7f6817e8fe00 10 client.15945 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:31:01.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.631+0000 7f6817e8fe00 10 client.15945 resolve_mds: validated gid 24760 aka daemon mds.a 2026-02-24T09:31:01.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.631+0000 7f6817e8fe00 20 client.15945 populate_metadata read hostname 'trial028' 2026-02-24T09:31:01.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.631+0000 7f6817e8fe00 1 --2- 10.20.193.28:0/4164210520 >> [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] conn(0x55d79ecb6e30 0x55d79ecb72d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.631+0000 7f6817e8fe00 4 client.15945 mds_command: new command op to 24760 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:31:01.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.631+0000 7f6817e8fe00 1 -- 10.20.193.28:0/4164210520 --> [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d79eba5800 con 0x55d79ecb6e30 2026-02-24T09:31:01.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.631+0000 7f680effd640 1 --2- 10.20.193.28:0/4164210520 >> [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] conn(0x55d79ecb6e30 0x55d79ecb72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.631+0000 7f680effd640 1 --2- 10.20.193.28:0/4164210520 >> [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] conn(0x55d79ecb6e30 0x55d79ecb72d0 crc :-1 s=READY pgs=23 gs=4 cs=0 l=0 c_cookie=5511149025257908275 s_cookie=15668298499791241602 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4c7b88d6d2bce833 server_cookie=d970fa78aad7c182 in_seq=0 out_seq=0 2026-02-24T09:31:01.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.631+0000 7f67d8ff9640 10 client.15945 ms_handle_connect on v2:10.20.193.28:6840/492586680 2026-02-24T09:31:01.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.632+0000 7f67d8ff9640 1 -- 10.20.193.28:0/4164210520 <== mds.2 v2:10.20.193.28:6840/492586680 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55d79eba5800 con 0x55d79ecb6e30 2026-02-24T09:31:01.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.632+0000 7f67d8ff9640 10 client.15945 handle_command_reply: tid=0 2026-02-24T09:31:01.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.632+0000 7f6817e8fe00 1 client.15945 shutdown 2026-02-24T09:31:01.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.632+0000 7f6817e8fe00 1 -- 10.20.193.28:0/4164210520 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79ecd0e10 msgr2=0x55d79ec8e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:01.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.632+0000 7f6817e8fe00 1 --2- 10.20.193.28:0/4164210520 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79ecd0e10 0x55d79ec8e900 secure :-1 s=READY pgs=511 gs=2 cs=0 l=1 c_cookie=9162081474119835905 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68000aaf30 tx=0x7f68000119f0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.632+0000 7f6817e8fe00 1 -- 10.20.193.28:0/4164210520 shutdown_connections 2026-02-24T09:31:01.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.632+0000 7f6817e8fe00 1 --2- 10.20.193.28:0/4164210520 >> [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] conn(0x55d79ecb6e30 0x55d79ecb72d0 crc :-1 s=READY pgs=23 gs=4 cs=0 l=0 c_cookie=5511149025257908275 s_cookie=15668298499791241602 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.632+0000 7f6817e8fe00 1 --2- 10.20.193.28:0/4164210520 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79ecd0e10 0x55d79ec8e900 unknown :-1 s=CLOSED pgs=511 gs=2 cs=0 l=1 c_cookie=9162081474119835905 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.632+0000 7f6817e8fe00 1 --2- 10.20.193.28:0/4164210520 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d79ec8c170 0x55d79ec8cf60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.632+0000 7f6817e8fe00 1 --2- 10.20.193.28:0/4164210520 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d79ec8b860 0x55d79ec8ca20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.632+0000 7f6817e8fe00 1 -- 10.20.193.28:0/4164210520 >> 10.20.193.28:0/4164210520 conn(0x55d79ec69d60 msgr2=0x55d79ec8a140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:01.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.632+0000 7f67d8ff9640 0 client.15945 ms_handle_reset on v2:10.20.193.28:6840/492586680 2026-02-24T09:31:01.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.632+0000 7f6817e8fe00 1 -- 10.20.193.28:0/4164210520 shutdown_connections 2026-02-24T09:31:01.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.632+0000 7f6817e8fe00 1 -- 10.20.193.28:0/4164210520 wait complete. 2026-02-24T09:31:01.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.632+0000 7f6817e8fe00 20 client.15945 trim_cache size 0 max 16384 2026-02-24T09:31:01.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.641+0000 7f6817e8fe00 1 Processor -- start 2026-02-24T09:31:01.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.641+0000 7f6817e8fe00 1 -- start start 2026-02-24T09:31:01.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.641+0000 7f6817e8fe00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d79ec8b860 0x55d79ec8b240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.641+0000 7f6817e8fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79ec8c170 0x55d79ec8e7c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.641+0000 7f6817e8fe00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d79ecd0e10 0x55d79ecee940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.641+0000 7f6817e8fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d79eb95930 con 0x55d79ec8c170 2026-02-24T09:31:01.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.641+0000 7f6817e8fe00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55d79e835690 con 0x55d79ecd0e10 2026-02-24T09:31:01.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.641+0000 7f6817e8fe00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55d79ecea320 con 0x55d79ec8b860 2026-02-24T09:31:01.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.641+0000 7f680e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79ec8c170 0x55d79ec8e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.641+0000 7f680e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79ec8c170 0x55d79ec8e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39786/0 (socket says 10.20.193.28:39786) 2026-02-24T09:31:01.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.641+0000 7f680e7fc640 1 -- 10.20.193.28:0/780201437 learned_addr learned my addr 10.20.193.28:0/780201437 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:31:01.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.642+0000 7f680e7fc640 1 -- 10.20.193.28:0/780201437 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d79ec8b860 msgr2=0x55d79ec8b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:31:01.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.642+0000 7f680e7fc640 1 --2- 10.20.193.28:0/780201437 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d79ec8b860 0x55d79ec8b240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.642+0000 7f680e7fc640 1 -- 10.20.193.28:0/780201437 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d79ecd0e10 msgr2=0x55d79ecee940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:31:01.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.642+0000 7f680e7fc640 1 --2- 10.20.193.28:0/780201437 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d79ecd0e10 0x55d79ecee940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.642+0000 7f680e7fc640 1 -- 10.20.193.28:0/780201437 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d79eb27fa0 con 0x55d79ec8c170 2026-02-24T09:31:01.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.642+0000 7f680e7fc640 1 --2- 10.20.193.28:0/780201437 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79ec8c170 0x55d79ec8e7c0 secure :-1 s=READY pgs=512 gs=1 cs=0 l=1 c_cookie=12113706733070063340 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f67f8004150 tx=0x7f67f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81c8817b1e616ec server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:01.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.642+0000 7f67daffd640 1 -- 10.20.193.28:0/780201437 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f67f8012ea0 con 0x55d79ec8c170 2026-02-24T09:31:01.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.642+0000 7f67daffd640 1 -- 10.20.193.28:0/780201437 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f67f8020070 con 0x55d79ec8c170 2026-02-24T09:31:01.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.642+0000 7f67daffd640 1 -- 10.20.193.28:0/780201437 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f67f8011750 con 0x55d79ec8c170 2026-02-24T09:31:01.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.642+0000 7f6817e8fe00 1 -- 10.20.193.28:0/780201437 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79ec8c170 msgr2=0x55d79ec8e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:01.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.642+0000 7f6817e8fe00 1 --2- 10.20.193.28:0/780201437 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79ec8c170 0x55d79ec8e7c0 secure :-1 s=READY pgs=512 gs=1 cs=0 l=1 c_cookie=12113706733070063340 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f67f8004150 tx=0x7f67f80057f0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.642+0000 7f6817e8fe00 1 -- 10.20.193.28:0/780201437 shutdown_connections 2026-02-24T09:31:01.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.642+0000 7f6817e8fe00 1 --2- 10.20.193.28:0/780201437 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d79ecd0e10 0x55d79ecee940 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.642+0000 7f6817e8fe00 1 --2- 10.20.193.28:0/780201437 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79ec8c170 0x55d79ec8e7c0 unknown :-1 s=CLOSED pgs=512 gs=1 cs=0 l=1 c_cookie=12113706733070063340 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.642+0000 7f6817e8fe00 1 --2- 10.20.193.28:0/780201437 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d79ec8b860 0x55d79ec8b240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.642+0000 7f6817e8fe00 1 -- 10.20.193.28:0/780201437 >> 10.20.193.28:0/780201437 conn(0x55d79ec69d60 msgr2=0x55d79ecd0590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:01.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.642+0000 7f6817e8fe00 1 -- 10.20.193.28:0/780201437 shutdown_connections 2026-02-24T09:31:01.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.642+0000 7f6817e8fe00 1 -- 10.20.193.28:0/780201437 wait complete. 2026-02-24T09:31:01.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.643+0000 7f6817e8fe00 1 -- start start 2026-02-24T09:31:01.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.643+0000 7f6817e8fe00 1 Processor -- start 2026-02-24T09:31:01.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.643+0000 7f6817e8fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79ec8b860 0x55d79ecc4d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.643+0000 7f6817e8fe00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d79ec8c170 0x55d79ecc5270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.643+0000 7f6817e8fe00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d79ecd0e10 0x55d79ed859c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.643+0000 7f6817e8fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d79ec667e0 con 0x55d79ec8b860 2026-02-24T09:31:01.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.643+0000 7f6817e8fe00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55d79ecb7460 con 0x55d79ec8c170 2026-02-24T09:31:01.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.643+0000 7f6817e8fe00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55d79ed85fb0 con 0x55d79ecd0e10 2026-02-24T09:31:01.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.643+0000 7f680effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79ec8b860 0x55d79ecc4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.643+0000 7f680effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79ec8b860 0x55d79ecc4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39796/0 (socket says 10.20.193.28:39796) 2026-02-24T09:31:01.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.643+0000 7f680effd640 1 -- 10.20.193.28:0/1342949728 learned_addr learned my addr 10.20.193.28:0/1342949728 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:31:01.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.644+0000 7f680e7fc640 1 --2- 10.20.193.28:0/1342949728 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d79ec8c170 0x55d79ecc5270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.644+0000 7f680f7fe640 1 --2- 10.20.193.28:0/1342949728 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d79ecd0e10 0x55d79ed859c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.644+0000 7f680effd640 1 -- 10.20.193.28:0/1342949728 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d79ecd0e10 msgr2=0x55d79ed859c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:31:01.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.644+0000 7f680effd640 1 --2- 10.20.193.28:0/1342949728 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d79ecd0e10 0x55d79ed859c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.644+0000 7f680effd640 1 -- 10.20.193.28:0/1342949728 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d79ec8c170 msgr2=0x55d79ecc5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:31:01.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.644+0000 7f680effd640 1 --2- 10.20.193.28:0/1342949728 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d79ec8c170 0x55d79ecc5270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.644+0000 7f680effd640 1 -- 10.20.193.28:0/1342949728 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d79eb1b8e0 con 0x55d79ec8b860 2026-02-24T09:31:01.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.644+0000 7f680effd640 1 --2- 10.20.193.28:0/1342949728 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79ec8b860 0x55d79ecc4d30 secure :-1 s=READY pgs=513 gs=1 cs=0 l=1 c_cookie=9109167103757180954 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6804005b30 tx=0x7f6804009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e6a4337eb1ee01a server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:01.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.644+0000 7f67d8ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:31:01.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.644+0000 7f67d8ff9640 1 -- 10.20.193.28:0/1342949728 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f680403d030 con 0x55d79ec8b860 2026-02-24T09:31:01.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.644+0000 7f67d8ff9640 1 -- 10.20.193.28:0/1342949728 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6804002a70 con 0x55d79ec8b860 2026-02-24T09:31:01.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.644+0000 7f67d8ff9640 1 -- 10.20.193.28:0/1342949728 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6804038920 con 0x55d79ec8b860 2026-02-24T09:31:01.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.644+0000 7f6817e8fe00 1 -- 10.20.193.28:0/1342949728 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d79eb431f0 con 0x55d79ec8b860 2026-02-24T09:31:01.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.644+0000 7f67d8ff9640 1 -- 10.20.193.28:0/1342949728 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(110..110 src has 1..110) ==== 8513+0+0 (secure 0 0 0) 0x7f6804038ab0 con 0x55d79ec8b860 2026-02-24T09:31:01.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.644+0000 7f6817e8fe00 10 client.15951 _ll_register_callbacks cb 0x55d79eb18c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:31:01.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.644+0000 7f6817e8fe00 1 -- 10.20.193.28:0/1342949728 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67f800fe50 con 0x55d79ec8b860 2026-02-24T09:31:01.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.644+0000 7f67d8ff9640 1 -- 10.20.193.28:0/1342949728 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f68040576a0 con 0x55d79ec8b860 2026-02-24T09:31:01.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.644+0000 7f6817e8fe00 10 client.15951 fetch_fsmap learned FSMap version 23 2026-02-24T09:31:01.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.644+0000 7f6817e8fe00 1 -- 10.20.193.28:0/1342949728 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x55d79eb2d960 con 0x55d79ec8b860 2026-02-24T09:31:01.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.645+0000 7f67d8ff9640 1 -- 10.20.193.28:0/1342949728 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f6804038c70 con 0x55d79ec8b860 2026-02-24T09:31:01.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.645+0000 7f6817e8fe00 10 client.15951 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:31:01.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.645+0000 7f6817e8fe00 10 client.15951 resolve_mds: validated gid 24760 aka daemon mds.a 2026-02-24T09:31:01.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.645+0000 7f6817e8fe00 20 client.15951 populate_metadata read hostname 'trial028' 2026-02-24T09:31:01.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.645+0000 7f6817e8fe00 1 --2- 10.20.193.28:0/1342949728 >> [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] conn(0x55d79ed87ca0 0x55d79eda8150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.645+0000 7f6817e8fe00 4 client.15951 mds_command: new command op to 24760 tid=0 multi_id=0 [{"prefix": "perf dump", "format": "json-pretty"}] 2026-02-24T09:31:01.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.645+0000 7f6817e8fe00 1 -- 10.20.193.28:0/1342949728 --> [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] -- command(tid 0: {"prefix": "perf dump", "format": "json-pretty"}) -- 0x55d79e8c8740 con 0x55d79ed87ca0 2026-02-24T09:31:01.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.645+0000 7f680e7fc640 1 --2- 10.20.193.28:0/1342949728 >> [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] conn(0x55d79ed87ca0 0x55d79eda8150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.645+0000 7f680e7fc640 1 --2- 10.20.193.28:0/1342949728 >> [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] conn(0x55d79ed87ca0 0x55d79eda8150 crc :-1 s=READY pgs=24 gs=4 cs=0 l=0 c_cookie=5066825767656340542 s_cookie=17109102196771817970 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4650fb30c3f3bc3e server_cookie=ed6fbdccd07089f2 in_seq=0 out_seq=0 2026-02-24T09:31:01.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.645+0000 7f67d8ff9640 10 client.15951 ms_handle_connect on v2:10.20.193.28:6840/492586680 2026-02-24T09:31:01.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.646+0000 7f67d8ff9640 1 -- 10.20.193.28:0/1342949728 <== mds.2 v2:10.20.193.28:6840/492586680 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18286 (crc 0 0 0) 0x55d79e8c8740 con 0x55d79ed87ca0 2026-02-24T09:31:01.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.646+0000 7f67d8ff9640 10 client.15951 handle_command_reply: tid=0 2026-02-24T09:31:01.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.646+0000 7f6817e8fe00 1 client.15951 shutdown 2026-02-24T09:31:01.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.646+0000 7f6817e8fe00 1 -- 10.20.193.28:0/1342949728 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79ec8b860 msgr2=0x55d79ecc4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:01.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.646+0000 7f6817e8fe00 1 --2- 10.20.193.28:0/1342949728 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79ec8b860 0x55d79ecc4d30 secure :-1 s=READY pgs=513 gs=1 cs=0 l=1 c_cookie=9109167103757180954 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6804005b30 tx=0x7f6804009310 comp rx=0 tx=0).stop 2026-02-24T09:31:01.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.646+0000 7f6817e8fe00 1 -- 10.20.193.28:0/1342949728 shutdown_connections 2026-02-24T09:31:01.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.646+0000 7f6817e8fe00 1 --2- 10.20.193.28:0/1342949728 >> [v2:10.20.193.28:6840/492586680,v1:10.20.193.28:6841/492586680] conn(0x55d79ed87ca0 0x55d79eda8150 crc :-1 s=READY pgs=24 gs=4 cs=0 l=0 c_cookie=5066825767656340542 s_cookie=17109102196771817970 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.646+0000 7f6817e8fe00 1 --2- 10.20.193.28:0/1342949728 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55d79ecd0e10 0x55d79ed859c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.646+0000 7f6817e8fe00 1 --2- 10.20.193.28:0/1342949728 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55d79ec8c170 0x55d79ecc5270 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.646+0000 7f6817e8fe00 1 --2- 10.20.193.28:0/1342949728 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d79ec8b860 0x55d79ecc4d30 unknown :-1 s=CLOSED pgs=513 gs=1 cs=0 l=1 c_cookie=9109167103757180954 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.646+0000 7f67d8ff9640 0 client.15951 ms_handle_reset on v2:10.20.193.28:6840/492586680 2026-02-24T09:31:01.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.646+0000 7f6817e8fe00 1 -- 10.20.193.28:0/1342949728 >> 10.20.193.28:0/1342949728 conn(0x55d79ec69d60 msgr2=0x55d79ecee940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:01.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.646+0000 7f6817e8fe00 1 -- 10.20.193.28:0/1342949728 shutdown_connections 2026-02-24T09:31:01.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.646+0000 7f6817e8fe00 1 -- 10.20.193.28:0/1342949728 wait complete. 2026-02-24T09:31:01.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.646+0000 7f6817e8fe00 20 client.15951 trim_cache size 0 max 16384 2026-02-24T09:31:01.654 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:31:01.654 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-24T09:31:01.654 INFO:teuthology.orchestra.run.trial028.stdout: "AsyncMessenger::Worker-0": { 2026-02-24T09:31:01.655 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_messages": 411, 2026-02-24T09:31:01.655 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages": 543, 2026-02-24T09:31:01.655 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_bytes": 140670, 2026-02-24T09:31:01.655 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_bytes": 367991, 2026-02-24T09:31:01.655 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_created_connections": 6, 2026-02-24T09:31:01.655 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_active_connections": 3, 2026-02-24T09:31:01.655 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_total_time": 0.047892147, 2026-02-24T09:31:01.655 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_send_time": 0.023879617, 2026-02-24T09:31:01.655 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_recv_time": 0.024324175, 2026-02-24T09:31:01.655 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_fast_dispatch_time": 0.000248657, 2026-02-24T09:31:01.655 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages_queue_lat": { 2026-02-24T09:31:01.656 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 544, 2026-02-24T09:31:01.656 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.030584365, 2026-02-24T09:31:01.656 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000056221 2026-02-24T09:31:01.656 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.656 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_handle_ack_lat": { 2026-02-24T09:31:01.656 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 901, 2026-02-24T09:31:01.656 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000099279, 2026-02-24T09:31:01.656 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000110 2026-02-24T09:31:01.656 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.656 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_encrypted_bytes": 0, 2026-02-24T09:31:01.656 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_encrypted_bytes": 0 2026-02-24T09:31:01.656 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.657 INFO:teuthology.orchestra.run.trial028.stdout: "AsyncMessenger::Worker-1": { 2026-02-24T09:31:01.657 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_messages": 314, 2026-02-24T09:31:01.657 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages": 327, 2026-02-24T09:31:01.657 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_bytes": 900698, 2026-02-24T09:31:01.657 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_bytes": 221674, 2026-02-24T09:31:01.657 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_created_connections": 9, 2026-02-24T09:31:01.657 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_active_connections": 7, 2026-02-24T09:31:01.657 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_total_time": 0.037722463, 2026-02-24T09:31:01.657 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_send_time": 0.018495549, 2026-02-24T09:31:01.657 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_recv_time": 0.026084947, 2026-02-24T09:31:01.657 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_fast_dispatch_time": 0.000188482, 2026-02-24T09:31:01.657 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages_queue_lat": { 2026-02-24T09:31:01.658 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 327, 2026-02-24T09:31:01.658 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.033883844, 2026-02-24T09:31:01.658 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000103620 2026-02-24T09:31:01.658 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.658 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_handle_ack_lat": { 2026-02-24T09:31:01.658 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 48, 2026-02-24T09:31:01.658 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000009257, 2026-02-24T09:31:01.658 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000192 2026-02-24T09:31:01.658 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.658 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_encrypted_bytes": 894048, 2026-02-24T09:31:01.658 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_encrypted_bytes": 148528 2026-02-24T09:31:01.658 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.659 INFO:teuthology.orchestra.run.trial028.stdout: "AsyncMessenger::Worker-2": { 2026-02-24T09:31:01.659 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_messages": 32, 2026-02-24T09:31:01.659 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages": 250, 2026-02-24T09:31:01.659 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_bytes": 7888, 2026-02-24T09:31:01.659 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_bytes": 464322, 2026-02-24T09:31:01.659 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_created_connections": 9, 2026-02-24T09:31:01.659 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_active_connections": 8, 2026-02-24T09:31:01.659 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_total_time": 0.021858716, 2026-02-24T09:31:01.659 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_send_time": 0.015634772, 2026-02-24T09:31:01.659 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_recv_time": 0.005005068, 2026-02-24T09:31:01.659 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_fast_dispatch_time": 0.000067085, 2026-02-24T09:31:01.659 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages_queue_lat": { 2026-02-24T09:31:01.660 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 247, 2026-02-24T09:31:01.660 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.015347222, 2026-02-24T09:31:01.660 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000062134 2026-02-24T09:31:01.660 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.660 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_handle_ack_lat": { 2026-02-24T09:31:01.660 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 81, 2026-02-24T09:31:01.660 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000006638, 2026-02-24T09:31:01.660 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000081 2026-02-24T09:31:01.660 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.660 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_encrypted_bytes": 6176, 2026-02-24T09:31:01.660 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_encrypted_bytes": 436368 2026-02-24T09:31:01.660 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.660 INFO:teuthology.orchestra.run.trial028.stdout: "cct": { 2026-02-24T09:31:01.661 INFO:teuthology.orchestra.run.trial028.stdout: "total_workers": 1, 2026-02-24T09:31:01.661 INFO:teuthology.orchestra.run.trial028.stdout: "unhealthy_workers": 0 2026-02-24T09:31:01.661 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.661 INFO:teuthology.orchestra.run.trial028.stdout: "finisher-MDSRank": { 2026-02-24T09:31:01.661 INFO:teuthology.orchestra.run.trial028.stdout: "queue_len": 0, 2026-02-24T09:31:01.661 INFO:teuthology.orchestra.run.trial028.stdout: "complete_latency": { 2026-02-24T09:31:01.661 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 55, 2026-02-24T09:31:01.661 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.001351375, 2026-02-24T09:31:01.661 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000024570 2026-02-24T09:31:01.661 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:01.661 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.661 INFO:teuthology.orchestra.run.trial028.stdout: "finisher-PurgeQueue": { 2026-02-24T09:31:01.662 INFO:teuthology.orchestra.run.trial028.stdout: "queue_len": 0, 2026-02-24T09:31:01.662 INFO:teuthology.orchestra.run.trial028.stdout: "complete_latency": { 2026-02-24T09:31:01.662 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 2, 2026-02-24T09:31:01.662 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000015638, 2026-02-24T09:31:01.662 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000007819 2026-02-24T09:31:01.662 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:01.662 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.662 INFO:teuthology.orchestra.run.trial028.stdout: "mds": { 2026-02-24T09:31:01.662 INFO:teuthology.orchestra.run.trial028.stdout: "request": 10, 2026-02-24T09:31:01.662 INFO:teuthology.orchestra.run.trial028.stdout: "reply": 7, 2026-02-24T09:31:01.662 INFO:teuthology.orchestra.run.trial028.stdout: "reply_latency": { 2026-02-24T09:31:01.662 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 7, 2026-02-24T09:31:01.662 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000820603, 2026-02-24T09:31:01.662 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000117229 2026-02-24T09:31:01.663 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.663 INFO:teuthology.orchestra.run.trial028.stdout: "slow_reply": 0, 2026-02-24T09:31:01.663 INFO:teuthology.orchestra.run.trial028.stdout: "forward": 3, 2026-02-24T09:31:01.663 INFO:teuthology.orchestra.run.trial028.stdout: "dir_fetch_complete": 0, 2026-02-24T09:31:01.663 INFO:teuthology.orchestra.run.trial028.stdout: "dir_fetch_keys": 0, 2026-02-24T09:31:01.663 INFO:teuthology.orchestra.run.trial028.stdout: "dir_commit": 11, 2026-02-24T09:31:01.663 INFO:teuthology.orchestra.run.trial028.stdout: "dir_split": 0, 2026-02-24T09:31:01.663 INFO:teuthology.orchestra.run.trial028.stdout: "dir_merge": 0, 2026-02-24T09:31:01.663 INFO:teuthology.orchestra.run.trial028.stdout: "inodes": 16, 2026-02-24T09:31:01.663 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_top": 0, 2026-02-24T09:31:01.663 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_bottom": 16, 2026-02-24T09:31:01.663 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_pin_tail": 0, 2026-02-24T09:31:01.663 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_pinned": 13, 2026-02-24T09:31:01.663 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_expired": 4, 2026-02-24T09:31:01.664 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_with_caps": 1, 2026-02-24T09:31:01.664 INFO:teuthology.orchestra.run.trial028.stdout: "caps": 1, 2026-02-24T09:31:01.664 INFO:teuthology.orchestra.run.trial028.stdout: "subtrees": 3, 2026-02-24T09:31:01.664 INFO:teuthology.orchestra.run.trial028.stdout: "traverse": 22, 2026-02-24T09:31:01.664 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_hit": 15, 2026-02-24T09:31:01.664 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_forward": 0, 2026-02-24T09:31:01.664 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_discover": 4, 2026-02-24T09:31:01.664 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_dir_fetch": 0, 2026-02-24T09:31:01.664 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_remote_ino": 0, 2026-02-24T09:31:01.664 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_lock": 0, 2026-02-24T09:31:01.664 INFO:teuthology.orchestra.run.trial028.stdout: "load_cent": 0, 2026-02-24T09:31:01.664 INFO:teuthology.orchestra.run.trial028.stdout: "q": 0, 2026-02-24T09:31:01.664 INFO:teuthology.orchestra.run.trial028.stdout: "exported": 0, 2026-02-24T09:31:01.664 INFO:teuthology.orchestra.run.trial028.stdout: "exported_inodes": 0, 2026-02-24T09:31:01.664 INFO:teuthology.orchestra.run.trial028.stdout: "imported": 0, 2026-02-24T09:31:01.665 INFO:teuthology.orchestra.run.trial028.stdout: "imported_inodes": 0, 2026-02-24T09:31:01.665 INFO:teuthology.orchestra.run.trial028.stdout: "openino_dir_fetch": 0, 2026-02-24T09:31:01.665 INFO:teuthology.orchestra.run.trial028.stdout: "openino_backtrace_fetch": 0, 2026-02-24T09:31:01.665 INFO:teuthology.orchestra.run.trial028.stdout: "openino_peer_discover": 0, 2026-02-24T09:31:01.665 INFO:teuthology.orchestra.run.trial028.stdout: "root_rfiles": 4, 2026-02-24T09:31:01.665 INFO:teuthology.orchestra.run.trial028.stdout: "root_rbytes": 234, 2026-02-24T09:31:01.665 INFO:teuthology.orchestra.run.trial028.stdout: "root_rsnaps": 0, 2026-02-24T09:31:01.665 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_backtrace_fetch": 0, 2026-02-24T09:31:01.665 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_set_tag": 0, 2026-02-24T09:31:01.665 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_backtrace_repaired": 0, 2026-02-24T09:31:01.665 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_inotable_repaired": 0, 2026-02-24T09:31:01.665 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_dir_inodes": 0, 2026-02-24T09:31:01.665 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_dir_base_inodes": 0, 2026-02-24T09:31:01.665 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_dirfrag_rstats": 0, 2026-02-24T09:31:01.666 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_file_inodes": 0, 2026-02-24T09:31:01.666 INFO:teuthology.orchestra.run.trial028.stdout: "handle_inode_file_caps": 0, 2026-02-24T09:31:01.666 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_revoke": 0, 2026-02-24T09:31:01.666 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_grant": 0, 2026-02-24T09:31:01.666 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_trunc": 0, 2026-02-24T09:31:01.666 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_flushsnap_ack": 0, 2026-02-24T09:31:01.666 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_flush_ack": 0, 2026-02-24T09:31:01.666 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_caps": 0, 2026-02-24T09:31:01.666 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_caps_dirty": 0, 2026-02-24T09:31:01.666 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_cap_release": 0, 2026-02-24T09:31:01.666 INFO:teuthology.orchestra.run.trial028.stdout: "process_request_cap_release": 1 2026-02-24T09:31:01.666 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.666 INFO:teuthology.orchestra.run.trial028.stdout: "mds_cache": { 2026-02-24T09:31:01.666 INFO:teuthology.orchestra.run.trial028.stdout: "dir_update": 0, 2026-02-24T09:31:01.666 INFO:teuthology.orchestra.run.trial028.stdout: "dir_update_receipt": 9, 2026-02-24T09:31:01.666 INFO:teuthology.orchestra.run.trial028.stdout: "dir_try_discover": 6, 2026-02-24T09:31:01.666 INFO:teuthology.orchestra.run.trial028.stdout: "dir_send_discover": 8, 2026-02-24T09:31:01.667 INFO:teuthology.orchestra.run.trial028.stdout: "dir_handle_discover": 0, 2026-02-24T09:31:01.667 INFO:teuthology.orchestra.run.trial028.stdout: "num_strays": 0, 2026-02-24T09:31:01.667 INFO:teuthology.orchestra.run.trial028.stdout: "num_strays_delayed": 0, 2026-02-24T09:31:01.667 INFO:teuthology.orchestra.run.trial028.stdout: "num_strays_enqueuing": 0, 2026-02-24T09:31:01.667 INFO:teuthology.orchestra.run.trial028.stdout: "strays_created": 0, 2026-02-24T09:31:01.667 INFO:teuthology.orchestra.run.trial028.stdout: "strays_enqueued": 0, 2026-02-24T09:31:01.667 INFO:teuthology.orchestra.run.trial028.stdout: "strays_reintegrated": 0, 2026-02-24T09:31:01.667 INFO:teuthology.orchestra.run.trial028.stdout: "strays_migrated": 0, 2026-02-24T09:31:01.667 INFO:teuthology.orchestra.run.trial028.stdout: "num_recovering_processing": 0, 2026-02-24T09:31:01.667 INFO:teuthology.orchestra.run.trial028.stdout: "num_recovering_enqueued": 0, 2026-02-24T09:31:01.667 INFO:teuthology.orchestra.run.trial028.stdout: "num_recovering_prioritized": 0, 2026-02-24T09:31:01.667 INFO:teuthology.orchestra.run.trial028.stdout: "recovery_started": 0, 2026-02-24T09:31:01.667 INFO:teuthology.orchestra.run.trial028.stdout: "recovery_completed": 0, 2026-02-24T09:31:01.667 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_quiesce_path": 0, 2026-02-24T09:31:01.667 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_quiesce_inode": 0, 2026-02-24T09:31:01.668 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_enqueue_scrub": 0, 2026-02-24T09:31:01.668 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_exportdir": 0, 2026-02-24T09:31:01.668 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_flush": 0, 2026-02-24T09:31:01.668 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_fragmentdir": 0, 2026-02-24T09:31:01.668 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_fragstats": 0, 2026-02-24T09:31:01.668 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_inodestats": 0, 2026-02-24T09:31:01.668 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-24T09:31:01.668 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_succeeded": 0, 2026-02-24T09:31:01.668 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_write_failed": 0 2026-02-24T09:31:01.668 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.668 INFO:teuthology.orchestra.run.trial028.stdout: "mds_log": { 2026-02-24T09:31:01.668 INFO:teuthology.orchestra.run.trial028.stdout: "evlrg": 0, 2026-02-24T09:31:01.668 INFO:teuthology.orchestra.run.trial028.stdout: "evadd": 6, 2026-02-24T09:31:01.668 INFO:teuthology.orchestra.run.trial028.stdout: "evex": 0, 2026-02-24T09:31:01.668 INFO:teuthology.orchestra.run.trial028.stdout: "evtrm": 0, 2026-02-24T09:31:01.668 INFO:teuthology.orchestra.run.trial028.stdout: "ev": 6, 2026-02-24T09:31:01.669 INFO:teuthology.orchestra.run.trial028.stdout: "evexg": 0, 2026-02-24T09:31:01.669 INFO:teuthology.orchestra.run.trial028.stdout: "evexd": 0, 2026-02-24T09:31:01.669 INFO:teuthology.orchestra.run.trial028.stdout: "segadd": 2, 2026-02-24T09:31:01.669 INFO:teuthology.orchestra.run.trial028.stdout: "segex": 0, 2026-02-24T09:31:01.669 INFO:teuthology.orchestra.run.trial028.stdout: "segtrm": 0, 2026-02-24T09:31:01.669 INFO:teuthology.orchestra.run.trial028.stdout: "seg": 2, 2026-02-24T09:31:01.669 INFO:teuthology.orchestra.run.trial028.stdout: "segmjr": 2, 2026-02-24T09:31:01.669 INFO:teuthology.orchestra.run.trial028.stdout: "segexg": 0, 2026-02-24T09:31:01.669 INFO:teuthology.orchestra.run.trial028.stdout: "segexd": 0, 2026-02-24T09:31:01.669 INFO:teuthology.orchestra.run.trial028.stdout: "expos": 4194304, 2026-02-24T09:31:01.669 INFO:teuthology.orchestra.run.trial028.stdout: "wrpos": 4196366, 2026-02-24T09:31:01.669 INFO:teuthology.orchestra.run.trial028.stdout: "rdpos": 0, 2026-02-24T09:31:01.669 INFO:teuthology.orchestra.run.trial028.stdout: "jlat": { 2026-02-24T09:31:01.669 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 5, 2026-02-24T09:31:01.669 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.006354155, 2026-02-24T09:31:01.669 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.001270831 2026-02-24T09:31:01.669 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.669 INFO:teuthology.orchestra.run.trial028.stdout: "replayed": 0 2026-02-24T09:31:01.670 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.670 INFO:teuthology.orchestra.run.trial028.stdout: "mds_mem": { 2026-02-24T09:31:01.670 INFO:teuthology.orchestra.run.trial028.stdout: "ino": 20, 2026-02-24T09:31:01.670 INFO:teuthology.orchestra.run.trial028.stdout: "ino+": 22, 2026-02-24T09:31:01.670 INFO:teuthology.orchestra.run.trial028.stdout: "ino-": 2, 2026-02-24T09:31:01.670 INFO:teuthology.orchestra.run.trial028.stdout: "dir": 19, 2026-02-24T09:31:01.670 INFO:teuthology.orchestra.run.trial028.stdout: "dir+": 22, 2026-02-24T09:31:01.670 INFO:teuthology.orchestra.run.trial028.stdout: "dir-": 3, 2026-02-24T09:31:01.670 INFO:teuthology.orchestra.run.trial028.stdout: "dn": 16, 2026-02-24T09:31:01.670 INFO:teuthology.orchestra.run.trial028.stdout: "dn+": 20, 2026-02-24T09:31:01.670 INFO:teuthology.orchestra.run.trial028.stdout: "dn-": 4, 2026-02-24T09:31:01.670 INFO:teuthology.orchestra.run.trial028.stdout: "cap": 1, 2026-02-24T09:31:01.670 INFO:teuthology.orchestra.run.trial028.stdout: "cap+": 3, 2026-02-24T09:31:01.670 INFO:teuthology.orchestra.run.trial028.stdout: "cap-": 2, 2026-02-24T09:31:01.670 INFO:teuthology.orchestra.run.trial028.stdout: "rss": 49088, 2026-02-24T09:31:01.670 INFO:teuthology.orchestra.run.trial028.stdout: "heap": 259751936 2026-02-24T09:31:01.670 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.670 INFO:teuthology.orchestra.run.trial028.stdout: "mds_server": { 2026-02-24T09:31:01.671 INFO:teuthology.orchestra.run.trial028.stdout: "dispatch_client_request": 11, 2026-02-24T09:31:01.671 INFO:teuthology.orchestra.run.trial028.stdout: "dispatch_server_request": 0, 2026-02-24T09:31:01.671 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_request": 10, 2026-02-24T09:31:01.671 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_session": 25, 2026-02-24T09:31:01.671 INFO:teuthology.orchestra.run.trial028.stdout: "handle_peer_request": 0, 2026-02-24T09:31:01.671 INFO:teuthology.orchestra.run.trial028.stdout: "req_create_latency": { 2026-02-24T09:31:01.671 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.671 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.671 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.671 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.671 INFO:teuthology.orchestra.run.trial028.stdout: "req_getattr_latency": { 2026-02-24T09:31:01.671 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 5, 2026-02-24T09:31:01.671 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000626192, 2026-02-24T09:31:01.671 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000125238 2026-02-24T09:31:01.671 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.671 INFO:teuthology.orchestra.run.trial028.stdout: "req_getfilelock_latency": { 2026-02-24T09:31:01.671 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.671 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.672 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.672 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.672 INFO:teuthology.orchestra.run.trial028.stdout: "req_link_latency": { 2026-02-24T09:31:01.672 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.672 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.672 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.672 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.672 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookup_latency": { 2026-02-24T09:31:01.672 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 1, 2026-02-24T09:31:01.672 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000146442, 2026-02-24T09:31:01.672 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000146442 2026-02-24T09:31:01.672 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.672 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookuphash_latency": { 2026-02-24T09:31:01.672 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.672 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.672 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.672 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.673 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupino_latency": { 2026-02-24T09:31:01.673 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.673 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.673 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.673 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.673 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupname_latency": { 2026-02-24T09:31:01.673 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.673 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.673 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.673 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.673 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupparent_latency": { 2026-02-24T09:31:01.673 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.673 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.673 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.673 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.673 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupsnap_latency": { 2026-02-24T09:31:01.673 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 1, 2026-02-24T09:31:01.674 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000047969, 2026-02-24T09:31:01.674 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000047969 2026-02-24T09:31:01.674 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.674 INFO:teuthology.orchestra.run.trial028.stdout: "req_lssnap_latency": { 2026-02-24T09:31:01.674 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.674 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.674 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.674 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.674 INFO:teuthology.orchestra.run.trial028.stdout: "req_mkdir_latency": { 2026-02-24T09:31:01.674 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.674 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.674 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.674 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.674 INFO:teuthology.orchestra.run.trial028.stdout: "req_mknod_latency": { 2026-02-24T09:31:01.674 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.674 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.674 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.675 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.675 INFO:teuthology.orchestra.run.trial028.stdout: "req_mksnap_latency": { 2026-02-24T09:31:01.675 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.675 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.675 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.675 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.675 INFO:teuthology.orchestra.run.trial028.stdout: "req_open_latency": { 2026-02-24T09:31:01.675 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.675 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.675 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.675 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.675 INFO:teuthology.orchestra.run.trial028.stdout: "req_readdir_latency": { 2026-02-24T09:31:01.675 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.675 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.675 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.675 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.675 INFO:teuthology.orchestra.run.trial028.stdout: "req_rename_latency": { 2026-02-24T09:31:01.675 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.675 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.676 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.676 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.676 INFO:teuthology.orchestra.run.trial028.stdout: "req_renamesnap_latency": { 2026-02-24T09:31:01.676 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.676 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.676 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.676 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.676 INFO:teuthology.orchestra.run.trial028.stdout: "req_snapdiff_latency": { 2026-02-24T09:31:01.676 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.676 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.676 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.676 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.676 INFO:teuthology.orchestra.run.trial028.stdout: "req_rmdir_latency": { 2026-02-24T09:31:01.676 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.676 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.676 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.676 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.676 INFO:teuthology.orchestra.run.trial028.stdout: "req_rmsnap_latency": { 2026-02-24T09:31:01.677 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.677 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.677 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.677 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.677 INFO:teuthology.orchestra.run.trial028.stdout: "req_rmxattr_latency": { 2026-02-24T09:31:01.677 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.677 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.677 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.677 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.677 INFO:teuthology.orchestra.run.trial028.stdout: "req_setattr_latency": { 2026-02-24T09:31:01.677 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.677 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.677 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.677 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.677 INFO:teuthology.orchestra.run.trial028.stdout: "req_setdirlayout_latency": { 2026-02-24T09:31:01.677 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.677 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.677 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.677 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.678 INFO:teuthology.orchestra.run.trial028.stdout: "req_setfilelock_latency": { 2026-02-24T09:31:01.678 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.678 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.678 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.678 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.678 INFO:teuthology.orchestra.run.trial028.stdout: "req_setlayout_latency": { 2026-02-24T09:31:01.678 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.678 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.678 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.678 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.678 INFO:teuthology.orchestra.run.trial028.stdout: "req_setxattr_latency": { 2026-02-24T09:31:01.678 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.678 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.678 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.678 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.678 INFO:teuthology.orchestra.run.trial028.stdout: "req_symlink_latency": { 2026-02-24T09:31:01.678 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.678 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.678 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.678 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.679 INFO:teuthology.orchestra.run.trial028.stdout: "req_unlink_latency": { 2026-02-24T09:31:01.679 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.679 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.679 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.679 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.679 INFO:teuthology.orchestra.run.trial028.stdout: "cap_revoke_eviction": 0, 2026-02-24T09:31:01.679 INFO:teuthology.orchestra.run.trial028.stdout: "cache_trim_throttle": 0, 2026-02-24T09:31:01.679 INFO:teuthology.orchestra.run.trial028.stdout: "session_recall_throttle": 0, 2026-02-24T09:31:01.679 INFO:teuthology.orchestra.run.trial028.stdout: "session_recall_throttle2o": 0, 2026-02-24T09:31:01.679 INFO:teuthology.orchestra.run.trial028.stdout: "global_recall_throttle": 0, 2026-02-24T09:31:01.679 INFO:teuthology.orchestra.run.trial028.stdout: "cap_acquisition_throttle": 0, 2026-02-24T09:31:01.679 INFO:teuthology.orchestra.run.trial028.stdout: "req_getvxattr_latency": { 2026-02-24T09:31:01.679 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.679 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.679 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.679 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.679 INFO:teuthology.orchestra.run.trial028.stdout: "req_blockdiff_latency": { 2026-02-24T09:31:01.679 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.679 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.679 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.680 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:01.680 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.680 INFO:teuthology.orchestra.run.trial028.stdout: "mds_sessions": { 2026-02-24T09:31:01.680 INFO:teuthology.orchestra.run.trial028.stdout: "session_count": 2, 2026-02-24T09:31:01.680 INFO:teuthology.orchestra.run.trial028.stdout: "session_add": 3, 2026-02-24T09:31:01.680 INFO:teuthology.orchestra.run.trial028.stdout: "session_remove": 1, 2026-02-24T09:31:01.680 INFO:teuthology.orchestra.run.trial028.stdout: "sessions_open": 2, 2026-02-24T09:31:01.680 INFO:teuthology.orchestra.run.trial028.stdout: "sessions_stale": 0, 2026-02-24T09:31:01.680 INFO:teuthology.orchestra.run.trial028.stdout: "total_load": 6, 2026-02-24T09:31:01.680 INFO:teuthology.orchestra.run.trial028.stdout: "average_load": 2, 2026-02-24T09:31:01.680 INFO:teuthology.orchestra.run.trial028.stdout: "avg_session_uptime": 789, 2026-02-24T09:31:01.680 INFO:teuthology.orchestra.run.trial028.stdout: "mdthresh_evicted": 0 2026-02-24T09:31:01.680 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.680 INFO:teuthology.orchestra.run.trial028.stdout: "mempool": { 2026-02-24T09:31:01.680 INFO:teuthology.orchestra.run.trial028.stdout: "bloom_filter_bytes": 0, 2026-02-24T09:31:01.680 INFO:teuthology.orchestra.run.trial028.stdout: "bloom_filter_items": 0, 2026-02-24T09:31:01.680 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_alloc_bytes": 0, 2026-02-24T09:31:01.680 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_alloc_items": 0, 2026-02-24T09:31:01.680 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_data_bytes": 0, 2026-02-24T09:31:01.680 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_data_items": 0, 2026-02-24T09:31:01.680 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_onode_bytes": 0, 2026-02-24T09:31:01.681 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_onode_items": 0, 2026-02-24T09:31:01.681 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_meta_bytes": 0, 2026-02-24T09:31:01.681 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_meta_items": 0, 2026-02-24T09:31:01.681 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_other_bytes": 0, 2026-02-24T09:31:01.681 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_other_items": 0, 2026-02-24T09:31:01.681 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_buffer_bytes": 0, 2026-02-24T09:31:01.681 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_buffer_items": 0, 2026-02-24T09:31:01.681 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_extent_bytes": 0, 2026-02-24T09:31:01.681 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_extent_items": 0, 2026-02-24T09:31:01.681 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_blob_bytes": 0, 2026-02-24T09:31:01.681 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_blob_items": 0, 2026-02-24T09:31:01.681 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_shared_blob_bytes": 0, 2026-02-24T09:31:01.681 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_shared_blob_items": 0, 2026-02-24T09:31:01.681 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_inline_bl_bytes": 0, 2026-02-24T09:31:01.681 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_inline_bl_items": 0, 2026-02-24T09:31:01.681 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_bytes": 0, 2026-02-24T09:31:01.681 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_items": 0, 2026-02-24T09:31:01.681 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_txc_bytes": 0, 2026-02-24T09:31:01.681 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_txc_items": 0, 2026-02-24T09:31:01.681 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_deferred_bytes": 0, 2026-02-24T09:31:01.681 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_deferred_items": 0, 2026-02-24T09:31:01.681 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_bytes": 0, 2026-02-24T09:31:01.682 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_items": 0, 2026-02-24T09:31:01.682 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_bytes": 0, 2026-02-24T09:31:01.682 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_items": 0, 2026-02-24T09:31:01.682 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_reader_bytes": 0, 2026-02-24T09:31:01.682 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_reader_items": 0, 2026-02-24T09:31:01.682 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_writer_bytes": 0, 2026-02-24T09:31:01.682 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_writer_items": 0, 2026-02-24T09:31:01.682 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_anon_bytes": 240407, 2026-02-24T09:31:01.682 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_anon_items": 90, 2026-02-24T09:31:01.682 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_meta_bytes": 88, 2026-02-24T09:31:01.682 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_meta_items": 1, 2026-02-24T09:31:01.682 INFO:teuthology.orchestra.run.trial028.stdout: "osd_bytes": 0, 2026-02-24T09:31:01.682 INFO:teuthology.orchestra.run.trial028.stdout: "osd_items": 0, 2026-02-24T09:31:01.682 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mapbl_bytes": 0, 2026-02-24T09:31:01.682 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mapbl_items": 0, 2026-02-24T09:31:01.682 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pglog_bytes": 0, 2026-02-24T09:31:01.682 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pglog_items": 0, 2026-02-24T09:31:01.682 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_bytes": 8272, 2026-02-24T09:31:01.682 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_items": 182, 2026-02-24T09:31:01.682 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_mapping_bytes": 0, 2026-02-24T09:31:01.682 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_mapping_items": 0, 2026-02-24T09:31:01.682 INFO:teuthology.orchestra.run.trial028.stdout: "pgmap_bytes": 0, 2026-02-24T09:31:01.683 INFO:teuthology.orchestra.run.trial028.stdout: "pgmap_items": 0, 2026-02-24T09:31:01.683 INFO:teuthology.orchestra.run.trial028.stdout: "mds_co_bytes": 87808, 2026-02-24T09:31:01.683 INFO:teuthology.orchestra.run.trial028.stdout: "mds_co_items": 964, 2026-02-24T09:31:01.683 INFO:teuthology.orchestra.run.trial028.stdout: "ec_extent_cache_bytes": 0, 2026-02-24T09:31:01.683 INFO:teuthology.orchestra.run.trial028.stdout: "ec_extent_cache_items": 0, 2026-02-24T09:31:01.683 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_1_bytes": 0, 2026-02-24T09:31:01.683 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_1_items": 0, 2026-02-24T09:31:01.683 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_2_bytes": 0, 2026-02-24T09:31:01.683 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_2_items": 0 2026-02-24T09:31:01.683 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.683 INFO:teuthology.orchestra.run.trial028.stdout: "objecter": { 2026-02-24T09:31:01.683 INFO:teuthology.orchestra.run.trial028.stdout: "op_active": 0, 2026-02-24T09:31:01.683 INFO:teuthology.orchestra.run.trial028.stdout: "op_laggy": 0, 2026-02-24T09:31:01.683 INFO:teuthology.orchestra.run.trial028.stdout: "op_send": 44, 2026-02-24T09:31:01.683 INFO:teuthology.orchestra.run.trial028.stdout: "op_send_bytes": 12709, 2026-02-24T09:31:01.683 INFO:teuthology.orchestra.run.trial028.stdout: "op_resend": 27, 2026-02-24T09:31:01.683 INFO:teuthology.orchestra.run.trial028.stdout: "op_reply": 44, 2026-02-24T09:31:01.683 INFO:teuthology.orchestra.run.trial028.stdout: "op_latency": { 2026-02-24T09:31:01.683 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 44, 2026-02-24T09:31:01.683 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.156997011, 2026-02-24T09:31:01.683 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.003568113 2026-02-24T09:31:01.683 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.683 INFO:teuthology.orchestra.run.trial028.stdout: "op_inflight": 0, 2026-02-24T09:31:01.684 INFO:teuthology.orchestra.run.trial028.stdout: "oplen_avg": { 2026-02-24T09:31:01.684 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 68, 2026-02-24T09:31:01.684 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 44 2026-02-24T09:31:01.684 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.684 INFO:teuthology.orchestra.run.trial028.stdout: "op": 44, 2026-02-24T09:31:01.684 INFO:teuthology.orchestra.run.trial028.stdout: "op_r": 0, 2026-02-24T09:31:01.684 INFO:teuthology.orchestra.run.trial028.stdout: "op_w": 44, 2026-02-24T09:31:01.684 INFO:teuthology.orchestra.run.trial028.stdout: "op_rmw": 0, 2026-02-24T09:31:01.684 INFO:teuthology.orchestra.run.trial028.stdout: "op_pg": 0, 2026-02-24T09:31:01.684 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_stat": 0, 2026-02-24T09:31:01.684 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_create": 10, 2026-02-24T09:31:01.684 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_read": 0, 2026-02-24T09:31:01.684 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_write": 5, 2026-02-24T09:31:01.684 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_writefull": 8, 2026-02-24T09:31:01.684 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_writesame": 0, 2026-02-24T09:31:01.684 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_append": 0, 2026-02-24T09:31:01.684 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_zero": 0, 2026-02-24T09:31:01.684 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_truncate": 0, 2026-02-24T09:31:01.684 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_delete": 6, 2026-02-24T09:31:01.684 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_mapext": 0, 2026-02-24T09:31:01.684 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_sparse_read": 0, 2026-02-24T09:31:01.684 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_clonerange": 0, 2026-02-24T09:31:01.684 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_getxattr": 0, 2026-02-24T09:31:01.684 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_setxattr": 20, 2026-02-24T09:31:01.685 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_cmpxattr": 0, 2026-02-24T09:31:01.685 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_rmxattr": 0, 2026-02-24T09:31:01.685 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_resetxattrs": 0, 2026-02-24T09:31:01.685 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_call": 0, 2026-02-24T09:31:01.685 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_watch": 0, 2026-02-24T09:31:01.685 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_notify": 0, 2026-02-24T09:31:01.685 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_src_cmpxattr": 0, 2026-02-24T09:31:01.685 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_pgls": 0, 2026-02-24T09:31:01.685 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_pgls_filter": 0, 2026-02-24T09:31:01.685 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_other": 0, 2026-02-24T09:31:01.685 INFO:teuthology.orchestra.run.trial028.stdout: "linger_active": 0, 2026-02-24T09:31:01.685 INFO:teuthology.orchestra.run.trial028.stdout: "linger_send": 0, 2026-02-24T09:31:01.685 INFO:teuthology.orchestra.run.trial028.stdout: "linger_resend": 0, 2026-02-24T09:31:01.685 INFO:teuthology.orchestra.run.trial028.stdout: "linger_ping": 0, 2026-02-24T09:31:01.685 INFO:teuthology.orchestra.run.trial028.stdout: "poolop_active": 0, 2026-02-24T09:31:01.685 INFO:teuthology.orchestra.run.trial028.stdout: "poolop_send": 0, 2026-02-24T09:31:01.685 INFO:teuthology.orchestra.run.trial028.stdout: "poolop_resend": 0, 2026-02-24T09:31:01.685 INFO:teuthology.orchestra.run.trial028.stdout: "poolstat_active": 0, 2026-02-24T09:31:01.685 INFO:teuthology.orchestra.run.trial028.stdout: "poolstat_send": 0, 2026-02-24T09:31:01.685 INFO:teuthology.orchestra.run.trial028.stdout: "poolstat_resend": 0, 2026-02-24T09:31:01.685 INFO:teuthology.orchestra.run.trial028.stdout: "statfs_active": 0, 2026-02-24T09:31:01.685 INFO:teuthology.orchestra.run.trial028.stdout: "statfs_send": 0, 2026-02-24T09:31:01.685 INFO:teuthology.orchestra.run.trial028.stdout: "statfs_resend": 0, 2026-02-24T09:31:01.685 INFO:teuthology.orchestra.run.trial028.stdout: "command_active": 0, 2026-02-24T09:31:01.686 INFO:teuthology.orchestra.run.trial028.stdout: "command_send": 0, 2026-02-24T09:31:01.686 INFO:teuthology.orchestra.run.trial028.stdout: "command_resend": 0, 2026-02-24T09:31:01.686 INFO:teuthology.orchestra.run.trial028.stdout: "map_epoch": 110, 2026-02-24T09:31:01.686 INFO:teuthology.orchestra.run.trial028.stdout: "map_full": 0, 2026-02-24T09:31:01.686 INFO:teuthology.orchestra.run.trial028.stdout: "map_inc": 18, 2026-02-24T09:31:01.686 INFO:teuthology.orchestra.run.trial028.stdout: "osd_sessions": 8, 2026-02-24T09:31:01.686 INFO:teuthology.orchestra.run.trial028.stdout: "osd_session_open": 8, 2026-02-24T09:31:01.686 INFO:teuthology.orchestra.run.trial028.stdout: "osd_session_close": 0, 2026-02-24T09:31:01.686 INFO:teuthology.orchestra.run.trial028.stdout: "osd_laggy": 0, 2026-02-24T09:31:01.686 INFO:teuthology.orchestra.run.trial028.stdout: "omap_wr": 17, 2026-02-24T09:31:01.686 INFO:teuthology.orchestra.run.trial028.stdout: "omap_rd": 0, 2026-02-24T09:31:01.686 INFO:teuthology.orchestra.run.trial028.stdout: "omap_del": 2, 2026-02-24T09:31:01.686 INFO:teuthology.orchestra.run.trial028.stdout: "replica_read_sent": 0, 2026-02-24T09:31:01.686 INFO:teuthology.orchestra.run.trial028.stdout: "replica_read_bounced": 0, 2026-02-24T09:31:01.686 INFO:teuthology.orchestra.run.trial028.stdout: "replica_read_completed": 0 2026-02-24T09:31:01.686 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.686 INFO:teuthology.orchestra.run.trial028.stdout: "oft": { 2026-02-24T09:31:01.686 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_objs": 1, 2026-02-24T09:31:01.686 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_kv_pairs": 0, 2026-02-24T09:31:01.686 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_updates": 0, 2026-02-24T09:31:01.686 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_removes": 0 2026-02-24T09:31:01.686 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.686 INFO:teuthology.orchestra.run.trial028.stdout: "purge_queue": { 2026-02-24T09:31:01.686 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing_ops": 0, 2026-02-24T09:31:01.687 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing_ops_high_water": 0, 2026-02-24T09:31:01.687 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing": 0, 2026-02-24T09:31:01.687 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing_high_water": 0, 2026-02-24T09:31:01.687 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executed_ops": 0, 2026-02-24T09:31:01.687 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executed": 0, 2026-02-24T09:31:01.687 INFO:teuthology.orchestra.run.trial028.stdout: "pq_item_in_journal": 0 2026-02-24T09:31:01.687 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.687 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-msgr_dispatch_throttler-mds": { 2026-02-24T09:31:01.687 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-24T09:31:01.687 INFO:teuthology.orchestra.run.trial028.stdout: "max": 104857600, 2026-02-24T09:31:01.687 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-24T09:31:01.687 INFO:teuthology.orchestra.run.trial028.stdout: "get": 757, 2026-02-24T09:31:01.687 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 965746, 2026-02-24T09:31:01.687 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-24T09:31:01.687 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 757, 2026-02-24T09:31:01.687 INFO:teuthology.orchestra.run.trial028.stdout: "take": 0, 2026-02-24T09:31:01.687 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 0, 2026-02-24T09:31:01.687 INFO:teuthology.orchestra.run.trial028.stdout: "put": 757, 2026-02-24T09:31:01.687 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 965746, 2026-02-24T09:31:01.687 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-24T09:31:01.687 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.687 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.687 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.687 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:01.687 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.688 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-objecter_bytes": { 2026-02-24T09:31:01.688 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-24T09:31:01.688 INFO:teuthology.orchestra.run.trial028.stdout: "max": 104857600, 2026-02-24T09:31:01.688 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-24T09:31:01.688 INFO:teuthology.orchestra.run.trial028.stdout: "get": 0, 2026-02-24T09:31:01.688 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 0, 2026-02-24T09:31:01.688 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-24T09:31:01.688 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 0, 2026-02-24T09:31:01.688 INFO:teuthology.orchestra.run.trial028.stdout: "take": 44, 2026-02-24T09:31:01.688 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 12709, 2026-02-24T09:31:01.688 INFO:teuthology.orchestra.run.trial028.stdout: "put": 44, 2026-02-24T09:31:01.688 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 12709, 2026-02-24T09:31:01.688 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-24T09:31:01.688 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.688 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.688 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.688 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:01.688 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.688 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-objecter_ops": { 2026-02-24T09:31:01.688 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-24T09:31:01.688 INFO:teuthology.orchestra.run.trial028.stdout: "max": 1024, 2026-02-24T09:31:01.688 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-24T09:31:01.688 INFO:teuthology.orchestra.run.trial028.stdout: "get": 0, 2026-02-24T09:31:01.688 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 0, 2026-02-24T09:31:01.688 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-24T09:31:01.689 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 0, 2026-02-24T09:31:01.689 INFO:teuthology.orchestra.run.trial028.stdout: "take": 44, 2026-02-24T09:31:01.689 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 44, 2026-02-24T09:31:01.689 INFO:teuthology.orchestra.run.trial028.stdout: "put": 44, 2026-02-24T09:31:01.689 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 44, 2026-02-24T09:31:01.689 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-24T09:31:01.689 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.689 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.689 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.689 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:01.689 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.689 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-write_buf_throttle": { 2026-02-24T09:31:01.689 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-24T09:31:01.689 INFO:teuthology.orchestra.run.trial028.stdout: "max": 3758096384, 2026-02-24T09:31:01.689 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-24T09:31:01.689 INFO:teuthology.orchestra.run.trial028.stdout: "get": 0, 2026-02-24T09:31:01.689 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 0, 2026-02-24T09:31:01.689 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-24T09:31:01.689 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 0, 2026-02-24T09:31:01.689 INFO:teuthology.orchestra.run.trial028.stdout: "take": 0, 2026-02-24T09:31:01.689 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 0, 2026-02-24T09:31:01.689 INFO:teuthology.orchestra.run.trial028.stdout: "put": 0, 2026-02-24T09:31:01.689 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 0, 2026-02-24T09:31:01.689 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-24T09:31:01.689 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.689 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.689 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.690 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:01.690 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.690 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-write_buf_throttle-0x2ad4a640": { 2026-02-24T09:31:01.690 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-24T09:31:01.690 INFO:teuthology.orchestra.run.trial028.stdout: "max": 3758096384, 2026-02-24T09:31:01.690 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-24T09:31:01.690 INFO:teuthology.orchestra.run.trial028.stdout: "get": 6, 2026-02-24T09:31:01.690 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 2062, 2026-02-24T09:31:01.690 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-24T09:31:01.690 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 6, 2026-02-24T09:31:01.690 INFO:teuthology.orchestra.run.trial028.stdout: "take": 0, 2026-02-24T09:31:01.690 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 0, 2026-02-24T09:31:01.690 INFO:teuthology.orchestra.run.trial028.stdout: "put": 5, 2026-02-24T09:31:01.690 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 2062, 2026-02-24T09:31:01.690 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-24T09:31:01.690 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.690 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.690 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.690 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:01.690 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.690 INFO:teuthology.orchestra.run.trial028.stdout: "trackedop": { 2026-02-24T09:31:01.690 INFO:teuthology.orchestra.run.trial028.stdout: "slow_ops_count": 0 2026-02-24T09:31:01.690 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:01.690 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-24T09:31:01.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.647+0000 7f680ffff640 1 -- 10.20.193.28:0/3429005771 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f67e40b58d0 msgr2=0x7f67e40d5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:01.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.647+0000 7f680ffff640 1 --2- 10.20.193.28:0/3429005771 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f67e40b58d0 0x7f67e40d5d80 secure :-1 s=READY pgs=262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68040098a0 tx=0x7f6804002390 comp rx=0 tx=0).stop 2026-02-24T09:31:01.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.647+0000 7f680ffff640 1 -- 10.20.193.28:0/3429005771 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f68101155b0 msgr2=0x7f6810122d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:01.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.647+0000 7f680ffff640 1 --2- 10.20.193.28:0/3429005771 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f68101155b0 0x7f6810122d30 secure :-1 s=READY pgs=509 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f680000e650 tx=0x7f680000eb20 comp rx=0 tx=0).stop 2026-02-24T09:31:01.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.647+0000 7f680ffff640 1 -- 10.20.193.28:0/3429005771 shutdown_connections 2026-02-24T09:31:01.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.647+0000 7f680ffff640 1 --2- 10.20.193.28:0/3429005771 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f67e40b58d0 0x7f67e40d5d80 unknown :-1 s=CLOSED pgs=262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.647+0000 7f680ffff640 1 --2- 10.20.193.28:0/3429005771 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f68101155b0 0x7f6810122d30 unknown :-1 s=CLOSED pgs=509 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.647+0000 7f680ffff640 1 --2- 10.20.193.28:0/3429005771 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f681010fdb0 0x7f681011d960 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.647+0000 7f680ffff640 1 --2- 10.20.193.28:0/3429005771 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f681010f3c0 0x7f681011d420 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.647+0000 7f680ffff640 1 -- 10.20.193.28:0/3429005771 >> 10.20.193.28:0/3429005771 conn(0x7f68100eccb0 msgr2=0x7f681010d090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:01.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.647+0000 7f680ffff640 1 -- 10.20.193.28:0/3429005771 shutdown_connections 2026-02-24T09:31:01.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.647+0000 7f680ffff640 1 -- 10.20.193.28:0/3429005771 wait complete. 2026-02-24T09:31:01.692 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2026-02-24T09:31:01.692 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2026-02-24T09:31:01.692 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2026-02-24T09:31:01.692 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=9 2026-02-24T09:31:01.692 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2026-02-24T09:31:01.692 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2026-02-24T09:31:01.692 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2026-02-24T09:31:01.692 DEBUG:tasks.check_counter:Getting stats from d 2026-02-24T09:31:01.692 DEBUG:tasks.check_counter:skipping mds.14862 2026-02-24T09:31:01.692 DEBUG:tasks.check_counter:Getting stats from g 2026-02-24T09:31:01.692 DEBUG:tasks.check_counter:skipping mds.14910 2026-02-24T09:31:01.693 DEBUG:tasks.check_counter:Getting stats from j 2026-02-24T09:31:01.693 DEBUG:tasks.check_counter:skipping mds.14856 2026-02-24T09:31:01.693 DEBUG:tasks.check_counter:Getting stats from b 2026-02-24T09:31:01.693 DEBUG:tasks.check_counter:Getting stats from mds.24788 2026-02-24T09:31:01.693 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24788 perf dump --format=json-pretty 2026-02-24T09:31:01.742 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:01 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/2676544253' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:31:01.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:01 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/2676544253' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:31:01.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.813+0000 7fed3f577640 1 -- 10.20.193.28:0/1673761453 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fed4010f3c0 msgr2=0x7fed4010f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:01.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.813+0000 7fed3f577640 1 --2- 10.20.193.28:0/1673761453 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fed4010f3c0 0x7fed4010f790 secure :-1 s=READY pgs=514 gs=1 cs=0 l=1 c_cookie=6817836480621895900 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed34009950 tx=0x7fed3402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.813+0000 7fed3f577640 1 -- 10.20.193.28:0/1673761453 shutdown_connections 2026-02-24T09:31:01.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.813+0000 7fed3f577640 1 --2- 10.20.193.28:0/1673761453 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fed401155b0 0x7fed40175f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.813+0000 7fed3f577640 1 --2- 10.20.193.28:0/1673761453 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fed4010fdb0 0x7fed40114e00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.813+0000 7fed3f577640 1 --2- 10.20.193.28:0/1673761453 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fed4010f3c0 0x7fed4010f790 unknown :-1 s=CLOSED pgs=514 gs=1 cs=0 l=1 c_cookie=6817836480621895900 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.813+0000 7fed3f577640 1 -- 10.20.193.28:0/1673761453 >> 10.20.193.28:0/1673761453 conn(0x7fed400eccb0 msgr2=0x7fed4010d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:01.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.813+0000 7fed3f577640 1 -- 10.20.193.28:0/1673761453 shutdown_connections 2026-02-24T09:31:01.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.813+0000 7fed3f577640 1 -- 10.20.193.28:0/1673761453 wait complete. 2026-02-24T09:31:01.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.813+0000 7fed3f577640 1 Processor -- start 2026-02-24T09:31:01.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.814+0000 7fed3f577640 1 -- start start 2026-02-24T09:31:01.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.814+0000 7fed3f577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fed4010f3c0 0x7fed4011d420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.814+0000 7fed3f577640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fed4010fdb0 0x7fed4011d960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.814+0000 7fed3f577640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fed401155b0 0x7fed40122d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.814+0000 7fed3f577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fed40123350 con 0x7fed4010f3c0 2026-02-24T09:31:01.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.814+0000 7fed3f577640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fed401234c0 con 0x7fed4010fdb0 2026-02-24T09:31:01.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.814+0000 7fed3f577640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fed40123680 con 0x7fed401155b0 2026-02-24T09:31:01.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.814+0000 7fed3e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fed4010f3c0 0x7fed4011d420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.814+0000 7fed3e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fed4010f3c0 0x7fed4011d420 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39808/0 (socket says 10.20.193.28:39808) 2026-02-24T09:31:01.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.814+0000 7fed3e575640 1 -- 10.20.193.28:0/988876112 learned_addr learned my addr 10.20.193.28:0/988876112 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:31:01.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.814+0000 7fed3ed76640 1 --2- 10.20.193.28:0/988876112 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fed401155b0 0x7fed40122d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.814+0000 7fed3dd74640 1 --2- 10.20.193.28:0/988876112 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fed4010fdb0 0x7fed4011d960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.814+0000 7fed3e575640 1 -- 10.20.193.28:0/988876112 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fed401155b0 msgr2=0x7fed40122d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:01.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.814+0000 7fed3e575640 1 --2- 10.20.193.28:0/988876112 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fed401155b0 0x7fed40122d30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.814+0000 7fed3e575640 1 -- 10.20.193.28:0/988876112 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fed4010fdb0 msgr2=0x7fed4011d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:01.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.814+0000 7fed3e575640 1 --2- 10.20.193.28:0/988876112 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fed4010fdb0 0x7fed4011d960 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.814+0000 7fed3e575640 1 -- 10.20.193.28:0/988876112 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed3000a590 con 0x7fed4010f3c0 2026-02-24T09:31:01.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.814+0000 7fed3e575640 1 --2- 10.20.193.28:0/988876112 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fed4010f3c0 0x7fed4011d420 secure :-1 s=READY pgs=515 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed340098a0 tx=0x7fed340028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:01.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.815+0000 7fed277fe640 1 -- 10.20.193.28:0/988876112 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed3403d070 con 0x7fed4010f3c0 2026-02-24T09:31:01.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.815+0000 7fed277fe640 1 -- 10.20.193.28:0/988876112 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fed34002a40 con 0x7fed4010f3c0 2026-02-24T09:31:01.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.815+0000 7fed277fe640 1 -- 10.20.193.28:0/988876112 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed34041720 con 0x7fed4010f3c0 2026-02-24T09:31:01.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.815+0000 7fed3f577640 1 -- 10.20.193.28:0/988876112 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed34009570 con 0x7fed4010f3c0 2026-02-24T09:31:01.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.815+0000 7fed3f577640 1 -- 10.20.193.28:0/988876112 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed40163ec0 con 0x7fed4010f3c0 2026-02-24T09:31:01.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.818+0000 7fed277fe640 1 -- 10.20.193.28:0/988876112 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7fed340386a0 con 0x7fed4010f3c0 2026-02-24T09:31:01.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.819+0000 7fed277fe640 1 --2- 10.20.193.28:0/988876112 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fed180b58d0 0x7fed180d5d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.819+0000 7fed277fe640 1 -- 10.20.193.28:0/988876112 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 8513+0+0 (secure 0 0 0) 0x7fed3410b3f0 con 0x7fed4010f3c0 2026-02-24T09:31:01.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.819+0000 7fed3dd74640 1 --2- 10.20.193.28:0/988876112 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fed180b58d0 0x7fed180d5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.820+0000 7fed3dd74640 1 --2- 10.20.193.28:0/988876112 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fed180b58d0 0x7fed180d5d80 secure :-1 s=READY pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed40123dc0 tx=0x7fed28005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:01.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.820+0000 7fed47655e00 1 Processor -- start 2026-02-24T09:31:01.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.820+0000 7fed47655e00 1 -- start start 2026-02-24T09:31:01.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.820+0000 7fed47655e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x558906860860 0x558906860c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.821+0000 7fed47655e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558906861170 0x5589068a58d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.821+0000 7fed47655e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5589068a5e10 0x5589068c61f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.821+0000 7fed47655e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558906776e70 con 0x558906861170 2026-02-24T09:31:01.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.821+0000 7fed47655e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x558906772ba0 con 0x558906860860 2026-02-24T09:31:01.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.821+0000 7fed47655e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55890676cd00 con 0x5589068a5e10 2026-02-24T09:31:01.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.821+0000 7fed3dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558906861170 0x5589068a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.821+0000 7fed3dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558906861170 0x5589068a58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39824/0 (socket says 10.20.193.28:39824) 2026-02-24T09:31:01.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.821+0000 7fed3e575640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x558906860860 0x558906860c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.821+0000 7fed3dd74640 1 -- 10.20.193.28:0/585643590 learned_addr learned my addr 10.20.193.28:0/585643590 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:31:01.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.821+0000 7fed3dd74640 1 -- 10.20.193.28:0/585643590 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5589068a5e10 msgr2=0x5589068c61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:31:01.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.821+0000 7fed3dd74640 1 --2- 10.20.193.28:0/585643590 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5589068a5e10 0x5589068c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.821+0000 7fed3dd74640 1 -- 10.20.193.28:0/585643590 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x558906860860 msgr2=0x558906860c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:31:01.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.821+0000 7fed3dd74640 1 --2- 10.20.193.28:0/585643590 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x558906860860 0x558906860c30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.821+0000 7fed3dd74640 1 -- 10.20.193.28:0/585643590 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589067181f0 con 0x558906861170 2026-02-24T09:31:01.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.821+0000 7fed3dd74640 1 --2- 10.20.193.28:0/585643590 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558906861170 0x5589068a58d0 secure :-1 s=READY pgs=516 gs=2 cs=0 l=1 c_cookie=9294343830135259785 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed280043f0 tx=0x7fed28013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80fc24784f8e4289 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:01.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.821+0000 7fed24ff9640 1 -- 10.20.193.28:0/585643590 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed2801d460 con 0x558906861170 2026-02-24T09:31:01.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.821+0000 7fed24ff9640 1 -- 10.20.193.28:0/585643590 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fed2801da80 con 0x558906861170 2026-02-24T09:31:01.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.821+0000 7fed24ff9640 1 -- 10.20.193.28:0/585643590 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed2801a9d0 con 0x558906861170 2026-02-24T09:31:01.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.822+0000 7fed47655e00 1 -- 10.20.193.28:0/585643590 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558906861170 msgr2=0x5589068a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:01.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.822+0000 7fed47655e00 1 --2- 10.20.193.28:0/585643590 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558906861170 0x5589068a58d0 secure :-1 s=READY pgs=516 gs=2 cs=0 l=1 c_cookie=9294343830135259785 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed280043f0 tx=0x7fed28013000 comp rx=0 tx=0).stop 2026-02-24T09:31:01.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.822+0000 7fed47655e00 1 -- 10.20.193.28:0/585643590 shutdown_connections 2026-02-24T09:31:01.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.822+0000 7fed47655e00 1 --2- 10.20.193.28:0/585643590 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5589068a5e10 0x5589068c61f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.822+0000 7fed47655e00 1 --2- 10.20.193.28:0/585643590 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558906861170 0x5589068a58d0 unknown :-1 s=CLOSED pgs=516 gs=2 cs=0 l=1 c_cookie=9294343830135259785 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.822+0000 7fed47655e00 1 --2- 10.20.193.28:0/585643590 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x558906860860 0x558906860c30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.822+0000 7fed47655e00 1 -- 10.20.193.28:0/585643590 >> 10.20.193.28:0/585643590 conn(0x55890683ed60 msgr2=0x55890685f140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:01.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.822+0000 7fed47655e00 1 -- 10.20.193.28:0/585643590 shutdown_connections 2026-02-24T09:31:01.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.822+0000 7fed47655e00 1 -- 10.20.193.28:0/585643590 wait complete. 2026-02-24T09:31:01.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.823+0000 7fed47655e00 1 -- start start 2026-02-24T09:31:01.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.823+0000 7fed47655e00 1 Processor -- start 2026-02-24T09:31:01.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.824+0000 7fed47655e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x558906860860 0x5589068bd8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.824+0000 7fed47655e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558906861170 0x5589068bde30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.824+0000 7fed47655e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5589068a5e10 0x5589068c2e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.824+0000 7fed47655e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5589068c3360 con 0x558906861170 2026-02-24T09:31:01.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.824+0000 7fed47655e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x5589068c34d0 con 0x558906860860 2026-02-24T09:31:01.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.824+0000 7fed47655e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x5589068c3690 con 0x5589068a5e10 2026-02-24T09:31:01.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.824+0000 7fed3dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558906861170 0x5589068bde30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.824+0000 7fed3dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558906861170 0x5589068bde30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39832/0 (socket says 10.20.193.28:39832) 2026-02-24T09:31:01.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.824+0000 7fed3dd74640 1 -- 10.20.193.28:0/3678549386 learned_addr learned my addr 10.20.193.28:0/3678549386 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:31:01.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.824+0000 7fed3e575640 1 --2- 10.20.193.28:0/3678549386 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x558906860860 0x5589068bd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.824+0000 7fed3ed76640 1 --2- 10.20.193.28:0/3678549386 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5589068a5e10 0x5589068c2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.824+0000 7fed3dd74640 1 -- 10.20.193.28:0/3678549386 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5589068a5e10 msgr2=0x5589068c2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:31:01.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.824+0000 7fed3dd74640 1 --2- 10.20.193.28:0/3678549386 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5589068a5e10 0x5589068c2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.824+0000 7fed3dd74640 1 -- 10.20.193.28:0/3678549386 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x558906860860 msgr2=0x5589068bd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:31:01.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.824+0000 7fed3dd74640 1 --2- 10.20.193.28:0/3678549386 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x558906860860 0x5589068bd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.824+0000 7fed3dd74640 1 -- 10.20.193.28:0/3678549386 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589066f05b0 con 0x558906861170 2026-02-24T09:31:01.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.825+0000 7fed3dd74640 1 --2- 10.20.193.28:0/3678549386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558906861170 0x5589068bde30 secure :-1 s=READY pgs=517 gs=1 cs=0 l=1 c_cookie=3832769708955368045 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed280040b0 tx=0x7fed28009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3530bbbe50297a6d server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:01.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.825+0000 7feceffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:31:01.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.825+0000 7feceffff640 1 -- 10.20.193.28:0/3678549386 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed2802c070 con 0x558906861170 2026-02-24T09:31:01.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.825+0000 7feceffff640 1 -- 10.20.193.28:0/3678549386 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fed2801ab60 con 0x558906861170 2026-02-24T09:31:01.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.825+0000 7feceffff640 1 -- 10.20.193.28:0/3678549386 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed280276c0 con 0x558906861170 2026-02-24T09:31:01.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.825+0000 7fed47655e00 1 -- 10.20.193.28:0/3678549386 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed28009890 con 0x558906861170 2026-02-24T09:31:01.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.825+0000 7feceffff640 1 -- 10.20.193.28:0/3678549386 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(110..110 src has 1..110) ==== 8513+0+0 (secure 0 0 0) 0x7fed2801d890 con 0x558906861170 2026-02-24T09:31:01.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.825+0000 7fed47655e00 10 client.15963 _ll_register_callbacks cb 0x5589066edc00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:31:01.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.825+0000 7fed47655e00 1 -- 10.20.193.28:0/3678549386 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55890644f9e0 con 0x558906861170 2026-02-24T09:31:01.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.825+0000 7feceffff640 1 -- 10.20.193.28:0/3678549386 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fed2801acd0 con 0x558906861170 2026-02-24T09:31:01.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.825+0000 7fed47655e00 10 client.15963 fetch_fsmap learned FSMap version 23 2026-02-24T09:31:01.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.825+0000 7fed47655e00 1 -- 10.20.193.28:0/3678549386 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x558906702700 con 0x558906861170 2026-02-24T09:31:01.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.826+0000 7feceffff640 1 -- 10.20.193.28:0/3678549386 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fed28039060 con 0x558906861170 2026-02-24T09:31:01.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.826+0000 7fed47655e00 10 client.15963 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:31:01.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.826+0000 7fed47655e00 10 client.15963 resolve_mds: validated gid 24788 aka daemon mds.b 2026-02-24T09:31:01.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.826+0000 7fed47655e00 20 client.15963 populate_metadata read hostname 'trial028' 2026-02-24T09:31:01.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.826+0000 7fed47655e00 1 --2- 10.20.193.28:0/3678549386 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5589068a3130 0x5589068a35d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.826+0000 7fed47655e00 4 client.15963 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:31:01.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.826+0000 7fed47655e00 1 -- 10.20.193.28:0/3678549386 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55890677a800 con 0x5589068a3130 2026-02-24T09:31:01.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.826+0000 7fed3e575640 1 --2- 10.20.193.28:0/3678549386 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5589068a3130 0x5589068a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.826+0000 7fed3e575640 1 --2- 10.20.193.28:0/3678549386 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5589068a3130 0x5589068a35d0 crc :-1 s=READY pgs=66 gs=4 cs=0 l=0 c_cookie=9480984204774652066 s_cookie=3690627970380370226 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=839338e6deaeb8a2 server_cookie=3337be95d4a49132 in_seq=0 out_seq=0 2026-02-24T09:31:01.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.826+0000 7feceffff640 10 client.15963 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:31:01.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.827+0000 7feceffff640 1 -- 10.20.193.28:0/3678549386 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55890677a800 con 0x5589068a3130 2026-02-24T09:31:01.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.827+0000 7feceffff640 10 client.15963 handle_command_reply: tid=0 2026-02-24T09:31:01.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.827+0000 7fed47655e00 1 client.15963 shutdown 2026-02-24T09:31:01.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.827+0000 7fed47655e00 1 -- 10.20.193.28:0/3678549386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558906861170 msgr2=0x5589068bde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:01.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.827+0000 7fed47655e00 1 --2- 10.20.193.28:0/3678549386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558906861170 0x5589068bde30 secure :-1 s=READY pgs=517 gs=1 cs=0 l=1 c_cookie=3832769708955368045 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed280040b0 tx=0x7fed28009260 comp rx=0 tx=0).stop 2026-02-24T09:31:01.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.827+0000 7fed47655e00 1 -- 10.20.193.28:0/3678549386 shutdown_connections 2026-02-24T09:31:01.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.827+0000 7fed47655e00 1 --2- 10.20.193.28:0/3678549386 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5589068a3130 0x5589068a35d0 crc :-1 s=READY pgs=66 gs=4 cs=0 l=0 c_cookie=9480984204774652066 s_cookie=3690627970380370226 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.827+0000 7fed47655e00 1 --2- 10.20.193.28:0/3678549386 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5589068a5e10 0x5589068c2e20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.827+0000 7fed47655e00 1 --2- 10.20.193.28:0/3678549386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558906861170 0x5589068bde30 unknown :-1 s=CLOSED pgs=517 gs=1 cs=0 l=1 c_cookie=3832769708955368045 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.827+0000 7fed47655e00 1 --2- 10.20.193.28:0/3678549386 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x558906860860 0x5589068bd8f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.827+0000 7fed47655e00 1 -- 10.20.193.28:0/3678549386 >> 10.20.193.28:0/3678549386 conn(0x55890683ed60 msgr2=0x55890685f140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:01.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.827+0000 7feceffff640 0 client.15963 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:31:01.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.827+0000 7fed47655e00 1 -- 10.20.193.28:0/3678549386 shutdown_connections 2026-02-24T09:31:01.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.827+0000 7fed47655e00 1 -- 10.20.193.28:0/3678549386 wait complete. 2026-02-24T09:31:01.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.828+0000 7fed47655e00 20 client.15963 trim_cache size 0 max 16384 2026-02-24T09:31:01.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.837+0000 7fed47655e00 1 Processor -- start 2026-02-24T09:31:01.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.837+0000 7fed47655e00 1 -- start start 2026-02-24T09:31:01.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.837+0000 7fed47655e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x558906860860 0x5589068baaa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.837+0000 7fed47655e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x558906861170 0x5589068bafe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.837+0000 7fed47655e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589068a5e10 0x5589068a4ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.837+0000 7fed47655e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55890676a930 con 0x5589068a5e10 2026-02-24T09:31:01.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.837+0000 7fed47655e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55890640a690 con 0x558906860860 2026-02-24T09:31:01.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.837+0000 7fed47655e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x5589068a3730 con 0x558906861170 2026-02-24T09:31:01.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.837+0000 7fed3ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589068a5e10 0x5589068a4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.837+0000 7fed3e575640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x558906860860 0x5589068baaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.837+0000 7fed3ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589068a5e10 0x5589068a4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39840/0 (socket says 10.20.193.28:39840) 2026-02-24T09:31:01.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.837+0000 7fed3ed76640 1 -- 10.20.193.28:0/2091711519 learned_addr learned my addr 10.20.193.28:0/2091711519 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:31:01.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.837+0000 7fed3dd74640 1 --2- 10.20.193.28:0/2091711519 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x558906861170 0x5589068bafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.837+0000 7fed3ed76640 1 -- 10.20.193.28:0/2091711519 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x558906861170 msgr2=0x5589068bafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:31:01.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.837+0000 7fed3ed76640 1 --2- 10.20.193.28:0/2091711519 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x558906861170 0x5589068bafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.837+0000 7fed3ed76640 1 -- 10.20.193.28:0/2091711519 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x558906860860 msgr2=0x5589068baaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:31:01.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.837+0000 7fed3ed76640 1 --2- 10.20.193.28:0/2091711519 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x558906860860 0x5589068baaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.837+0000 7fed3ed76640 1 -- 10.20.193.28:0/2091711519 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589068afeb0 con 0x5589068a5e10 2026-02-24T09:31:01.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.837+0000 7fed3ed76640 1 --2- 10.20.193.28:0/2091711519 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589068a5e10 0x5589068a4ca0 secure :-1 s=READY pgs=518 gs=3 cs=0 l=1 c_cookie=6947589332032789509 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed3000a8c0 tx=0x7fed3000ad90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=606acbb0051b9c05 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:01.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.838+0000 7fed0a3ff640 1 -- 10.20.193.28:0/2091711519 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed30018070 con 0x5589068a5e10 2026-02-24T09:31:01.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.838+0000 7fed0a3ff640 1 -- 10.20.193.28:0/2091711519 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fed30003e20 con 0x5589068a5e10 2026-02-24T09:31:01.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.838+0000 7fed0a3ff640 1 -- 10.20.193.28:0/2091711519 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed30010990 con 0x5589068a5e10 2026-02-24T09:31:01.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.838+0000 7fed47655e00 1 -- 10.20.193.28:0/2091711519 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589068a5e10 msgr2=0x5589068a4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:01.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.838+0000 7fed47655e00 1 --2- 10.20.193.28:0/2091711519 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589068a5e10 0x5589068a4ca0 secure :-1 s=READY pgs=518 gs=3 cs=0 l=1 c_cookie=6947589332032789509 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed3000a8c0 tx=0x7fed3000ad90 comp rx=0 tx=0).stop 2026-02-24T09:31:01.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.838+0000 7fed47655e00 1 -- 10.20.193.28:0/2091711519 shutdown_connections 2026-02-24T09:31:01.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.838+0000 7fed47655e00 1 --2- 10.20.193.28:0/2091711519 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5589068a5e10 0x5589068a4ca0 unknown :-1 s=CLOSED pgs=518 gs=3 cs=0 l=1 c_cookie=6947589332032789509 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.838+0000 7fed47655e00 1 --2- 10.20.193.28:0/2091711519 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x558906861170 0x5589068bafe0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.838+0000 7fed47655e00 1 --2- 10.20.193.28:0/2091711519 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x558906860860 0x5589068baaa0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.838+0000 7fed47655e00 1 -- 10.20.193.28:0/2091711519 >> 10.20.193.28:0/2091711519 conn(0x55890683ed60 msgr2=0x5589068ba390 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:01.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.838+0000 7fed47655e00 1 -- 10.20.193.28:0/2091711519 shutdown_connections 2026-02-24T09:31:01.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.838+0000 7fed47655e00 1 -- 10.20.193.28:0/2091711519 wait complete. 2026-02-24T09:31:01.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.838+0000 7fed47655e00 1 -- start start 2026-02-24T09:31:01.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.839+0000 7fed47655e00 1 Processor -- start 2026-02-24T09:31:01.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.839+0000 7fed47655e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558906860860 0x558906844f20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.839+0000 7fed47655e00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x558906861170 0x558906842560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.839+0000 7fed47655e00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5589068a5e10 0x558906842cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.839+0000 7fed47655e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5589068433c0 con 0x558906860860 2026-02-24T09:31:01.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.839+0000 7fed47655e00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x5589068f4340 con 0x558906861170 2026-02-24T09:31:01.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.839+0000 7fed47655e00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x5589068f4500 con 0x5589068a5e10 2026-02-24T09:31:01.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.839+0000 7fed3e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558906860860 0x558906844f20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.839+0000 7fed3ed76640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5589068a5e10 0x558906842cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.839+0000 7fed3e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558906860860 0x558906844f20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39848/0 (socket says 10.20.193.28:39848) 2026-02-24T09:31:01.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.839+0000 7fed3e575640 1 -- 10.20.193.28:0/1448655656 learned_addr learned my addr 10.20.193.28:0/1448655656 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:31:01.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.839+0000 7fed3dd74640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x558906861170 0x558906842560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.839+0000 7fed3e575640 1 -- 10.20.193.28:0/1448655656 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5589068a5e10 msgr2=0x558906842cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:31:01.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.839+0000 7fed3e575640 1 --2- 10.20.193.28:0/1448655656 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5589068a5e10 0x558906842cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.839+0000 7fed3e575640 1 -- 10.20.193.28:0/1448655656 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x558906861170 msgr2=0x558906842560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:31:01.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.839+0000 7fed3e575640 1 --2- 10.20.193.28:0/1448655656 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x558906861170 0x558906842560 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.839+0000 7fed3e575640 1 -- 10.20.193.28:0/1448655656 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589066fcfa0 con 0x558906860860 2026-02-24T09:31:01.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.839+0000 7fed3dd74640 1 --2- 10.20.193.28:0/1448655656 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x558906861170 0x558906842560 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:31:01.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.840+0000 7fed3e575640 1 --2- 10.20.193.28:0/1448655656 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558906860860 0x558906844f20 secure :-1 s=READY pgs=519 gs=1 cs=0 l=1 c_cookie=4224752711112903106 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed34108010 tx=0x7fed3402f1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aa1563501c0c9c2 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:01.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.840+0000 7feceffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:31:01.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.840+0000 7feceffff640 1 -- 10.20.193.28:0/1448655656 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed34038ba0 con 0x558906860860 2026-02-24T09:31:01.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.840+0000 7fed47655e00 1 -- 10.20.193.28:0/1448655656 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed30005550 con 0x558906860860 2026-02-24T09:31:01.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.840+0000 7fed47655e00 10 client.15969 _ll_register_callbacks cb 0x5589066edc00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:31:01.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.840+0000 7fed47655e00 1 -- 10.20.193.28:0/1448655656 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed2801da80 con 0x558906860860 2026-02-24T09:31:01.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.840+0000 7feceffff640 1 -- 10.20.193.28:0/1448655656 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fed340d1f10 con 0x558906860860 2026-02-24T09:31:01.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.840+0000 7feceffff640 1 -- 10.20.193.28:0/1448655656 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed340d1330 con 0x558906860860 2026-02-24T09:31:01.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.840+0000 7feceffff640 1 -- 10.20.193.28:0/1448655656 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(110..110 src has 1..110) ==== 8513+0+0 (secure 0 0 0) 0x7fed340d21a0 con 0x558906860860 2026-02-24T09:31:01.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.840+0000 7feceffff640 1 -- 10.20.193.28:0/1448655656 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fed340d23a0 con 0x558906860860 2026-02-24T09:31:01.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.840+0000 7fed47655e00 10 client.15969 fetch_fsmap learned FSMap version 23 2026-02-24T09:31:01.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.840+0000 7fed47655e00 1 -- 10.20.193.28:0/1448655656 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x5589066f08e0 con 0x558906860860 2026-02-24T09:31:01.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.840+0000 7feceffff640 1 -- 10.20.193.28:0/1448655656 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fed340dc1c0 con 0x558906860860 2026-02-24T09:31:01.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.840+0000 7fed47655e00 10 client.15969 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:31:01.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.840+0000 7fed47655e00 10 client.15969 resolve_mds: validated gid 24788 aka daemon mds.b 2026-02-24T09:31:01.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.840+0000 7fed47655e00 20 client.15969 populate_metadata read hostname 'trial028' 2026-02-24T09:31:01.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.840+0000 7fed47655e00 1 --2- 10.20.193.28:0/1448655656 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5589068f5fc0 0x5589068f6460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:01.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.840+0000 7fed47655e00 4 client.15969 mds_command: new command op to 24788 tid=0 multi_id=0 [{"prefix": "perf dump", "format": "json-pretty"}] 2026-02-24T09:31:01.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.840+0000 7fed47655e00 1 -- 10.20.193.28:0/1448655656 --> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] -- command(tid 0: {"prefix": "perf dump", "format": "json-pretty"}) -- 0x55890649d740 con 0x5589068f5fc0 2026-02-24T09:31:01.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.841+0000 7fed3dd74640 1 --2- 10.20.193.28:0/1448655656 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5589068f5fc0 0x5589068f6460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:01.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.841+0000 7fed3dd74640 1 --2- 10.20.193.28:0/1448655656 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5589068f5fc0 0x5589068f6460 crc :-1 s=READY pgs=67 gs=4 cs=0 l=0 c_cookie=3609145678517266888 s_cookie=11741534897190263424 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=321642df5ea869c8 server_cookie=a2f24fc798e0da80 in_seq=0 out_seq=0 2026-02-24T09:31:01.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.841+0000 7feceffff640 10 client.15969 ms_handle_connect on v2:10.20.193.74:6838/828566790 2026-02-24T09:31:01.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.842+0000 7feceffff640 1 -- 10.20.193.28:0/1448655656 <== mds.0 v2:10.20.193.74:6838/828566790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18426 (crc 0 0 0) 0x55890649d740 con 0x5589068f5fc0 2026-02-24T09:31:01.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.842+0000 7feceffff640 10 client.15969 handle_command_reply: tid=0 2026-02-24T09:31:01.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.842+0000 7fed47655e00 1 client.15969 shutdown 2026-02-24T09:31:01.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.842+0000 7fed47655e00 1 -- 10.20.193.28:0/1448655656 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558906860860 msgr2=0x558906844f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:01.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.842+0000 7fed47655e00 1 --2- 10.20.193.28:0/1448655656 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558906860860 0x558906844f20 secure :-1 s=READY pgs=519 gs=1 cs=0 l=1 c_cookie=4224752711112903106 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed34108010 tx=0x7fed3402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.842+0000 7fed47655e00 1 -- 10.20.193.28:0/1448655656 shutdown_connections 2026-02-24T09:31:01.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.842+0000 7fed47655e00 1 --2- 10.20.193.28:0/1448655656 >> [v2:10.20.193.74:6838/828566790,v1:10.20.193.74:6839/828566790] conn(0x5589068f5fc0 0x5589068f6460 crc :-1 s=READY pgs=67 gs=4 cs=0 l=0 c_cookie=3609145678517266888 s_cookie=11741534897190263424 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.842+0000 7fed47655e00 1 --2- 10.20.193.28:0/1448655656 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x5589068a5e10 0x558906842cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.842+0000 7fed47655e00 1 --2- 10.20.193.28:0/1448655656 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x558906861170 0x558906842560 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.842+0000 7fed47655e00 1 --2- 10.20.193.28:0/1448655656 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558906860860 0x558906844f20 unknown :-1 s=CLOSED pgs=519 gs=1 cs=0 l=1 c_cookie=4224752711112903106 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.842+0000 7fed47655e00 1 -- 10.20.193.28:0/1448655656 >> 10.20.193.28:0/1448655656 conn(0x55890683ed60 msgr2=0x5589068baaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:01.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.842+0000 7feceffff640 0 client.15969 ms_handle_reset on v2:10.20.193.74:6838/828566790 2026-02-24T09:31:01.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.842+0000 7fed47655e00 1 -- 10.20.193.28:0/1448655656 shutdown_connections 2026-02-24T09:31:01.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.842+0000 7fed47655e00 1 -- 10.20.193.28:0/1448655656 wait complete. 2026-02-24T09:31:01.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.842+0000 7fed47655e00 20 client.15969 trim_cache size 0 max 16384 2026-02-24T09:31:01.850 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:31:01.850 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-24T09:31:01.850 INFO:teuthology.orchestra.run.trial028.stdout: "AsyncMessenger::Worker-0": { 2026-02-24T09:31:01.850 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_messages": 2817, 2026-02-24T09:31:01.850 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages": 1938, 2026-02-24T09:31:01.851 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_bytes": 1948861, 2026-02-24T09:31:01.851 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_bytes": 969334, 2026-02-24T09:31:01.851 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_created_connections": 16, 2026-02-24T09:31:01.851 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_active_connections": 6, 2026-02-24T09:31:01.851 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_total_time": 0.190788991, 2026-02-24T09:31:01.851 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_send_time": 0.083542151, 2026-02-24T09:31:01.851 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_recv_time": 0.107471271, 2026-02-24T09:31:01.851 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_fast_dispatch_time": 0.019661007, 2026-02-24T09:31:01.851 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages_queue_lat": { 2026-02-24T09:31:01.851 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 1938, 2026-02-24T09:31:01.851 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.190893741, 2026-02-24T09:31:01.851 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000098500 2026-02-24T09:31:01.852 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.852 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_handle_ack_lat": { 2026-02-24T09:31:01.852 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 2093, 2026-02-24T09:31:01.852 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000144898, 2026-02-24T09:31:01.852 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000069 2026-02-24T09:31:01.852 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.852 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_encrypted_bytes": 1331568, 2026-02-24T09:31:01.852 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_encrypted_bytes": 302128 2026-02-24T09:31:01.852 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.852 INFO:teuthology.orchestra.run.trial028.stdout: "AsyncMessenger::Worker-1": { 2026-02-24T09:31:01.852 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_messages": 1895, 2026-02-24T09:31:01.852 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages": 1994, 2026-02-24T09:31:01.853 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_bytes": 506902, 2026-02-24T09:31:01.853 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_bytes": 1619690, 2026-02-24T09:31:01.853 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_created_connections": 43, 2026-02-24T09:31:01.853 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_active_connections": 7, 2026-02-24T09:31:01.853 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_total_time": 0.145932521, 2026-02-24T09:31:01.853 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_send_time": 0.062424288, 2026-02-24T09:31:01.853 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_recv_time": 0.041206635, 2026-02-24T09:31:01.853 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_fast_dispatch_time": 0.034105520, 2026-02-24T09:31:01.853 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages_queue_lat": { 2026-02-24T09:31:01.853 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 1993, 2026-02-24T09:31:01.853 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.376098977, 2026-02-24T09:31:01.853 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000188709 2026-02-24T09:31:01.854 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.854 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_handle_ack_lat": { 2026-02-24T09:31:01.854 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 268, 2026-02-24T09:31:01.854 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000016584, 2026-02-24T09:31:01.854 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000061 2026-02-24T09:31:01.854 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.854 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_encrypted_bytes": 65248, 2026-02-24T09:31:01.854 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_encrypted_bytes": 552912 2026-02-24T09:31:01.854 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.854 INFO:teuthology.orchestra.run.trial028.stdout: "AsyncMessenger::Worker-2": { 2026-02-24T09:31:01.854 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_messages": 2807, 2026-02-24T09:31:01.854 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages": 1975, 2026-02-24T09:31:01.855 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_bytes": 968829, 2026-02-24T09:31:01.855 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_bytes": 1758262, 2026-02-24T09:31:01.855 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_created_connections": 11, 2026-02-24T09:31:01.855 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_active_connections": 6, 2026-02-24T09:31:01.855 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_total_time": 0.211512958, 2026-02-24T09:31:01.855 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_send_time": 0.117835453, 2026-02-24T09:31:01.855 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_recv_time": 0.086524530, 2026-02-24T09:31:01.855 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_fast_dispatch_time": 0.023526227, 2026-02-24T09:31:01.855 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages_queue_lat": { 2026-02-24T09:31:01.855 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 1974, 2026-02-24T09:31:01.855 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.357053158, 2026-02-24T09:31:01.855 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000180877 2026-02-24T09:31:01.855 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.856 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_handle_ack_lat": { 2026-02-24T09:31:01.856 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 2018, 2026-02-24T09:31:01.856 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000197900, 2026-02-24T09:31:01.856 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000098 2026-02-24T09:31:01.856 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.856 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_encrypted_bytes": 0, 2026-02-24T09:31:01.856 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_encrypted_bytes": 0 2026-02-24T09:31:01.856 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.856 INFO:teuthology.orchestra.run.trial028.stdout: "cct": { 2026-02-24T09:31:01.856 INFO:teuthology.orchestra.run.trial028.stdout: "total_workers": 1, 2026-02-24T09:31:01.856 INFO:teuthology.orchestra.run.trial028.stdout: "unhealthy_workers": 0 2026-02-24T09:31:01.856 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.856 INFO:teuthology.orchestra.run.trial028.stdout: "finisher-MDSRank": { 2026-02-24T09:31:01.857 INFO:teuthology.orchestra.run.trial028.stdout: "queue_len": 0, 2026-02-24T09:31:01.857 INFO:teuthology.orchestra.run.trial028.stdout: "complete_latency": { 2026-02-24T09:31:01.857 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 676, 2026-02-24T09:31:01.857 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.051083262, 2026-02-24T09:31:01.857 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000075566 2026-02-24T09:31:01.857 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:01.857 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.857 INFO:teuthology.orchestra.run.trial028.stdout: "finisher-PurgeQueue": { 2026-02-24T09:31:01.857 INFO:teuthology.orchestra.run.trial028.stdout: "queue_len": 0, 2026-02-24T09:31:01.857 INFO:teuthology.orchestra.run.trial028.stdout: "complete_latency": { 2026-02-24T09:31:01.857 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 2793, 2026-02-24T09:31:01.857 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.066524337, 2026-02-24T09:31:01.857 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000023818 2026-02-24T09:31:01.857 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:01.858 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.858 INFO:teuthology.orchestra.run.trial028.stdout: "mds": { 2026-02-24T09:31:01.858 INFO:teuthology.orchestra.run.trial028.stdout: "request": 264, 2026-02-24T09:31:01.858 INFO:teuthology.orchestra.run.trial028.stdout: "reply": 264, 2026-02-24T09:31:01.858 INFO:teuthology.orchestra.run.trial028.stdout: "reply_latency": { 2026-02-24T09:31:01.858 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 264, 2026-02-24T09:31:01.858 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.112970852, 2026-02-24T09:31:01.858 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000427919 2026-02-24T09:31:01.858 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.858 INFO:teuthology.orchestra.run.trial028.stdout: "slow_reply": 0, 2026-02-24T09:31:01.858 INFO:teuthology.orchestra.run.trial028.stdout: "forward": 0, 2026-02-24T09:31:01.858 INFO:teuthology.orchestra.run.trial028.stdout: "dir_fetch_complete": 0, 2026-02-24T09:31:01.858 INFO:teuthology.orchestra.run.trial028.stdout: "dir_fetch_keys": 0, 2026-02-24T09:31:01.858 INFO:teuthology.orchestra.run.trial028.stdout: "dir_commit": 110, 2026-02-24T09:31:01.859 INFO:teuthology.orchestra.run.trial028.stdout: "dir_split": 0, 2026-02-24T09:31:01.859 INFO:teuthology.orchestra.run.trial028.stdout: "dir_merge": 0, 2026-02-24T09:31:01.859 INFO:teuthology.orchestra.run.trial028.stdout: "inodes": 33, 2026-02-24T09:31:01.859 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_top": 7, 2026-02-24T09:31:01.859 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_bottom": 26, 2026-02-24T09:31:01.859 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_pin_tail": 0, 2026-02-24T09:31:01.859 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_pinned": 23, 2026-02-24T09:31:01.859 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_expired": 0, 2026-02-24T09:31:01.859 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_with_caps": 3, 2026-02-24T09:31:01.859 INFO:teuthology.orchestra.run.trial028.stdout: "caps": 3, 2026-02-24T09:31:01.859 INFO:teuthology.orchestra.run.trial028.stdout: "subtrees": 2, 2026-02-24T09:31:01.859 INFO:teuthology.orchestra.run.trial028.stdout: "traverse": 341, 2026-02-24T09:31:01.859 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_hit": 314, 2026-02-24T09:31:01.859 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_forward": 0, 2026-02-24T09:31:01.859 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_discover": 0, 2026-02-24T09:31:01.859 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_dir_fetch": 0, 2026-02-24T09:31:01.860 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_remote_ino": 0, 2026-02-24T09:31:01.860 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_lock": 0, 2026-02-24T09:31:01.860 INFO:teuthology.orchestra.run.trial028.stdout: "load_cent": 0, 2026-02-24T09:31:01.860 INFO:teuthology.orchestra.run.trial028.stdout: "q": 0, 2026-02-24T09:31:01.860 INFO:teuthology.orchestra.run.trial028.stdout: "exported": 0, 2026-02-24T09:31:01.860 INFO:teuthology.orchestra.run.trial028.stdout: "exported_inodes": 0, 2026-02-24T09:31:01.860 INFO:teuthology.orchestra.run.trial028.stdout: "imported": 0, 2026-02-24T09:31:01.860 INFO:teuthology.orchestra.run.trial028.stdout: "imported_inodes": 0, 2026-02-24T09:31:01.860 INFO:teuthology.orchestra.run.trial028.stdout: "openino_dir_fetch": 0, 2026-02-24T09:31:01.860 INFO:teuthology.orchestra.run.trial028.stdout: "openino_backtrace_fetch": 0, 2026-02-24T09:31:01.860 INFO:teuthology.orchestra.run.trial028.stdout: "openino_peer_discover": 0, 2026-02-24T09:31:01.860 INFO:teuthology.orchestra.run.trial028.stdout: "root_rfiles": 4, 2026-02-24T09:31:01.860 INFO:teuthology.orchestra.run.trial028.stdout: "root_rbytes": 234, 2026-02-24T09:31:01.860 INFO:teuthology.orchestra.run.trial028.stdout: "root_rsnaps": 6, 2026-02-24T09:31:01.860 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_backtrace_fetch": 0, 2026-02-24T09:31:01.860 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_set_tag": 0, 2026-02-24T09:31:01.861 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_backtrace_repaired": 0, 2026-02-24T09:31:01.861 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_inotable_repaired": 0, 2026-02-24T09:31:01.861 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_dir_inodes": 0, 2026-02-24T09:31:01.861 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_dir_base_inodes": 0, 2026-02-24T09:31:01.861 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_dirfrag_rstats": 0, 2026-02-24T09:31:01.861 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_file_inodes": 0, 2026-02-24T09:31:01.861 INFO:teuthology.orchestra.run.trial028.stdout: "handle_inode_file_caps": 0, 2026-02-24T09:31:01.861 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_revoke": 27, 2026-02-24T09:31:01.861 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_grant": 74, 2026-02-24T09:31:01.861 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_trunc": 0, 2026-02-24T09:31:01.861 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_flushsnap_ack": 0, 2026-02-24T09:31:01.861 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_flush_ack": 0, 2026-02-24T09:31:01.861 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_caps": 91, 2026-02-24T09:31:01.861 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_caps_dirty": 58, 2026-02-24T09:31:01.861 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_cap_release": 5, 2026-02-24T09:31:01.861 INFO:teuthology.orchestra.run.trial028.stdout: "process_request_cap_release": 32 2026-02-24T09:31:01.862 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.862 INFO:teuthology.orchestra.run.trial028.stdout: "mds_cache": { 2026-02-24T09:31:01.862 INFO:teuthology.orchestra.run.trial028.stdout: "dir_update": 7, 2026-02-24T09:31:01.862 INFO:teuthology.orchestra.run.trial028.stdout: "dir_update_receipt": 0, 2026-02-24T09:31:01.862 INFO:teuthology.orchestra.run.trial028.stdout: "dir_try_discover": 0, 2026-02-24T09:31:01.862 INFO:teuthology.orchestra.run.trial028.stdout: "dir_send_discover": 0, 2026-02-24T09:31:01.862 INFO:teuthology.orchestra.run.trial028.stdout: "dir_handle_discover": 16, 2026-02-24T09:31:01.862 INFO:teuthology.orchestra.run.trial028.stdout: "num_strays": 2, 2026-02-24T09:31:01.862 INFO:teuthology.orchestra.run.trial028.stdout: "num_strays_delayed": 0, 2026-02-24T09:31:01.862 INFO:teuthology.orchestra.run.trial028.stdout: "num_strays_enqueuing": 0, 2026-02-24T09:31:01.862 INFO:teuthology.orchestra.run.trial028.stdout: "strays_created": 5, 2026-02-24T09:31:01.862 INFO:teuthology.orchestra.run.trial028.stdout: "strays_enqueued": 3, 2026-02-24T09:31:01.862 INFO:teuthology.orchestra.run.trial028.stdout: "strays_reintegrated": 0, 2026-02-24T09:31:01.862 INFO:teuthology.orchestra.run.trial028.stdout: "strays_migrated": 0, 2026-02-24T09:31:01.862 INFO:teuthology.orchestra.run.trial028.stdout: "num_recovering_processing": 0, 2026-02-24T09:31:01.862 INFO:teuthology.orchestra.run.trial028.stdout: "num_recovering_enqueued": 0, 2026-02-24T09:31:01.863 INFO:teuthology.orchestra.run.trial028.stdout: "num_recovering_prioritized": 0, 2026-02-24T09:31:01.863 INFO:teuthology.orchestra.run.trial028.stdout: "recovery_started": 0, 2026-02-24T09:31:01.863 INFO:teuthology.orchestra.run.trial028.stdout: "recovery_completed": 0, 2026-02-24T09:31:01.863 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_quiesce_path": 0, 2026-02-24T09:31:01.863 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_quiesce_inode": 0, 2026-02-24T09:31:01.863 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_enqueue_scrub": 0, 2026-02-24T09:31:01.863 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_exportdir": 0, 2026-02-24T09:31:01.863 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_flush": 0, 2026-02-24T09:31:01.863 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_fragmentdir": 0, 2026-02-24T09:31:01.863 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_fragstats": 0, 2026-02-24T09:31:01.863 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_inodestats": 0, 2026-02-24T09:31:01.863 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-24T09:31:01.863 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_succeeded": 0, 2026-02-24T09:31:01.863 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_write_failed": 0 2026-02-24T09:31:01.863 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.863 INFO:teuthology.orchestra.run.trial028.stdout: "mds_log": { 2026-02-24T09:31:01.863 INFO:teuthology.orchestra.run.trial028.stdout: "evlrg": 0, 2026-02-24T09:31:01.864 INFO:teuthology.orchestra.run.trial028.stdout: "evadd": 249, 2026-02-24T09:31:01.864 INFO:teuthology.orchestra.run.trial028.stdout: "evex": 169, 2026-02-24T09:31:01.864 INFO:teuthology.orchestra.run.trial028.stdout: "evtrm": 169, 2026-02-24T09:31:01.864 INFO:teuthology.orchestra.run.trial028.stdout: "ev": 80, 2026-02-24T09:31:01.864 INFO:teuthology.orchestra.run.trial028.stdout: "evexg": 0, 2026-02-24T09:31:01.864 INFO:teuthology.orchestra.run.trial028.stdout: "evexd": 4, 2026-02-24T09:31:01.864 INFO:teuthology.orchestra.run.trial028.stdout: "segadd": 22, 2026-02-24T09:31:01.864 INFO:teuthology.orchestra.run.trial028.stdout: "segex": 21, 2026-02-24T09:31:01.864 INFO:teuthology.orchestra.run.trial028.stdout: "segtrm": 21, 2026-02-24T09:31:01.864 INFO:teuthology.orchestra.run.trial028.stdout: "seg": 1, 2026-02-24T09:31:01.864 INFO:teuthology.orchestra.run.trial028.stdout: "segmjr": 1, 2026-02-24T09:31:01.864 INFO:teuthology.orchestra.run.trial028.stdout: "segexg": 0, 2026-02-24T09:31:01.864 INFO:teuthology.orchestra.run.trial028.stdout: "segexd": 1, 2026-02-24T09:31:01.864 INFO:teuthology.orchestra.run.trial028.stdout: "expos": 4999130, 2026-02-24T09:31:01.864 INFO:teuthology.orchestra.run.trial028.stdout: "wrpos": 5124029, 2026-02-24T09:31:01.864 INFO:teuthology.orchestra.run.trial028.stdout: "rdpos": 0, 2026-02-24T09:31:01.864 INFO:teuthology.orchestra.run.trial028.stdout: "jlat": { 2026-02-24T09:31:01.864 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 197, 2026-02-24T09:31:01.865 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.250098603, 2026-02-24T09:31:01.865 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.001269536 2026-02-24T09:31:01.865 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.865 INFO:teuthology.orchestra.run.trial028.stdout: "replayed": 0 2026-02-24T09:31:01.865 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.865 INFO:teuthology.orchestra.run.trial028.stdout: "mds_mem": { 2026-02-24T09:31:01.865 INFO:teuthology.orchestra.run.trial028.stdout: "ino": 29, 2026-02-24T09:31:01.865 INFO:teuthology.orchestra.run.trial028.stdout: "ino+": 32, 2026-02-24T09:31:01.865 INFO:teuthology.orchestra.run.trial028.stdout: "ino-": 3, 2026-02-24T09:31:01.865 INFO:teuthology.orchestra.run.trial028.stdout: "dir": 20, 2026-02-24T09:31:01.865 INFO:teuthology.orchestra.run.trial028.stdout: "dir+": 20, 2026-02-24T09:31:01.865 INFO:teuthology.orchestra.run.trial028.stdout: "dir-": 0, 2026-02-24T09:31:01.865 INFO:teuthology.orchestra.run.trial028.stdout: "dn": 33, 2026-02-24T09:31:01.865 INFO:teuthology.orchestra.run.trial028.stdout: "dn+": 38, 2026-02-24T09:31:01.865 INFO:teuthology.orchestra.run.trial028.stdout: "dn-": 5, 2026-02-24T09:31:01.865 INFO:teuthology.orchestra.run.trial028.stdout: "cap": 3, 2026-02-24T09:31:01.865 INFO:teuthology.orchestra.run.trial028.stdout: "cap+": 19, 2026-02-24T09:31:01.866 INFO:teuthology.orchestra.run.trial028.stdout: "cap-": 16, 2026-02-24T09:31:01.866 INFO:teuthology.orchestra.run.trial028.stdout: "rss": 53340, 2026-02-24T09:31:01.866 INFO:teuthology.orchestra.run.trial028.stdout: "heap": 273387520 2026-02-24T09:31:01.866 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.866 INFO:teuthology.orchestra.run.trial028.stdout: "mds_server": { 2026-02-24T09:31:01.866 INFO:teuthology.orchestra.run.trial028.stdout: "dispatch_client_request": 345, 2026-02-24T09:31:01.866 INFO:teuthology.orchestra.run.trial028.stdout: "dispatch_server_request": 3, 2026-02-24T09:31:01.866 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_request": 264, 2026-02-24T09:31:01.866 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_session": 27, 2026-02-24T09:31:01.866 INFO:teuthology.orchestra.run.trial028.stdout: "handle_peer_request": 6, 2026-02-24T09:31:01.866 INFO:teuthology.orchestra.run.trial028.stdout: "req_create_latency": { 2026-02-24T09:31:01.866 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 7, 2026-02-24T09:31:01.866 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.003426179, 2026-02-24T09:31:01.866 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000489454 2026-02-24T09:31:01.866 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.866 INFO:teuthology.orchestra.run.trial028.stdout: "req_getattr_latency": { 2026-02-24T09:31:01.866 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 172, 2026-02-24T09:31:01.866 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.012798792, 2026-02-24T09:31:01.867 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000074411 2026-02-24T09:31:01.867 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.867 INFO:teuthology.orchestra.run.trial028.stdout: "req_getfilelock_latency": { 2026-02-24T09:31:01.867 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.867 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.867 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.867 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.867 INFO:teuthology.orchestra.run.trial028.stdout: "req_link_latency": { 2026-02-24T09:31:01.867 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.867 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.867 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.867 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.867 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookup_latency": { 2026-02-24T09:31:01.867 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 2, 2026-02-24T09:31:01.867 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000108934, 2026-02-24T09:31:01.867 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000054467 2026-02-24T09:31:01.867 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.868 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookuphash_latency": { 2026-02-24T09:31:01.868 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.868 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.868 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.868 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.868 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupino_latency": { 2026-02-24T09:31:01.868 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.868 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.868 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.868 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.868 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupname_latency": { 2026-02-24T09:31:01.868 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.868 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.868 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.868 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.868 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupparent_latency": { 2026-02-24T09:31:01.868 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.869 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.869 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.869 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.869 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupsnap_latency": { 2026-02-24T09:31:01.869 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 13, 2026-02-24T09:31:01.869 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000533280, 2026-02-24T09:31:01.869 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000041021 2026-02-24T09:31:01.869 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.869 INFO:teuthology.orchestra.run.trial028.stdout: "req_lssnap_latency": { 2026-02-24T09:31:01.869 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 14, 2026-02-24T09:31:01.869 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.001126275, 2026-02-24T09:31:01.869 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000080448 2026-02-24T09:31:01.869 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.869 INFO:teuthology.orchestra.run.trial028.stdout: "req_mkdir_latency": { 2026-02-24T09:31:01.869 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 8, 2026-02-24T09:31:01.869 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.008831996, 2026-02-24T09:31:01.869 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.001103999 2026-02-24T09:31:01.869 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.870 INFO:teuthology.orchestra.run.trial028.stdout: "req_mknod_latency": { 2026-02-24T09:31:01.870 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.870 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.870 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.870 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.870 INFO:teuthology.orchestra.run.trial028.stdout: "req_mksnap_latency": { 2026-02-24T09:31:01.870 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 14, 2026-02-24T09:31:01.870 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.039797627, 2026-02-24T09:31:01.870 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.002842687 2026-02-24T09:31:01.870 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.870 INFO:teuthology.orchestra.run.trial028.stdout: "req_open_latency": { 2026-02-24T09:31:01.870 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 2, 2026-02-24T09:31:01.870 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000558445, 2026-02-24T09:31:01.870 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000279222 2026-02-24T09:31:01.870 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.870 INFO:teuthology.orchestra.run.trial028.stdout: "req_readdir_latency": { 2026-02-24T09:31:01.870 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 2, 2026-02-24T09:31:01.870 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.003404699, 2026-02-24T09:31:01.870 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.001702349 2026-02-24T09:31:01.871 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.871 INFO:teuthology.orchestra.run.trial028.stdout: "req_rename_latency": { 2026-02-24T09:31:01.871 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 2, 2026-02-24T09:31:01.871 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000960697, 2026-02-24T09:31:01.871 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000480348 2026-02-24T09:31:01.871 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.871 INFO:teuthology.orchestra.run.trial028.stdout: "req_renamesnap_latency": { 2026-02-24T09:31:01.871 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.871 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.871 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.871 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.871 INFO:teuthology.orchestra.run.trial028.stdout: "req_snapdiff_latency": { 2026-02-24T09:31:01.871 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.871 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.871 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.871 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.871 INFO:teuthology.orchestra.run.trial028.stdout: "req_rmdir_latency": { 2026-02-24T09:31:01.871 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 2, 2026-02-24T09:31:01.871 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.005458573, 2026-02-24T09:31:01.872 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.002729286 2026-02-24T09:31:01.872 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.872 INFO:teuthology.orchestra.run.trial028.stdout: "req_rmsnap_latency": { 2026-02-24T09:31:01.872 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 8, 2026-02-24T09:31:01.872 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.018266600, 2026-02-24T09:31:01.872 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.002283325 2026-02-24T09:31:01.872 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.872 INFO:teuthology.orchestra.run.trial028.stdout: "req_rmxattr_latency": { 2026-02-24T09:31:01.872 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.872 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.872 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.872 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.872 INFO:teuthology.orchestra.run.trial028.stdout: "req_setattr_latency": { 2026-02-24T09:31:01.872 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 3, 2026-02-24T09:31:01.872 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.001149291, 2026-02-24T09:31:01.872 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000383097 2026-02-24T09:31:01.872 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.872 INFO:teuthology.orchestra.run.trial028.stdout: "req_setdirlayout_latency": { 2026-02-24T09:31:01.872 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.872 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.873 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.873 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.873 INFO:teuthology.orchestra.run.trial028.stdout: "req_setfilelock_latency": { 2026-02-24T09:31:01.873 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.873 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.873 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.873 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.873 INFO:teuthology.orchestra.run.trial028.stdout: "req_setlayout_latency": { 2026-02-24T09:31:01.873 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.873 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.873 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.873 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.873 INFO:teuthology.orchestra.run.trial028.stdout: "req_setxattr_latency": { 2026-02-24T09:31:01.873 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 12, 2026-02-24T09:31:01.873 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.013342364, 2026-02-24T09:31:01.873 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.001111863 2026-02-24T09:31:01.873 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.873 INFO:teuthology.orchestra.run.trial028.stdout: "req_symlink_latency": { 2026-02-24T09:31:01.873 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.873 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.874 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.874 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.874 INFO:teuthology.orchestra.run.trial028.stdout: "req_unlink_latency": { 2026-02-24T09:31:01.874 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 3, 2026-02-24T09:31:01.874 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.003207100, 2026-02-24T09:31:01.874 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.001069033 2026-02-24T09:31:01.874 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.874 INFO:teuthology.orchestra.run.trial028.stdout: "cap_revoke_eviction": 0, 2026-02-24T09:31:01.874 INFO:teuthology.orchestra.run.trial028.stdout: "cache_trim_throttle": 0, 2026-02-24T09:31:01.874 INFO:teuthology.orchestra.run.trial028.stdout: "session_recall_throttle": 0, 2026-02-24T09:31:01.874 INFO:teuthology.orchestra.run.trial028.stdout: "session_recall_throttle2o": 0, 2026-02-24T09:31:01.874 INFO:teuthology.orchestra.run.trial028.stdout: "global_recall_throttle": 0, 2026-02-24T09:31:01.874 INFO:teuthology.orchestra.run.trial028.stdout: "cap_acquisition_throttle": 0, 2026-02-24T09:31:01.874 INFO:teuthology.orchestra.run.trial028.stdout: "req_getvxattr_latency": { 2026-02-24T09:31:01.874 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.874 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.874 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.874 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.874 INFO:teuthology.orchestra.run.trial028.stdout: "req_blockdiff_latency": { 2026-02-24T09:31:01.874 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.874 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.874 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.875 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:01.875 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.875 INFO:teuthology.orchestra.run.trial028.stdout: "mds_sessions": { 2026-02-24T09:31:01.875 INFO:teuthology.orchestra.run.trial028.stdout: "session_count": 2, 2026-02-24T09:31:01.875 INFO:teuthology.orchestra.run.trial028.stdout: "session_add": 3, 2026-02-24T09:31:01.875 INFO:teuthology.orchestra.run.trial028.stdout: "session_remove": 1, 2026-02-24T09:31:01.875 INFO:teuthology.orchestra.run.trial028.stdout: "sessions_open": 2, 2026-02-24T09:31:01.875 INFO:teuthology.orchestra.run.trial028.stdout: "sessions_stale": 0, 2026-02-24T09:31:01.875 INFO:teuthology.orchestra.run.trial028.stdout: "total_load": 33, 2026-02-24T09:31:01.875 INFO:teuthology.orchestra.run.trial028.stdout: "average_load": 16, 2026-02-24T09:31:01.875 INFO:teuthology.orchestra.run.trial028.stdout: "avg_session_uptime": 791, 2026-02-24T09:31:01.875 INFO:teuthology.orchestra.run.trial028.stdout: "mdthresh_evicted": 0 2026-02-24T09:31:01.875 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.875 INFO:teuthology.orchestra.run.trial028.stdout: "mempool": { 2026-02-24T09:31:01.875 INFO:teuthology.orchestra.run.trial028.stdout: "bloom_filter_bytes": 0, 2026-02-24T09:31:01.875 INFO:teuthology.orchestra.run.trial028.stdout: "bloom_filter_items": 0, 2026-02-24T09:31:01.875 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_alloc_bytes": 0, 2026-02-24T09:31:01.875 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_alloc_items": 0, 2026-02-24T09:31:01.875 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_data_bytes": 0, 2026-02-24T09:31:01.875 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_data_items": 0, 2026-02-24T09:31:01.875 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_onode_bytes": 0, 2026-02-24T09:31:01.875 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_onode_items": 0, 2026-02-24T09:31:01.876 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_meta_bytes": 0, 2026-02-24T09:31:01.876 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_meta_items": 0, 2026-02-24T09:31:01.876 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_other_bytes": 0, 2026-02-24T09:31:01.876 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_other_items": 0, 2026-02-24T09:31:01.876 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_buffer_bytes": 0, 2026-02-24T09:31:01.876 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_buffer_items": 0, 2026-02-24T09:31:01.876 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_extent_bytes": 0, 2026-02-24T09:31:01.876 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_extent_items": 0, 2026-02-24T09:31:01.876 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_blob_bytes": 0, 2026-02-24T09:31:01.876 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_blob_items": 0, 2026-02-24T09:31:01.876 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_shared_blob_bytes": 0, 2026-02-24T09:31:01.876 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_shared_blob_items": 0, 2026-02-24T09:31:01.876 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_inline_bl_bytes": 0, 2026-02-24T09:31:01.876 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_inline_bl_items": 0, 2026-02-24T09:31:01.876 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_bytes": 0, 2026-02-24T09:31:01.876 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_items": 0, 2026-02-24T09:31:01.876 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_txc_bytes": 0, 2026-02-24T09:31:01.876 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_txc_items": 0, 2026-02-24T09:31:01.876 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_deferred_bytes": 0, 2026-02-24T09:31:01.876 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_deferred_items": 0, 2026-02-24T09:31:01.876 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_bytes": 0, 2026-02-24T09:31:01.876 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_items": 0, 2026-02-24T09:31:01.877 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_bytes": 0, 2026-02-24T09:31:01.877 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_items": 0, 2026-02-24T09:31:01.877 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_reader_bytes": 0, 2026-02-24T09:31:01.877 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_reader_items": 0, 2026-02-24T09:31:01.877 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_writer_bytes": 0, 2026-02-24T09:31:01.877 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_writer_items": 0, 2026-02-24T09:31:01.877 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_anon_bytes": 363730, 2026-02-24T09:31:01.877 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_anon_items": 150, 2026-02-24T09:31:01.877 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_meta_bytes": 264, 2026-02-24T09:31:01.877 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_meta_items": 3, 2026-02-24T09:31:01.877 INFO:teuthology.orchestra.run.trial028.stdout: "osd_bytes": 0, 2026-02-24T09:31:01.877 INFO:teuthology.orchestra.run.trial028.stdout: "osd_items": 0, 2026-02-24T09:31:01.877 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mapbl_bytes": 0, 2026-02-24T09:31:01.877 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mapbl_items": 0, 2026-02-24T09:31:01.877 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pglog_bytes": 0, 2026-02-24T09:31:01.877 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pglog_items": 0, 2026-02-24T09:31:01.877 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_bytes": 8272, 2026-02-24T09:31:01.877 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_items": 182, 2026-02-24T09:31:01.877 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_mapping_bytes": 0, 2026-02-24T09:31:01.877 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_mapping_items": 0, 2026-02-24T09:31:01.877 INFO:teuthology.orchestra.run.trial028.stdout: "pgmap_bytes": 0, 2026-02-24T09:31:01.877 INFO:teuthology.orchestra.run.trial028.stdout: "pgmap_items": 0, 2026-02-24T09:31:01.877 INFO:teuthology.orchestra.run.trial028.stdout: "mds_co_bytes": 147895, 2026-02-24T09:31:01.877 INFO:teuthology.orchestra.run.trial028.stdout: "mds_co_items": 2925, 2026-02-24T09:31:01.877 INFO:teuthology.orchestra.run.trial028.stdout: "ec_extent_cache_bytes": 0, 2026-02-24T09:31:01.878 INFO:teuthology.orchestra.run.trial028.stdout: "ec_extent_cache_items": 0, 2026-02-24T09:31:01.878 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_1_bytes": 0, 2026-02-24T09:31:01.878 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_1_items": 0, 2026-02-24T09:31:01.878 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_2_bytes": 0, 2026-02-24T09:31:01.878 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_2_items": 0 2026-02-24T09:31:01.878 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.878 INFO:teuthology.orchestra.run.trial028.stdout: "objecter": { 2026-02-24T09:31:01.878 INFO:teuthology.orchestra.run.trial028.stdout: "op_active": 0, 2026-02-24T09:31:01.878 INFO:teuthology.orchestra.run.trial028.stdout: "op_laggy": 0, 2026-02-24T09:31:01.878 INFO:teuthology.orchestra.run.trial028.stdout: "op_send": 4061, 2026-02-24T09:31:01.878 INFO:teuthology.orchestra.run.trial028.stdout: "op_send_bytes": 1166042, 2026-02-24T09:31:01.878 INFO:teuthology.orchestra.run.trial028.stdout: "op_resend": 23, 2026-02-24T09:31:01.878 INFO:teuthology.orchestra.run.trial028.stdout: "op_reply": 4061, 2026-02-24T09:31:01.878 INFO:teuthology.orchestra.run.trial028.stdout: "op_latency": { 2026-02-24T09:31:01.878 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 4061, 2026-02-24T09:31:01.878 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 21.798819008, 2026-02-24T09:31:01.878 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.005367845 2026-02-24T09:31:01.878 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.878 INFO:teuthology.orchestra.run.trial028.stdout: "op_inflight": 0, 2026-02-24T09:31:01.878 INFO:teuthology.orchestra.run.trial028.stdout: "oplen_avg": { 2026-02-24T09:31:01.878 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 4349, 2026-02-24T09:31:01.878 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 4061 2026-02-24T09:31:01.878 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.879 INFO:teuthology.orchestra.run.trial028.stdout: "op": 4061, 2026-02-24T09:31:01.879 INFO:teuthology.orchestra.run.trial028.stdout: "op_r": 3, 2026-02-24T09:31:01.879 INFO:teuthology.orchestra.run.trial028.stdout: "op_w": 4058, 2026-02-24T09:31:01.879 INFO:teuthology.orchestra.run.trial028.stdout: "op_rmw": 0, 2026-02-24T09:31:01.879 INFO:teuthology.orchestra.run.trial028.stdout: "op_pg": 0, 2026-02-24T09:31:01.879 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_stat": 90, 2026-02-24T09:31:01.879 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_create": 31, 2026-02-24T09:31:01.879 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_read": 3, 2026-02-24T09:31:01.879 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_write": 200, 2026-02-24T09:31:01.879 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_writefull": 72, 2026-02-24T09:31:01.879 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_writesame": 0, 2026-02-24T09:31:01.879 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_append": 0, 2026-02-24T09:31:01.879 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_zero": 0, 2026-02-24T09:31:01.879 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_truncate": 0, 2026-02-24T09:31:01.879 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_delete": 3584, 2026-02-24T09:31:01.879 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_mapext": 0, 2026-02-24T09:31:01.879 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_sparse_read": 0, 2026-02-24T09:31:01.879 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_clonerange": 0, 2026-02-24T09:31:01.879 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_getxattr": 0, 2026-02-24T09:31:01.879 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_setxattr": 62, 2026-02-24T09:31:01.879 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_cmpxattr": 0, 2026-02-24T09:31:01.879 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_rmxattr": 0, 2026-02-24T09:31:01.879 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_resetxattrs": 0, 2026-02-24T09:31:01.879 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_call": 0, 2026-02-24T09:31:01.879 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_watch": 0, 2026-02-24T09:31:01.879 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_notify": 0, 2026-02-24T09:31:01.880 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_src_cmpxattr": 0, 2026-02-24T09:31:01.880 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_pgls": 0, 2026-02-24T09:31:01.880 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_pgls_filter": 0, 2026-02-24T09:31:01.880 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_other": 0, 2026-02-24T09:31:01.880 INFO:teuthology.orchestra.run.trial028.stdout: "linger_active": 0, 2026-02-24T09:31:01.880 INFO:teuthology.orchestra.run.trial028.stdout: "linger_send": 0, 2026-02-24T09:31:01.880 INFO:teuthology.orchestra.run.trial028.stdout: "linger_resend": 0, 2026-02-24T09:31:01.880 INFO:teuthology.orchestra.run.trial028.stdout: "linger_ping": 0, 2026-02-24T09:31:01.880 INFO:teuthology.orchestra.run.trial028.stdout: "poolop_active": 0, 2026-02-24T09:31:01.880 INFO:teuthology.orchestra.run.trial028.stdout: "poolop_send": 0, 2026-02-24T09:31:01.880 INFO:teuthology.orchestra.run.trial028.stdout: "poolop_resend": 0, 2026-02-24T09:31:01.880 INFO:teuthology.orchestra.run.trial028.stdout: "poolstat_active": 0, 2026-02-24T09:31:01.880 INFO:teuthology.orchestra.run.trial028.stdout: "poolstat_send": 0, 2026-02-24T09:31:01.880 INFO:teuthology.orchestra.run.trial028.stdout: "poolstat_resend": 0, 2026-02-24T09:31:01.880 INFO:teuthology.orchestra.run.trial028.stdout: "statfs_active": 0, 2026-02-24T09:31:01.880 INFO:teuthology.orchestra.run.trial028.stdout: "statfs_send": 0, 2026-02-24T09:31:01.880 INFO:teuthology.orchestra.run.trial028.stdout: "statfs_resend": 0, 2026-02-24T09:31:01.880 INFO:teuthology.orchestra.run.trial028.stdout: "command_active": 0, 2026-02-24T09:31:01.880 INFO:teuthology.orchestra.run.trial028.stdout: "command_send": 0, 2026-02-24T09:31:01.880 INFO:teuthology.orchestra.run.trial028.stdout: "command_resend": 0, 2026-02-24T09:31:01.880 INFO:teuthology.orchestra.run.trial028.stdout: "map_epoch": 110, 2026-02-24T09:31:01.880 INFO:teuthology.orchestra.run.trial028.stdout: "map_full": 0, 2026-02-24T09:31:01.880 INFO:teuthology.orchestra.run.trial028.stdout: "map_inc": 19, 2026-02-24T09:31:01.880 INFO:teuthology.orchestra.run.trial028.stdout: "osd_sessions": 12, 2026-02-24T09:31:01.881 INFO:teuthology.orchestra.run.trial028.stdout: "osd_session_open": 12, 2026-02-24T09:31:01.881 INFO:teuthology.orchestra.run.trial028.stdout: "osd_session_close": 0, 2026-02-24T09:31:01.881 INFO:teuthology.orchestra.run.trial028.stdout: "osd_laggy": 0, 2026-02-24T09:31:01.881 INFO:teuthology.orchestra.run.trial028.stdout: "omap_wr": 283, 2026-02-24T09:31:01.881 INFO:teuthology.orchestra.run.trial028.stdout: "omap_rd": 0, 2026-02-24T09:31:01.881 INFO:teuthology.orchestra.run.trial028.stdout: "omap_del": 24, 2026-02-24T09:31:01.881 INFO:teuthology.orchestra.run.trial028.stdout: "replica_read_sent": 0, 2026-02-24T09:31:01.881 INFO:teuthology.orchestra.run.trial028.stdout: "replica_read_bounced": 0, 2026-02-24T09:31:01.881 INFO:teuthology.orchestra.run.trial028.stdout: "replica_read_completed": 0 2026-02-24T09:31:01.881 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.881 INFO:teuthology.orchestra.run.trial028.stdout: "oft": { 2026-02-24T09:31:01.881 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_objs": 1, 2026-02-24T09:31:01.881 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_kv_pairs": 0, 2026-02-24T09:31:01.881 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_updates": 0, 2026-02-24T09:31:01.881 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_removes": 0 2026-02-24T09:31:01.881 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.881 INFO:teuthology.orchestra.run.trial028.stdout: "purge_queue": { 2026-02-24T09:31:01.881 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing_ops": 0, 2026-02-24T09:31:01.881 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing_ops_high_water": 2560, 2026-02-24T09:31:01.881 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing": 0, 2026-02-24T09:31:01.881 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing_high_water": 1, 2026-02-24T09:31:01.881 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executed_ops": 3072, 2026-02-24T09:31:01.881 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executed": 3, 2026-02-24T09:31:01.881 INFO:teuthology.orchestra.run.trial028.stdout: "pq_item_in_journal": 0 2026-02-24T09:31:01.881 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.882 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-msgr_dispatch_throttler-mds": { 2026-02-24T09:31:01.882 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-24T09:31:01.882 INFO:teuthology.orchestra.run.trial028.stdout: "max": 104857600, 2026-02-24T09:31:01.882 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-24T09:31:01.882 INFO:teuthology.orchestra.run.trial028.stdout: "get": 7519, 2026-02-24T09:31:01.882 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 2680890, 2026-02-24T09:31:01.882 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-24T09:31:01.882 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 7519, 2026-02-24T09:31:01.882 INFO:teuthology.orchestra.run.trial028.stdout: "take": 0, 2026-02-24T09:31:01.882 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 0, 2026-02-24T09:31:01.882 INFO:teuthology.orchestra.run.trial028.stdout: "put": 7519, 2026-02-24T09:31:01.882 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 2680890, 2026-02-24T09:31:01.882 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-24T09:31:01.882 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.882 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.882 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.882 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:01.882 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.882 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-objecter_bytes": { 2026-02-24T09:31:01.882 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-24T09:31:01.882 INFO:teuthology.orchestra.run.trial028.stdout: "max": 104857600, 2026-02-24T09:31:01.882 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-24T09:31:01.882 INFO:teuthology.orchestra.run.trial028.stdout: "get": 0, 2026-02-24T09:31:01.882 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 0, 2026-02-24T09:31:01.882 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-24T09:31:01.883 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 0, 2026-02-24T09:31:01.883 INFO:teuthology.orchestra.run.trial028.stdout: "take": 4061, 2026-02-24T09:31:01.883 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 1166377, 2026-02-24T09:31:01.883 INFO:teuthology.orchestra.run.trial028.stdout: "put": 4061, 2026-02-24T09:31:01.883 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 1166377, 2026-02-24T09:31:01.883 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-24T09:31:01.883 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.883 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.883 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.883 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:01.883 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.883 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-objecter_ops": { 2026-02-24T09:31:01.883 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-24T09:31:01.883 INFO:teuthology.orchestra.run.trial028.stdout: "max": 1024, 2026-02-24T09:31:01.883 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-24T09:31:01.883 INFO:teuthology.orchestra.run.trial028.stdout: "get": 0, 2026-02-24T09:31:01.883 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 0, 2026-02-24T09:31:01.883 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-24T09:31:01.883 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 0, 2026-02-24T09:31:01.883 INFO:teuthology.orchestra.run.trial028.stdout: "take": 4061, 2026-02-24T09:31:01.883 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 4061, 2026-02-24T09:31:01.883 INFO:teuthology.orchestra.run.trial028.stdout: "put": 4061, 2026-02-24T09:31:01.883 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 4061, 2026-02-24T09:31:01.883 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-24T09:31:01.883 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.883 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.883 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.884 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:01.884 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.884 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-write_buf_throttle": { 2026-02-24T09:31:01.884 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-24T09:31:01.884 INFO:teuthology.orchestra.run.trial028.stdout: "max": 3758096384, 2026-02-24T09:31:01.884 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-24T09:31:01.884 INFO:teuthology.orchestra.run.trial028.stdout: "get": 3, 2026-02-24T09:31:01.884 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 335, 2026-02-24T09:31:01.884 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-24T09:31:01.884 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 3, 2026-02-24T09:31:01.884 INFO:teuthology.orchestra.run.trial028.stdout: "take": 0, 2026-02-24T09:31:01.884 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 0, 2026-02-24T09:31:01.884 INFO:teuthology.orchestra.run.trial028.stdout: "put": 3, 2026-02-24T09:31:01.884 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 335, 2026-02-24T09:31:01.884 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-24T09:31:01.884 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.884 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.884 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.884 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:01.884 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.884 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-write_buf_throttle-0x128a0640": { 2026-02-24T09:31:01.884 INFO:teuthology.orchestra.run.trial028.stdout: "val": 84, 2026-02-24T09:31:01.884 INFO:teuthology.orchestra.run.trial028.stdout: "max": 3758096384, 2026-02-24T09:31:01.884 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-24T09:31:01.884 INFO:teuthology.orchestra.run.trial028.stdout: "get": 249, 2026-02-24T09:31:01.884 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 929725, 2026-02-24T09:31:01.884 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-24T09:31:01.885 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 249, 2026-02-24T09:31:01.885 INFO:teuthology.orchestra.run.trial028.stdout: "take": 0, 2026-02-24T09:31:01.885 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 0, 2026-02-24T09:31:01.885 INFO:teuthology.orchestra.run.trial028.stdout: "put": 197, 2026-02-24T09:31:01.885 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 929641, 2026-02-24T09:31:01.885 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-24T09:31:01.885 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:01.885 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:01.885 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:01.885 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:01.885 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:01.885 INFO:teuthology.orchestra.run.trial028.stdout: "trackedop": { 2026-02-24T09:31:01.885 INFO:teuthology.orchestra.run.trial028.stdout: "slow_ops_count": 0 2026-02-24T09:31:01.885 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:01.885 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-24T09:31:01.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.842+0000 7fed3f577640 1 -- 10.20.193.28:0/988876112 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fed180b58d0 msgr2=0x7fed180d5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:01.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.842+0000 7fed3f577640 1 --2- 10.20.193.28:0/988876112 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fed180b58d0 0x7fed180d5d80 secure :-1 s=READY pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed40123dc0 tx=0x7fed28005f90 comp rx=0 tx=0).stop 2026-02-24T09:31:01.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.842+0000 7fed3f577640 1 -- 10.20.193.28:0/988876112 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fed4010f3c0 msgr2=0x7fed4011d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:01.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.842+0000 7fed3f577640 1 --2- 10.20.193.28:0/988876112 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fed4010f3c0 0x7fed4011d420 secure :-1 s=READY pgs=515 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed340098a0 tx=0x7fed340028d0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.842+0000 7fed3f577640 1 -- 10.20.193.28:0/988876112 shutdown_connections 2026-02-24T09:31:01.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.842+0000 7fed3f577640 1 --2- 10.20.193.28:0/988876112 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fed180b58d0 0x7fed180d5d80 unknown :-1 s=CLOSED pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.843+0000 7fed3f577640 1 --2- 10.20.193.28:0/988876112 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fed401155b0 0x7fed40122d30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.843+0000 7fed3f577640 1 --2- 10.20.193.28:0/988876112 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fed4010fdb0 0x7fed4011d960 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.843+0000 7fed3f577640 1 --2- 10.20.193.28:0/988876112 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fed4010f3c0 0x7fed4011d420 unknown :-1 s=CLOSED pgs=515 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:01.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.843+0000 7fed3f577640 1 -- 10.20.193.28:0/988876112 >> 10.20.193.28:0/988876112 conn(0x7fed400eccb0 msgr2=0x7fed4010d090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:01.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.843+0000 7fed3f577640 1 -- 10.20.193.28:0/988876112 shutdown_connections 2026-02-24T09:31:01.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:01.843+0000 7fed3f577640 1 -- 10.20.193.28:0/988876112 wait complete. 2026-02-24T09:31:01.887 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2026-02-24T09:31:01.887 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2026-02-24T09:31:01.887 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=7 2026-02-24T09:31:01.887 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2026-02-24T09:31:01.887 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2026-02-24T09:31:01.887 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=14 2026-02-24T09:31:01.887 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=8 2026-02-24T09:31:01.887 DEBUG:tasks.check_counter:Getting stats from e 2026-02-24T09:31:01.887 DEBUG:tasks.check_counter:skipping mds.24734 2026-02-24T09:31:01.887 DEBUG:tasks.check_counter:Getting stats from h 2026-02-24T09:31:01.887 DEBUG:tasks.check_counter:Getting stats from mds.24761 2026-02-24T09:31:01.887 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24761 perf dump --format=json-pretty 2026-02-24T09:31:01.888 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:01 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/2676544253' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:31:02.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.007+0000 7f0730dd4640 1 -- 10.20.193.28:0/1597096929 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f072c10f550 msgr2=0x7f072c10f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:02.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.007+0000 7f0730dd4640 1 --2- 10.20.193.28:0/1597096929 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f072c10f550 0x7f072c10f920 secure :-1 s=READY pgs=520 gs=1 cs=0 l=1 c_cookie=14897114802575764837 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0720009950 tx=0x7f072002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.007+0000 7f0730dd4640 1 -- 10.20.193.28:0/1597096929 shutdown_connections 2026-02-24T09:31:02.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.007+0000 7f0730dd4640 1 --2- 10.20.193.28:0/1597096929 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f072c115740 0x7f072c176110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.007+0000 7f0730dd4640 1 --2- 10.20.193.28:0/1597096929 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f072c10ff40 0x7f072c114f90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.007+0000 7f0730dd4640 1 --2- 10.20.193.28:0/1597096929 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f072c10f550 0x7f072c10f920 unknown :-1 s=CLOSED pgs=520 gs=1 cs=0 l=1 c_cookie=14897114802575764837 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.007+0000 7f0730dd4640 1 -- 10.20.193.28:0/1597096929 >> 10.20.193.28:0/1597096929 conn(0x7f072c0ece00 msgr2=0x7f072c10d210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:02.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.007+0000 7f0730dd4640 1 -- 10.20.193.28:0/1597096929 shutdown_connections 2026-02-24T09:31:02.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.007+0000 7f0730dd4640 1 -- 10.20.193.28:0/1597096929 wait complete. 2026-02-24T09:31:02.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.007+0000 7f0730dd4640 1 Processor -- start 2026-02-24T09:31:02.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.007+0000 7f0730dd4640 1 -- start start 2026-02-24T09:31:02.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.008+0000 7f0730dd4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f072c10f550 0x7f072c11d5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:02.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.008+0000 7f0730dd4640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f072c10ff40 0x7f072c11dae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:02.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.008+0000 7f0730dd4640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f072c115740 0x7f072c122eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:02.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.008+0000 7f0730dd4640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f072c1234d0 con 0x7f072c10f550 2026-02-24T09:31:02.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.008+0000 7f0730dd4640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f072c123640 con 0x7f072c10ff40 2026-02-24T09:31:02.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.008+0000 7f0730dd4640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f072c123800 con 0x7f072c115740 2026-02-24T09:31:02.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.008+0000 7f072a575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f072c10f550 0x7f072c11d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:02.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.008+0000 7f072a575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f072c10f550 0x7f072c11d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39874/0 (socket says 10.20.193.28:39874) 2026-02-24T09:31:02.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.008+0000 7f072a575640 1 -- 10.20.193.28:0/172037448 learned_addr learned my addr 10.20.193.28:0/172037448 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:31:02.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.008+0000 7f0729d74640 1 --2- 10.20.193.28:0/172037448 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f072c10ff40 0x7f072c11dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:02.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.008+0000 7f072ad76640 1 --2- 10.20.193.28:0/172037448 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f072c115740 0x7f072c122eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:02.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.008+0000 7f072a575640 1 -- 10.20.193.28:0/172037448 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f072c115740 msgr2=0x7f072c122eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:02.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.008+0000 7f072a575640 1 --2- 10.20.193.28:0/172037448 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f072c115740 0x7f072c122eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.008+0000 7f072a575640 1 -- 10.20.193.28:0/172037448 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f072c10ff40 msgr2=0x7f072c11dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:02.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.008+0000 7f072a575640 1 --2- 10.20.193.28:0/172037448 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f072c10ff40 0x7f072c11dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.008+0000 7f072a575640 1 -- 10.20.193.28:0/172037448 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0720009570 con 0x7f072c10f550 2026-02-24T09:31:02.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.008+0000 7f072ad76640 1 --2- 10.20.193.28:0/172037448 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f072c115740 0x7f072c122eb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:31:02.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.008+0000 7f072a575640 1 --2- 10.20.193.28:0/172037448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f072c10f550 0x7f072c11d5a0 secure :-1 s=READY pgs=521 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07200098a0 tx=0x7f07200028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:02.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.008+0000 7f07137fe640 1 -- 10.20.193.28:0/172037448 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f072003d070 con 0x7f072c10f550 2026-02-24T09:31:02.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.009+0000 7f07137fe640 1 -- 10.20.193.28:0/172037448 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f0720002a40 con 0x7f072c10f550 2026-02-24T09:31:02.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.009+0000 7f07137fe640 1 -- 10.20.193.28:0/172037448 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0720041820 con 0x7f072c10f550 2026-02-24T09:31:02.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.009+0000 7f0730dd4640 1 -- 10.20.193.28:0/172037448 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f072c123a80 con 0x7f072c10f550 2026-02-24T09:31:02.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.009+0000 7f0730dd4640 1 -- 10.20.193.28:0/172037448 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f072c1641e0 con 0x7f072c10f550 2026-02-24T09:31:02.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.012+0000 7f07137fe640 1 -- 10.20.193.28:0/172037448 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7f07200419c0 con 0x7f072c10f550 2026-02-24T09:31:02.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.013+0000 7f07137fe640 1 --2- 10.20.193.28:0/172037448 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f07040b58d0 0x7f07040d5d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:02.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.013+0000 7f07137fe640 1 -- 10.20.193.28:0/172037448 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 8513+0+0 (secure 0 0 0) 0x7f072010b430 con 0x7f072c10f550 2026-02-24T09:31:02.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.013+0000 7f0729d74640 1 --2- 10.20.193.28:0/172037448 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f07040b58d0 0x7f07040d5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:02.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.013+0000 7f07333bae00 1 Processor -- start 2026-02-24T09:31:02.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.014+0000 7f07333bae00 1 -- start start 2026-02-24T09:31:02.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.014+0000 7f0729d74640 1 --2- 10.20.193.28:0/172037448 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f07040b58d0 0x7f07040d5d80 secure :-1 s=READY pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f072c123f40 tx=0x7f0714005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:02.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.014+0000 7f07333bae00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6b1819e00 0x55e6b181a1d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:02.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.014+0000 7f07333bae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6b181a710 0x55e6b185ee70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:02.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.014+0000 7f07333bae00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6b185f3b0 0x55e6b187f790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:02.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.014+0000 7f07333bae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e6b172fe70 con 0x55e6b181a710 2026-02-24T09:31:02.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.014+0000 7f07333bae00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55e6b172bba0 con 0x55e6b185f3b0 2026-02-24T09:31:02.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.014+0000 7f07333bae00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55e6b1725d00 con 0x55e6b1819e00 2026-02-24T09:31:02.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.014+0000 7f0729d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6b181a710 0x55e6b185ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:02.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.014+0000 7f0729d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6b181a710 0x55e6b185ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39878/0 (socket says 10.20.193.28:39878) 2026-02-24T09:31:02.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.014+0000 7f0729d74640 1 -- 10.20.193.28:0/4102375223 learned_addr learned my addr 10.20.193.28:0/4102375223 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:31:02.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.014+0000 7f072a575640 1 --2- 10.20.193.28:0/4102375223 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6b1819e00 0x55e6b181a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:02.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.014+0000 7f072ad76640 1 --2- 10.20.193.28:0/4102375223 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6b185f3b0 0x55e6b187f790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:02.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.014+0000 7f0729d74640 1 -- 10.20.193.28:0/4102375223 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6b1819e00 msgr2=0x55e6b181a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:31:02.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.014+0000 7f0729d74640 1 --2- 10.20.193.28:0/4102375223 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6b1819e00 0x55e6b181a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.014+0000 7f0729d74640 1 -- 10.20.193.28:0/4102375223 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6b185f3b0 msgr2=0x55e6b187f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:31:02.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.014+0000 7f0729d74640 1 --2- 10.20.193.28:0/4102375223 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6b185f3b0 0x55e6b187f790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.014+0000 7f0729d74640 1 -- 10.20.193.28:0/4102375223 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6b16d11f0 con 0x55e6b181a710 2026-02-24T09:31:02.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.015+0000 7f0729d74640 1 --2- 10.20.193.28:0/4102375223 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6b181a710 0x55e6b185ee70 secure :-1 s=READY pgs=522 gs=2 cs=0 l=1 c_cookie=3415601931741220227 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0714004200 tx=0x7f0714014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f66a7dc3b92cd83 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:02.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.015+0000 7f0710ff9640 1 -- 10.20.193.28:0/4102375223 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0714011e60 con 0x55e6b181a710 2026-02-24T09:31:02.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.015+0000 7f0710ff9640 1 -- 10.20.193.28:0/4102375223 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f0714009d70 con 0x55e6b181a710 2026-02-24T09:31:02.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.015+0000 7f0710ff9640 1 -- 10.20.193.28:0/4102375223 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f071401b8a0 con 0x55e6b181a710 2026-02-24T09:31:02.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.015+0000 7f07333bae00 1 -- 10.20.193.28:0/4102375223 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6b181a710 msgr2=0x55e6b185ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:02.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.015+0000 7f07333bae00 1 --2- 10.20.193.28:0/4102375223 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6b181a710 0x55e6b185ee70 secure :-1 s=READY pgs=522 gs=2 cs=0 l=1 c_cookie=3415601931741220227 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0714004200 tx=0x7f0714014000 comp rx=0 tx=0).stop 2026-02-24T09:31:02.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.015+0000 7f07333bae00 1 -- 10.20.193.28:0/4102375223 shutdown_connections 2026-02-24T09:31:02.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.015+0000 7f07333bae00 1 --2- 10.20.193.28:0/4102375223 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6b185f3b0 0x55e6b187f790 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.015+0000 7f07333bae00 1 --2- 10.20.193.28:0/4102375223 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6b181a710 0x55e6b185ee70 unknown :-1 s=CLOSED pgs=522 gs=2 cs=0 l=1 c_cookie=3415601931741220227 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.015+0000 7f07333bae00 1 --2- 10.20.193.28:0/4102375223 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6b1819e00 0x55e6b181a1d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.015+0000 7f07333bae00 1 -- 10.20.193.28:0/4102375223 >> 10.20.193.28:0/4102375223 conn(0x55e6b17f8300 msgr2=0x55e6b18186e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:02.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.015+0000 7f07333bae00 1 -- 10.20.193.28:0/4102375223 shutdown_connections 2026-02-24T09:31:02.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.015+0000 7f07333bae00 1 -- 10.20.193.28:0/4102375223 wait complete. 2026-02-24T09:31:02.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.016+0000 7f07333bae00 1 -- start start 2026-02-24T09:31:02.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.017+0000 7f07333bae00 1 Processor -- start 2026-02-24T09:31:02.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.017+0000 7f07333bae00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6b1819e00 0x55e6b1832330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:02.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.017+0000 7f07333bae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6b181a710 0x55e6b1832870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:02.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.017+0000 7f07333bae00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6b185f3b0 0x55e6b1837860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:02.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.017+0000 7f07333bae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e6b1837da0 con 0x55e6b181a710 2026-02-24T09:31:02.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.017+0000 7f07333bae00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55e6b1837f10 con 0x55e6b1819e00 2026-02-24T09:31:02.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.017+0000 7f07333bae00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55e6b18380d0 con 0x55e6b185f3b0 2026-02-24T09:31:02.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.017+0000 7f0729d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6b181a710 0x55e6b1832870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:02.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.017+0000 7f0729d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6b181a710 0x55e6b1832870 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39892/0 (socket says 10.20.193.28:39892) 2026-02-24T09:31:02.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.017+0000 7f0729d74640 1 -- 10.20.193.28:0/155848091 learned_addr learned my addr 10.20.193.28:0/155848091 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:31:02.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.017+0000 7f072a575640 1 --2- 10.20.193.28:0/155848091 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6b1819e00 0x55e6b1832330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:02.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.017+0000 7f072ad76640 1 --2- 10.20.193.28:0/155848091 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6b185f3b0 0x55e6b1837860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:02.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.017+0000 7f0729d74640 1 -- 10.20.193.28:0/155848091 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6b185f3b0 msgr2=0x55e6b1837860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:31:02.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.017+0000 7f0729d74640 1 --2- 10.20.193.28:0/155848091 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6b185f3b0 0x55e6b1837860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.017+0000 7f0729d74640 1 -- 10.20.193.28:0/155848091 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6b1819e00 msgr2=0x55e6b1832330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:31:02.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.017+0000 7f0729d74640 1 --2- 10.20.193.28:0/155848091 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6b1819e00 0x55e6b1832330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.017+0000 7f0729d74640 1 -- 10.20.193.28:0/155848091 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6b16a95b0 con 0x55e6b181a710 2026-02-24T09:31:02.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.018+0000 7f0729d74640 1 --2- 10.20.193.28:0/155848091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6b181a710 0x55e6b1832870 secure :-1 s=READY pgs=523 gs=1 cs=0 l=1 c_cookie=11003513456027163059 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0714005940 tx=0x7f071401bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b455306bbad9b3 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:02.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.018+0000 7f06dbfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:31:02.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.018+0000 7f06dbfff640 1 -- 10.20.193.28:0/155848091 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0714011e60 con 0x55e6b181a710 2026-02-24T09:31:02.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.018+0000 7f06dbfff640 1 -- 10.20.193.28:0/155848091 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f071401ae50 con 0x55e6b181a710 2026-02-24T09:31:02.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.018+0000 7f06dbfff640 1 -- 10.20.193.28:0/155848091 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0714009ee0 con 0x55e6b181a710 2026-02-24T09:31:02.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.018+0000 7f07333bae00 1 -- 10.20.193.28:0/155848091 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0714009940 con 0x55e6b181a710 2026-02-24T09:31:02.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.018+0000 7f06dbfff640 1 -- 10.20.193.28:0/155848091 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(110..110 src has 1..110) ==== 8513+0+0 (secure 0 0 0) 0x7f0714004720 con 0x55e6b181a710 2026-02-24T09:31:02.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.018+0000 7f06dbfff640 10 client.15981 inactive, discarding osd_map(110..110 src has 1..110) 2026-02-24T09:31:02.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.018+0000 7f07333bae00 10 client.15981 _ll_register_callbacks cb 0x55e6b16a6c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:31:02.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.018+0000 7f07333bae00 1 -- 10.20.193.28:0/155848091 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e6b14089e0 con 0x55e6b181a710 2026-02-24T09:31:02.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.018+0000 7f06dbfff640 1 -- 10.20.193.28:0/155848091 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f071401ab80 con 0x55e6b181a710 2026-02-24T09:31:02.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.018+0000 7f07333bae00 10 client.15981 fetch_fsmap learned FSMap version 23 2026-02-24T09:31:02.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.018+0000 7f07333bae00 1 -- 10.20.193.28:0/155848091 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x55e6b16bb700 con 0x55e6b181a710 2026-02-24T09:31:02.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.018+0000 7f06dbfff640 1 -- 10.20.193.28:0/155848091 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f0714035030 con 0x55e6b181a710 2026-02-24T09:31:02.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.019+0000 7f07333bae00 10 client.15981 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:31:02.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.019+0000 7f07333bae00 10 client.15981 resolve_mds: validated gid 24761 aka daemon mds.h 2026-02-24T09:31:02.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.019+0000 7f07333bae00 20 client.15981 populate_metadata read hostname 'trial028' 2026-02-24T09:31:02.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.019+0000 7f07333bae00 1 --2- 10.20.193.28:0/155848091 >> [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] conn(0x55e6b185c9a0 0x55e6b185ce40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:02.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.019+0000 7f07333bae00 4 client.15981 mds_command: new command op to 24761 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:31:02.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.019+0000 7f07333bae00 1 -- 10.20.193.28:0/155848091 --> [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6b1733800 con 0x55e6b185c9a0 2026-02-24T09:31:02.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.019+0000 7f072a575640 1 --2- 10.20.193.28:0/155848091 >> [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] conn(0x55e6b185c9a0 0x55e6b185ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:02.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.019+0000 7f072a575640 1 --2- 10.20.193.28:0/155848091 >> [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] conn(0x55e6b185c9a0 0x55e6b185ce40 crc :-1 s=READY pgs=22 gs=4 cs=0 l=0 c_cookie=1144120081911603254 s_cookie=7115880449180409972 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fe0bb2716bb6036 server_cookie=62c0af91258ba074 in_seq=0 out_seq=0 2026-02-24T09:31:02.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.019+0000 7f06dbfff640 10 client.15981 ms_handle_connect on v2:10.20.193.74:6836/958749351 2026-02-24T09:31:02.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.020+0000 7f06dbfff640 1 -- 10.20.193.28:0/155848091 <== mds.1 v2:10.20.193.74:6836/958749351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55e6b1733800 con 0x55e6b185c9a0 2026-02-24T09:31:02.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.020+0000 7f06dbfff640 10 client.15981 handle_command_reply: tid=0 2026-02-24T09:31:02.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.020+0000 7f07333bae00 1 client.15981 shutdown 2026-02-24T09:31:02.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.020+0000 7f07333bae00 1 -- 10.20.193.28:0/155848091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6b181a710 msgr2=0x55e6b1832870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:02.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.020+0000 7f07333bae00 1 --2- 10.20.193.28:0/155848091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6b181a710 0x55e6b1832870 secure :-1 s=READY pgs=523 gs=1 cs=0 l=1 c_cookie=11003513456027163059 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0714005940 tx=0x7f071401bce0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.020+0000 7f07333bae00 1 -- 10.20.193.28:0/155848091 shutdown_connections 2026-02-24T09:31:02.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.020+0000 7f07333bae00 1 --2- 10.20.193.28:0/155848091 >> [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] conn(0x55e6b185c9a0 0x55e6b185ce40 crc :-1 s=READY pgs=22 gs=4 cs=0 l=0 c_cookie=1144120081911603254 s_cookie=7115880449180409972 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.020+0000 7f07333bae00 1 --2- 10.20.193.28:0/155848091 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6b185f3b0 0x55e6b1837860 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.020+0000 7f07333bae00 1 --2- 10.20.193.28:0/155848091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6b181a710 0x55e6b1832870 unknown :-1 s=CLOSED pgs=523 gs=1 cs=0 l=1 c_cookie=11003513456027163059 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.020+0000 7f07333bae00 1 --2- 10.20.193.28:0/155848091 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6b1819e00 0x55e6b1832330 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.020+0000 7f06dbfff640 0 client.15981 ms_handle_reset on v2:10.20.193.74:6836/958749351 2026-02-24T09:31:02.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.020+0000 7f07333bae00 1 -- 10.20.193.28:0/155848091 >> 10.20.193.28:0/155848091 conn(0x55e6b17f8300 msgr2=0x55e6b1818ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:02.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.020+0000 7f07333bae00 1 -- 10.20.193.28:0/155848091 shutdown_connections 2026-02-24T09:31:02.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.020+0000 7f07333bae00 1 -- 10.20.193.28:0/155848091 wait complete. 2026-02-24T09:31:02.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.020+0000 7f07333bae00 20 client.15981 trim_cache size 0 max 16384 2026-02-24T09:31:02.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.029+0000 7f07333bae00 1 Processor -- start 2026-02-24T09:31:02.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.029+0000 7f07333bae00 1 -- start start 2026-02-24T09:31:02.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.029+0000 7f07333bae00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6b1819e00 0x55e6b181cbe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:02.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.029+0000 7f07333bae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6b181a710 0x55e6b182f550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:02.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.029+0000 7f07333bae00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6b185f3b0 0x55e6b182fa90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:02.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.029+0000 7f07333bae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e6b1723930 con 0x55e6b181a710 2026-02-24T09:31:02.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.029+0000 7f07333bae00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55e6b13c3690 con 0x55e6b1819e00 2026-02-24T09:31:02.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.029+0000 7f07333bae00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55e6b178d4f0 con 0x55e6b185f3b0 2026-02-24T09:31:02.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.029+0000 7f0729d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6b181a710 0x55e6b182f550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:02.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.029+0000 7f0729d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6b181a710 0x55e6b182f550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39896/0 (socket says 10.20.193.28:39896) 2026-02-24T09:31:02.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.029+0000 7f0729d74640 1 -- 10.20.193.28:0/2605086555 learned_addr learned my addr 10.20.193.28:0/2605086555 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:31:02.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.029+0000 7f072ad76640 1 --2- 10.20.193.28:0/2605086555 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6b185f3b0 0x55e6b182fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:02.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.029+0000 7f072a575640 1 --2- 10.20.193.28:0/2605086555 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6b1819e00 0x55e6b181cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:02.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.030+0000 7f0729d74640 1 -- 10.20.193.28:0/2605086555 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6b185f3b0 msgr2=0x55e6b182fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:31:02.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.030+0000 7f0729d74640 1 --2- 10.20.193.28:0/2605086555 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6b185f3b0 0x55e6b182fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.030+0000 7f0729d74640 1 -- 10.20.193.28:0/2605086555 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6b1819e00 msgr2=0x55e6b181cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:31:02.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.030+0000 7f0729d74640 1 --2- 10.20.193.28:0/2605086555 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6b1819e00 0x55e6b181cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.030+0000 7f0729d74640 1 -- 10.20.193.28:0/2605086555 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6b18248c0 con 0x55e6b181a710 2026-02-24T09:31:02.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.030+0000 7f0729d74640 1 --2- 10.20.193.28:0/2605086555 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6b181a710 0x55e6b182f550 secure :-1 s=READY pgs=524 gs=1 cs=0 l=1 c_cookie=12544909475873144781 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0714016040 tx=0x7f0714036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae1878b3d8d9bfcd server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:02.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.030+0000 7f06f63ff640 1 -- 10.20.193.28:0/2605086555 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0714009ee0 con 0x55e6b181a710 2026-02-24T09:31:02.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.030+0000 7f06f63ff640 1 -- 10.20.193.28:0/2605086555 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x55e6b14089e0 con 0x55e6b181a710 2026-02-24T09:31:02.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.030+0000 7f06f63ff640 1 -- 10.20.193.28:0/2605086555 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0714004720 con 0x55e6b181a710 2026-02-24T09:31:02.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.030+0000 7f07333bae00 1 -- 10.20.193.28:0/2605086555 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6b181a710 msgr2=0x55e6b182f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:02.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.030+0000 7f07333bae00 1 --2- 10.20.193.28:0/2605086555 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6b181a710 0x55e6b182f550 secure :-1 s=READY pgs=524 gs=1 cs=0 l=1 c_cookie=12544909475873144781 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0714016040 tx=0x7f0714036000 comp rx=0 tx=0).stop 2026-02-24T09:31:02.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.030+0000 7f07333bae00 1 -- 10.20.193.28:0/2605086555 shutdown_connections 2026-02-24T09:31:02.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.030+0000 7f07333bae00 1 --2- 10.20.193.28:0/2605086555 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6b185f3b0 0x55e6b182fa90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.030+0000 7f07333bae00 1 --2- 10.20.193.28:0/2605086555 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6b181a710 0x55e6b182f550 unknown :-1 s=CLOSED pgs=524 gs=1 cs=0 l=1 c_cookie=12544909475873144781 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.030+0000 7f07333bae00 1 --2- 10.20.193.28:0/2605086555 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6b1819e00 0x55e6b181cbe0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.030+0000 7f07333bae00 1 -- 10.20.193.28:0/2605086555 >> 10.20.193.28:0/2605086555 conn(0x55e6b17f8300 msgr2=0x55e6b182ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:02.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.030+0000 7f07333bae00 1 -- 10.20.193.28:0/2605086555 shutdown_connections 2026-02-24T09:31:02.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.030+0000 7f07333bae00 1 -- 10.20.193.28:0/2605086555 wait complete. 2026-02-24T09:31:02.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.031+0000 7f07333bae00 1 -- start start 2026-02-24T09:31:02.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.031+0000 7f07333bae00 1 Processor -- start 2026-02-24T09:31:02.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.031+0000 7f07333bae00 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6b1819e00 0x55e6b183c0f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:02.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.031+0000 7f07333bae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6b181a710 0x55e6b183c670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:02.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.031+0000 7f07333bae00 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6b185f3b0 0x55e6b18c48e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:02.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.031+0000 7f07333bae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e6b1837970 con 0x55e6b181a710 2026-02-24T09:31:02.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.031+0000 7f07333bae00 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x55e6b17d5ba0 con 0x55e6b185f3b0 2026-02-24T09:31:02.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.031+0000 7f07333bae00 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x55e6b18c4f50 con 0x55e6b1819e00 2026-02-24T09:31:02.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.031+0000 7f0729d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6b181a710 0x55e6b183c670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:02.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.031+0000 7f0729d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6b181a710 0x55e6b183c670 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39908/0 (socket says 10.20.193.28:39908) 2026-02-24T09:31:02.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.031+0000 7f0729d74640 1 -- 10.20.193.28:0/196287676 learned_addr learned my addr 10.20.193.28:0/196287676 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:31:02.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.031+0000 7f072a575640 1 --2- 10.20.193.28:0/196287676 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6b1819e00 0x55e6b183c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:02.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.032+0000 7f0729d74640 1 -- 10.20.193.28:0/196287676 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6b1819e00 msgr2=0x55e6b183c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:31:02.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.032+0000 7f072ad76640 1 --2- 10.20.193.28:0/196287676 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6b185f3b0 0x55e6b18c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:02.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.032+0000 7f0729d74640 1 --2- 10.20.193.28:0/196287676 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6b1819e00 0x55e6b183c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.032+0000 7f0729d74640 1 -- 10.20.193.28:0/196287676 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6b185f3b0 msgr2=0x55e6b18c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:31:02.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.032+0000 7f0729d74640 1 --2- 10.20.193.28:0/196287676 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6b185f3b0 0x55e6b18c48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.032+0000 7f0729d74640 1 -- 10.20.193.28:0/196287676 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6b16b5fa0 con 0x55e6b181a710 2026-02-24T09:31:02.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.032+0000 7f072ad76640 1 --2- 10.20.193.28:0/196287676 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6b185f3b0 0x55e6b18c48e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:31:02.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.032+0000 7f0729d74640 1 --2- 10.20.193.28:0/196287676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6b181a710 0x55e6b183c670 secure :-1 s=READY pgs=525 gs=1 cs=0 l=1 c_cookie=15802626437707486179 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0714005940 tx=0x7f0714025440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4e3504e9c053e3 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:02.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.032+0000 7f06dbfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-24T09:31:02.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.032+0000 7f06dbfff640 1 -- 10.20.193.28:0/196287676 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f071401ae00 con 0x55e6b181a710 2026-02-24T09:31:02.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.032+0000 7f06dbfff640 1 -- 10.20.193.28:0/196287676 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f071402e8b0 con 0x55e6b181a710 2026-02-24T09:31:02.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.032+0000 7f07333bae00 1 -- 10.20.193.28:0/196287676 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6b16bb700 con 0x55e6b181a710 2026-02-24T09:31:02.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.032+0000 7f06dbfff640 1 -- 10.20.193.28:0/196287676 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0714025760 con 0x55e6b181a710 2026-02-24T09:31:02.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.032+0000 7f07333bae00 10 client.15987 _ll_register_callbacks cb 0x55e6b16a6c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:31:02.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.032+0000 7f07333bae00 1 -- 10.20.193.28:0/196287676 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0714009d70 con 0x55e6b181a710 2026-02-24T09:31:02.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.032+0000 7f06dbfff640 1 -- 10.20.193.28:0/196287676 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(110..110 src has 1..110) ==== 8513+0+0 (secure 0 0 0) 0x7f07140258c0 con 0x55e6b181a710 2026-02-24T09:31:02.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.032+0000 7f06dbfff640 1 -- 10.20.193.28:0/196287676 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f0714025aa0 con 0x55e6b181a710 2026-02-24T09:31:02.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.032+0000 7f07333bae00 10 client.15987 fetch_fsmap learned FSMap version 23 2026-02-24T09:31:02.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.032+0000 7f07333bae00 1 -- 10.20.193.28:0/196287676 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x55e6b16a98e0 con 0x55e6b181a710 2026-02-24T09:31:02.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.033+0000 7f06dbfff640 1 -- 10.20.193.28:0/196287676 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f0714054070 con 0x55e6b181a710 2026-02-24T09:31:02.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.033+0000 7f07333bae00 10 client.15987 fetch_fsmap finished waiting for FSMap version 23 2026-02-24T09:31:02.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.033+0000 7f07333bae00 10 client.15987 resolve_mds: validated gid 24761 aka daemon mds.h 2026-02-24T09:31:02.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.033+0000 7f07333bae00 20 client.15987 populate_metadata read hostname 'trial028' 2026-02-24T09:31:02.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.033+0000 7f07333bae00 1 --2- 10.20.193.28:0/196287676 >> [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] conn(0x55e6b190c850 0x55e6b192cd00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:02.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.033+0000 7f07333bae00 4 client.15987 mds_command: new command op to 24761 tid=0 multi_id=0 [{"prefix": "perf dump", "format": "json-pretty"}] 2026-02-24T09:31:02.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.033+0000 7f07333bae00 1 -- 10.20.193.28:0/196287676 --> [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] -- command(tid 0: {"prefix": "perf dump", "format": "json-pretty"}) -- 0x55e6b1456740 con 0x55e6b190c850 2026-02-24T09:31:02.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.033+0000 7f072a575640 1 --2- 10.20.193.28:0/196287676 >> [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] conn(0x55e6b190c850 0x55e6b192cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:02.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.033+0000 7f072a575640 1 --2- 10.20.193.28:0/196287676 >> [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] conn(0x55e6b190c850 0x55e6b192cd00 crc :-1 s=READY pgs=23 gs=4 cs=0 l=0 c_cookie=1763444667574166227 s_cookie=14437034649096933655 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=18790394ffd0a2d3 server_cookie=c85aa685cd6dd117 in_seq=0 out_seq=0 2026-02-24T09:31:02.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.033+0000 7f06dbfff640 10 client.15987 ms_handle_connect on v2:10.20.193.74:6836/958749351 2026-02-24T09:31:02.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.034+0000 7f06dbfff640 1 -- 10.20.193.28:0/196287676 <== mds.1 v2:10.20.193.74:6836/958749351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18283 (crc 0 0 0) 0x55e6b1456740 con 0x55e6b190c850 2026-02-24T09:31:02.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.034+0000 7f06dbfff640 10 client.15987 handle_command_reply: tid=0 2026-02-24T09:31:02.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.034+0000 7f07333bae00 1 client.15987 shutdown 2026-02-24T09:31:02.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.034+0000 7f07333bae00 1 -- 10.20.193.28:0/196287676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6b181a710 msgr2=0x55e6b183c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:02.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.034+0000 7f07333bae00 1 --2- 10.20.193.28:0/196287676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6b181a710 0x55e6b183c670 secure :-1 s=READY pgs=525 gs=1 cs=0 l=1 c_cookie=15802626437707486179 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0714005940 tx=0x7f0714025440 comp rx=0 tx=0).stop 2026-02-24T09:31:02.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.034+0000 7f07333bae00 1 -- 10.20.193.28:0/196287676 shutdown_connections 2026-02-24T09:31:02.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.034+0000 7f07333bae00 1 --2- 10.20.193.28:0/196287676 >> [v2:10.20.193.74:6836/958749351,v1:10.20.193.74:6837/958749351] conn(0x55e6b190c850 0x55e6b192cd00 crc :-1 s=READY pgs=23 gs=4 cs=0 l=0 c_cookie=1763444667574166227 s_cookie=14437034649096933655 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.034+0000 7f07333bae00 1 --2- 10.20.193.28:0/196287676 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x55e6b185f3b0 0x55e6b18c48e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.034+0000 7f07333bae00 1 --2- 10.20.193.28:0/196287676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e6b181a710 0x55e6b183c670 unknown :-1 s=CLOSED pgs=525 gs=1 cs=0 l=1 c_cookie=15802626437707486179 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.034+0000 7f07333bae00 1 --2- 10.20.193.28:0/196287676 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x55e6b1819e00 0x55e6b183c0f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.034+0000 7f07333bae00 1 -- 10.20.193.28:0/196287676 >> 10.20.193.28:0/196287676 conn(0x55e6b17f8300 msgr2=0x55e6b182f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:02.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.034+0000 7f06dbfff640 0 client.15987 ms_handle_reset on v2:10.20.193.74:6836/958749351 2026-02-24T09:31:02.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.034+0000 7f07333bae00 1 -- 10.20.193.28:0/196287676 shutdown_connections 2026-02-24T09:31:02.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.034+0000 7f07333bae00 1 -- 10.20.193.28:0/196287676 wait complete. 2026-02-24T09:31:02.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.034+0000 7f07333bae00 20 client.15987 trim_cache size 0 max 16384 2026-02-24T09:31:02.043 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:31:02.043 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-24T09:31:02.043 INFO:teuthology.orchestra.run.trial028.stdout: "AsyncMessenger::Worker-0": { 2026-02-24T09:31:02.043 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_messages": 28, 2026-02-24T09:31:02.043 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages": 31, 2026-02-24T09:31:02.043 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_bytes": 7013, 2026-02-24T09:31:02.043 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_bytes": 37889, 2026-02-24T09:31:02.043 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_created_connections": 9, 2026-02-24T09:31:02.044 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_active_connections": 7, 2026-02-24T09:31:02.044 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_total_time": 0.007542838, 2026-02-24T09:31:02.044 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_send_time": 0.000565230, 2026-02-24T09:31:02.044 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_recv_time": 0.002519769, 2026-02-24T09:31:02.044 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_fast_dispatch_time": 0.000129940, 2026-02-24T09:31:02.044 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages_queue_lat": { 2026-02-24T09:31:02.044 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 28, 2026-02-24T09:31:02.044 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.016837459, 2026-02-24T09:31:02.044 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000601337 2026-02-24T09:31:02.044 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.044 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_handle_ack_lat": { 2026-02-24T09:31:02.044 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 10, 2026-02-24T09:31:02.045 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000621, 2026-02-24T09:31:02.045 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000062 2026-02-24T09:31:02.045 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.045 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_encrypted_bytes": 944, 2026-02-24T09:31:02.045 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_encrypted_bytes": 976 2026-02-24T09:31:02.045 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.045 INFO:teuthology.orchestra.run.trial028.stdout: "AsyncMessenger::Worker-1": { 2026-02-24T09:31:02.045 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_messages": 400, 2026-02-24T09:31:02.045 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages": 714, 2026-02-24T09:31:02.045 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_bytes": 135502, 2026-02-24T09:31:02.045 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_bytes": 616438, 2026-02-24T09:31:02.045 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_created_connections": 6, 2026-02-24T09:31:02.045 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_active_connections": 4, 2026-02-24T09:31:02.046 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_total_time": 0.065817823, 2026-02-24T09:31:02.046 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_send_time": 0.046385553, 2026-02-24T09:31:02.046 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_recv_time": 0.020922155, 2026-02-24T09:31:02.046 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_fast_dispatch_time": 0.000074259, 2026-02-24T09:31:02.046 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages_queue_lat": { 2026-02-24T09:31:02.046 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 715, 2026-02-24T09:31:02.046 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.031477111, 2026-02-24T09:31:02.046 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000044023 2026-02-24T09:31:02.046 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.046 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_handle_ack_lat": { 2026-02-24T09:31:02.046 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 914, 2026-02-24T09:31:02.046 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000099130, 2026-02-24T09:31:02.047 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000108 2026-02-24T09:31:02.047 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.047 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_encrypted_bytes": 160, 2026-02-24T09:31:02.047 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_encrypted_bytes": 380416 2026-02-24T09:31:02.047 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.047 INFO:teuthology.orchestra.run.trial028.stdout: "AsyncMessenger::Worker-2": { 2026-02-24T09:31:02.047 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_messages": 314, 2026-02-24T09:31:02.047 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages": 347, 2026-02-24T09:31:02.047 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_bytes": 904468, 2026-02-24T09:31:02.047 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_bytes": 225693, 2026-02-24T09:31:02.047 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_created_connections": 9, 2026-02-24T09:31:02.047 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_active_connections": 7, 2026-02-24T09:31:02.047 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_total_time": 0.039645254, 2026-02-24T09:31:02.048 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_send_time": 0.021652661, 2026-02-24T09:31:02.048 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_recv_time": 0.023291412, 2026-02-24T09:31:02.048 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_fast_dispatch_time": 0.000086923, 2026-02-24T09:31:02.048 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages_queue_lat": { 2026-02-24T09:31:02.048 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 347, 2026-02-24T09:31:02.048 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.029719876, 2026-02-24T09:31:02.048 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000085648 2026-02-24T09:31:02.048 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.048 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_handle_ack_lat": { 2026-02-24T09:31:02.048 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 64, 2026-02-24T09:31:02.048 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000004510, 2026-02-24T09:31:02.048 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000070 2026-02-24T09:31:02.048 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.049 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_encrypted_bytes": 897856, 2026-02-24T09:31:02.049 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_encrypted_bytes": 148368 2026-02-24T09:31:02.049 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.049 INFO:teuthology.orchestra.run.trial028.stdout: "cct": { 2026-02-24T09:31:02.049 INFO:teuthology.orchestra.run.trial028.stdout: "total_workers": 1, 2026-02-24T09:31:02.049 INFO:teuthology.orchestra.run.trial028.stdout: "unhealthy_workers": 0 2026-02-24T09:31:02.049 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.049 INFO:teuthology.orchestra.run.trial028.stdout: "finisher-MDSRank": { 2026-02-24T09:31:02.049 INFO:teuthology.orchestra.run.trial028.stdout: "queue_len": 0, 2026-02-24T09:31:02.049 INFO:teuthology.orchestra.run.trial028.stdout: "complete_latency": { 2026-02-24T09:31:02.049 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 49, 2026-02-24T09:31:02.049 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.001346165, 2026-02-24T09:31:02.049 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000027472 2026-02-24T09:31:02.049 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:02.049 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.050 INFO:teuthology.orchestra.run.trial028.stdout: "finisher-PurgeQueue": { 2026-02-24T09:31:02.050 INFO:teuthology.orchestra.run.trial028.stdout: "queue_len": 0, 2026-02-24T09:31:02.050 INFO:teuthology.orchestra.run.trial028.stdout: "complete_latency": { 2026-02-24T09:31:02.050 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 2, 2026-02-24T09:31:02.050 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000012694, 2026-02-24T09:31:02.050 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000006347 2026-02-24T09:31:02.050 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:02.050 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.050 INFO:teuthology.orchestra.run.trial028.stdout: "mds": { 2026-02-24T09:31:02.050 INFO:teuthology.orchestra.run.trial028.stdout: "request": 4, 2026-02-24T09:31:02.050 INFO:teuthology.orchestra.run.trial028.stdout: "reply": 3, 2026-02-24T09:31:02.050 INFO:teuthology.orchestra.run.trial028.stdout: "reply_latency": { 2026-02-24T09:31:02.050 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 3, 2026-02-24T09:31:02.050 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.001836527, 2026-02-24T09:31:02.050 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000612175 2026-02-24T09:31:02.051 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.051 INFO:teuthology.orchestra.run.trial028.stdout: "slow_reply": 0, 2026-02-24T09:31:02.051 INFO:teuthology.orchestra.run.trial028.stdout: "forward": 1, 2026-02-24T09:31:02.051 INFO:teuthology.orchestra.run.trial028.stdout: "dir_fetch_complete": 0, 2026-02-24T09:31:02.051 INFO:teuthology.orchestra.run.trial028.stdout: "dir_fetch_keys": 0, 2026-02-24T09:31:02.051 INFO:teuthology.orchestra.run.trial028.stdout: "dir_commit": 11, 2026-02-24T09:31:02.051 INFO:teuthology.orchestra.run.trial028.stdout: "dir_split": 0, 2026-02-24T09:31:02.051 INFO:teuthology.orchestra.run.trial028.stdout: "dir_merge": 0, 2026-02-24T09:31:02.051 INFO:teuthology.orchestra.run.trial028.stdout: "inodes": 16, 2026-02-24T09:31:02.051 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_top": 0, 2026-02-24T09:31:02.051 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_bottom": 16, 2026-02-24T09:31:02.051 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_pin_tail": 0, 2026-02-24T09:31:02.051 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_pinned": 13, 2026-02-24T09:31:02.051 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_expired": 4, 2026-02-24T09:31:02.052 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_with_caps": 3, 2026-02-24T09:31:02.052 INFO:teuthology.orchestra.run.trial028.stdout: "caps": 3, 2026-02-24T09:31:02.052 INFO:teuthology.orchestra.run.trial028.stdout: "subtrees": 3, 2026-02-24T09:31:02.052 INFO:teuthology.orchestra.run.trial028.stdout: "traverse": 12, 2026-02-24T09:31:02.052 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_hit": 8, 2026-02-24T09:31:02.052 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_forward": 1, 2026-02-24T09:31:02.052 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_discover": 3, 2026-02-24T09:31:02.052 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_dir_fetch": 0, 2026-02-24T09:31:02.052 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_remote_ino": 0, 2026-02-24T09:31:02.052 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_lock": 0, 2026-02-24T09:31:02.052 INFO:teuthology.orchestra.run.trial028.stdout: "load_cent": 0, 2026-02-24T09:31:02.052 INFO:teuthology.orchestra.run.trial028.stdout: "q": 0, 2026-02-24T09:31:02.052 INFO:teuthology.orchestra.run.trial028.stdout: "exported": 0, 2026-02-24T09:31:02.052 INFO:teuthology.orchestra.run.trial028.stdout: "exported_inodes": 0, 2026-02-24T09:31:02.052 INFO:teuthology.orchestra.run.trial028.stdout: "imported": 0, 2026-02-24T09:31:02.052 INFO:teuthology.orchestra.run.trial028.stdout: "imported_inodes": 0, 2026-02-24T09:31:02.052 INFO:teuthology.orchestra.run.trial028.stdout: "openino_dir_fetch": 0, 2026-02-24T09:31:02.053 INFO:teuthology.orchestra.run.trial028.stdout: "openino_backtrace_fetch": 0, 2026-02-24T09:31:02.053 INFO:teuthology.orchestra.run.trial028.stdout: "openino_peer_discover": 0, 2026-02-24T09:31:02.053 INFO:teuthology.orchestra.run.trial028.stdout: "root_rfiles": 4, 2026-02-24T09:31:02.053 INFO:teuthology.orchestra.run.trial028.stdout: "root_rbytes": 234, 2026-02-24T09:31:02.053 INFO:teuthology.orchestra.run.trial028.stdout: "root_rsnaps": 0, 2026-02-24T09:31:02.053 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_backtrace_fetch": 0, 2026-02-24T09:31:02.053 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_set_tag": 0, 2026-02-24T09:31:02.053 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_backtrace_repaired": 0, 2026-02-24T09:31:02.053 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_inotable_repaired": 0, 2026-02-24T09:31:02.053 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_dir_inodes": 0, 2026-02-24T09:31:02.053 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_dir_base_inodes": 0, 2026-02-24T09:31:02.053 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_dirfrag_rstats": 0, 2026-02-24T09:31:02.053 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_file_inodes": 0, 2026-02-24T09:31:02.053 INFO:teuthology.orchestra.run.trial028.stdout: "handle_inode_file_caps": 0, 2026-02-24T09:31:02.053 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_revoke": 2, 2026-02-24T09:31:02.053 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_grant": 0, 2026-02-24T09:31:02.053 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_trunc": 0, 2026-02-24T09:31:02.054 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_flushsnap_ack": 0, 2026-02-24T09:31:02.054 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_flush_ack": 0, 2026-02-24T09:31:02.054 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_caps": 2, 2026-02-24T09:31:02.054 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_caps_dirty": 0, 2026-02-24T09:31:02.054 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_cap_release": 0, 2026-02-24T09:31:02.054 INFO:teuthology.orchestra.run.trial028.stdout: "process_request_cap_release": 0 2026-02-24T09:31:02.054 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.054 INFO:teuthology.orchestra.run.trial028.stdout: "mds_cache": { 2026-02-24T09:31:02.054 INFO:teuthology.orchestra.run.trial028.stdout: "dir_update": 0, 2026-02-24T09:31:02.054 INFO:teuthology.orchestra.run.trial028.stdout: "dir_update_receipt": 11, 2026-02-24T09:31:02.054 INFO:teuthology.orchestra.run.trial028.stdout: "dir_try_discover": 7, 2026-02-24T09:31:02.054 INFO:teuthology.orchestra.run.trial028.stdout: "dir_send_discover": 8, 2026-02-24T09:31:02.054 INFO:teuthology.orchestra.run.trial028.stdout: "dir_handle_discover": 0, 2026-02-24T09:31:02.054 INFO:teuthology.orchestra.run.trial028.stdout: "num_strays": 0, 2026-02-24T09:31:02.054 INFO:teuthology.orchestra.run.trial028.stdout: "num_strays_delayed": 0, 2026-02-24T09:31:02.054 INFO:teuthology.orchestra.run.trial028.stdout: "num_strays_enqueuing": 0, 2026-02-24T09:31:02.054 INFO:teuthology.orchestra.run.trial028.stdout: "strays_created": 0, 2026-02-24T09:31:02.055 INFO:teuthology.orchestra.run.trial028.stdout: "strays_enqueued": 0, 2026-02-24T09:31:02.055 INFO:teuthology.orchestra.run.trial028.stdout: "strays_reintegrated": 0, 2026-02-24T09:31:02.055 INFO:teuthology.orchestra.run.trial028.stdout: "strays_migrated": 0, 2026-02-24T09:31:02.055 INFO:teuthology.orchestra.run.trial028.stdout: "num_recovering_processing": 0, 2026-02-24T09:31:02.055 INFO:teuthology.orchestra.run.trial028.stdout: "num_recovering_enqueued": 0, 2026-02-24T09:31:02.055 INFO:teuthology.orchestra.run.trial028.stdout: "num_recovering_prioritized": 0, 2026-02-24T09:31:02.055 INFO:teuthology.orchestra.run.trial028.stdout: "recovery_started": 0, 2026-02-24T09:31:02.055 INFO:teuthology.orchestra.run.trial028.stdout: "recovery_completed": 0, 2026-02-24T09:31:02.055 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_quiesce_path": 0, 2026-02-24T09:31:02.055 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_quiesce_inode": 0, 2026-02-24T09:31:02.055 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_enqueue_scrub": 0, 2026-02-24T09:31:02.055 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_exportdir": 0, 2026-02-24T09:31:02.055 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_flush": 0, 2026-02-24T09:31:02.055 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_fragmentdir": 0, 2026-02-24T09:31:02.055 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_fragstats": 0, 2026-02-24T09:31:02.055 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_inodestats": 0, 2026-02-24T09:31:02.055 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_started": 0, 2026-02-24T09:31:02.056 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_succeeded": 0, 2026-02-24T09:31:02.056 INFO:teuthology.orchestra.run.trial028.stdout: "uninline_write_failed": 0 2026-02-24T09:31:02.056 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.056 INFO:teuthology.orchestra.run.trial028.stdout: "mds_log": { 2026-02-24T09:31:02.056 INFO:teuthology.orchestra.run.trial028.stdout: "evlrg": 0, 2026-02-24T09:31:02.056 INFO:teuthology.orchestra.run.trial028.stdout: "evadd": 5, 2026-02-24T09:31:02.056 INFO:teuthology.orchestra.run.trial028.stdout: "evex": 0, 2026-02-24T09:31:02.056 INFO:teuthology.orchestra.run.trial028.stdout: "evtrm": 0, 2026-02-24T09:31:02.056 INFO:teuthology.orchestra.run.trial028.stdout: "ev": 5, 2026-02-24T09:31:02.056 INFO:teuthology.orchestra.run.trial028.stdout: "evexg": 0, 2026-02-24T09:31:02.056 INFO:teuthology.orchestra.run.trial028.stdout: "evexd": 0, 2026-02-24T09:31:02.056 INFO:teuthology.orchestra.run.trial028.stdout: "segadd": 2, 2026-02-24T09:31:02.056 INFO:teuthology.orchestra.run.trial028.stdout: "segex": 0, 2026-02-24T09:31:02.056 INFO:teuthology.orchestra.run.trial028.stdout: "segtrm": 0, 2026-02-24T09:31:02.056 INFO:teuthology.orchestra.run.trial028.stdout: "seg": 2, 2026-02-24T09:31:02.056 INFO:teuthology.orchestra.run.trial028.stdout: "segmjr": 2, 2026-02-24T09:31:02.056 INFO:teuthology.orchestra.run.trial028.stdout: "segexg": 0, 2026-02-24T09:31:02.056 INFO:teuthology.orchestra.run.trial028.stdout: "segexd": 0, 2026-02-24T09:31:02.056 INFO:teuthology.orchestra.run.trial028.stdout: "expos": 4194304, 2026-02-24T09:31:02.057 INFO:teuthology.orchestra.run.trial028.stdout: "wrpos": 4195956, 2026-02-24T09:31:02.057 INFO:teuthology.orchestra.run.trial028.stdout: "rdpos": 0, 2026-02-24T09:31:02.057 INFO:teuthology.orchestra.run.trial028.stdout: "jlat": { 2026-02-24T09:31:02.057 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 4, 2026-02-24T09:31:02.057 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.004713078, 2026-02-24T09:31:02.057 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.001178269 2026-02-24T09:31:02.057 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.057 INFO:teuthology.orchestra.run.trial028.stdout: "replayed": 0 2026-02-24T09:31:02.057 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.057 INFO:teuthology.orchestra.run.trial028.stdout: "mds_mem": { 2026-02-24T09:31:02.057 INFO:teuthology.orchestra.run.trial028.stdout: "ino": 20, 2026-02-24T09:31:02.057 INFO:teuthology.orchestra.run.trial028.stdout: "ino+": 22, 2026-02-24T09:31:02.057 INFO:teuthology.orchestra.run.trial028.stdout: "ino-": 2, 2026-02-24T09:31:02.057 INFO:teuthology.orchestra.run.trial028.stdout: "dir": 19, 2026-02-24T09:31:02.057 INFO:teuthology.orchestra.run.trial028.stdout: "dir+": 23, 2026-02-24T09:31:02.057 INFO:teuthology.orchestra.run.trial028.stdout: "dir-": 4, 2026-02-24T09:31:02.057 INFO:teuthology.orchestra.run.trial028.stdout: "dn": 16, 2026-02-24T09:31:02.057 INFO:teuthology.orchestra.run.trial028.stdout: "dn+": 20, 2026-02-24T09:31:02.058 INFO:teuthology.orchestra.run.trial028.stdout: "dn-": 4, 2026-02-24T09:31:02.058 INFO:teuthology.orchestra.run.trial028.stdout: "cap": 3, 2026-02-24T09:31:02.058 INFO:teuthology.orchestra.run.trial028.stdout: "cap+": 3, 2026-02-24T09:31:02.058 INFO:teuthology.orchestra.run.trial028.stdout: "cap-": 0, 2026-02-24T09:31:02.058 INFO:teuthology.orchestra.run.trial028.stdout: "rss": 48932, 2026-02-24T09:31:02.058 INFO:teuthology.orchestra.run.trial028.stdout: "heap": 259751936 2026-02-24T09:31:02.058 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.058 INFO:teuthology.orchestra.run.trial028.stdout: "mds_server": { 2026-02-24T09:31:02.058 INFO:teuthology.orchestra.run.trial028.stdout: "dispatch_client_request": 11, 2026-02-24T09:31:02.058 INFO:teuthology.orchestra.run.trial028.stdout: "dispatch_server_request": 0, 2026-02-24T09:31:02.058 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_request": 4, 2026-02-24T09:31:02.058 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_session": 15, 2026-02-24T09:31:02.058 INFO:teuthology.orchestra.run.trial028.stdout: "handle_peer_request": 3, 2026-02-24T09:31:02.058 INFO:teuthology.orchestra.run.trial028.stdout: "req_create_latency": { 2026-02-24T09:31:02.058 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.058 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.058 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.058 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.058 INFO:teuthology.orchestra.run.trial028.stdout: "req_getattr_latency": { 2026-02-24T09:31:02.058 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 3, 2026-02-24T09:31:02.059 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.001836527, 2026-02-24T09:31:02.059 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000612175 2026-02-24T09:31:02.059 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.059 INFO:teuthology.orchestra.run.trial028.stdout: "req_getfilelock_latency": { 2026-02-24T09:31:02.059 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.059 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.059 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.059 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.059 INFO:teuthology.orchestra.run.trial028.stdout: "req_link_latency": { 2026-02-24T09:31:02.059 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.059 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.059 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.059 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.059 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookup_latency": { 2026-02-24T09:31:02.059 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.059 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.059 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.059 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.059 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookuphash_latency": { 2026-02-24T09:31:02.060 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.060 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.060 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.060 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.060 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupino_latency": { 2026-02-24T09:31:02.060 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.060 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.060 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.060 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.060 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupname_latency": { 2026-02-24T09:31:02.060 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.060 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.060 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.060 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.060 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupparent_latency": { 2026-02-24T09:31:02.060 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.060 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.060 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.060 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.061 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupsnap_latency": { 2026-02-24T09:31:02.061 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.061 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.061 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.061 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.061 INFO:teuthology.orchestra.run.trial028.stdout: "req_lssnap_latency": { 2026-02-24T09:31:02.061 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.061 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.061 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.061 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.061 INFO:teuthology.orchestra.run.trial028.stdout: "req_mkdir_latency": { 2026-02-24T09:31:02.061 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.061 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.061 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.061 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.061 INFO:teuthology.orchestra.run.trial028.stdout: "req_mknod_latency": { 2026-02-24T09:31:02.061 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.061 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.061 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.062 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.062 INFO:teuthology.orchestra.run.trial028.stdout: "req_mksnap_latency": { 2026-02-24T09:31:02.062 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.062 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.062 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.062 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.062 INFO:teuthology.orchestra.run.trial028.stdout: "req_open_latency": { 2026-02-24T09:31:02.062 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.062 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.062 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.062 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.062 INFO:teuthology.orchestra.run.trial028.stdout: "req_readdir_latency": { 2026-02-24T09:31:02.062 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.062 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.062 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.062 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.062 INFO:teuthology.orchestra.run.trial028.stdout: "req_rename_latency": { 2026-02-24T09:31:02.062 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.062 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.062 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.063 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.063 INFO:teuthology.orchestra.run.trial028.stdout: "req_renamesnap_latency": { 2026-02-24T09:31:02.063 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.063 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.063 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.063 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.063 INFO:teuthology.orchestra.run.trial028.stdout: "req_snapdiff_latency": { 2026-02-24T09:31:02.063 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.063 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.063 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.063 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.063 INFO:teuthology.orchestra.run.trial028.stdout: "req_rmdir_latency": { 2026-02-24T09:31:02.063 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.063 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.063 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.063 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.063 INFO:teuthology.orchestra.run.trial028.stdout: "req_rmsnap_latency": { 2026-02-24T09:31:02.063 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.063 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.064 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.064 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.064 INFO:teuthology.orchestra.run.trial028.stdout: "req_rmxattr_latency": { 2026-02-24T09:31:02.064 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.064 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.064 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.064 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.064 INFO:teuthology.orchestra.run.trial028.stdout: "req_setattr_latency": { 2026-02-24T09:31:02.064 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.064 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.064 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.064 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.064 INFO:teuthology.orchestra.run.trial028.stdout: "req_setdirlayout_latency": { 2026-02-24T09:31:02.064 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.064 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.064 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.064 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.064 INFO:teuthology.orchestra.run.trial028.stdout: "req_setfilelock_latency": { 2026-02-24T09:31:02.064 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.064 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.064 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.064 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.065 INFO:teuthology.orchestra.run.trial028.stdout: "req_setlayout_latency": { 2026-02-24T09:31:02.065 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.065 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.065 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.065 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.065 INFO:teuthology.orchestra.run.trial028.stdout: "req_setxattr_latency": { 2026-02-24T09:31:02.065 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.065 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.065 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.065 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.065 INFO:teuthology.orchestra.run.trial028.stdout: "req_symlink_latency": { 2026-02-24T09:31:02.065 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.065 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.065 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.065 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.065 INFO:teuthology.orchestra.run.trial028.stdout: "req_unlink_latency": { 2026-02-24T09:31:02.065 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.065 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.065 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.065 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.065 INFO:teuthology.orchestra.run.trial028.stdout: "cap_revoke_eviction": 0, 2026-02-24T09:31:02.066 INFO:teuthology.orchestra.run.trial028.stdout: "cache_trim_throttle": 0, 2026-02-24T09:31:02.066 INFO:teuthology.orchestra.run.trial028.stdout: "session_recall_throttle": 0, 2026-02-24T09:31:02.066 INFO:teuthology.orchestra.run.trial028.stdout: "session_recall_throttle2o": 0, 2026-02-24T09:31:02.066 INFO:teuthology.orchestra.run.trial028.stdout: "global_recall_throttle": 0, 2026-02-24T09:31:02.066 INFO:teuthology.orchestra.run.trial028.stdout: "cap_acquisition_throttle": 0, 2026-02-24T09:31:02.066 INFO:teuthology.orchestra.run.trial028.stdout: "req_getvxattr_latency": { 2026-02-24T09:31:02.066 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.066 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.066 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.066 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.066 INFO:teuthology.orchestra.run.trial028.stdout: "req_blockdiff_latency": { 2026-02-24T09:31:02.066 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.066 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.066 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.066 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:02.066 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.066 INFO:teuthology.orchestra.run.trial028.stdout: "mds_sessions": { 2026-02-24T09:31:02.066 INFO:teuthology.orchestra.run.trial028.stdout: "session_count": 1, 2026-02-24T09:31:02.066 INFO:teuthology.orchestra.run.trial028.stdout: "session_add": 2, 2026-02-24T09:31:02.066 INFO:teuthology.orchestra.run.trial028.stdout: "session_remove": 1, 2026-02-24T09:31:02.066 INFO:teuthology.orchestra.run.trial028.stdout: "sessions_open": 1, 2026-02-24T09:31:02.066 INFO:teuthology.orchestra.run.trial028.stdout: "sessions_stale": 0, 2026-02-24T09:31:02.067 INFO:teuthology.orchestra.run.trial028.stdout: "total_load": 2, 2026-02-24T09:31:02.067 INFO:teuthology.orchestra.run.trial028.stdout: "average_load": 1, 2026-02-24T09:31:02.067 INFO:teuthology.orchestra.run.trial028.stdout: "avg_session_uptime": 803, 2026-02-24T09:31:02.067 INFO:teuthology.orchestra.run.trial028.stdout: "mdthresh_evicted": 0 2026-02-24T09:31:02.067 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.067 INFO:teuthology.orchestra.run.trial028.stdout: "mempool": { 2026-02-24T09:31:02.067 INFO:teuthology.orchestra.run.trial028.stdout: "bloom_filter_bytes": 0, 2026-02-24T09:31:02.067 INFO:teuthology.orchestra.run.trial028.stdout: "bloom_filter_items": 0, 2026-02-24T09:31:02.067 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_alloc_bytes": 0, 2026-02-24T09:31:02.067 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_alloc_items": 0, 2026-02-24T09:31:02.067 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_data_bytes": 0, 2026-02-24T09:31:02.067 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_data_items": 0, 2026-02-24T09:31:02.067 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_onode_bytes": 0, 2026-02-24T09:31:02.067 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_onode_items": 0, 2026-02-24T09:31:02.067 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_meta_bytes": 0, 2026-02-24T09:31:02.067 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_meta_items": 0, 2026-02-24T09:31:02.067 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_other_bytes": 0, 2026-02-24T09:31:02.067 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_other_items": 0, 2026-02-24T09:31:02.067 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_buffer_bytes": 0, 2026-02-24T09:31:02.067 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_buffer_items": 0, 2026-02-24T09:31:02.067 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_extent_bytes": 0, 2026-02-24T09:31:02.067 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_extent_items": 0, 2026-02-24T09:31:02.067 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_blob_bytes": 0, 2026-02-24T09:31:02.068 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_blob_items": 0, 2026-02-24T09:31:02.068 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_shared_blob_bytes": 0, 2026-02-24T09:31:02.068 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_shared_blob_items": 0, 2026-02-24T09:31:02.068 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_inline_bl_bytes": 0, 2026-02-24T09:31:02.068 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_inline_bl_items": 0, 2026-02-24T09:31:02.068 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_bytes": 0, 2026-02-24T09:31:02.068 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_items": 0, 2026-02-24T09:31:02.068 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_txc_bytes": 0, 2026-02-24T09:31:02.068 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_txc_items": 0, 2026-02-24T09:31:02.068 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_deferred_bytes": 0, 2026-02-24T09:31:02.068 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_deferred_items": 0, 2026-02-24T09:31:02.068 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_bytes": 0, 2026-02-24T09:31:02.068 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_items": 0, 2026-02-24T09:31:02.068 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_bytes": 0, 2026-02-24T09:31:02.068 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_items": 0, 2026-02-24T09:31:02.068 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_reader_bytes": 0, 2026-02-24T09:31:02.068 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_reader_items": 0, 2026-02-24T09:31:02.068 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_writer_bytes": 0, 2026-02-24T09:31:02.068 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_writer_items": 0, 2026-02-24T09:31:02.068 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_anon_bytes": 247116, 2026-02-24T09:31:02.068 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_anon_items": 84, 2026-02-24T09:31:02.068 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_meta_bytes": 0, 2026-02-24T09:31:02.068 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_meta_items": 0, 2026-02-24T09:31:02.068 INFO:teuthology.orchestra.run.trial028.stdout: "osd_bytes": 0, 2026-02-24T09:31:02.069 INFO:teuthology.orchestra.run.trial028.stdout: "osd_items": 0, 2026-02-24T09:31:02.069 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mapbl_bytes": 0, 2026-02-24T09:31:02.069 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mapbl_items": 0, 2026-02-24T09:31:02.069 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pglog_bytes": 0, 2026-02-24T09:31:02.069 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pglog_items": 0, 2026-02-24T09:31:02.069 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_bytes": 8272, 2026-02-24T09:31:02.069 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_items": 182, 2026-02-24T09:31:02.069 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_mapping_bytes": 0, 2026-02-24T09:31:02.069 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_mapping_items": 0, 2026-02-24T09:31:02.069 INFO:teuthology.orchestra.run.trial028.stdout: "pgmap_bytes": 0, 2026-02-24T09:31:02.069 INFO:teuthology.orchestra.run.trial028.stdout: "pgmap_items": 0, 2026-02-24T09:31:02.069 INFO:teuthology.orchestra.run.trial028.stdout: "mds_co_bytes": 88488, 2026-02-24T09:31:02.069 INFO:teuthology.orchestra.run.trial028.stdout: "mds_co_items": 973, 2026-02-24T09:31:02.069 INFO:teuthology.orchestra.run.trial028.stdout: "ec_extent_cache_bytes": 0, 2026-02-24T09:31:02.069 INFO:teuthology.orchestra.run.trial028.stdout: "ec_extent_cache_items": 0, 2026-02-24T09:31:02.069 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_1_bytes": 0, 2026-02-24T09:31:02.069 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_1_items": 0, 2026-02-24T09:31:02.069 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_2_bytes": 0, 2026-02-24T09:31:02.069 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_2_items": 0 2026-02-24T09:31:02.069 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.069 INFO:teuthology.orchestra.run.trial028.stdout: "objecter": { 2026-02-24T09:31:02.069 INFO:teuthology.orchestra.run.trial028.stdout: "op_active": 0, 2026-02-24T09:31:02.069 INFO:teuthology.orchestra.run.trial028.stdout: "op_laggy": 0, 2026-02-24T09:31:02.069 INFO:teuthology.orchestra.run.trial028.stdout: "op_send": 41, 2026-02-24T09:31:02.070 INFO:teuthology.orchestra.run.trial028.stdout: "op_send_bytes": 12223, 2026-02-24T09:31:02.070 INFO:teuthology.orchestra.run.trial028.stdout: "op_resend": 26, 2026-02-24T09:31:02.070 INFO:teuthology.orchestra.run.trial028.stdout: "op_reply": 41, 2026-02-24T09:31:02.070 INFO:teuthology.orchestra.run.trial028.stdout: "op_latency": { 2026-02-24T09:31:02.070 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 41, 2026-02-24T09:31:02.070 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.153998735, 2026-02-24T09:31:02.070 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.003756066 2026-02-24T09:31:02.070 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.070 INFO:teuthology.orchestra.run.trial028.stdout: "op_inflight": 0, 2026-02-24T09:31:02.070 INFO:teuthology.orchestra.run.trial028.stdout: "oplen_avg": { 2026-02-24T09:31:02.070 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 64, 2026-02-24T09:31:02.070 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 41 2026-02-24T09:31:02.070 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.070 INFO:teuthology.orchestra.run.trial028.stdout: "op": 41, 2026-02-24T09:31:02.070 INFO:teuthology.orchestra.run.trial028.stdout: "op_r": 0, 2026-02-24T09:31:02.070 INFO:teuthology.orchestra.run.trial028.stdout: "op_w": 41, 2026-02-24T09:31:02.070 INFO:teuthology.orchestra.run.trial028.stdout: "op_rmw": 0, 2026-02-24T09:31:02.070 INFO:teuthology.orchestra.run.trial028.stdout: "op_pg": 0, 2026-02-24T09:31:02.070 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_stat": 0, 2026-02-24T09:31:02.070 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_create": 10, 2026-02-24T09:31:02.070 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_read": 0, 2026-02-24T09:31:02.070 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_write": 4, 2026-02-24T09:31:02.070 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_writefull": 7, 2026-02-24T09:31:02.070 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_writesame": 0, 2026-02-24T09:31:02.070 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_append": 0, 2026-02-24T09:31:02.070 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_zero": 0, 2026-02-24T09:31:02.071 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_truncate": 0, 2026-02-24T09:31:02.071 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_delete": 6, 2026-02-24T09:31:02.071 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_mapext": 0, 2026-02-24T09:31:02.071 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_sparse_read": 0, 2026-02-24T09:31:02.071 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_clonerange": 0, 2026-02-24T09:31:02.071 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_getxattr": 0, 2026-02-24T09:31:02.071 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_setxattr": 20, 2026-02-24T09:31:02.071 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_cmpxattr": 0, 2026-02-24T09:31:02.071 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_rmxattr": 0, 2026-02-24T09:31:02.071 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_resetxattrs": 0, 2026-02-24T09:31:02.071 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_call": 0, 2026-02-24T09:31:02.071 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_watch": 0, 2026-02-24T09:31:02.071 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_notify": 0, 2026-02-24T09:31:02.071 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_src_cmpxattr": 0, 2026-02-24T09:31:02.071 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_pgls": 0, 2026-02-24T09:31:02.071 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_pgls_filter": 0, 2026-02-24T09:31:02.071 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_other": 0, 2026-02-24T09:31:02.071 INFO:teuthology.orchestra.run.trial028.stdout: "linger_active": 0, 2026-02-24T09:31:02.071 INFO:teuthology.orchestra.run.trial028.stdout: "linger_send": 0, 2026-02-24T09:31:02.071 INFO:teuthology.orchestra.run.trial028.stdout: "linger_resend": 0, 2026-02-24T09:31:02.071 INFO:teuthology.orchestra.run.trial028.stdout: "linger_ping": 0, 2026-02-24T09:31:02.071 INFO:teuthology.orchestra.run.trial028.stdout: "poolop_active": 0, 2026-02-24T09:31:02.071 INFO:teuthology.orchestra.run.trial028.stdout: "poolop_send": 0, 2026-02-24T09:31:02.071 INFO:teuthology.orchestra.run.trial028.stdout: "poolop_resend": 0, 2026-02-24T09:31:02.071 INFO:teuthology.orchestra.run.trial028.stdout: "poolstat_active": 0, 2026-02-24T09:31:02.071 INFO:teuthology.orchestra.run.trial028.stdout: "poolstat_send": 0, 2026-02-24T09:31:02.072 INFO:teuthology.orchestra.run.trial028.stdout: "poolstat_resend": 0, 2026-02-24T09:31:02.072 INFO:teuthology.orchestra.run.trial028.stdout: "statfs_active": 0, 2026-02-24T09:31:02.072 INFO:teuthology.orchestra.run.trial028.stdout: "statfs_send": 0, 2026-02-24T09:31:02.072 INFO:teuthology.orchestra.run.trial028.stdout: "statfs_resend": 0, 2026-02-24T09:31:02.072 INFO:teuthology.orchestra.run.trial028.stdout: "command_active": 0, 2026-02-24T09:31:02.072 INFO:teuthology.orchestra.run.trial028.stdout: "command_send": 0, 2026-02-24T09:31:02.072 INFO:teuthology.orchestra.run.trial028.stdout: "command_resend": 0, 2026-02-24T09:31:02.072 INFO:teuthology.orchestra.run.trial028.stdout: "map_epoch": 110, 2026-02-24T09:31:02.072 INFO:teuthology.orchestra.run.trial028.stdout: "map_full": 0, 2026-02-24T09:31:02.072 INFO:teuthology.orchestra.run.trial028.stdout: "map_inc": 18, 2026-02-24T09:31:02.072 INFO:teuthology.orchestra.run.trial028.stdout: "osd_sessions": 9, 2026-02-24T09:31:02.072 INFO:teuthology.orchestra.run.trial028.stdout: "osd_session_open": 9, 2026-02-24T09:31:02.072 INFO:teuthology.orchestra.run.trial028.stdout: "osd_session_close": 0, 2026-02-24T09:31:02.072 INFO:teuthology.orchestra.run.trial028.stdout: "osd_laggy": 0, 2026-02-24T09:31:02.072 INFO:teuthology.orchestra.run.trial028.stdout: "omap_wr": 16, 2026-02-24T09:31:02.072 INFO:teuthology.orchestra.run.trial028.stdout: "omap_rd": 0, 2026-02-24T09:31:02.072 INFO:teuthology.orchestra.run.trial028.stdout: "omap_del": 1, 2026-02-24T09:31:02.072 INFO:teuthology.orchestra.run.trial028.stdout: "replica_read_sent": 0, 2026-02-24T09:31:02.072 INFO:teuthology.orchestra.run.trial028.stdout: "replica_read_bounced": 0, 2026-02-24T09:31:02.072 INFO:teuthology.orchestra.run.trial028.stdout: "replica_read_completed": 0 2026-02-24T09:31:02.072 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.072 INFO:teuthology.orchestra.run.trial028.stdout: "oft": { 2026-02-24T09:31:02.072 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_objs": 1, 2026-02-24T09:31:02.072 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_kv_pairs": 0, 2026-02-24T09:31:02.072 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_updates": 0, 2026-02-24T09:31:02.072 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_removes": 0 2026-02-24T09:31:02.072 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.073 INFO:teuthology.orchestra.run.trial028.stdout: "purge_queue": { 2026-02-24T09:31:02.073 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing_ops": 0, 2026-02-24T09:31:02.073 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing_ops_high_water": 0, 2026-02-24T09:31:02.073 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing": 0, 2026-02-24T09:31:02.073 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing_high_water": 0, 2026-02-24T09:31:02.073 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executed_ops": 0, 2026-02-24T09:31:02.073 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executed": 0, 2026-02-24T09:31:02.073 INFO:teuthology.orchestra.run.trial028.stdout: "pq_item_in_journal": 0 2026-02-24T09:31:02.073 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.073 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-msgr_dispatch_throttler-mds": { 2026-02-24T09:31:02.073 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-24T09:31:02.073 INFO:teuthology.orchestra.run.trial028.stdout: "max": 104857600, 2026-02-24T09:31:02.073 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-24T09:31:02.073 INFO:teuthology.orchestra.run.trial028.stdout: "get": 742, 2026-02-24T09:31:02.073 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 965652, 2026-02-24T09:31:02.073 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-24T09:31:02.073 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 742, 2026-02-24T09:31:02.073 INFO:teuthology.orchestra.run.trial028.stdout: "take": 0, 2026-02-24T09:31:02.073 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 0, 2026-02-24T09:31:02.073 INFO:teuthology.orchestra.run.trial028.stdout: "put": 742, 2026-02-24T09:31:02.073 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 965652, 2026-02-24T09:31:02.073 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-24T09:31:02.073 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.073 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.073 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.074 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:02.074 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.074 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-objecter_bytes": { 2026-02-24T09:31:02.074 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-24T09:31:02.074 INFO:teuthology.orchestra.run.trial028.stdout: "max": 104857600, 2026-02-24T09:31:02.074 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-24T09:31:02.074 INFO:teuthology.orchestra.run.trial028.stdout: "get": 0, 2026-02-24T09:31:02.074 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 0, 2026-02-24T09:31:02.074 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-24T09:31:02.074 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 0, 2026-02-24T09:31:02.074 INFO:teuthology.orchestra.run.trial028.stdout: "take": 41, 2026-02-24T09:31:02.074 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 12223, 2026-02-24T09:31:02.074 INFO:teuthology.orchestra.run.trial028.stdout: "put": 41, 2026-02-24T09:31:02.074 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 12223, 2026-02-24T09:31:02.074 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-24T09:31:02.074 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.074 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.074 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.074 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:02.074 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.074 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-objecter_ops": { 2026-02-24T09:31:02.074 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-24T09:31:02.074 INFO:teuthology.orchestra.run.trial028.stdout: "max": 1024, 2026-02-24T09:31:02.074 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-24T09:31:02.074 INFO:teuthology.orchestra.run.trial028.stdout: "get": 0, 2026-02-24T09:31:02.074 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 0, 2026-02-24T09:31:02.074 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-24T09:31:02.075 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 0, 2026-02-24T09:31:02.075 INFO:teuthology.orchestra.run.trial028.stdout: "take": 41, 2026-02-24T09:31:02.075 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 41, 2026-02-24T09:31:02.075 INFO:teuthology.orchestra.run.trial028.stdout: "put": 41, 2026-02-24T09:31:02.075 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 41, 2026-02-24T09:31:02.075 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-24T09:31:02.075 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.075 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.075 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.075 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:02.075 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.075 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-write_buf_throttle": { 2026-02-24T09:31:02.075 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-24T09:31:02.075 INFO:teuthology.orchestra.run.trial028.stdout: "max": 3758096384, 2026-02-24T09:31:02.075 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-24T09:31:02.075 INFO:teuthology.orchestra.run.trial028.stdout: "get": 0, 2026-02-24T09:31:02.075 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 0, 2026-02-24T09:31:02.075 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-24T09:31:02.075 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 0, 2026-02-24T09:31:02.075 INFO:teuthology.orchestra.run.trial028.stdout: "take": 0, 2026-02-24T09:31:02.075 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 0, 2026-02-24T09:31:02.075 INFO:teuthology.orchestra.run.trial028.stdout: "put": 0, 2026-02-24T09:31:02.075 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 0, 2026-02-24T09:31:02.075 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-24T09:31:02.075 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.075 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.075 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.075 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:02.076 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.076 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-write_buf_throttle-0x3de26640": { 2026-02-24T09:31:02.076 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-24T09:31:02.076 INFO:teuthology.orchestra.run.trial028.stdout: "max": 3758096384, 2026-02-24T09:31:02.076 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-24T09:31:02.076 INFO:teuthology.orchestra.run.trial028.stdout: "get": 5, 2026-02-24T09:31:02.076 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 1652, 2026-02-24T09:31:02.076 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-24T09:31:02.076 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 5, 2026-02-24T09:31:02.076 INFO:teuthology.orchestra.run.trial028.stdout: "take": 0, 2026-02-24T09:31:02.076 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 0, 2026-02-24T09:31:02.076 INFO:teuthology.orchestra.run.trial028.stdout: "put": 4, 2026-02-24T09:31:02.076 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 1652, 2026-02-24T09:31:02.076 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-24T09:31:02.076 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-24T09:31:02.076 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-24T09:31:02.076 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-24T09:31:02.076 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:02.076 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-24T09:31:02.076 INFO:teuthology.orchestra.run.trial028.stdout: "trackedop": { 2026-02-24T09:31:02.076 INFO:teuthology.orchestra.run.trial028.stdout: "slow_ops_count": 0 2026-02-24T09:31:02.076 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-24T09:31:02.076 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-24T09:31:02.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.035+0000 7f0730dd4640 1 -- 10.20.193.28:0/172037448 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f07040b58d0 msgr2=0x7f07040d5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:02.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.035+0000 7f0730dd4640 1 --2- 10.20.193.28:0/172037448 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f07040b58d0 0x7f07040d5d80 secure :-1 s=READY pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f072c123f40 tx=0x7f0714005f90 comp rx=0 tx=0).stop 2026-02-24T09:31:02.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.035+0000 7f0730dd4640 1 -- 10.20.193.28:0/172037448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f072c10f550 msgr2=0x7f072c11d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:02.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.035+0000 7f0730dd4640 1 --2- 10.20.193.28:0/172037448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f072c10f550 0x7f072c11d5a0 secure :-1 s=READY pgs=521 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07200098a0 tx=0x7f07200028d0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.035+0000 7f0730dd4640 1 -- 10.20.193.28:0/172037448 shutdown_connections 2026-02-24T09:31:02.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.035+0000 7f0730dd4640 1 --2- 10.20.193.28:0/172037448 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f07040b58d0 0x7f07040d5d80 unknown :-1 s=CLOSED pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.035+0000 7f0730dd4640 1 --2- 10.20.193.28:0/172037448 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f072c115740 0x7f072c122eb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.035+0000 7f0730dd4640 1 --2- 10.20.193.28:0/172037448 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f072c10ff40 0x7f072c11dae0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.035+0000 7f0730dd4640 1 --2- 10.20.193.28:0/172037448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f072c10f550 0x7f072c11d5a0 unknown :-1 s=CLOSED pgs=521 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.035+0000 7f0730dd4640 1 -- 10.20.193.28:0/172037448 >> 10.20.193.28:0/172037448 conn(0x7f072c0ece00 msgr2=0x7f072c10d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:02.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.035+0000 7f0730dd4640 1 -- 10.20.193.28:0/172037448 shutdown_connections 2026-02-24T09:31:02.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.035+0000 7f0730dd4640 1 -- 10.20.193.28:0/172037448 wait complete. 2026-02-24T09:31:02.078 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2026-02-24T09:31:02.078 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2026-02-24T09:31:02.078 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2026-02-24T09:31:02.078 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=11 2026-02-24T09:31:02.078 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=0 2026-02-24T09:31:02.078 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2026-02-24T09:31:02.078 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2026-02-24T09:31:02.078 DEBUG:tasks.check_counter:Getting stats from k 2026-02-24T09:31:02.078 DEBUG:tasks.check_counter:skipping mds.24710 2026-02-24T09:31:02.078 DEBUG:tasks.check_counter:Getting stats from c 2026-02-24T09:31:02.078 DEBUG:tasks.check_counter:skipping mds.24727 2026-02-24T09:31:02.078 DEBUG:tasks.check_counter:Getting stats from f 2026-02-24T09:31:02.078 DEBUG:tasks.check_counter:skipping mds.24721 2026-02-24T09:31:02.078 DEBUG:tasks.check_counter:Getting stats from i 2026-02-24T09:31:02.079 DEBUG:tasks.check_counter:skipping mds.24745 2026-02-24T09:31:02.079 DEBUG:tasks.check_counter:Getting stats from l 2026-02-24T09:31:02.079 DEBUG:tasks.check_counter:skipping mds.24691 2026-02-24T09:31:02.079 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2026-02-24T09:31:02.094 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2026-02-24T09:31:02.094 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-24T09:31:02.094 DEBUG:teuthology.orchestra.run.trial028:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-24T09:31:02.133 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-24T09:31:02.134 DEBUG:teuthology.orchestra.run.trial028:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-24T09:31:02.215 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd blocklist ls 2026-02-24T09:31:02.437 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:31:02.554 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:02 trial028 ceph-mon[40371]: pgmap v619: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 597 B/s wr, 7 op/s 2026-02-24T09:31:02.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.621+0000 7f24c7577640 1 -- 10.20.193.28:0/3968431350 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f24c8061570 msgr2=0x7f24c80619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:02.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.621+0000 7f24c7577640 1 --2- 10.20.193.28:0/3968431350 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f24c8061570 0x7f24c80619a0 secure :-1 s=READY pgs=119 gs=3 cs=0 l=1 c_cookie=5942905460250303965 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24b0009890 tx=0x7f24b002f120 comp rx=0 tx=0).stop 2026-02-24T09:31:02.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.621+0000 7f24c7577640 1 -- 10.20.193.28:0/3968431350 shutdown_connections 2026-02-24T09:31:02.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.621+0000 7f24c7577640 1 --2- 10.20.193.28:0/3968431350 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f24c8159ec0 0x7f24c817a2a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.621+0000 7f24c7577640 1 --2- 10.20.193.28:0/3968431350 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f24c8061570 0x7f24c80619a0 unknown :-1 s=CLOSED pgs=119 gs=3 cs=0 l=1 c_cookie=5942905460250303965 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.621+0000 7f24c7577640 1 --2- 10.20.193.28:0/3968431350 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f24c8062b60 0x7f24c8061030 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.621+0000 7f24c7577640 1 -- 10.20.193.28:0/3968431350 >> 10.20.193.28:0/3968431350 conn(0x7f24c80eac60 msgr2=0x7f24c810b070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:02.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.621+0000 7f24c7577640 1 -- 10.20.193.28:0/3968431350 shutdown_connections 2026-02-24T09:31:02.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.621+0000 7f24c7577640 1 -- 10.20.193.28:0/3968431350 wait complete. 2026-02-24T09:31:02.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.622+0000 7f24c7577640 1 Processor -- start 2026-02-24T09:31:02.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.622+0000 7f24c7577640 1 -- start start 2026-02-24T09:31:02.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.622+0000 7f24c7577640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f24c8061570 0x7f24c80f3000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:02.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.622+0000 7f24c7577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f24c8062b60 0x7f24c80f3540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:02.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.622+0000 7f24c7577640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f24c8159ec0 0x7f24c80f8910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:02.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.622+0000 7f24c7577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f24c80f8f30 con 0x7f24c8062b60 2026-02-24T09:31:02.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.622+0000 7f24c7577640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f24c80f90a0 con 0x7f24c8159ec0 2026-02-24T09:31:02.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.622+0000 7f24c7577640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f24c80f9260 con 0x7f24c8061570 2026-02-24T09:31:02.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.622+0000 7f24c5d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f24c8062b60 0x7f24c80f3540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:02.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.622+0000 7f24c6575640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f24c8061570 0x7f24c80f3000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:02.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.622+0000 7f24c6575640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f24c8061570 0x7f24c80f3000 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:51358/0 (socket says 10.20.193.28:51358) 2026-02-24T09:31:02.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.622+0000 7f24c6575640 1 -- 10.20.193.28:0/1676708202 learned_addr learned my addr 10.20.193.28:0/1676708202 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:31:02.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.622+0000 7f24c6d76640 1 --2- 10.20.193.28:0/1676708202 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f24c8159ec0 0x7f24c80f8910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:02.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.623+0000 7f24c5d74640 1 -- 10.20.193.28:0/1676708202 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f24c8061570 msgr2=0x7f24c80f3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:02.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.623+0000 7f24c5d74640 1 --2- 10.20.193.28:0/1676708202 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f24c8061570 0x7f24c80f3000 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.623+0000 7f24c5d74640 1 -- 10.20.193.28:0/1676708202 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f24c8159ec0 msgr2=0x7f24c80f8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:02.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.623+0000 7f24c5d74640 1 --2- 10.20.193.28:0/1676708202 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f24c8159ec0 0x7f24c80f8910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.623+0000 7f24c5d74640 1 -- 10.20.193.28:0/1676708202 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24b00094b0 con 0x7f24c8062b60 2026-02-24T09:31:02.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.623+0000 7f24c5d74640 1 --2- 10.20.193.28:0/1676708202 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f24c8062b60 0x7f24c80f3540 secure :-1 s=READY pgs=526 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24b0009890 tx=0x7f24b0004660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:02.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.623+0000 7f24af7fe640 1 -- 10.20.193.28:0/1676708202 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f24b003d070 con 0x7f24c8062b60 2026-02-24T09:31:02.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.623+0000 7f24c7577640 1 -- 10.20.193.28:0/1676708202 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24c80f94e0 con 0x7f24c8062b60 2026-02-24T09:31:02.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.623+0000 7f24af7fe640 1 -- 10.20.193.28:0/1676708202 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f24b0005d40 con 0x7f24c8062b60 2026-02-24T09:31:02.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.623+0000 7f24af7fe640 1 -- 10.20.193.28:0/1676708202 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f24b00373d0 con 0x7f24c8062b60 2026-02-24T09:31:02.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.623+0000 7f24c7577640 1 -- 10.20.193.28:0/1676708202 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24c80f9c20 con 0x7f24c8062b60 2026-02-24T09:31:02.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.624+0000 7f24c7577640 1 -- 10.20.193.28:0/1676708202 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f248c005300 con 0x7f24c8062b60 2026-02-24T09:31:02.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.626+0000 7f24af7fe640 1 -- 10.20.193.28:0/1676708202 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7f24b00416d0 con 0x7f24c8062b60 2026-02-24T09:31:02.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.627+0000 7f24af7fe640 1 --2- 10.20.193.28:0/1676708202 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f24a00b58d0 0x7f24a00d5d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:02.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.627+0000 7f24af7fe640 1 -- 10.20.193.28:0/1676708202 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 8513+0+0 (secure 0 0 0) 0x7f24b010b1e0 con 0x7f24c8062b60 2026-02-24T09:31:02.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.627+0000 7f24c6575640 1 --2- 10.20.193.28:0/1676708202 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f24a00b58d0 0x7f24a00d5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:02.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.628+0000 7f24c6575640 1 --2- 10.20.193.28:0/1676708202 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f24a00b58d0 0x7f24a00d5d80 secure :-1 s=READY pgs=265 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24bc0095b0 tx=0x7f24bc005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:02.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.629+0000 7f24af7fe640 1 -- 10.20.193.28:0/1676708202 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f24b00cdad0 con 0x7f24c8062b60 2026-02-24T09:31:02.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.749+0000 7f24c7577640 1 -- 10.20.193.28:0/1676708202 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f248c005880 con 0x7f24c8062b60 2026-02-24T09:31:02.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.749+0000 7f24af7fe640 1 -- 10.20.193.28:0/1676708202 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v110) ==== 81+0+885 (secure 0 0 0) 0x7f24b00d0bf0 con 0x7f24c8062b60 2026-02-24T09:31:02.751 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/3696280830 2026-02-25T09:13:39.242729+0000 2026-02-24T09:31:02.751 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:6801/3539300247 2026-02-25T09:13:39.242729+0000 2026-02-24T09:31:02.752 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/3799405177 2026-02-25T09:12:46.171932+0000 2026-02-24T09:31:02.752 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/1189576634 2026-02-25T09:12:46.171932+0000 2026-02-24T09:31:02.752 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:6800/1682009277 2026-02-25T09:12:46.171932+0000 2026-02-24T09:31:02.752 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:6800/3539300247 2026-02-25T09:13:39.242729+0000 2026-02-24T09:31:02.752 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:6801/1682009277 2026-02-25T09:12:46.171932+0000 2026-02-24T09:31:02.752 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/673213915 2026-02-25T09:12:59.028609+0000 2026-02-24T09:31:02.752 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/857248143 2026-02-25T09:13:39.242729+0000 2026-02-24T09:31:02.752 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/1541006046 2026-02-25T09:12:46.171932+0000 2026-02-24T09:31:02.752 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/264576041 2026-02-25T09:12:59.028609+0000 2026-02-24T09:31:02.752 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:6800/2303472235 2026-02-25T09:12:59.028609+0000 2026-02-24T09:31:02.752 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:6801/2303472235 2026-02-25T09:12:59.028609+0000 2026-02-24T09:31:02.752 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/2622827224 2026-02-25T09:12:59.028609+0000 2026-02-24T09:31:02.753 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/3614117448 2026-02-25T09:13:39.242729+0000 2026-02-24T09:31:02.753 INFO:teuthology.orchestra.run.trial028.stderr:listed 15 entries 2026-02-24T09:31:02.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.750+0000 7f24c7577640 1 -- 10.20.193.28:0/1676708202 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f24a00b58d0 msgr2=0x7f24a00d5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:02.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.750+0000 7f24c7577640 1 --2- 10.20.193.28:0/1676708202 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f24a00b58d0 0x7f24a00d5d80 secure :-1 s=READY pgs=265 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24bc0095b0 tx=0x7f24bc005f90 comp rx=0 tx=0).stop 2026-02-24T09:31:02.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.750+0000 7f24c7577640 1 -- 10.20.193.28:0/1676708202 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f24c8062b60 msgr2=0x7f24c80f3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:02.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.750+0000 7f24c7577640 1 --2- 10.20.193.28:0/1676708202 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f24c8062b60 0x7f24c80f3540 secure :-1 s=READY pgs=526 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24b0009890 tx=0x7f24b0004660 comp rx=0 tx=0).stop 2026-02-24T09:31:02.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.751+0000 7f24c7577640 1 -- 10.20.193.28:0/1676708202 shutdown_connections 2026-02-24T09:31:02.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.751+0000 7f24c7577640 1 --2- 10.20.193.28:0/1676708202 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f24a00b58d0 0x7f24a00d5d80 unknown :-1 s=CLOSED pgs=265 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.751+0000 7f24c7577640 1 --2- 10.20.193.28:0/1676708202 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f24c8159ec0 0x7f24c80f8910 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.751+0000 7f24c7577640 1 --2- 10.20.193.28:0/1676708202 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f24c8062b60 0x7f24c80f3540 unknown :-1 s=CLOSED pgs=526 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.751+0000 7f24c7577640 1 --2- 10.20.193.28:0/1676708202 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f24c8061570 0x7f24c80f3000 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:02.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.751+0000 7f24c7577640 1 -- 10.20.193.28:0/1676708202 >> 10.20.193.28:0/1676708202 conn(0x7f24c80eac60 msgr2=0x7f24c810e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:02.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.751+0000 7f24c7577640 1 -- 10.20.193.28:0/1676708202 shutdown_connections 2026-02-24T09:31:02.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:02.751+0000 7f24c7577640 1 -- 10.20.193.28:0/1676708202 wait complete. 2026-02-24T09:31:02.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:02 trial159 ceph-mon[44242]: pgmap v619: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 597 B/s wr, 7 op/s 2026-02-24T09:31:02.849 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-24T09:31:02.850 DEBUG:teuthology.orchestra.run.trial028:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-24T09:31:02.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:02 trial074 ceph-mon[44412]: pgmap v619: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 597 B/s wr, 7 op/s 2026-02-24T09:31:02.891 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd blocklist ls 2026-02-24T09:31:03.115 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:31:03.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.290+0000 7f3f82ebd640 1 -- 10.20.193.28:0/2352972891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f7c1158b0 msgr2=0x7f3f7c176280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:03.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.290+0000 7f3f82ebd640 1 --2- 10.20.193.28:0/2352972891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f7c1158b0 0x7f3f7c176280 secure :-1 s=READY pgs=527 gs=1 cs=0 l=1 c_cookie=3636440237476524442 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f7800aa30 tx=0x7f3f78030270 comp rx=0 tx=0).stop 2026-02-24T09:31:03.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.290+0000 7f3f82ebd640 1 -- 10.20.193.28:0/2352972891 shutdown_connections 2026-02-24T09:31:03.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.290+0000 7f3f82ebd640 1 --2- 10.20.193.28:0/2352972891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f7c1158b0 0x7f3f7c176280 unknown :-1 s=CLOSED pgs=527 gs=1 cs=0 l=1 c_cookie=3636440237476524442 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:03.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.290+0000 7f3f82ebd640 1 --2- 10.20.193.28:0/2352972891 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3f7c1100b0 0x7f3f7c115100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:03.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.290+0000 7f3f82ebd640 1 --2- 10.20.193.28:0/2352972891 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3f7c10f6c0 0x7f3f7c10fa90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:03.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.290+0000 7f3f82ebd640 1 -- 10.20.193.28:0/2352972891 >> 10.20.193.28:0/2352972891 conn(0x7f3f7c0ecfd0 msgr2=0x7f3f7c10d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:03.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.290+0000 7f3f82ebd640 1 -- 10.20.193.28:0/2352972891 shutdown_connections 2026-02-24T09:31:03.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.290+0000 7f3f82ebd640 1 -- 10.20.193.28:0/2352972891 wait complete. 2026-02-24T09:31:03.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.291+0000 7f3f82ebd640 1 Processor -- start 2026-02-24T09:31:03.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.291+0000 7f3f82ebd640 1 -- start start 2026-02-24T09:31:03.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.291+0000 7f3f82ebd640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3f7c10f6c0 0x7f3f7c066fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:03.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.291+0000 7f3f82ebd640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3f7c1100b0 0x7f3f7c063220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:03.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.291+0000 7f3f82ebd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f7c1158b0 0x7f3f7c0638d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:03.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.291+0000 7f3f82ebd640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7c064060 con 0x7f3f7c1158b0 2026-02-24T09:31:03.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.291+0000 7f3f82ebd640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7c1687b0 con 0x7f3f7c10f6c0 2026-02-24T09:31:03.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.291+0000 7f3f82ebd640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7c168970 con 0x7f3f7c1100b0 2026-02-24T09:31:03.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.291+0000 7f3f80c32640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3f7c10f6c0 0x7f3f7c066fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:03.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.292+0000 7f3f81433640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f7c1158b0 0x7f3f7c0638d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:03.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.292+0000 7f3f73fff640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3f7c1100b0 0x7f3f7c063220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:03.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.292+0000 7f3f73fff640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3f7c1100b0 0x7f3f7c063220 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.159:3300/0 says I am v2:10.20.193.28:51376/0 (socket says 10.20.193.28:51376) 2026-02-24T09:31:03.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.292+0000 7f3f80c32640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3f7c10f6c0 0x7f3f7c066fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.74:3300/0 says I am v2:10.20.193.28:55780/0 (socket says 10.20.193.28:55780) 2026-02-24T09:31:03.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.292+0000 7f3f73fff640 1 -- 10.20.193.28:0/4111391067 learned_addr learned my addr 10.20.193.28:0/4111391067 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:31:03.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.292+0000 7f3f81433640 1 -- 10.20.193.28:0/4111391067 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3f7c1100b0 msgr2=0x7f3f7c063220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:03.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.292+0000 7f3f81433640 1 --2- 10.20.193.28:0/4111391067 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3f7c1100b0 0x7f3f7c063220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:03.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.292+0000 7f3f81433640 1 -- 10.20.193.28:0/4111391067 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3f7c10f6c0 msgr2=0x7f3f7c066fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:03.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.292+0000 7f3f81433640 1 --2- 10.20.193.28:0/4111391067 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3f7c10f6c0 0x7f3f7c066fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:03.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.292+0000 7f3f81433640 1 -- 10.20.193.28:0/4111391067 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f7800a650 con 0x7f3f7c1158b0 2026-02-24T09:31:03.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.292+0000 7f3f81433640 1 --2- 10.20.193.28:0/4111391067 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f7c1158b0 0x7f3f7c0638d0 secure :-1 s=READY pgs=528 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f78033040 tx=0x7f3f78003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:03.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.292+0000 7f3f71ffb640 1 -- 10.20.193.28:0/4111391067 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f7803e070 con 0x7f3f7c1158b0 2026-02-24T09:31:03.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.292+0000 7f3f71ffb640 1 -- 10.20.193.28:0/4111391067 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3f78039de0 con 0x7f3f7c1158b0 2026-02-24T09:31:03.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.292+0000 7f3f82ebd640 1 -- 10.20.193.28:0/4111391067 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f7c168b90 con 0x7f3f7c1158b0 2026-02-24T09:31:03.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.292+0000 7f3f71ffb640 1 -- 10.20.193.28:0/4111391067 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f78042820 con 0x7f3f7c1158b0 2026-02-24T09:31:03.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.292+0000 7f3f82ebd640 1 -- 10.20.193.28:0/4111391067 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f7c169000 con 0x7f3f7c1158b0 2026-02-24T09:31:03.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.293+0000 7f3f82ebd640 1 -- 10.20.193.28:0/4111391067 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f7c1109a0 con 0x7f3f7c1158b0 2026-02-24T09:31:03.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.295+0000 7f3f71ffb640 1 -- 10.20.193.28:0/4111391067 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7f3f780053a0 con 0x7f3f7c1158b0 2026-02-24T09:31:03.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.296+0000 7f3f71ffb640 1 --2- 10.20.193.28:0/4111391067 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3f580b58d0 0x7f3f580d5d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:03.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.297+0000 7f3f71ffb640 1 -- 10.20.193.28:0/4111391067 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 8513+0+0 (secure 0 0 0) 0x7f3f7810c6e0 con 0x7f3f7c1158b0 2026-02-24T09:31:03.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.297+0000 7f3f80c32640 1 --2- 10.20.193.28:0/4111391067 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3f580b58d0 0x7f3f580d5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:03.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.297+0000 7f3f71ffb640 1 -- 10.20.193.28:0/4111391067 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f3f780cef00 con 0x7f3f7c1158b0 2026-02-24T09:31:03.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.297+0000 7f3f80c32640 1 --2- 10.20.193.28:0/4111391067 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3f580b58d0 0x7f3f580d5d80 secure :-1 s=READY pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f6c004740 tx=0x7f3f6c00b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:03.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.417+0000 7f3f82ebd640 1 -- 10.20.193.28:0/4111391067 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3f7c10fa90 con 0x7f3f7c1158b0 2026-02-24T09:31:03.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.418+0000 7f3f71ffb640 1 -- 10.20.193.28:0/4111391067 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v110) ==== 81+0+885 (secure 0 0 0) 0x7f3f780d20b0 con 0x7f3f7c1158b0 2026-02-24T09:31:03.419 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/3696280830 2026-02-25T09:13:39.242729+0000 2026-02-24T09:31:03.419 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:6801/3539300247 2026-02-25T09:13:39.242729+0000 2026-02-24T09:31:03.420 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/3799405177 2026-02-25T09:12:46.171932+0000 2026-02-24T09:31:03.420 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/1189576634 2026-02-25T09:12:46.171932+0000 2026-02-24T09:31:03.420 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:6800/1682009277 2026-02-25T09:12:46.171932+0000 2026-02-24T09:31:03.420 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:6800/3539300247 2026-02-25T09:13:39.242729+0000 2026-02-24T09:31:03.420 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:6801/1682009277 2026-02-25T09:12:46.171932+0000 2026-02-24T09:31:03.420 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/673213915 2026-02-25T09:12:59.028609+0000 2026-02-24T09:31:03.420 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/857248143 2026-02-25T09:13:39.242729+0000 2026-02-24T09:31:03.420 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/1541006046 2026-02-25T09:12:46.171932+0000 2026-02-24T09:31:03.420 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/264576041 2026-02-25T09:12:59.028609+0000 2026-02-24T09:31:03.420 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:6800/2303472235 2026-02-25T09:12:59.028609+0000 2026-02-24T09:31:03.420 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:6801/2303472235 2026-02-25T09:12:59.028609+0000 2026-02-24T09:31:03.420 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/2622827224 2026-02-25T09:12:59.028609+0000 2026-02-24T09:31:03.420 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/3614117448 2026-02-25T09:13:39.242729+0000 2026-02-24T09:31:03.421 INFO:teuthology.orchestra.run.trial028.stderr:listed 15 entries 2026-02-24T09:31:03.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.419+0000 7f3f82ebd640 1 -- 10.20.193.28:0/4111391067 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3f580b58d0 msgr2=0x7f3f580d5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:03.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.419+0000 7f3f82ebd640 1 --2- 10.20.193.28:0/4111391067 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3f580b58d0 0x7f3f580d5d80 secure :-1 s=READY pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f6c004740 tx=0x7f3f6c00b410 comp rx=0 tx=0).stop 2026-02-24T09:31:03.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.419+0000 7f3f82ebd640 1 -- 10.20.193.28:0/4111391067 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f7c1158b0 msgr2=0x7f3f7c0638d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:03.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.419+0000 7f3f82ebd640 1 --2- 10.20.193.28:0/4111391067 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f7c1158b0 0x7f3f7c0638d0 secure :-1 s=READY pgs=528 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f78033040 tx=0x7f3f78003f60 comp rx=0 tx=0).stop 2026-02-24T09:31:03.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.419+0000 7f3f82ebd640 1 -- 10.20.193.28:0/4111391067 shutdown_connections 2026-02-24T09:31:03.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.419+0000 7f3f82ebd640 1 --2- 10.20.193.28:0/4111391067 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f3f580b58d0 0x7f3f580d5d80 unknown :-1 s=CLOSED pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:03.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.419+0000 7f3f82ebd640 1 --2- 10.20.193.28:0/4111391067 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f7c1158b0 0x7f3f7c0638d0 unknown :-1 s=CLOSED pgs=528 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:03.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.419+0000 7f3f82ebd640 1 --2- 10.20.193.28:0/4111391067 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f3f7c1100b0 0x7f3f7c063220 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:03.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.419+0000 7f3f82ebd640 1 --2- 10.20.193.28:0/4111391067 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f3f7c10f6c0 0x7f3f7c066fb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:03.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.419+0000 7f3f82ebd640 1 -- 10.20.193.28:0/4111391067 >> 10.20.193.28:0/4111391067 conn(0x7f3f7c0ecfd0 msgr2=0x7f3f7c10d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:03.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.419+0000 7f3f82ebd640 1 -- 10.20.193.28:0/4111391067 shutdown_connections 2026-02-24T09:31:03.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:03.419+0000 7f3f82ebd640 1 -- 10.20.193.28:0/4111391067 wait complete. 2026-02-24T09:31:03.518 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@trial028.front.sepia.ceph.com... 2026-02-24T09:31:03.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-24T09:31:03.519 DEBUG:teuthology.orchestra.run.trial028:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2026-02-24T09:31:03.578 INFO:teuthology.orchestra.run:waiting for 300 2026-02-24T09:31:03.642 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.trial028.stderr:ceph-fuse[118839]: fuse finished with error 0 and tester_r 0 2026-02-24T09:31:03.779 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:03 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/1676708202' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2026-02-24T09:31:03.780 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:03 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/4111391067' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2026-02-24T09:31:03.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:03 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/1676708202' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2026-02-24T09:31:03.860 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:03 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/4111391067' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2026-02-24T09:31:03.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:03 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/1676708202' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2026-02-24T09:31:03.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:03 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/4111391067' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2026-02-24T09:31:04.609 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:04 trial028 ceph-mon[40371]: pgmap v620: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2026-02-24T09:31:04.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:04 trial074 ceph-mon[44412]: pgmap v620: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2026-02-24T09:31:05.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:04 trial159 ceph-mon[44242]: pgmap v620: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2026-02-24T09:31:05.859 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:05 trial028 ceph-mon[40371]: osdmap e111: 12 total, 12 up, 12 in 2026-02-24T09:31:05.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:05 trial074 ceph-mon[44412]: osdmap e111: 12 total, 12 up, 12 in 2026-02-24T09:31:06.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:05 trial159 ceph-mon[44242]: osdmap e111: 12 total, 12 up, 12 in 2026-02-24T09:31:06.859 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:06 trial028 ceph-mon[40371]: pgmap v622: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 29 op/s 2026-02-24T09:31:06.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:06 trial074 ceph-mon[44412]: pgmap v622: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 29 op/s 2026-02-24T09:31:06.930 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:06 trial159 ceph-mon[44242]: pgmap v622: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 29 op/s 2026-02-24T09:31:08.859 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:08 trial028 ceph-mon[40371]: pgmap v623: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2026-02-24T09:31:08.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:08 trial074 ceph-mon[44412]: pgmap v623: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2026-02-24T09:31:09.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:08 trial159 ceph-mon[44242]: pgmap v623: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2026-02-24T09:31:09.680 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@trial028.front.sepia.ceph.com 2026-02-24T09:31:09.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-24T09:31:09.680 DEBUG:teuthology.orchestra.run.trial028:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2026-02-24T09:31:09.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-24T09:31:09.722 DEBUG:teuthology.orchestra.run.trial028:> ip netns list 2026-02-24T09:31:09.802 INFO:teuthology.orchestra.run.trial028.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2026-02-24T09:31:09.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-24T09:31:09.802 DEBUG:teuthology.orchestra.run.trial028:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2026-02-24T09:31:09.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-24T09:31:09.900 DEBUG:teuthology.orchestra.run.trial028:> sudo ip link delete ceph-brx 2026-02-24T09:31:09.996 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-02-24T09:31:10.012 INFO:tasks.cephadm:Teardown begin 2026-02-24T09:31:10.013 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2026-02-24T09:31:10.013 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:31:10.198 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:31:10.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.373+0000 7fa3588e8640 1 -- 10.20.193.28:0/3880527717 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa354113500 msgr2=0x7fa354173ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:10.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.373+0000 7fa3588e8640 1 --2- 10.20.193.28:0/3880527717 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa354113500 0x7fa354173ed0 secure :-1 s=READY pgs=529 gs=1 cs=0 l=1 c_cookie=11921646348609522282 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa34800aa30 tx=0x7fa348030270 comp rx=0 tx=0).stop 2026-02-24T09:31:10.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.373+0000 7fa3588e8640 1 -- 10.20.193.28:0/3880527717 shutdown_connections 2026-02-24T09:31:10.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.373+0000 7fa3588e8640 1 --2- 10.20.193.28:0/3880527717 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa354113500 0x7fa354173ed0 unknown :-1 s=CLOSED pgs=529 gs=1 cs=0 l=1 c_cookie=11921646348609522282 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:10.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.373+0000 7fa3588e8640 1 --2- 10.20.193.28:0/3880527717 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa35410c1a0 0x7fa354112d50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:10.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.373+0000 7fa3588e8640 1 --2- 10.20.193.28:0/3880527717 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa35410b7b0 0x7fa35410bb80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:10.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.373+0000 7fa3588e8640 1 -- 10.20.193.28:0/3880527717 >> 10.20.193.28:0/3880527717 conn(0x7fa3540e9260 msgr2=0x7fa354109670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:10.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.373+0000 7fa3588e8640 1 -- 10.20.193.28:0/3880527717 shutdown_connections 2026-02-24T09:31:10.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.373+0000 7fa3588e8640 1 -- 10.20.193.28:0/3880527717 wait complete. 2026-02-24T09:31:10.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.374+0000 7fa3588e8640 1 Processor -- start 2026-02-24T09:31:10.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.374+0000 7fa3588e8640 1 -- start start 2026-02-24T09:31:10.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.374+0000 7fa3588e8640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa35410b7b0 0x7fa3540f3fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:10.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.374+0000 7fa3588e8640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa35410c1a0 0x7fa354173dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:10.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.374+0000 7fa3588e8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa354113500 0x7fa3540f46d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:10.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.374+0000 7fa3588e8640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa3540f98e0 con 0x7fa354113500 2026-02-24T09:31:10.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.374+0000 7fa3588e8640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fa3540f9a50 con 0x7fa35410c1a0 2026-02-24T09:31:10.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.374+0000 7fa3588e8640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa3540f9c10 con 0x7fa35410b7b0 2026-02-24T09:31:10.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.374+0000 7fa353fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa354113500 0x7fa3540f46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:10.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.374+0000 7fa353fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa354113500 0x7fa3540f46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37878/0 (socket says 10.20.193.28:37878) 2026-02-24T09:31:10.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.374+0000 7fa353fff640 1 -- 10.20.193.28:0/718308577 learned_addr learned my addr 10.20.193.28:0/718308577 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:31:10.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.374+0000 7fa3537fe640 1 --2- 10.20.193.28:0/718308577 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa35410b7b0 0x7fa3540f3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:10.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.375+0000 7fa352ffd640 1 --2- 10.20.193.28:0/718308577 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa35410c1a0 0x7fa354173dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:10.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.375+0000 7fa353fff640 1 -- 10.20.193.28:0/718308577 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa35410b7b0 msgr2=0x7fa3540f3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:10.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.375+0000 7fa353fff640 1 --2- 10.20.193.28:0/718308577 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa35410b7b0 0x7fa3540f3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:10.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.375+0000 7fa353fff640 1 -- 10.20.193.28:0/718308577 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa35410c1a0 msgr2=0x7fa354173dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:10.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.375+0000 7fa353fff640 1 --2- 10.20.193.28:0/718308577 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa35410c1a0 0x7fa354173dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:10.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.375+0000 7fa353fff640 1 -- 10.20.193.28:0/718308577 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa34800a650 con 0x7fa354113500 2026-02-24T09:31:10.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.375+0000 7fa353fff640 1 --2- 10.20.193.28:0/718308577 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa354113500 0x7fa3540f46d0 secure :-1 s=READY pgs=530 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa348032fe0 tx=0x7fa3480039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:10.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.375+0000 7fa350ff9640 1 -- 10.20.193.28:0/718308577 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa34803e070 con 0x7fa354113500 2026-02-24T09:31:10.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.375+0000 7fa350ff9640 1 -- 10.20.193.28:0/718308577 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fa348003e00 con 0x7fa354113500 2026-02-24T09:31:10.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.375+0000 7fa3588e8640 1 -- 10.20.193.28:0/718308577 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3540f9e90 con 0x7fa354113500 2026-02-24T09:31:10.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.375+0000 7fa350ff9640 1 -- 10.20.193.28:0/718308577 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa348042940 con 0x7fa354113500 2026-02-24T09:31:10.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.375+0000 7fa3588e8640 1 -- 10.20.193.28:0/718308577 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3540fa300 con 0x7fa354113500 2026-02-24T09:31:10.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.376+0000 7fa3588e8640 1 -- 10.20.193.28:0/718308577 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa35405f9b0 con 0x7fa354113500 2026-02-24T09:31:10.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.378+0000 7fa350ff9640 1 -- 10.20.193.28:0/718308577 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7fa348042ad0 con 0x7fa354113500 2026-02-24T09:31:10.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.379+0000 7fa350ff9640 1 --2- 10.20.193.28:0/718308577 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa3280b58c0 0x7fa3280d5d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:10.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.380+0000 7fa350ff9640 1 -- 10.20.193.28:0/718308577 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 8557+0+0 (secure 0 0 0) 0x7fa34810ccc0 con 0x7fa354113500 2026-02-24T09:31:10.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.380+0000 7fa350ff9640 1 -- 10.20.193.28:0/718308577 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fa34810d140 con 0x7fa354113500 2026-02-24T09:31:10.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.380+0000 7fa3537fe640 1 --2- 10.20.193.28:0/718308577 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa3280b58c0 0x7fa3280d5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:10.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.380+0000 7fa3537fe640 1 --2- 10.20.193.28:0/718308577 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa3280b58c0 0x7fa3280d5d70 secure :-1 s=READY pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa340004740 tx=0x7fa34000b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:10.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.521+0000 7fa3588e8640 1 -- 10.20.193.28:0/718308577 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa35410bb80 con 0x7fa354113500 2026-02-24T09:31:10.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.522+0000 7fa350ff9640 1 -- 10.20.193.28:0/718308577 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11901 (secure 0 0 0) 0x7fa3480cf4c0 con 0x7fa354113500 2026-02-24T09:31:10.524 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:31:10.524 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":23,"btime":"2026-02-24T09:17:37:340018+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14856,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/3473030842","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":3473030842},{"type":"v1","addr":"10.20.193.28:6835","nonce":3473030842}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14862,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/4120804601","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":4120804601},{"type":"v1","addr":"10.20.193.28:6837","nonce":4120804601}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14910,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/1354296520","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1354296520},{"type":"v1","addr":"10.20.193.28:6839","nonce":1354296520}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24691,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.159:6833/3049112106","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6832","nonce":3049112106},{"type":"v1","addr":"10.20.193.159:6833","nonce":3049112106}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24710,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.74:6833/1426135976","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6832","nonce":1426135976},{"type":"v1","addr":"10.20.193.74:6833","nonce":1426135976}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24721,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.159:6835/3999384392","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6834","nonce":3999384392},{"type":"v1","addr":"10.20.193.159:6835","nonce":3999384392}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:16:59.889500+0000","modified":"2026-02-24T09:17:36.673190+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24788,"mds_1":24761,"mds_2":24760},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24727":{"gid":24727,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.159:6837/2059577520","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6836","nonce":2059577520},{"type":"v1","addr":"10.20.193.159:6837","nonce":2059577520}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24734":{"gid":24734,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.74:6835/2067708838","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6834","nonce":2067708838},{"type":"v1","addr":"10.20.193.74:6835","nonce":2067708838}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24745":{"gid":24745,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.159:6839/533862317","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6838","nonce":533862317},{"type":"v1","addr":"10.20.193.159:6839","nonce":533862317}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24760":{"gid":24760,"name":"a","rank":2,"incarnation":20,"state":"up:active","state_seq":5,"addr":"10.20.193.28:6841/492586680","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":492586680},{"type":"v1","addr":"10.20.193.28:6841","nonce":492586680}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24761":{"gid":24761,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"10.20.193.74:6837/958749351","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6836","nonce":958749351},{"type":"v1","addr":"10.20.193.74:6837","nonce":958749351}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24788":{"gid":24788,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"10.20.193.74:6839/828566790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6838","nonce":828566790},{"type":"v1","addr":"10.20.193.74:6839","nonce":828566790}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24788,"qdb_cluster":[24760,24761,24788]},"id":1}]} 2026-02-24T09:31:10.524 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 23 2026-02-24T09:31:10.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.524+0000 7fa3588e8640 1 -- 10.20.193.28:0/718308577 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa3280b58c0 msgr2=0x7fa3280d5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:10.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.524+0000 7fa3588e8640 1 --2- 10.20.193.28:0/718308577 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa3280b58c0 0x7fa3280d5d70 secure :-1 s=READY pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa340004740 tx=0x7fa34000b410 comp rx=0 tx=0).stop 2026-02-24T09:31:10.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.524+0000 7fa3588e8640 1 -- 10.20.193.28:0/718308577 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa354113500 msgr2=0x7fa3540f46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:10.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.524+0000 7fa3588e8640 1 --2- 10.20.193.28:0/718308577 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa354113500 0x7fa3540f46d0 secure :-1 s=READY pgs=530 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa348032fe0 tx=0x7fa3480039b0 comp rx=0 tx=0).stop 2026-02-24T09:31:10.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.524+0000 7fa3588e8640 1 -- 10.20.193.28:0/718308577 shutdown_connections 2026-02-24T09:31:10.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.524+0000 7fa3588e8640 1 --2- 10.20.193.28:0/718308577 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa3280b58c0 0x7fa3280d5d70 unknown :-1 s=CLOSED pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:10.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.524+0000 7fa3588e8640 1 --2- 10.20.193.28:0/718308577 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa354113500 0x7fa3540f46d0 unknown :-1 s=CLOSED pgs=530 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:10.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.524+0000 7fa3588e8640 1 --2- 10.20.193.28:0/718308577 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa35410c1a0 0x7fa354173dd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:10.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.524+0000 7fa3588e8640 1 --2- 10.20.193.28:0/718308577 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa35410b7b0 0x7fa3540f3fd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:10.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.524+0000 7fa3588e8640 1 -- 10.20.193.28:0/718308577 >> 10.20.193.28:0/718308577 conn(0x7fa3540e9260 msgr2=0x7fa354109e20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:10.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.524+0000 7fa3588e8640 1 -- 10.20.193.28:0/718308577 shutdown_connections 2026-02-24T09:31:10.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.524+0000 7fa3588e8640 1 -- 10.20.193.28:0/718308577 wait complete. 2026-02-24T09:31:10.626 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:31:10.812 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:31:10.857 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:10 trial028 ceph-mon[40371]: pgmap v624: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2026-02-24T09:31:10.857 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:10 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/718308577' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:31:10.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:10 trial074 ceph-mon[44412]: pgmap v624: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2026-02-24T09:31:10.873 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:10 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/718308577' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:31:11.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.999+0000 7fdc676dd640 1 -- 10.20.193.28:0/983032182 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdc60060fd0 msgr2=0x7fdc600613a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:11.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.999+0000 7fdc676dd640 1 --2- 10.20.193.28:0/983032182 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdc60060fd0 0x7fdc600613a0 secure :-1 s=READY pgs=531 gs=1 cs=0 l=1 c_cookie=7511937631215116492 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc50009950 tx=0x7fdc5002f190 comp rx=0 tx=0).stop 2026-02-24T09:31:11.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.999+0000 7fdc676dd640 1 -- 10.20.193.28:0/983032182 shutdown_connections 2026-02-24T09:31:11.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.999+0000 7fdc676dd640 1 --2- 10.20.193.28:0/983032182 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fdc60155730 0x7fdc60175b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:11.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.999+0000 7fdc676dd640 1 --2- 10.20.193.28:0/983032182 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fdc600618e0 0x7fdc601551f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:11.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.999+0000 7fdc676dd640 1 --2- 10.20.193.28:0/983032182 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdc60060fd0 0x7fdc600613a0 unknown :-1 s=CLOSED pgs=531 gs=1 cs=0 l=1 c_cookie=7511937631215116492 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:11.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.999+0000 7fdc676dd640 1 -- 10.20.193.28:0/983032182 >> 10.20.193.28:0/983032182 conn(0x7fdc6005f830 msgr2=0x7fdc6010ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:11.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.999+0000 7fdc676dd640 1 -- 10.20.193.28:0/983032182 shutdown_connections 2026-02-24T09:31:11.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:10.999+0000 7fdc676dd640 1 -- 10.20.193.28:0/983032182 wait complete. 2026-02-24T09:31:11.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.000+0000 7fdc676dd640 1 Processor -- start 2026-02-24T09:31:11.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.000+0000 7fdc676dd640 1 -- start start 2026-02-24T09:31:11.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.000+0000 7fdc676dd640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fdc60060fd0 0x7fdc60161f20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:11.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.000+0000 7fdc676dd640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fdc600618e0 0x7fdc60162460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:11.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.000+0000 7fdc676dd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdc60155730 0x7fdc60167830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:11.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.000+0000 7fdc676dd640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdc60167e50 con 0x7fdc60155730 2026-02-24T09:31:11.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.000+0000 7fdc676dd640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fdc60167fc0 con 0x7fdc600618e0 2026-02-24T09:31:11.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.000+0000 7fdc676dd640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fdc60168180 con 0x7fdc60060fd0 2026-02-24T09:31:11.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.000+0000 7fdc65c53640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdc60155730 0x7fdc60167830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:11.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.000+0000 7fdc65c53640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdc60155730 0x7fdc60167830 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37886/0 (socket says 10.20.193.28:37886) 2026-02-24T09:31:11.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.000+0000 7fdc65c53640 1 -- 10.20.193.28:0/2307609929 learned_addr learned my addr 10.20.193.28:0/2307609929 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:31:11.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.000+0000 7fdc65452640 1 --2- 10.20.193.28:0/2307609929 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fdc60060fd0 0x7fdc60161f20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:11.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.000+0000 7fdc64c51640 1 --2- 10.20.193.28:0/2307609929 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fdc600618e0 0x7fdc60162460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:11.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.000+0000 7fdc65c53640 1 -- 10.20.193.28:0/2307609929 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fdc60060fd0 msgr2=0x7fdc60161f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:11.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.000+0000 7fdc65c53640 1 --2- 10.20.193.28:0/2307609929 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fdc60060fd0 0x7fdc60161f20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:11.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.000+0000 7fdc65c53640 1 -- 10.20.193.28:0/2307609929 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fdc600618e0 msgr2=0x7fdc60162460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:11.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.000+0000 7fdc65c53640 1 --2- 10.20.193.28:0/2307609929 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fdc600618e0 0x7fdc60162460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:11.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.000+0000 7fdc65c53640 1 -- 10.20.193.28:0/2307609929 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc50009570 con 0x7fdc60155730 2026-02-24T09:31:11.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.001+0000 7fdc65c53640 1 --2- 10.20.193.28:0/2307609929 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdc60155730 0x7fdc60167830 secure :-1 s=READY pgs=532 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc5c00e950 tx=0x7fdc5c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:11.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.001+0000 7fdc4e7fc640 1 -- 10.20.193.28:0/2307609929 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdc5c005500 con 0x7fdc60155730 2026-02-24T09:31:11.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.001+0000 7fdc4e7fc640 1 -- 10.20.193.28:0/2307609929 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fdc5c00cd00 con 0x7fdc60155730 2026-02-24T09:31:11.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.001+0000 7fdc4e7fc640 1 -- 10.20.193.28:0/2307609929 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdc5c0116e0 con 0x7fdc60155730 2026-02-24T09:31:11.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.001+0000 7fdc676dd640 1 -- 10.20.193.28:0/2307609929 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc60168460 con 0x7fdc60155730 2026-02-24T09:31:11.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.001+0000 7fdc676dd640 1 -- 10.20.193.28:0/2307609929 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc60151350 con 0x7fdc60155730 2026-02-24T09:31:11.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.002+0000 7fdc676dd640 1 -- 10.20.193.28:0/2307609929 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc28005300 con 0x7fdc60155730 2026-02-24T09:31:11.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.004+0000 7fdc4e7fc640 1 -- 10.20.193.28:0/2307609929 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7fdc5c00c840 con 0x7fdc60155730 2026-02-24T09:31:11.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.006+0000 7fdc4e7fc640 1 --2- 10.20.193.28:0/2307609929 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fdc3c0b58d0 0x7fdc3c0d5d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:11.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.006+0000 7fdc4e7fc640 1 -- 10.20.193.28:0/2307609929 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 8513+0+0 (secure 0 0 0) 0x7fdc5c0e7e20 con 0x7fdc60155730 2026-02-24T09:31:11.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.006+0000 7fdc65452640 1 --2- 10.20.193.28:0/2307609929 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fdc3c0b58d0 0x7fdc3c0d5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:11.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.006+0000 7fdc4e7fc640 1 -- 10.20.193.28:0/2307609929 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fdc5c0e82a0 con 0x7fdc60155730 2026-02-24T09:31:11.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.007+0000 7fdc65452640 1 --2- 10.20.193.28:0/2307609929 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fdc3c0b58d0 0x7fdc3c0d5d80 secure :-1 s=READY pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc500098a0 tx=0x7fdc5003a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:11.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:10 trial159 ceph-mon[44242]: pgmap v624: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2026-02-24T09:31:11.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:10 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/718308577' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:31:11.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.147+0000 7fdc676dd640 1 -- 10.20.193.28:0/2307609929 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc28005950 con 0x7fdc60155730 2026-02-24T09:31:11.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.148+0000 7fdc4e7fc640 1 -- 10.20.193.28:0/2307609929 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11901 (secure 0 0 0) 0x7fdc5c0aa530 con 0x7fdc60155730 2026-02-24T09:31:11.150 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:31:11.150 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":23,"btime":"2026-02-24T09:17:37:340018+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14856,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/3473030842","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":3473030842},{"type":"v1","addr":"10.20.193.28:6835","nonce":3473030842}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14862,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/4120804601","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":4120804601},{"type":"v1","addr":"10.20.193.28:6837","nonce":4120804601}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14910,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/1354296520","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":1354296520},{"type":"v1","addr":"10.20.193.28:6839","nonce":1354296520}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24691,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.159:6833/3049112106","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6832","nonce":3049112106},{"type":"v1","addr":"10.20.193.159:6833","nonce":3049112106}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24710,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.74:6833/1426135976","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6832","nonce":1426135976},{"type":"v1","addr":"10.20.193.74:6833","nonce":1426135976}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24721,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.159:6835/3999384392","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6834","nonce":3999384392},{"type":"v1","addr":"10.20.193.159:6835","nonce":3999384392}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:16:59.889500+0000","modified":"2026-02-24T09:17:36.673190+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24788,"mds_1":24761,"mds_2":24760},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24727":{"gid":24727,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.159:6837/2059577520","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6836","nonce":2059577520},{"type":"v1","addr":"10.20.193.159:6837","nonce":2059577520}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24734":{"gid":24734,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.74:6835/2067708838","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6834","nonce":2067708838},{"type":"v1","addr":"10.20.193.74:6835","nonce":2067708838}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24745":{"gid":24745,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.159:6839/533862317","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6838","nonce":533862317},{"type":"v1","addr":"10.20.193.159:6839","nonce":533862317}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24760":{"gid":24760,"name":"a","rank":2,"incarnation":20,"state":"up:active","state_seq":5,"addr":"10.20.193.28:6841/492586680","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":492586680},{"type":"v1","addr":"10.20.193.28:6841","nonce":492586680}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24761":{"gid":24761,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"10.20.193.74:6837/958749351","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6836","nonce":958749351},{"type":"v1","addr":"10.20.193.74:6837","nonce":958749351}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24788":{"gid":24788,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"10.20.193.74:6839/828566790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6838","nonce":828566790},{"type":"v1","addr":"10.20.193.74:6839","nonce":828566790}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24788,"qdb_cluster":[24760,24761,24788]},"id":1}]} 2026-02-24T09:31:11.151 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 23 2026-02-24T09:31:11.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.149+0000 7fdc676dd640 1 -- 10.20.193.28:0/2307609929 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fdc3c0b58d0 msgr2=0x7fdc3c0d5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:11.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.149+0000 7fdc676dd640 1 --2- 10.20.193.28:0/2307609929 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fdc3c0b58d0 0x7fdc3c0d5d80 secure :-1 s=READY pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc500098a0 tx=0x7fdc5003a040 comp rx=0 tx=0).stop 2026-02-24T09:31:11.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.149+0000 7fdc676dd640 1 -- 10.20.193.28:0/2307609929 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdc60155730 msgr2=0x7fdc60167830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:11.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.149+0000 7fdc676dd640 1 --2- 10.20.193.28:0/2307609929 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdc60155730 0x7fdc60167830 secure :-1 s=READY pgs=532 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc5c00e950 tx=0x7fdc5c00ee20 comp rx=0 tx=0).stop 2026-02-24T09:31:11.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.149+0000 7fdc676dd640 1 -- 10.20.193.28:0/2307609929 shutdown_connections 2026-02-24T09:31:11.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.149+0000 7fdc676dd640 1 --2- 10.20.193.28:0/2307609929 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fdc3c0b58d0 0x7fdc3c0d5d80 unknown :-1 s=CLOSED pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:11.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.149+0000 7fdc676dd640 1 --2- 10.20.193.28:0/2307609929 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdc60155730 0x7fdc60167830 unknown :-1 s=CLOSED pgs=532 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:11.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.149+0000 7fdc676dd640 1 --2- 10.20.193.28:0/2307609929 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fdc600618e0 0x7fdc60162460 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:11.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.149+0000 7fdc676dd640 1 --2- 10.20.193.28:0/2307609929 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fdc60060fd0 0x7fdc60161f20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:11.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.149+0000 7fdc676dd640 1 -- 10.20.193.28:0/2307609929 >> 10.20.193.28:0/2307609929 conn(0x7fdc6005f830 msgr2=0x7fdc6010ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:11.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.149+0000 7fdc676dd640 1 -- 10.20.193.28:0/2307609929 shutdown_connections 2026-02-24T09:31:11.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.149+0000 7fdc676dd640 1 -- 10.20.193.28:0/2307609929 wait complete. 2026-02-24T09:31:11.252 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T09:31:11.435 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:31:11.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.618+0000 7fa6164b0640 1 -- 10.20.193.28:0/3914793291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa61010fc70 msgr2=0x7fa610114cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:11.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.618+0000 7fa6164b0640 1 --2- 10.20.193.28:0/3914793291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa61010fc70 0x7fa610114cc0 secure :-1 s=READY pgs=533 gs=1 cs=0 l=1 c_cookie=8619703494005819687 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa600009950 tx=0x7fa60002f190 comp rx=0 tx=0).stop 2026-02-24T09:31:11.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.618+0000 7fa6164b0640 1 -- 10.20.193.28:0/3914793291 shutdown_connections 2026-02-24T09:31:11.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.618+0000 7fa6164b0640 1 --2- 10.20.193.28:0/3914793291 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa610115470 0x7fa610175e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:11.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.618+0000 7fa6164b0640 1 --2- 10.20.193.28:0/3914793291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa61010fc70 0x7fa610114cc0 unknown :-1 s=CLOSED pgs=533 gs=1 cs=0 l=1 c_cookie=8619703494005819687 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:11.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.618+0000 7fa6164b0640 1 --2- 10.20.193.28:0/3914793291 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa61010f280 0x7fa61010f650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:11.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.618+0000 7fa6164b0640 1 -- 10.20.193.28:0/3914793291 >> 10.20.193.28:0/3914793291 conn(0x7fa61005f830 msgr2=0x7fa61010cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:11.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.618+0000 7fa6164b0640 1 -- 10.20.193.28:0/3914793291 shutdown_connections 2026-02-24T09:31:11.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.618+0000 7fa6164b0640 1 -- 10.20.193.28:0/3914793291 wait complete. 2026-02-24T09:31:11.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.619+0000 7fa6164b0640 1 Processor -- start 2026-02-24T09:31:11.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.619+0000 7fa6164b0640 1 -- start start 2026-02-24T09:31:11.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.619+0000 7fa6164b0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa61010f280 0x7fa6100f5610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:11.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.619+0000 7fa6164b0640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa61010fc70 0x7fa610175d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:11.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.619+0000 7fa6164b0640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa610115470 0x7fa6100f5d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:11.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.619+0000 7fa6164b0640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa6100faf20 con 0x7fa61010f280 2026-02-24T09:31:11.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.619+0000 7fa6164b0640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fa6100fb090 con 0x7fa610115470 2026-02-24T09:31:11.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.619+0000 7fa6164b0640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa6100fb250 con 0x7fa61010fc70 2026-02-24T09:31:11.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.620+0000 7fa60ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa61010f280 0x7fa6100f5610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:11.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.620+0000 7fa60ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa61010f280 0x7fa6100f5610 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37898/0 (socket says 10.20.193.28:37898) 2026-02-24T09:31:11.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.620+0000 7fa60ffff640 1 -- 10.20.193.28:0/3615873315 learned_addr learned my addr 10.20.193.28:0/3615873315 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:31:11.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.620+0000 7fa60f7fe640 1 --2- 10.20.193.28:0/3615873315 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa61010fc70 0x7fa610175d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:11.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.620+0000 7fa60ffff640 1 -- 10.20.193.28:0/3615873315 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa61010fc70 msgr2=0x7fa610175d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:11.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.620+0000 7fa60ffff640 1 --2- 10.20.193.28:0/3615873315 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa61010fc70 0x7fa610175d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:11.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.620+0000 7fa614a26640 1 --2- 10.20.193.28:0/3615873315 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa610115470 0x7fa6100f5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:11.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.620+0000 7fa60ffff640 1 -- 10.20.193.28:0/3615873315 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa610115470 msgr2=0x7fa6100f5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:11.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.620+0000 7fa60ffff640 1 --2- 10.20.193.28:0/3615873315 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa610115470 0x7fa6100f5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:11.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.620+0000 7fa60ffff640 1 -- 10.20.193.28:0/3615873315 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa600009570 con 0x7fa61010f280 2026-02-24T09:31:11.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.620+0000 7fa614a26640 1 --2- 10.20.193.28:0/3615873315 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa610115470 0x7fa6100f5d10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:31:11.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.620+0000 7fa60ffff640 1 --2- 10.20.193.28:0/3615873315 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa61010f280 0x7fa6100f5610 secure :-1 s=READY pgs=534 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5fc00d950 tx=0x7fa5fc00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:11.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.620+0000 7fa60d7fa640 1 -- 10.20.193.28:0/3615873315 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa5fc004540 con 0x7fa61010f280 2026-02-24T09:31:11.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.620+0000 7fa60d7fa640 1 -- 10.20.193.28:0/3615873315 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fa5fc009ce0 con 0x7fa61010f280 2026-02-24T09:31:11.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.620+0000 7fa60d7fa640 1 -- 10.20.193.28:0/3615873315 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa5fc0106e0 con 0x7fa61010f280 2026-02-24T09:31:11.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.620+0000 7fa6164b0640 1 -- 10.20.193.28:0/3615873315 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6100fb530 con 0x7fa61010f280 2026-02-24T09:31:11.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.621+0000 7fa6164b0640 1 -- 10.20.193.28:0/3615873315 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6100fb9b0 con 0x7fa61010f280 2026-02-24T09:31:11.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.621+0000 7fa6164b0640 1 -- 10.20.193.28:0/3615873315 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5d4005300 con 0x7fa61010f280 2026-02-24T09:31:11.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.624+0000 7fa60d7fa640 1 -- 10.20.193.28:0/3615873315 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7fa5fc0097c0 con 0x7fa61010f280 2026-02-24T09:31:11.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.625+0000 7fa60d7fa640 1 --2- 10.20.193.28:0/3615873315 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa5e40b58c0 0x7fa5e40d5d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:11.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.625+0000 7fa60d7fa640 1 -- 10.20.193.28:0/3615873315 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 8513+0+0 (secure 0 0 0) 0x7fa5fc0e7590 con 0x7fa61010f280 2026-02-24T09:31:11.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.625+0000 7fa60d7fa640 1 -- 10.20.193.28:0/3615873315 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fa5fc0e7a10 con 0x7fa61010f280 2026-02-24T09:31:11.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.626+0000 7fa60f7fe640 1 --2- 10.20.193.28:0/3615873315 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa5e40b58c0 0x7fa5e40d5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:11.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.626+0000 7fa60f7fe640 1 --2- 10.20.193.28:0/3615873315 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa5e40b58c0 0x7fa5e40d5d70 secure :-1 s=READY pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6100fbfb0 tx=0x7fa60003a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:11.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.747+0000 7fa6164b0640 1 -- 10.20.193.28:0/3615873315 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa5d4005880 con 0x7fa61010f280 2026-02-24T09:31:11.749 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:11 trial028 ceph-mon[40371]: osdmap e112: 12 total, 12 up, 12 in 2026-02-24T09:31:11.749 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:11 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/2307609929' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:31:11.749 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:11 trial028 ceph-mon[40371]: pgmap v626: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 895 B/s wr, 8 op/s 2026-02-24T09:31:11.749 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:11 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:31:11.751 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-24T09:31:11.751 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":112,"fsid":"e9ad50af-1160-11f1-800e-d404e6e7d460","created":"2026-02-24T09:12:33.966733+0000","modified":"2026-02-24T09:31:10.704193+0000","last_up_change":"2026-02-24T09:16:34.222008+0000","last_in_change":"2026-02-24T09:16:20.530109+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":38,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T09:14:33.468078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-24T09:16:57.259549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-24T09:16:58.835796+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":23,"snap_epoch":111,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7836f68-f25a-4aea-830a-3c2ce8ac79e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6803","nonce":2124354447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6805","nonce":2124354447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6809","nonce":2124354447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":2124354447},{"type":"v1","addr":"10.20.193.28:6807","nonce":2124354447}]},"public_addr":"10.20.193.28:6803/2124354447","cluster_addr":"10.20.193.28:6805/2124354447","heartbeat_back_addr":"10.20.193.28:6809/2124354447","heartbeat_front_addr":"10.20.193.28:6807/2124354447","state":["exists","up"]},{"osd":1,"uuid":"04273ff8-91e3-4e70-8041-cc8c205b9a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6800","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6801","nonce":267363486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6802","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6803","nonce":267363486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6806","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6807","nonce":267363486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6804","nonce":267363486},{"type":"v1","addr":"10.20.193.74:6805","nonce":267363486}]},"public_addr":"10.20.193.74:6801/267363486","cluster_addr":"10.20.193.74:6803/267363486","heartbeat_back_addr":"10.20.193.74:6807/267363486","heartbeat_front_addr":"10.20.193.74:6805/267363486","state":["exists","up"]},{"osd":2,"uuid":"dea96db1-588b-4d08-8e52-52c4c995bdc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6800","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6801","nonce":3320466721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6802","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6803","nonce":3320466721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6806","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6807","nonce":3320466721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6804","nonce":3320466721},{"type":"v1","addr":"10.20.193.159:6805","nonce":3320466721}]},"public_addr":"10.20.193.159:6801/3320466721","cluster_addr":"10.20.193.159:6803/3320466721","heartbeat_back_addr":"10.20.193.159:6807/3320466721","heartbeat_front_addr":"10.20.193.159:6805/3320466721","state":["exists","up"]},{"osd":3,"uuid":"c785c244-eb3f-4af5-83c6-cd492459f75e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6811","nonce":1790609615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6813","nonce":1790609615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6817","nonce":1790609615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":1790609615},{"type":"v1","addr":"10.20.193.28:6815","nonce":1790609615}]},"public_addr":"10.20.193.28:6811/1790609615","cluster_addr":"10.20.193.28:6813/1790609615","heartbeat_back_addr":"10.20.193.28:6817/1790609615","heartbeat_front_addr":"10.20.193.28:6815/1790609615","state":["exists","up"]},{"osd":4,"uuid":"041239c2-6187-4154-9557-b1b5846f9e0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6808","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6809","nonce":610990618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6810","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6811","nonce":610990618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6814","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6815","nonce":610990618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6812","nonce":610990618},{"type":"v1","addr":"10.20.193.74:6813","nonce":610990618}]},"public_addr":"10.20.193.74:6809/610990618","cluster_addr":"10.20.193.74:6811/610990618","heartbeat_back_addr":"10.20.193.74:6815/610990618","heartbeat_front_addr":"10.20.193.74:6813/610990618","state":["exists","up"]},{"osd":5,"uuid":"ffeeb021-0924-4421-aecf-bac2e74364a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6808","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6809","nonce":1653417923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6810","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6811","nonce":1653417923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6814","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6815","nonce":1653417923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6812","nonce":1653417923},{"type":"v1","addr":"10.20.193.159:6813","nonce":1653417923}]},"public_addr":"10.20.193.159:6809/1653417923","cluster_addr":"10.20.193.159:6811/1653417923","heartbeat_back_addr":"10.20.193.159:6815/1653417923","heartbeat_front_addr":"10.20.193.159:6813/1653417923","state":["exists","up"]},{"osd":6,"uuid":"f3736156-4951-4901-9323-7930fb73b8dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6819","nonce":1891043856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6821","nonce":1891043856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6825","nonce":1891043856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":1891043856},{"type":"v1","addr":"10.20.193.28:6823","nonce":1891043856}]},"public_addr":"10.20.193.28:6819/1891043856","cluster_addr":"10.20.193.28:6821/1891043856","heartbeat_back_addr":"10.20.193.28:6825/1891043856","heartbeat_front_addr":"10.20.193.28:6823/1891043856","state":["exists","up"]},{"osd":7,"uuid":"214b27ee-75f9-4a54-a59b-e8bfbb895903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6816","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6817","nonce":2328869739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6818","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6819","nonce":2328869739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6822","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6823","nonce":2328869739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6820","nonce":2328869739},{"type":"v1","addr":"10.20.193.74:6821","nonce":2328869739}]},"public_addr":"10.20.193.74:6817/2328869739","cluster_addr":"10.20.193.74:6819/2328869739","heartbeat_back_addr":"10.20.193.74:6823/2328869739","heartbeat_front_addr":"10.20.193.74:6821/2328869739","state":["exists","up"]},{"osd":8,"uuid":"76599c26-6778-4fa2-b85d-feea8baac7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6816","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6817","nonce":3877834753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6818","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6819","nonce":3877834753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6822","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6823","nonce":3877834753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6820","nonce":3877834753},{"type":"v1","addr":"10.20.193.159:6821","nonce":3877834753}]},"public_addr":"10.20.193.159:6817/3877834753","cluster_addr":"10.20.193.159:6819/3877834753","heartbeat_back_addr":"10.20.193.159:6823/3877834753","heartbeat_front_addr":"10.20.193.159:6821/3877834753","state":["exists","up"]},{"osd":9,"uuid":"52b52b35-2d65-4e53-b7d8-fd7385d5ae88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6827","nonce":4207785690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6829","nonce":4207785690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6833","nonce":4207785690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":4207785690},{"type":"v1","addr":"10.20.193.28:6831","nonce":4207785690}]},"public_addr":"10.20.193.28:6827/4207785690","cluster_addr":"10.20.193.28:6829/4207785690","heartbeat_back_addr":"10.20.193.28:6833/4207785690","heartbeat_front_addr":"10.20.193.28:6831/4207785690","state":["exists","up"]},{"osd":10,"uuid":"65c8e576-a1c7-4c03-bbf6-57c775f2860f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6824","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6825","nonce":2590408209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6826","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6827","nonce":2590408209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6830","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6831","nonce":2590408209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.74:6828","nonce":2590408209},{"type":"v1","addr":"10.20.193.74:6829","nonce":2590408209}]},"public_addr":"10.20.193.74:6825/2590408209","cluster_addr":"10.20.193.74:6827/2590408209","heartbeat_back_addr":"10.20.193.74:6831/2590408209","heartbeat_front_addr":"10.20.193.74:6829/2590408209","state":["exists","up"]},{"osd":11,"uuid":"e2305377-fadb-4cf0-8384-87387f116255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":87,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6824","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6825","nonce":709820718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6826","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6827","nonce":709820718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6830","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6831","nonce":709820718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.159:6828","nonce":709820718},{"type":"v1","addr":"10.20.193.159:6829","nonce":709820718}]},"public_addr":"10.20.193.159:6825/709820718","cluster_addr":"10.20.193.159:6827/709820718","heartbeat_back_addr":"10.20.193.159:6831/709820718","heartbeat_front_addr":"10.20.193.159:6829/709820718","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:02.414561+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:16.784172+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:30.639920+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:44.510387+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:14:58.186053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:11.714819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:25.188981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:38.602303+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:15:51.899864+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:16:05.444224+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:16:18.900719+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:16:32.290361+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.c","mappings":[{"from":3,"to":9},{"from":5,"to":8}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:0/3696280830":"2026-02-25T09:13:39.242729+0000","10.20.193.28:6801/3539300247":"2026-02-25T09:13:39.242729+0000","10.20.193.28:0/3799405177":"2026-02-25T09:12:46.171932+0000","10.20.193.28:0/1189576634":"2026-02-25T09:12:46.171932+0000","10.20.193.28:6800/1682009277":"2026-02-25T09:12:46.171932+0000","10.20.193.28:6800/3539300247":"2026-02-25T09:13:39.242729+0000","10.20.193.28:6801/1682009277":"2026-02-25T09:12:46.171932+0000","10.20.193.28:0/673213915":"2026-02-25T09:12:59.028609+0000","10.20.193.28:0/857248143":"2026-02-25T09:13:39.242729+0000","10.20.193.28:0/1541006046":"2026-02-25T09:12:46.171932+0000","10.20.193.28:0/264576041":"2026-02-25T09:12:59.028609+0000","10.20.193.28:6800/2303472235":"2026-02-25T09:12:59.028609+0000","10.20.193.28:6801/2303472235":"2026-02-25T09:12:59.028609+0000","10.20.193.28:0/2622827224":"2026-02-25T09:12:59.028609+0000","10.20.193.28:0/3614117448":"2026-02-25T09:13:39.242729+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":10,"length":1},{"begin":23,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T09:31:11.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.748+0000 7fa60d7fa640 1 -- 10.20.193.28:0/3615873315 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) ==== 74+0+23242 (secure 0 0 0) 0x7fa5fc0a9d00 con 0x7fa61010f280 2026-02-24T09:31:11.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.750+0000 7fa6164b0640 1 -- 10.20.193.28:0/3615873315 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa5e40b58c0 msgr2=0x7fa5e40d5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:11.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.750+0000 7fa6164b0640 1 --2- 10.20.193.28:0/3615873315 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa5e40b58c0 0x7fa5e40d5d70 secure :-1 s=READY pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6100fbfb0 tx=0x7fa60003a040 comp rx=0 tx=0).stop 2026-02-24T09:31:11.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.750+0000 7fa6164b0640 1 -- 10.20.193.28:0/3615873315 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa61010f280 msgr2=0x7fa6100f5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:11.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.750+0000 7fa6164b0640 1 --2- 10.20.193.28:0/3615873315 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa61010f280 0x7fa6100f5610 secure :-1 s=READY pgs=534 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5fc00d950 tx=0x7fa5fc00de20 comp rx=0 tx=0).stop 2026-02-24T09:31:11.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.750+0000 7fa6164b0640 1 -- 10.20.193.28:0/3615873315 shutdown_connections 2026-02-24T09:31:11.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.750+0000 7fa6164b0640 1 --2- 10.20.193.28:0/3615873315 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fa5e40b58c0 0x7fa5e40d5d70 unknown :-1 s=CLOSED pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:11.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.750+0000 7fa6164b0640 1 --2- 10.20.193.28:0/3615873315 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fa610115470 0x7fa6100f5d10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:11.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.750+0000 7fa6164b0640 1 --2- 10.20.193.28:0/3615873315 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fa61010fc70 0x7fa610175d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:11.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.750+0000 7fa6164b0640 1 --2- 10.20.193.28:0/3615873315 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa61010f280 0x7fa6100f5610 unknown :-1 s=CLOSED pgs=534 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:11.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.750+0000 7fa6164b0640 1 -- 10.20.193.28:0/3615873315 >> 10.20.193.28:0/3615873315 conn(0x7fa61005f830 msgr2=0x7fa610111a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:11.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.750+0000 7fa6164b0640 1 -- 10.20.193.28:0/3615873315 shutdown_connections 2026-02-24T09:31:11.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:11.750+0000 7fa6164b0640 1 -- 10.20.193.28:0/3615873315 wait complete. 2026-02-24T09:31:11.857 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph fs fail cephfs 2026-02-24T09:31:12.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:11 trial159 ceph-mon[44242]: osdmap e112: 12 total, 12 up, 12 in 2026-02-24T09:31:12.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:11 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/2307609929' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:31:12.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:11 trial159 ceph-mon[44242]: pgmap v626: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 895 B/s wr, 8 op/s 2026-02-24T09:31:12.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:11 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:31:12.045 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:31:12.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:11 trial074 ceph-mon[44412]: osdmap e112: 12 total, 12 up, 12 in 2026-02-24T09:31:12.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:11 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/2307609929' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:31:12.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:11 trial074 ceph-mon[44412]: pgmap v626: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 895 B/s wr, 8 op/s 2026-02-24T09:31:12.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:11 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:31:12.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.229+0000 7f85e179d640 1 -- 10.20.193.28:0/314512462 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85dc114a10 msgr2=0x7f85dc1191f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:12.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.229+0000 7f85e179d640 1 --2- 10.20.193.28:0/314512462 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85dc114a10 0x7f85dc1191f0 secure :-1 s=READY pgs=535 gs=1 cs=0 l=1 c_cookie=4374706461478776818 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85cc009950 tx=0x7f85cc02f1b0 comp rx=0 tx=0).stop 2026-02-24T09:31:12.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.229+0000 7f85e179d640 1 -- 10.20.193.28:0/314512462 shutdown_connections 2026-02-24T09:31:12.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.229+0000 7f85e179d640 1 --2- 10.20.193.28:0/314512462 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f85dc1199a0 0x7f85dc17a370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:12.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.229+0000 7f85e179d640 1 --2- 10.20.193.28:0/314512462 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85dc114a10 0x7f85dc1191f0 unknown :-1 s=CLOSED pgs=535 gs=1 cs=0 l=1 c_cookie=4374706461478776818 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:12.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.229+0000 7f85e179d640 1 --2- 10.20.193.28:0/314512462 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f85dc114020 0x7f85dc1143f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:12.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.229+0000 7f85e179d640 1 -- 10.20.193.28:0/314512462 >> 10.20.193.28:0/314512462 conn(0x7f85dc064810 msgr2=0x7f85dc064c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:12.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.229+0000 7f85e179d640 1 -- 10.20.193.28:0/314512462 shutdown_connections 2026-02-24T09:31:12.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.229+0000 7f85e179d640 1 -- 10.20.193.28:0/314512462 wait complete. 2026-02-24T09:31:12.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.230+0000 7f85e179d640 1 Processor -- start 2026-02-24T09:31:12.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.230+0000 7f85e179d640 1 -- start start 2026-02-24T09:31:12.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.230+0000 7f85e179d640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f85dc114020 0x7f85dc06e4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:12.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.230+0000 7f85e179d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85dc114a10 0x7f85dc17a270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:12.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.230+0000 7f85e179d640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f85dc1199a0 0x7f85dc06ea00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:12.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.230+0000 7f85e179d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f85dc06f190 con 0x7f85dc114a10 2026-02-24T09:31:12.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.230+0000 7f85e179d640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f85dc10a320 con 0x7f85dc1199a0 2026-02-24T09:31:12.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.230+0000 7f85e179d640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f85dc10a4b0 con 0x7f85dc114020 2026-02-24T09:31:12.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.230+0000 7f85db7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85dc114a10 0x7f85dc17a270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:12.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.231+0000 7f85dbfff640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f85dc114020 0x7f85dc06e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:12.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.231+0000 7f85db7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85dc114a10 0x7f85dc17a270 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37910/0 (socket says 10.20.193.28:37910) 2026-02-24T09:31:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.231+0000 7f85db7fe640 1 -- 10.20.193.28:0/2922712268 learned_addr learned my addr 10.20.193.28:0/2922712268 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:31:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.231+0000 7f85e0f9c640 1 --2- 10.20.193.28:0/2922712268 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f85dc1199a0 0x7f85dc06ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.231+0000 7f85db7fe640 1 -- 10.20.193.28:0/2922712268 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f85dc114020 msgr2=0x7f85dc06e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.231+0000 7f85db7fe640 1 --2- 10.20.193.28:0/2922712268 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f85dc114020 0x7f85dc06e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.231+0000 7f85db7fe640 1 -- 10.20.193.28:0/2922712268 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f85dc1199a0 msgr2=0x7f85dc06ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.231+0000 7f85db7fe640 1 --2- 10.20.193.28:0/2922712268 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f85dc1199a0 0x7f85dc06ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.231+0000 7f85db7fe640 1 -- 10.20.193.28:0/2922712268 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85cc009570 con 0x7f85dc114a10 2026-02-24T09:31:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.231+0000 7f85db7fe640 1 --2- 10.20.193.28:0/2922712268 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85dc114a10 0x7f85dc17a270 secure :-1 s=READY pgs=536 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85cc0023d0 tx=0x7f85cc0028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.231+0000 7f85d97fa640 1 -- 10.20.193.28:0/2922712268 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f85cc03d070 con 0x7f85dc114a10 2026-02-24T09:31:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.231+0000 7f85d97fa640 1 -- 10.20.193.28:0/2922712268 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f85cc002a40 con 0x7f85dc114a10 2026-02-24T09:31:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.231+0000 7f85e179d640 1 -- 10.20.193.28:0/2922712268 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85dc10a730 con 0x7f85dc114a10 2026-02-24T09:31:12.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.231+0000 7f85d97fa640 1 -- 10.20.193.28:0/2922712268 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f85cc041930 con 0x7f85dc114a10 2026-02-24T09:31:12.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.231+0000 7f85e179d640 1 -- 10.20.193.28:0/2922712268 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85dc10abf0 con 0x7f85dc114a10 2026-02-24T09:31:12.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.232+0000 7f85e179d640 1 -- 10.20.193.28:0/2922712268 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85dc067220 con 0x7f85dc114a10 2026-02-24T09:31:12.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.234+0000 7f85d97fa640 1 -- 10.20.193.28:0/2922712268 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7f85cc0386b0 con 0x7f85dc114a10 2026-02-24T09:31:12.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.236+0000 7f85d97fa640 1 --2- 10.20.193.28:0/2922712268 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f85b00b58d0 0x7f85b00d5d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:12.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.236+0000 7f85d97fa640 1 -- 10.20.193.28:0/2922712268 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 8513+0+0 (secure 0 0 0) 0x7f85cc10b860 con 0x7f85dc114a10 2026-02-24T09:31:12.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.236+0000 7f85dbfff640 1 --2- 10.20.193.28:0/2922712268 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f85b00b58d0 0x7f85b00d5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:12.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.236+0000 7f85d97fa640 1 -- 10.20.193.28:0/2922712268 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f85cc144930 con 0x7f85dc114a10 2026-02-24T09:31:12.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.236+0000 7f85dbfff640 1 --2- 10.20.193.28:0/2922712268 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f85b00b58d0 0x7f85b00d5d80 secure :-1 s=READY pgs=271 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85c8004740 tx=0x7f85c8004420 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:12.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.378+0000 7f85e179d640 1 -- 10.20.193.28:0/2922712268 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f85dc06f5d0 con 0x7f85dc114a10 2026-02-24T09:31:12.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.380+0000 7f85d97fa640 1 -- 10.20.193.28:0/2922712268 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) ==== 161+0+0 (secure 0 0 0) 0x7f85cc0cd070 con 0x7f85dc114a10 2026-02-24T09:31:12.381 INFO:teuthology.orchestra.run.trial028.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2026-02-24T09:31:12.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.382+0000 7f85e179d640 1 -- 10.20.193.28:0/2922712268 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f85b00b58d0 msgr2=0x7f85b00d5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:12.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.382+0000 7f85e179d640 1 --2- 10.20.193.28:0/2922712268 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f85b00b58d0 0x7f85b00d5d80 secure :-1 s=READY pgs=271 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85c8004740 tx=0x7f85c8004420 comp rx=0 tx=0).stop 2026-02-24T09:31:12.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.382+0000 7f85e179d640 1 -- 10.20.193.28:0/2922712268 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85dc114a10 msgr2=0x7f85dc17a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:12.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.382+0000 7f85e179d640 1 --2- 10.20.193.28:0/2922712268 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85dc114a10 0x7f85dc17a270 secure :-1 s=READY pgs=536 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85cc0023d0 tx=0x7f85cc0028d0 comp rx=0 tx=0).stop 2026-02-24T09:31:12.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.382+0000 7f85e179d640 1 -- 10.20.193.28:0/2922712268 shutdown_connections 2026-02-24T09:31:12.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.382+0000 7f85e179d640 1 --2- 10.20.193.28:0/2922712268 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f85b00b58d0 0x7f85b00d5d80 unknown :-1 s=CLOSED pgs=271 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:12.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.382+0000 7f85e179d640 1 --2- 10.20.193.28:0/2922712268 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f85dc1199a0 0x7f85dc06ea00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:12.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.382+0000 7f85e179d640 1 --2- 10.20.193.28:0/2922712268 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85dc114a10 0x7f85dc17a270 unknown :-1 s=CLOSED pgs=536 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:12.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.382+0000 7f85e179d640 1 --2- 10.20.193.28:0/2922712268 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f85dc114020 0x7f85dc06e4c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:12.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.382+0000 7f85e179d640 1 -- 10.20.193.28:0/2922712268 >> 10.20.193.28:0/2922712268 conn(0x7f85dc064810 msgr2=0x7f85dc117780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:12.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.383+0000 7f85e179d640 1 -- 10.20.193.28:0/2922712268 shutdown_connections 2026-02-24T09:31:12.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.383+0000 7f85e179d640 1 -- 10.20.193.28:0/2922712268 wait complete. 2026-02-24T09:31:12.482 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph fs rm cephfs --yes-i-really-mean-it 2026-02-24T09:31:12.667 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:31:12.710 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:12 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mon-a[40367]: 2026-02-24T09:31:12.379+0000 7f3b5288e640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2026-02-24T09:31:12.711 INFO:journalctl@ceph.mds.a.trial028.stdout:Feb 24 09:31:12 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-a[109619]: ignoring --setuser ceph since I am not root 2026-02-24T09:31:12.711 INFO:journalctl@ceph.mds.a.trial028.stdout:Feb 24 09:31:12 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-a[109619]: ignoring --setgroup ceph since I am not root 2026-02-24T09:31:12.711 INFO:journalctl@ceph.mds.a.trial028.stdout:Feb 24 09:31:12 trial028 ceph-mds[109623]: -- 10.20.193.28:0/3641437992 <== mon.2 v2:10.20.193.74:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0xd9d0ea0 con 0xdb12000 2026-02-24T09:31:12.711 INFO:journalctl@ceph.mds.a.trial028.stdout:Feb 24 09:31:12 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-a[109619]: starting mds.a at 2026-02-24T09:31:12.712 INFO:journalctl@ceph.mds.i.trial159.stdout:Feb 24 09:31:12 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-i[98194]: ignoring --setuser ceph since I am not root 2026-02-24T09:31:12.712 INFO:journalctl@ceph.mds.i.trial159.stdout:Feb 24 09:31:12 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-i[98194]: ignoring --setgroup ceph since I am not root 2026-02-24T09:31:12.713 INFO:journalctl@ceph.mds.i.trial159.stdout:Feb 24 09:31:12 trial159 ceph-mds[98198]: -- 10.20.193.159:0/3529046152 <== mon.1 v2:10.20.193.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x39466ea0 con 0x395a8000 2026-02-24T09:31:12.713 INFO:journalctl@ceph.mds.i.trial159.stdout:Feb 24 09:31:12 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-i[98194]: starting mds.i at 2026-02-24T09:31:12.713 INFO:journalctl@ceph.mds.c.trial159.stdout:Feb 24 09:31:12 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-c[97899]: ignoring --setuser ceph since I am not root 2026-02-24T09:31:12.713 INFO:journalctl@ceph.mds.c.trial159.stdout:Feb 24 09:31:12 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-c[97899]: ignoring --setgroup ceph since I am not root 2026-02-24T09:31:12.713 INFO:journalctl@ceph.mds.c.trial159.stdout:Feb 24 09:31:12 trial159 ceph-mds[97903]: -- 10.20.193.159:0/878268045 <== mon.1 v2:10.20.193.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x1901aea0 con 0x1915c400 2026-02-24T09:31:12.713 INFO:journalctl@ceph.mds.c.trial159.stdout:Feb 24 09:31:12 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-c[97899]: starting mds.c at 2026-02-24T09:31:12.714 INFO:journalctl@ceph.mds.e.trial074.stdout:Feb 24 09:31:12 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-e[97215]: ignoring --setuser ceph since I am not root 2026-02-24T09:31:12.714 INFO:journalctl@ceph.mds.e.trial074.stdout:Feb 24 09:31:12 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-e[97215]: ignoring --setgroup ceph since I am not root 2026-02-24T09:31:12.714 INFO:journalctl@ceph.mds.e.trial074.stdout:Feb 24 09:31:12 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-e[97215]: starting mds.e at 2026-02-24T09:31:12.714 INFO:journalctl@ceph.mds.h.trial074.stdout:Feb 24 09:31:12 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-h[97510]: ignoring --setuser ceph since I am not root 2026-02-24T09:31:12.714 INFO:journalctl@ceph.mds.h.trial074.stdout:Feb 24 09:31:12 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-h[97510]: ignoring --setgroup ceph since I am not root 2026-02-24T09:31:12.714 INFO:journalctl@ceph.mds.h.trial074.stdout:Feb 24 09:31:12 trial074 ceph-mds[97514]: -- 10.20.193.74:0/3654696126 <== mon.2 v2:10.20.193.74:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0xbb8eea0 con 0xbcd0400 2026-02-24T09:31:12.715 INFO:journalctl@ceph.mds.h.trial074.stdout:Feb 24 09:31:12 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-h[97510]: starting mds.h at 2026-02-24T09:31:12.715 INFO:journalctl@ceph.mds.b.trial074.stdout:Feb 24 09:31:12 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-b[97806]: ignoring --setuser ceph since I am not root 2026-02-24T09:31:12.715 INFO:journalctl@ceph.mds.b.trial074.stdout:Feb 24 09:31:12 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-b[97806]: ignoring --setgroup ceph since I am not root 2026-02-24T09:31:12.715 INFO:journalctl@ceph.mds.b.trial074.stdout:Feb 24 09:31:12 trial074 ceph-mds[97810]: --2- 10.20.193.74:0/3852794526 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x8e6bc00 0x8f74000 secure :-1 s=READY pgs=120 gs=1 cs=0 l=1 c_cookie=17801318484069822367 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x8e24570 tx=0x8e0daa0 comp rx=0 tx=0).write_message sending message m=0x8e41500 seq=3 auth(proto 2 2 bytes epoch 0) 2026-02-24T09:31:12.715 INFO:journalctl@ceph.mds.b.trial074.stdout:Feb 24 09:31:12 trial074 ceph-mds[97810]: -- 10.20.193.74:0/3852794526 <== mon.2 v2:10.20.193.74:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x8e36ea0 con 0x8e6bc00 2026-02-24T09:31:12.715 INFO:journalctl@ceph.mds.b.trial074.stdout:Feb 24 09:31:12 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-b[97806]: starting mds.b at 2026-02-24T09:31:12.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.856+0000 7f43982d0640 1 -- 10.20.193.28:0/3835949277 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4390115930 msgr2=0x7f4390176300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:12.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.856+0000 7f43982d0640 1 --2- 10.20.193.28:0/3835949277 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4390115930 0x7f4390176300 secure :-1 s=READY pgs=538 gs=1 cs=0 l=1 c_cookie=2349547803481866308 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f438c00aa30 tx=0x7f438c030270 comp rx=0 tx=0).stop 2026-02-24T09:31:12.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.856+0000 7f43982d0640 1 -- 10.20.193.28:0/3835949277 shutdown_connections 2026-02-24T09:31:12.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.856+0000 7f43982d0640 1 --2- 10.20.193.28:0/3835949277 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4390115930 0x7f4390176300 unknown :-1 s=CLOSED pgs=538 gs=1 cs=0 l=1 c_cookie=2349547803481866308 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:12.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.856+0000 7f43982d0640 1 --2- 10.20.193.28:0/3835949277 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f4390110130 0x7f4390115180 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:12.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.856+0000 7f43982d0640 1 --2- 10.20.193.28:0/3835949277 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f439010f740 0x7f439010fb10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:12.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.856+0000 7f43982d0640 1 -- 10.20.193.28:0/3835949277 >> 10.20.193.28:0/3835949277 conn(0x7f43900ed050 msgr2=0x7f439010d460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:12.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.856+0000 7f43982d0640 1 -- 10.20.193.28:0/3835949277 shutdown_connections 2026-02-24T09:31:12.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.856+0000 7f43982d0640 1 -- 10.20.193.28:0/3835949277 wait complete. 2026-02-24T09:31:12.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.856+0000 7f43982d0640 1 Processor -- start 2026-02-24T09:31:12.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.857+0000 7f43982d0640 1 -- start start 2026-02-24T09:31:12.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.857+0000 7f43982d0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f439010f740 0x7f439011e060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:12.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.857+0000 7f43982d0640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f4390110130 0x7f439011e5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:12.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.857+0000 7f43982d0640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f4390115930 0x7f4390123970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:12.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.857+0000 7f43982d0640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4390123f00 con 0x7f439010f740 2026-02-24T09:31:12.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.857+0000 7f43982d0640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f4390124070 con 0x7f4390115930 2026-02-24T09:31:12.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.857+0000 7f43982d0640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4390124230 con 0x7f4390110130 2026-02-24T09:31:12.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.857+0000 7f4396045640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f439010f740 0x7f439011e060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:12.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.857+0000 7f4396045640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f439010f740 0x7f439011e060 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37938/0 (socket says 10.20.193.28:37938) 2026-02-24T09:31:12.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.857+0000 7f4396045640 1 -- 10.20.193.28:0/1750921891 learned_addr learned my addr 10.20.193.28:0/1750921891 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:31:12.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.857+0000 7f4395844640 1 --2- 10.20.193.28:0/1750921891 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f4390110130 0x7f439011e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:12.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.857+0000 7f4396846640 1 --2- 10.20.193.28:0/1750921891 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f4390115930 0x7f4390123970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:12.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.857+0000 7f4396045640 1 -- 10.20.193.28:0/1750921891 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f4390110130 msgr2=0x7f439011e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:12.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.857+0000 7f4396045640 1 --2- 10.20.193.28:0/1750921891 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f4390110130 0x7f439011e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:12.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.857+0000 7f4396045640 1 -- 10.20.193.28:0/1750921891 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f4390115930 msgr2=0x7f4390123970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:12.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.857+0000 7f4396045640 1 --2- 10.20.193.28:0/1750921891 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f4390115930 0x7f4390123970 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:12.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.857+0000 7f4396045640 1 -- 10.20.193.28:0/1750921891 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f438c00a650 con 0x7f439010f740 2026-02-24T09:31:12.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.858+0000 7f4396045640 1 --2- 10.20.193.28:0/1750921891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f439010f740 0x7f439011e060 secure :-1 s=READY pgs=539 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f438000c9b0 tx=0x7f438000ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:12.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.858+0000 7f43777fe640 1 -- 10.20.193.28:0/1750921891 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f43800044a0 con 0x7f439010f740 2026-02-24T09:31:12.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.858+0000 7f43777fe640 1 -- 10.20.193.28:0/1750921891 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f4380007d00 con 0x7f439010f740 2026-02-24T09:31:12.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.858+0000 7f43777fe640 1 -- 10.20.193.28:0/1750921891 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f438000f6d0 con 0x7f439010f740 2026-02-24T09:31:12.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.858+0000 7f43982d0640 1 -- 10.20.193.28:0/1750921891 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4390124510 con 0x7f439010f740 2026-02-24T09:31:12.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.858+0000 7f43982d0640 1 -- 10.20.193.28:0/1750921891 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43901247f0 con 0x7f439010f740 2026-02-24T09:31:12.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.859+0000 7f43982d0640 1 -- 10.20.193.28:0/1750921891 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4390110a20 con 0x7f439010f740 2026-02-24T09:31:12.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.861+0000 7f43777fe640 1 -- 10.20.193.28:0/1750921891 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7f4380007840 con 0x7f439010f740 2026-02-24T09:31:12.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.863+0000 7f43777fe640 1 --2- 10.20.193.28:0/1750921891 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f436c0b58d0 0x7f436c0d5d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:12.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.863+0000 7f43777fe640 1 -- 10.20.193.28:0/1750921891 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 8727+0+0 (secure 0 0 0) 0x7f43800e7170 con 0x7f439010f740 2026-02-24T09:31:12.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.863+0000 7f4395844640 1 --2- 10.20.193.28:0/1750921891 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f436c0b58d0 0x7f436c0d5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:12.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.863+0000 7f43777fe640 1 -- 10.20.193.28:0/1750921891 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f43800e75f0 con 0x7f439010f740 2026-02-24T09:31:12.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:12.863+0000 7f4395844640 1 --2- 10.20.193.28:0/1750921891 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f436c0b58d0 0x7f436c0d5d80 secure :-1 s=READY pgs=272 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4390124a00 tx=0x7f438400a380 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:13.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.004+0000 7f43982d0640 1 -- 10.20.193.28:0/1750921891 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f439011f1c0 con 0x7f439010f740 2026-02-24T09:31:13.006 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:12 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/3615873315' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:31:13.006 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:12 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:31:13.006 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:12 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:31:13.006 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:12 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:31:13.006 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:12 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:31:13.007 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:12 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/2922712268' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2026-02-24T09:31:13.007 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:12 trial028 ceph-mon[40371]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2026-02-24T09:31:13.007 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:12 trial028 ceph-mon[40371]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2026-02-24T09:31:13.007 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:12 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/2922712268' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2026-02-24T09:31:13.007 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:12 trial028 ceph-mon[40371]: osdmap e113: 12 total, 12 up, 12 in 2026-02-24T09:31:13.007 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:12 trial028 ceph-mon[40371]: fsmap cephfs:0/3 6 up:standby, 3 failed 2026-02-24T09:31:13.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:12 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/3615873315' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:31:13.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:12 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:31:13.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:12 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:31:13.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:12 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:31:13.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:12 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:31:13.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:12 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/2922712268' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2026-02-24T09:31:13.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:12 trial159 ceph-mon[44242]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2026-02-24T09:31:13.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:12 trial159 ceph-mon[44242]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2026-02-24T09:31:13.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:12 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/2922712268' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2026-02-24T09:31:13.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:12 trial159 ceph-mon[44242]: osdmap e113: 12 total, 12 up, 12 in 2026-02-24T09:31:13.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:12 trial159 ceph-mon[44242]: fsmap cephfs:0/3 6 up:standby, 3 failed 2026-02-24T09:31:13.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:12 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/3615873315' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:31:13.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:12 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:31:13.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:12 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:31:13.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:12 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' 2026-02-24T09:31:13.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:12 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:31:13.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:12 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/2922712268' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2026-02-24T09:31:13.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:12 trial074 ceph-mon[44412]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2026-02-24T09:31:13.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:12 trial074 ceph-mon[44412]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2026-02-24T09:31:13.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:12 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/2922712268' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2026-02-24T09:31:13.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:12 trial074 ceph-mon[44412]: osdmap e113: 12 total, 12 up, 12 in 2026-02-24T09:31:13.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:12 trial074 ceph-mon[44412]: fsmap cephfs:0/3 6 up:standby, 3 failed 2026-02-24T09:31:13.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.381+0000 7f43777fe640 1 -- 10.20.193.28:0/1750921891 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 If there are active snapshot schedules associated with this file-system, you might see EIO errors in the mgr logs or at the snap-schedule command-line due to the missing file-system. However, these errors are transient and will get auto-resolved. v25) ==== 350+0+0 (secure 0 0 0) 0x7f43800a97b0 con 0x7f439010f740 2026-02-24T09:31:13.383 INFO:teuthology.orchestra.run.trial028.stderr:If there are active snapshot schedules associated with this file-system, you might see EIO errors in the mgr logs or at the snap-schedule command-line due to the missing file-system. However, these errors are transient and will get auto-resolved. 2026-02-24T09:31:13.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.383+0000 7f43982d0640 1 -- 10.20.193.28:0/1750921891 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f436c0b58d0 msgr2=0x7f436c0d5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:13.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.383+0000 7f43982d0640 1 --2- 10.20.193.28:0/1750921891 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f436c0b58d0 0x7f436c0d5d80 secure :-1 s=READY pgs=272 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4390124a00 tx=0x7f438400a380 comp rx=0 tx=0).stop 2026-02-24T09:31:13.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.383+0000 7f43982d0640 1 -- 10.20.193.28:0/1750921891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f439010f740 msgr2=0x7f439011e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:13.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.383+0000 7f43982d0640 1 --2- 10.20.193.28:0/1750921891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f439010f740 0x7f439011e060 secure :-1 s=READY pgs=539 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f438000c9b0 tx=0x7f438000ce80 comp rx=0 tx=0).stop 2026-02-24T09:31:13.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.384+0000 7f43982d0640 1 -- 10.20.193.28:0/1750921891 shutdown_connections 2026-02-24T09:31:13.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.384+0000 7f43982d0640 1 --2- 10.20.193.28:0/1750921891 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f436c0b58d0 0x7f436c0d5d80 unknown :-1 s=CLOSED pgs=272 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:13.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.384+0000 7f43982d0640 1 --2- 10.20.193.28:0/1750921891 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f4390115930 0x7f4390123970 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:13.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.384+0000 7f43982d0640 1 --2- 10.20.193.28:0/1750921891 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f4390110130 0x7f439011e5a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:13.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.384+0000 7f43982d0640 1 --2- 10.20.193.28:0/1750921891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f439010f740 0x7f439011e060 unknown :-1 s=CLOSED pgs=539 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:13.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.384+0000 7f43982d0640 1 -- 10.20.193.28:0/1750921891 >> 10.20.193.28:0/1750921891 conn(0x7f43900ed050 msgr2=0x7f439010d430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:13.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.384+0000 7f43982d0640 1 -- 10.20.193.28:0/1750921891 shutdown_connections 2026-02-24T09:31:13.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.384+0000 7f43982d0640 1 -- 10.20.193.28:0/1750921891 wait complete. 2026-02-24T09:31:13.489 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2026-02-24T09:31:13.673 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:31:13.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.856+0000 7f878f09c640 1 -- 10.20.193.28:0/1745732984 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f87881112f0 msgr2=0x7f8788111cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:13.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.856+0000 7f878f09c640 1 --2- 10.20.193.28:0/1745732984 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f87881112f0 0x7f8788111cd0 secure :-1 s=READY pgs=540 gs=1 cs=0 l=1 c_cookie=3532330809236508965 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f878400aa30 tx=0x7f8784030270 comp rx=0 tx=0).stop 2026-02-24T09:31:13.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.856+0000 7f878f09c640 1 -- 10.20.193.28:0/1745732984 shutdown_connections 2026-02-24T09:31:13.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.856+0000 7f878f09c640 1 --2- 10.20.193.28:0/1745732984 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f87881112f0 0x7f8788111cd0 unknown :-1 s=CLOSED pgs=540 gs=1 cs=0 l=1 c_cookie=3532330809236508965 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:13.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.856+0000 7f878f09c640 1 --2- 10.20.193.28:0/1745732984 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f878810bcd0 0x7f8788110b60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:13.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.856+0000 7f878f09c640 1 --2- 10.20.193.28:0/1745732984 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f878810b2e0 0x7f878810b6b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:13.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.856+0000 7f878f09c640 1 -- 10.20.193.28:0/1745732984 >> 10.20.193.28:0/1745732984 conn(0x7f87880e8e50 msgr2=0x7f8788109260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:13.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.856+0000 7f878f09c640 1 -- 10.20.193.28:0/1745732984 shutdown_connections 2026-02-24T09:31:13.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.856+0000 7f878f09c640 1 -- 10.20.193.28:0/1745732984 wait complete. 2026-02-24T09:31:13.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.857+0000 7f878f09c640 1 Processor -- start 2026-02-24T09:31:13.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.857+0000 7f878f09c640 1 -- start start 2026-02-24T09:31:13.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.858+0000 7f878f09c640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f878810b2e0 0x7f8788122ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:13.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.858+0000 7f878f09c640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f878810bcd0 0x7f87881230e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:13.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.858+0000 7f878f09c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f87881112f0 0x7f87881284b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:13.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.858+0000 7f878f09c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8788128ad0 con 0x7f87881112f0 2026-02-24T09:31:13.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.858+0000 7f878f09c640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7f8788128c40 con 0x7f878810bcd0 2026-02-24T09:31:13.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.858+0000 7f878f09c640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8788128e00 con 0x7f878810b2e0 2026-02-24T09:31:13.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.858+0000 7f878d612640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f87881112f0 0x7f87881284b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:13.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.858+0000 7f878d612640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f87881112f0 0x7f87881284b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37968/0 (socket says 10.20.193.28:37968) 2026-02-24T09:31:13.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.858+0000 7f878d612640 1 -- 10.20.193.28:0/2809305582 learned_addr learned my addr 10.20.193.28:0/2809305582 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:31:13.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.858+0000 7f878ce11640 1 --2- 10.20.193.28:0/2809305582 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f878810b2e0 0x7f8788122ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:13.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.858+0000 7f877ffff640 1 --2- 10.20.193.28:0/2809305582 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f878810bcd0 0x7f87881230e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:13.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.858+0000 7f878d612640 1 -- 10.20.193.28:0/2809305582 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f878810b2e0 msgr2=0x7f8788122ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:13.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.858+0000 7f878d612640 1 --2- 10.20.193.28:0/2809305582 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f878810b2e0 0x7f8788122ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:13.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.858+0000 7f878d612640 1 -- 10.20.193.28:0/2809305582 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f878810bcd0 msgr2=0x7f87881230e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:13.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.858+0000 7f878d612640 1 --2- 10.20.193.28:0/2809305582 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f878810bcd0 0x7f87881230e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:13.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.858+0000 7f878d612640 1 -- 10.20.193.28:0/2809305582 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f878400a650 con 0x7f87881112f0 2026-02-24T09:31:13.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.858+0000 7f877ffff640 1 --2- 10.20.193.28:0/2809305582 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f878810bcd0 0x7f87881230e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:31:13.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.858+0000 7f878d612640 1 --2- 10.20.193.28:0/2809305582 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f87881112f0 0x7f87881284b0 secure :-1 s=READY pgs=541 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8784032fe0 tx=0x7f87840039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:13.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.859+0000 7f877dffb640 1 -- 10.20.193.28:0/2809305582 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f878403e070 con 0x7f87881112f0 2026-02-24T09:31:13.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.859+0000 7f877dffb640 1 -- 10.20.193.28:0/2809305582 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8784003e00 con 0x7f87881112f0 2026-02-24T09:31:13.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.859+0000 7f877dffb640 1 -- 10.20.193.28:0/2809305582 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8784042940 con 0x7f87881112f0 2026-02-24T09:31:13.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.859+0000 7f878f09c640 1 -- 10.20.193.28:0/2809305582 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8788129080 con 0x7f87881112f0 2026-02-24T09:31:13.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.859+0000 7f878f09c640 1 -- 10.20.193.28:0/2809305582 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8788169640 con 0x7f87881112f0 2026-02-24T09:31:13.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.859+0000 7f87577fe640 1 -- 10.20.193.28:0/2809305582 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f878810c400 con 0x7f87881112f0 2026-02-24T09:31:13.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.862+0000 7f877dffb640 1 -- 10.20.193.28:0/2809305582 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7f87840050c0 con 0x7f87881112f0 2026-02-24T09:31:13.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.863+0000 7f877dffb640 1 --2- 10.20.193.28:0/2809305582 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f87640b5950 0x7f87640d5e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:13.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.863+0000 7f877dffb640 1 -- 10.20.193.28:0/2809305582 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 8727+0+0 (secure 0 0 0) 0x7f878410cee0 con 0x7f87881112f0 2026-02-24T09:31:13.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.863+0000 7f877dffb640 1 -- 10.20.193.28:0/2809305582 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f878410d2e0 con 0x7f87881112f0 2026-02-24T09:31:13.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.863+0000 7f878ce11640 1 --2- 10.20.193.28:0/2809305582 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f87640b5950 0x7f87640d5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:13.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.864+0000 7f878ce11640 1 --2- 10.20.193.28:0/2809305582 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f87640b5950 0x7f87640d5e00 secure :-1 s=READY pgs=279 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8778004740 tx=0x7f8778005d00 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:13.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:13.978+0000 7f87577fe640 1 -- 10.20.193.28:0/2809305582 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8788110b60 con 0x7f87881112f0 2026-02-24T09:31:13.980 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:13 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/1750921891' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2026-02-24T09:31:13.980 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:13 trial028 ceph-mon[40371]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2026-02-24T09:31:13.980 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:13 trial028 ceph-mon[40371]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2026-02-24T09:31:13.980 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:13 trial028 ceph-mon[40371]: Cluster is now healthy 2026-02-24T09:31:13.981 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:13 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/1750921891' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2026-02-24T09:31:13.981 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:13 trial028 ceph-mon[40371]: mds.? [v2:10.20.193.74:6834/2023443755,v1:10.20.193.74:6837/2023443755] up:boot 2026-02-24T09:31:13.981 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:13 trial028 ceph-mon[40371]: mds.? [v2:10.20.193.74:6835/1934037639,v1:10.20.193.74:6838/1934037639] up:boot 2026-02-24T09:31:13.981 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:13 trial028 ceph-mon[40371]: mds.? [v2:10.20.193.159:6836/3301439211,v1:10.20.193.159:6838/3301439211] up:boot 2026-02-24T09:31:13.981 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:13 trial028 ceph-mon[40371]: mds.? [v2:10.20.193.159:6837/3555885768,v1:10.20.193.159:6839/3555885768] up:boot 2026-02-24T09:31:13.981 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:13 trial028 ceph-mon[40371]: mds.? [v2:10.20.193.74:6836/2743133701,v1:10.20.193.74:6839/2743133701] up:boot 2026-02-24T09:31:13.981 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:13 trial028 ceph-mon[40371]: mds.? [v2:10.20.193.28:6840/1952401028,v1:10.20.193.28:6841/1952401028] up:boot 2026-02-24T09:31:13.981 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:13 trial028 ceph-mon[40371]: fsmap 12 up:standby 2026-02-24T09:31:13.981 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:13 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-24T09:31:13.981 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:13 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-24T09:31:13.982 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:13 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-24T09:31:13.982 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:13 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-24T09:31:13.982 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:13 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-24T09:31:13.982 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:13 trial028 ceph-mon[40371]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-24T09:31:13.982 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:13 trial028 ceph-mon[40371]: pgmap v628: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 767 B/s wr, 8 op/s 2026-02-24T09:31:14.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:13 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/1750921891' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2026-02-24T09:31:14.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:13 trial159 ceph-mon[44242]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2026-02-24T09:31:14.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:13 trial159 ceph-mon[44242]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2026-02-24T09:31:14.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:13 trial159 ceph-mon[44242]: Cluster is now healthy 2026-02-24T09:31:14.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:13 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/1750921891' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2026-02-24T09:31:14.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:13 trial159 ceph-mon[44242]: mds.? [v2:10.20.193.74:6834/2023443755,v1:10.20.193.74:6837/2023443755] up:boot 2026-02-24T09:31:14.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:13 trial159 ceph-mon[44242]: mds.? [v2:10.20.193.74:6835/1934037639,v1:10.20.193.74:6838/1934037639] up:boot 2026-02-24T09:31:14.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:13 trial159 ceph-mon[44242]: mds.? [v2:10.20.193.159:6836/3301439211,v1:10.20.193.159:6838/3301439211] up:boot 2026-02-24T09:31:14.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:13 trial159 ceph-mon[44242]: mds.? [v2:10.20.193.159:6837/3555885768,v1:10.20.193.159:6839/3555885768] up:boot 2026-02-24T09:31:14.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:13 trial159 ceph-mon[44242]: mds.? [v2:10.20.193.74:6836/2743133701,v1:10.20.193.74:6839/2743133701] up:boot 2026-02-24T09:31:14.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:13 trial159 ceph-mon[44242]: mds.? [v2:10.20.193.28:6840/1952401028,v1:10.20.193.28:6841/1952401028] up:boot 2026-02-24T09:31:14.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:13 trial159 ceph-mon[44242]: fsmap 12 up:standby 2026-02-24T09:31:14.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:13 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-24T09:31:14.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:13 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-24T09:31:14.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:13 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-24T09:31:14.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:13 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-24T09:31:14.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:13 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-24T09:31:14.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:13 trial159 ceph-mon[44242]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-24T09:31:14.030 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:13 trial159 ceph-mon[44242]: pgmap v628: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 767 B/s wr, 8 op/s 2026-02-24T09:31:14.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:13 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/1750921891' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2026-02-24T09:31:14.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:13 trial074 ceph-mon[44412]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2026-02-24T09:31:14.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:13 trial074 ceph-mon[44412]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2026-02-24T09:31:14.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:13 trial074 ceph-mon[44412]: Cluster is now healthy 2026-02-24T09:31:14.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:13 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/1750921891' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2026-02-24T09:31:14.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:13 trial074 ceph-mon[44412]: mds.? [v2:10.20.193.74:6834/2023443755,v1:10.20.193.74:6837/2023443755] up:boot 2026-02-24T09:31:14.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:13 trial074 ceph-mon[44412]: mds.? [v2:10.20.193.74:6835/1934037639,v1:10.20.193.74:6838/1934037639] up:boot 2026-02-24T09:31:14.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:13 trial074 ceph-mon[44412]: mds.? [v2:10.20.193.159:6836/3301439211,v1:10.20.193.159:6838/3301439211] up:boot 2026-02-24T09:31:14.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:13 trial074 ceph-mon[44412]: mds.? [v2:10.20.193.159:6837/3555885768,v1:10.20.193.159:6839/3555885768] up:boot 2026-02-24T09:31:14.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:13 trial074 ceph-mon[44412]: mds.? [v2:10.20.193.74:6836/2743133701,v1:10.20.193.74:6839/2743133701] up:boot 2026-02-24T09:31:14.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:13 trial074 ceph-mon[44412]: mds.? [v2:10.20.193.28:6840/1952401028,v1:10.20.193.28:6841/1952401028] up:boot 2026-02-24T09:31:14.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:13 trial074 ceph-mon[44412]: fsmap 12 up:standby 2026-02-24T09:31:14.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:13 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-24T09:31:14.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:13 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-24T09:31:14.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:13 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-24T09:31:14.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:13 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-24T09:31:14.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:13 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-24T09:31:14.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:13 trial074 ceph-mon[44412]: from='mgr.14223 10.20.193.28:0/45058782' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-24T09:31:14.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:13 trial074 ceph-mon[44412]: pgmap v628: 97 pgs: 97 active+clean; 2.2 MiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 767 B/s wr, 8 op/s 2026-02-24T09:31:14.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:14.717+0000 7f877dffb640 1 -- 10.20.193.28:0/2809305582 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v114) ==== 181+0+0 (secure 0 0 0) 0x7f87840cf580 con 0x7f87881112f0 2026-02-24T09:31:14.718 INFO:teuthology.orchestra.run.trial028.stderr:pool 'cephfs_metadata' removed 2026-02-24T09:31:14.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:14.719+0000 7f87577fe640 1 -- 10.20.193.28:0/2809305582 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f87640b5950 msgr2=0x7f87640d5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:14.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:14.719+0000 7f87577fe640 1 --2- 10.20.193.28:0/2809305582 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f87640b5950 0x7f87640d5e00 secure :-1 s=READY pgs=279 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8778004740 tx=0x7f8778005d00 comp rx=0 tx=0).stop 2026-02-24T09:31:14.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:14.719+0000 7f87577fe640 1 -- 10.20.193.28:0/2809305582 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f87881112f0 msgr2=0x7f87881284b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:14.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:14.719+0000 7f87577fe640 1 --2- 10.20.193.28:0/2809305582 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f87881112f0 0x7f87881284b0 secure :-1 s=READY pgs=541 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8784032fe0 tx=0x7f87840039b0 comp rx=0 tx=0).stop 2026-02-24T09:31:14.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:14.719+0000 7f87577fe640 1 -- 10.20.193.28:0/2809305582 shutdown_connections 2026-02-24T09:31:14.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:14.719+0000 7f87577fe640 1 --2- 10.20.193.28:0/2809305582 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7f87640b5950 0x7f87640d5e00 unknown :-1 s=CLOSED pgs=279 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:14.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:14.719+0000 7f87577fe640 1 --2- 10.20.193.28:0/2809305582 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f87881112f0 0x7f87881284b0 unknown :-1 s=CLOSED pgs=541 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:14.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:14.719+0000 7f87577fe640 1 --2- 10.20.193.28:0/2809305582 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7f878810bcd0 0x7f87881230e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:14.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:14.719+0000 7f87577fe640 1 --2- 10.20.193.28:0/2809305582 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7f878810b2e0 0x7f8788122ba0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:14.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:14.719+0000 7f87577fe640 1 -- 10.20.193.28:0/2809305582 >> 10.20.193.28:0/2809305582 conn(0x7f87880e8e50 msgr2=0x7f8788109230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:14.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:14.720+0000 7f87577fe640 1 -- 10.20.193.28:0/2809305582 shutdown_connections 2026-02-24T09:31:14.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:14.720+0000 7f87577fe640 1 -- 10.20.193.28:0/2809305582 wait complete. 2026-02-24T09:31:14.823 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2026-02-24T09:31:15.018 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:31:15.029 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:14 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/2809305582' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2026-02-24T09:31:15.061 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:14 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/2809305582' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2026-02-24T09:31:15.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:14 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/2809305582' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2026-02-24T09:31:15.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.194+0000 7fea0adad640 1 -- 10.20.193.28:0/1556986869 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea0410fc30 msgr2=0x7fea04114c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:15.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.194+0000 7fea0adad640 1 --2- 10.20.193.28:0/1556986869 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea0410fc30 0x7fea04114c80 secure :-1 s=READY pgs=542 gs=1 cs=0 l=1 c_cookie=3548556105027611668 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9f8009950 tx=0x7fe9f802f190 comp rx=0 tx=0).stop 2026-02-24T09:31:15.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.194+0000 7fea0adad640 1 -- 10.20.193.28:0/1556986869 shutdown_connections 2026-02-24T09:31:15.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.194+0000 7fea0adad640 1 --2- 10.20.193.28:0/1556986869 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fea04115430 0x7fea04175e00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:15.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.194+0000 7fea0adad640 1 --2- 10.20.193.28:0/1556986869 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea0410fc30 0x7fea04114c80 unknown :-1 s=CLOSED pgs=542 gs=1 cs=0 l=1 c_cookie=3548556105027611668 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:15.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.194+0000 7fea0adad640 1 --2- 10.20.193.28:0/1556986869 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fea0410f240 0x7fea0410f610 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:15.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.194+0000 7fea0adad640 1 -- 10.20.193.28:0/1556986869 >> 10.20.193.28:0/1556986869 conn(0x7fea040ecaf0 msgr2=0x7fea0410cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:15.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.194+0000 7fea0adad640 1 -- 10.20.193.28:0/1556986869 shutdown_connections 2026-02-24T09:31:15.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.194+0000 7fea0adad640 1 -- 10.20.193.28:0/1556986869 wait complete. 2026-02-24T09:31:15.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.195+0000 7fea0adad640 1 Processor -- start 2026-02-24T09:31:15.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.195+0000 7fea0adad640 1 -- start start 2026-02-24T09:31:15.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.195+0000 7fea0adad640 1 --2- >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fea0410f240 0x7fea040f9ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:15.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.195+0000 7fea0adad640 1 --2- >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fea0410fc30 0x7fea04175d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:15.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.195+0000 7fea0adad640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea04115430 0x7fea040fa1d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:15.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.195+0000 7fea0adad640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fea040ff390 con 0x7fea04115430 2026-02-24T09:31:15.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.195+0000 7fea0adad640 1 -- --> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] -- mon_getmap magic: 0 -- 0x7fea040ff500 con 0x7fea0410fc30 2026-02-24T09:31:15.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.195+0000 7fea0adad640 1 -- --> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] -- mon_getmap magic: 0 -- 0x7fea040ff6c0 con 0x7fea0410f240 2026-02-24T09:31:15.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.196+0000 7fea0a5ac640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea04115430 0x7fea040fa1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:15.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.196+0000 7fea0a5ac640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea04115430 0x7fea040fa1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37976/0 (socket says 10.20.193.28:37976) 2026-02-24T09:31:15.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.196+0000 7fea0a5ac640 1 -- 10.20.193.28:0/50924164 learned_addr learned my addr 10.20.193.28:0/50924164 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-24T09:31:15.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.196+0000 7fea09dab640 1 --2- 10.20.193.28:0/50924164 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fea0410f240 0x7fea040f9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:15.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.196+0000 7fea095aa640 1 --2- 10.20.193.28:0/50924164 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fea0410fc30 0x7fea04175d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:15.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.196+0000 7fea0a5ac640 1 -- 10.20.193.28:0/50924164 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fea0410f240 msgr2=0x7fea040f9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:15.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.196+0000 7fea0a5ac640 1 --2- 10.20.193.28:0/50924164 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fea0410f240 0x7fea040f9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:15.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.196+0000 7fea0a5ac640 1 -- 10.20.193.28:0/50924164 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fea0410fc30 msgr2=0x7fea04175d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:15.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.196+0000 7fea0a5ac640 1 --2- 10.20.193.28:0/50924164 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fea0410fc30 0x7fea04175d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:15.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.196+0000 7fea0a5ac640 1 -- 10.20.193.28:0/50924164 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9f8009570 con 0x7fea04115430 2026-02-24T09:31:15.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.196+0000 7fea0a5ac640 1 --2- 10.20.193.28:0/50924164 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea04115430 0x7fea040fa1d0 secure :-1 s=READY pgs=543 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea00006e90 tx=0x7fea0000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:15.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.196+0000 7fe9f2ffd640 1 -- 10.20.193.28:0/50924164 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fea00005500 con 0x7fea04115430 2026-02-24T09:31:15.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.196+0000 7fea0adad640 1 -- 10.20.193.28:0/50924164 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea040ff9a0 con 0x7fea04115430 2026-02-24T09:31:15.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.196+0000 7fe9f2ffd640 1 -- 10.20.193.28:0/50924164 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fea00005df0 con 0x7fea04115430 2026-02-24T09:31:15.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.196+0000 7fe9f2ffd640 1 -- 10.20.193.28:0/50924164 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fea00003a00 con 0x7fea04115430 2026-02-24T09:31:15.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.196+0000 7fea0adad640 1 -- 10.20.193.28:0/50924164 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea040ffec0 con 0x7fea04115430 2026-02-24T09:31:15.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.197+0000 7fea0adad640 1 -- 10.20.193.28:0/50924164 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea04110520 con 0x7fea04115430 2026-02-24T09:31:15.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.199+0000 7fe9f2ffd640 1 -- 10.20.193.28:0/50924164 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 23) ==== 157253+0+0 (secure 0 0 0) 0x7fea00003b60 con 0x7fea04115430 2026-02-24T09:31:15.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.201+0000 7fe9f2ffd640 1 --2- 10.20.193.28:0/50924164 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe9e00b58c0 0x7fe9e00d5d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:31:15.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.201+0000 7fe9f2ffd640 1 -- 10.20.193.28:0/50924164 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 8220+0+0 (secure 0 0 0) 0x7fea000e7870 con 0x7fea04115430 2026-02-24T09:31:15.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.201+0000 7fea09dab640 1 --2- 10.20.193.28:0/50924164 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe9e00b58c0 0x7fe9e00d5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:31:15.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.201+0000 7fe9f2ffd640 1 -- 10.20.193.28:0/50924164 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fea000aa000 con 0x7fea04115430 2026-02-24T09:31:15.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.202+0000 7fea09dab640 1 --2- 10.20.193.28:0/50924164 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe9e00b58c0 0x7fe9e00d5d70 secure :-1 s=READY pgs=280 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9f4005e30 tx=0x7fe9f4005da0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:31:15.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.317+0000 7fea0adad640 1 -- 10.20.193.28:0/50924164 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fea040389d0 con 0x7fea04115430 2026-02-24T09:31:15.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.722+0000 7fe9f2ffd640 1 -- 10.20.193.28:0/50924164 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v115) ==== 169+0+0 (secure 0 0 0) 0x7fea000ad1b0 con 0x7fea04115430 2026-02-24T09:31:15.723 INFO:teuthology.orchestra.run.trial028.stderr:pool 'cephfs_data' removed 2026-02-24T09:31:15.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.725+0000 7fea0adad640 1 -- 10.20.193.28:0/50924164 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe9e00b58c0 msgr2=0x7fe9e00d5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:15.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.725+0000 7fea0adad640 1 --2- 10.20.193.28:0/50924164 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe9e00b58c0 0x7fe9e00d5d70 secure :-1 s=READY pgs=280 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9f4005e30 tx=0x7fe9f4005da0 comp rx=0 tx=0).stop 2026-02-24T09:31:15.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.725+0000 7fea0adad640 1 -- 10.20.193.28:0/50924164 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea04115430 msgr2=0x7fea040fa1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:31:15.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.725+0000 7fea0adad640 1 --2- 10.20.193.28:0/50924164 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea04115430 0x7fea040fa1d0 secure :-1 s=READY pgs=543 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea00006e90 tx=0x7fea0000edf0 comp rx=0 tx=0).stop 2026-02-24T09:31:15.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.725+0000 7fea0adad640 1 -- 10.20.193.28:0/50924164 shutdown_connections 2026-02-24T09:31:15.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.725+0000 7fea0adad640 1 --2- 10.20.193.28:0/50924164 >> [v2:10.20.193.28:6800/906910473,v1:10.20.193.28:6801/906910473] conn(0x7fe9e00b58c0 0x7fe9e00d5d70 unknown :-1 s=CLOSED pgs=280 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:15.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.725+0000 7fea0adad640 1 --2- 10.20.193.28:0/50924164 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea04115430 0x7fea040fa1d0 unknown :-1 s=CLOSED pgs=543 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:15.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.725+0000 7fea0adad640 1 --2- 10.20.193.28:0/50924164 >> [v2:10.20.193.74:3300/0,v1:10.20.193.74:6789/0] conn(0x7fea0410fc30 0x7fea04175d00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:15.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.725+0000 7fea0adad640 1 --2- 10.20.193.28:0/50924164 >> [v2:10.20.193.159:3300/0,v1:10.20.193.159:6789/0] conn(0x7fea0410f240 0x7fea040f9ad0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:31:15.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.725+0000 7fea0adad640 1 -- 10.20.193.28:0/50924164 >> 10.20.193.28:0/50924164 conn(0x7fea040ecaf0 msgr2=0x7fea04111a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:31:15.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.725+0000 7fea0adad640 1 -- 10.20.193.28:0/50924164 shutdown_connections 2026-02-24T09:31:15.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-24T09:31:15.725+0000 7fea0adad640 1 -- 10.20.193.28:0/50924164 wait complete. 2026-02-24T09:31:15.830 DEBUG:teuthology.orchestra.run.trial028:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-24T09:31:15.887 DEBUG:teuthology.orchestra.run.trial074:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-24T09:31:15.948 DEBUG:teuthology.orchestra.run.trial159:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-24T09:31:16.001 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:15 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/2809305582' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2026-02-24T09:31:16.001 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:15 trial159 ceph-mon[44242]: osdmap e114: 12 total, 12 up, 12 in 2026-02-24T09:31:16.001 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:15 trial159 ceph-mon[44242]: from='client.? 10.20.193.28:0/50924164' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2026-02-24T09:31:16.001 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:15 trial159 ceph-mon[44242]: pgmap v630: 65 pgs: 65 active+clean; 577 KiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:31:16.010 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-02-24T09:31:16.010 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 -- ceph mgr module disable cephadm 2026-02-24T09:31:16.061 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:15 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/2809305582' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2026-02-24T09:31:16.061 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:15 trial028 ceph-mon[40371]: osdmap e114: 12 total, 12 up, 12 in 2026-02-24T09:31:16.061 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:15 trial028 ceph-mon[40371]: from='client.? 10.20.193.28:0/50924164' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2026-02-24T09:31:16.061 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:15 trial028 ceph-mon[40371]: pgmap v630: 65 pgs: 65 active+clean; 577 KiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:31:16.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:15 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/2809305582' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2026-02-24T09:31:16.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:15 trial074 ceph-mon[44412]: osdmap e114: 12 total, 12 up, 12 in 2026-02-24T09:31:16.123 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:15 trial074 ceph-mon[44412]: from='client.? 10.20.193.28:0/50924164' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2026-02-24T09:31:16.124 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:15 trial074 ceph-mon[44412]: pgmap v630: 65 pgs: 65 active+clean; 577 KiB data, 547 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:31:16.194 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/mon.a/config 2026-02-24T09:31:16.231 INFO:teuthology.orchestra.run.trial028.stderr:Error: statfs /etc/ceph/ceph.client.admin.keyring: no such file or directory 2026-02-24T09:31:16.258 DEBUG:teuthology.orchestra.run:got remote process result: 125 2026-02-24T09:31:16.259 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2026-02-24T09:31:16.259 DEBUG:teuthology.orchestra.run.trial028:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-24T09:31:16.298 DEBUG:teuthology.orchestra.run.trial074:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-24T09:31:16.335 DEBUG:teuthology.orchestra.run.trial159:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-24T09:31:16.375 INFO:tasks.cephadm:Stopping all daemons... 2026-02-24T09:31:16.376 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2026-02-24T09:31:16.376 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mon.a 2026-02-24T09:31:16.827 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:16 trial028 systemd[1]: Stopping Ceph mon.a for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:31:16.827 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:16 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mon-a[40367]: 2026-02-24T09:31:16.562+0000 7f3b58099640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T09:31:16.827 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 24 09:31:16 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mon-a[40367]: 2026-02-24T09:31:16.562+0000 7f3b58099640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2026-02-24T09:31:17.001 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mon.a.service' 2026-02-24T09:31:17.076 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:31:17.077 INFO:tasks.cephadm.mon.a:Stopped mon.a 2026-02-24T09:31:17.077 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2026-02-24T09:31:17.077 DEBUG:teuthology.orchestra.run.trial074:> sudo systemctl stop ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mon.b 2026-02-24T09:31:17.379 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:17 trial074 systemd[1]: Stopping Ceph mon.b for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:31:17.379 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:17 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mon-b[44408]: 2026-02-24T09:31:17.261+0000 7f1b7f702640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T09:31:17.379 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:17 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mon-b[44408]: 2026-02-24T09:31:17.261+0000 7f1b7f702640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2026-02-24T09:31:17.380 INFO:journalctl@ceph.mon.b.trial074.stdout:Feb 24 09:31:17 trial074 podman[101268]: 2026-02-24 09:31:17.333853655 +0000 UTC m=+0.095876930 container died 53b93562cdbc19b9101181e751404069ec066354924713de9765d9f7bb6b0201 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mon-b, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, CEPH_REF=wip-vshankar-testing-20260223.155722, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260223, io.buildah.version=1.41.3) 2026-02-24T09:31:17.507 DEBUG:teuthology.orchestra.run.trial074:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mon.b.service' 2026-02-24T09:31:17.582 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:31:17.583 INFO:tasks.cephadm.mon.c:Stopped mon.b 2026-02-24T09:31:17.583 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2026-02-24T09:31:17.583 DEBUG:teuthology.orchestra.run.trial159:> sudo systemctl stop ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mon.c 2026-02-24T09:31:17.951 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:17 trial159 systemd[1]: Stopping Ceph mon.c for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:31:17.951 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:17 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mon-c[44237]: 2026-02-24T09:31:17.769+0000 7f7db45f2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T09:31:17.951 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:17 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mon-c[44237]: 2026-02-24T09:31:17.769+0000 7f7db45f2640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2026-02-24T09:31:17.951 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:17 trial159 podman[101734]: 2026-02-24 09:31:17.800938501 +0000 UTC m=+0.053499175 container died 6c87cc974a4b8cbafaaf4e5c39daebc36f0893554f03a622152db963bdc737af (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-vshankar-testing-20260223.155722, io.buildah.version=1.41.3, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260223, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , ceph=True) 2026-02-24T09:31:17.951 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:17 trial159 podman[101734]: 2026-02-24 09:31:17.861534924 +0000 UTC m=+0.114095598 container remove 6c87cc974a4b8cbafaaf4e5c39daebc36f0893554f03a622152db963bdc737af (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mon-c, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, CEPH_REF=wip-vshankar-testing-20260223.155722, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.build-date=20260223, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-24T09:31:17.951 INFO:journalctl@ceph.mon.c.trial159.stdout:Feb 24 09:31:17 trial159 bash[101734]: ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mon-c 2026-02-24T09:31:17.970 DEBUG:teuthology.orchestra.run.trial159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mon.c.service' 2026-02-24T09:31:18.045 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:31:18.045 INFO:tasks.cephadm.mon.c:Stopped mon.c 2026-02-24T09:31:18.046 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2026-02-24T09:31:18.046 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mgr.x 2026-02-24T09:31:18.347 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:31:18 trial028 systemd[1]: Stopping Ceph mgr.x for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:31:18.347 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:31:18 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: 2026-02-24T09:31:18.231+0000 7fd6fe558640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T09:31:18.347 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:31:18 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x[40608]: 2026-02-24T09:31:18.231+0000 7fd6fe558640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2026-02-24T09:31:18.348 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 24 09:31:18 trial028 podman[125020]: 2026-02-24 09:31:18.334533794 +0000 UTC m=+0.126484997 container died 1e11c7f0ee80d9bb78c3420d3585d2bda75a38b70d9e53944ff83c5d3980bdb6 (image=quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-x, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, CEPH_REF=wip-vshankar-testing-20260223.155722, ceph=True, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260223, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2) 2026-02-24T09:31:18.531 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mgr.x.service' 2026-02-24T09:31:18.600 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:31:18.600 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2026-02-24T09:31:18.600 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2026-02-24T09:31:18.600 DEBUG:teuthology.orchestra.run.trial074:> sudo systemctl stop ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mgr.y 2026-02-24T09:31:18.910 INFO:journalctl@ceph.mgr.y.trial074.stdout:Feb 24 09:31:18 trial074 systemd[1]: Stopping Ceph mgr.y for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:31:18.910 INFO:journalctl@ceph.mgr.y.trial074.stdout:Feb 24 09:31:18 trial074 podman[101399]: 2026-02-24 09:31:18.862424555 +0000 UTC m=+0.105190111 container died 03163885a70e1046b8fe19a7ca7e3f9a6ba582fb506561768660261915ec47af (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-y, org.label-schema.vendor=CentOS, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, io.buildah.version=1.41.3, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-24T09:31:19.047 DEBUG:teuthology.orchestra.run.trial074:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mgr.y.service' 2026-02-24T09:31:19.116 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:31:19.116 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2026-02-24T09:31:19.117 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2026-02-24T09:31:19.117 DEBUG:teuthology.orchestra.run.trial159:> sudo systemctl stop ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mgr.z 2026-02-24T09:31:19.419 INFO:journalctl@ceph.mgr.z.trial159.stdout:Feb 24 09:31:19 trial159 systemd[1]: Stopping Ceph mgr.z for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:31:19.419 INFO:journalctl@ceph.mgr.z.trial159.stdout:Feb 24 09:31:19 trial159 podman[101865]: 2026-02-24 09:31:19.373388316 +0000 UTC m=+0.096391258 container died be3c8d53ef6cf7182b582a44a8de4433ad39f102d0fa7061fa8b926a48a9047b (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mgr-z, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, org.label-schema.build-date=20260223) 2026-02-24T09:31:19.556 DEBUG:teuthology.orchestra.run.trial159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mgr.z.service' 2026-02-24T09:31:19.626 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:31:19.626 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2026-02-24T09:31:19.626 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2026-02-24T09:31:19.626 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.0 2026-02-24T09:31:20.036 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 24 09:31:19 trial028 systemd[1]: Stopping Ceph osd.0 for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:31:20.036 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 24 09:31:19 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-0[60771]: 2026-02-24T09:31:19.808+0000 7fa8fd506640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T09:31:20.036 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 24 09:31:19 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-0[60771]: 2026-02-24T09:31:19.808+0000 7fa8fd506640 -1 osd.0 115 *** Got signal Terminated *** 2026-02-24T09:31:20.036 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 24 09:31:19 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-0[60771]: 2026-02-24T09:31:19.808+0000 7fa8fd506640 -1 osd.0 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T09:31:25.237 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 24 09:31:24 trial028 podman[125153]: 2026-02-24 09:31:24.935667307 +0000 UTC m=+5.149164964 container died 63613c52ffbab7cd4bfe4353326d3d793a71104fdb6c078ae65942014e8d12f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-0, CEPH_REF=wip-vshankar-testing-20260223.155722, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-24T09:31:25.237 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 24 09:31:24 trial028 podman[125153]: 2026-02-24 09:31:24.994522454 +0000 UTC m=+5.208020111 container remove 63613c52ffbab7cd4bfe4353326d3d793a71104fdb6c078ae65942014e8d12f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-0, org.label-schema.build-date=20260223, OSD_FLAVOR=default, CEPH_REF=wip-vshankar-testing-20260223.155722, ceph=True, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-24T09:31:25.237 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 24 09:31:24 trial028 bash[125153]: ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-0 2026-02-24T09:31:25.493 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 24 09:31:25 trial028 podman[125254]: 2026-02-24 09:31:25.237041501 +0000 UTC m=+0.028398229 container create bf2767ac8f0359884fd1cb46c80c4a3dabd4a251779850452d93aa56ace5b0bc (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-0-deactivate, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-vshankar-testing-20260223.155722, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260223) 2026-02-24T09:31:25.493 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 24 09:31:25 trial028 podman[125254]: 2026-02-24 09:31:25.288606903 +0000 UTC m=+0.079963641 container init bf2767ac8f0359884fd1cb46c80c4a3dabd4a251779850452d93aa56ace5b0bc (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-0-deactivate, org.label-schema.vendor=CentOS, CEPH_REF=wip-vshankar-testing-20260223.155722, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, ceph=True, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260223, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, io.buildah.version=1.41.3) 2026-02-24T09:31:25.493 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 24 09:31:25 trial028 podman[125254]: 2026-02-24 09:31:25.293966183 +0000 UTC m=+0.085322921 container start bf2767ac8f0359884fd1cb46c80c4a3dabd4a251779850452d93aa56ace5b0bc (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-0-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, CEPH_REF=wip-vshankar-testing-20260223.155722, OSD_FLAVOR=default, org.label-schema.build-date=20260223, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-24T09:31:25.493 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 24 09:31:25 trial028 podman[125254]: 2026-02-24 09:31:25.294850856 +0000 UTC m=+0.086207604 container attach bf2767ac8f0359884fd1cb46c80c4a3dabd4a251779850452d93aa56ace5b0bc (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-0-deactivate, org.label-schema.build-date=20260223, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-24T09:31:25.493 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 24 09:31:25 trial028 podman[125254]: 2026-02-24 09:31:25.226109794 +0000 UTC m=+0.017466522 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b 2026-02-24T09:31:25.493 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 24 09:31:25 trial028 podman[125254]: 2026-02-24 09:31:25.492746029 +0000 UTC m=+0.284102767 container died bf2767ac8f0359884fd1cb46c80c4a3dabd4a251779850452d93aa56ace5b0bc (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-0-deactivate, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-vshankar-testing-20260223.155722, ceph=True, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b) 2026-02-24T09:31:25.582 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.0.service' 2026-02-24T09:31:25.655 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:31:25.655 INFO:tasks.cephadm.osd.0:Stopped osd.0 2026-02-24T09:31:25.655 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2026-02-24T09:31:25.655 DEBUG:teuthology.orchestra.run.trial074:> sudo systemctl stop ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.1 2026-02-24T09:31:26.123 INFO:journalctl@ceph.osd.1.trial074.stdout:Feb 24 09:31:25 trial074 systemd[1]: Stopping Ceph osd.1 for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:31:26.124 INFO:journalctl@ceph.osd.1.trial074.stdout:Feb 24 09:31:25 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-1[51395]: 2026-02-24T09:31:25.844+0000 7f6e8cdca640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T09:31:26.124 INFO:journalctl@ceph.osd.1.trial074.stdout:Feb 24 09:31:25 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-1[51395]: 2026-02-24T09:31:25.844+0000 7f6e8cdca640 -1 osd.1 115 *** Got signal Terminated *** 2026-02-24T09:31:26.124 INFO:journalctl@ceph.osd.1.trial074.stdout:Feb 24 09:31:25 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-1[51395]: 2026-02-24T09:31:25.844+0000 7f6e8cdca640 -1 osd.1 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T09:31:31.272 INFO:journalctl@ceph.osd.1.trial074.stdout:Feb 24 09:31:30 trial074 podman[101528]: 2026-02-24 09:31:30.970356011 +0000 UTC m=+5.149361450 container died 566bc4e692ec011221ef9c8c1895143d92fe4f6798f30484eb14f2780baf2857 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.build-date=20260223, CEPH_REF=wip-vshankar-testing-20260223.155722, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b) 2026-02-24T09:31:31.273 INFO:journalctl@ceph.osd.1.trial074.stdout:Feb 24 09:31:31 trial074 podman[101528]: 2026-02-24 09:31:31.029936329 +0000 UTC m=+5.208941758 container remove 566bc4e692ec011221ef9c8c1895143d92fe4f6798f30484eb14f2780baf2857 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, CEPH_REF=wip-vshankar-testing-20260223.155722, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True) 2026-02-24T09:31:31.273 INFO:journalctl@ceph.osd.1.trial074.stdout:Feb 24 09:31:31 trial074 bash[101528]: ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-1 2026-02-24T09:31:31.527 INFO:journalctl@ceph.osd.1.trial074.stdout:Feb 24 09:31:31 trial074 podman[101633]: 2026-02-24 09:31:31.271447806 +0000 UTC m=+0.026907246 container create 7aed98c38b16d13d366b1134eba165b58622d46fe7f3fc73a1d1d51262400115 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-1-deactivate, org.label-schema.build-date=20260223, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, OSD_FLAVOR=default, ceph=True, org.label-schema.schema-version=1.0, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-24T09:31:31.527 INFO:journalctl@ceph.osd.1.trial074.stdout:Feb 24 09:31:31 trial074 podman[101633]: 2026-02-24 09:31:31.32635927 +0000 UTC m=+0.081818710 container init 7aed98c38b16d13d366b1134eba165b58622d46fe7f3fc73a1d1d51262400115 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-1-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.license=GPLv2) 2026-02-24T09:31:31.527 INFO:journalctl@ceph.osd.1.trial074.stdout:Feb 24 09:31:31 trial074 podman[101633]: 2026-02-24 09:31:31.332679242 +0000 UTC m=+0.088138682 container start 7aed98c38b16d13d366b1134eba165b58622d46fe7f3fc73a1d1d51262400115 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-1-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.build-date=20260223, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-24T09:31:31.527 INFO:journalctl@ceph.osd.1.trial074.stdout:Feb 24 09:31:31 trial074 podman[101633]: 2026-02-24 09:31:31.333489208 +0000 UTC m=+0.088948648 container attach 7aed98c38b16d13d366b1134eba165b58622d46fe7f3fc73a1d1d51262400115 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-1-deactivate, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, OSD_FLAVOR=default, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.vendor=CentOS, CEPH_REF=wip-vshankar-testing-20260223.155722, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260223, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-24T09:31:31.527 INFO:journalctl@ceph.osd.1.trial074.stdout:Feb 24 09:31:31 trial074 podman[101633]: 2026-02-24 09:31:31.262119145 +0000 UTC m=+0.017578585 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b 2026-02-24T09:31:31.528 INFO:journalctl@ceph.osd.1.trial074.stdout:Feb 24 09:31:31 trial074 podman[101633]: 2026-02-24 09:31:31.526211435 +0000 UTC m=+0.281670885 container died 7aed98c38b16d13d366b1134eba165b58622d46fe7f3fc73a1d1d51262400115 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-1-deactivate, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.license=GPLv2, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3) 2026-02-24T09:31:31.614 DEBUG:teuthology.orchestra.run.trial074:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.1.service' 2026-02-24T09:31:31.685 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:31:31.685 INFO:tasks.cephadm.osd.1:Stopped osd.1 2026-02-24T09:31:31.685 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2026-02-24T09:31:31.685 DEBUG:teuthology.orchestra.run.trial159:> sudo systemctl stop ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.2 2026-02-24T09:31:32.030 INFO:journalctl@ceph.osd.2.trial159.stdout:Feb 24 09:31:31 trial159 systemd[1]: Stopping Ceph osd.2 for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:31:32.030 INFO:journalctl@ceph.osd.2.trial159.stdout:Feb 24 09:31:31 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-2[51436]: 2026-02-24T09:31:31.866+0000 7fa16b26c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T09:31:32.030 INFO:journalctl@ceph.osd.2.trial159.stdout:Feb 24 09:31:31 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-2[51436]: 2026-02-24T09:31:31.866+0000 7fa16b26c640 -1 osd.2 115 *** Got signal Terminated *** 2026-02-24T09:31:32.030 INFO:journalctl@ceph.osd.2.trial159.stdout:Feb 24 09:31:31 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-2[51436]: 2026-02-24T09:31:31.866+0000 7fa16b26c640 -1 osd.2 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T09:31:37.279 INFO:journalctl@ceph.osd.2.trial159.stdout:Feb 24 09:31:36 trial159 podman[101996]: 2026-02-24 09:31:36.982972682 +0000 UTC m=+5.139545266 container died 3bf50f93b569229888502346d13ce26e71349a2982560cc31f2bc2b792f71884 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-2, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, org.label-schema.vendor=CentOS, ceph=True, CEPH_REF=wip-vshankar-testing-20260223.155722, OSD_FLAVOR=default, org.label-schema.build-date=20260223, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-24T09:31:37.280 INFO:journalctl@ceph.osd.2.trial159.stdout:Feb 24 09:31:37 trial159 podman[101996]: 2026-02-24 09:31:37.042655488 +0000 UTC m=+5.199228072 container remove 3bf50f93b569229888502346d13ce26e71349a2982560cc31f2bc2b792f71884 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-2, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, CEPH_REF=wip-vshankar-testing-20260223.155722, ceph=True, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260223, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3) 2026-02-24T09:31:37.280 INFO:journalctl@ceph.osd.2.trial159.stdout:Feb 24 09:31:37 trial159 bash[101996]: ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-2 2026-02-24T09:31:37.535 INFO:journalctl@ceph.osd.2.trial159.stdout:Feb 24 09:31:37 trial159 podman[102099]: 2026-02-24 09:31:37.288812062 +0000 UTC m=+0.029364422 container create b42d5acabd78a6b1c92bd1651d7e18f2e024e595d69ec17052c3e6675e1f6dd1 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.label-schema.license=GPLv2, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-24T09:31:37.536 INFO:journalctl@ceph.osd.2.trial159.stdout:Feb 24 09:31:37 trial159 podman[102099]: 2026-02-24 09:31:37.337572556 +0000 UTC m=+0.078124906 container init b42d5acabd78a6b1c92bd1651d7e18f2e024e595d69ec17052c3e6675e1f6dd1 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-2-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.label-schema.build-date=20260223, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.schema-version=1.0, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS) 2026-02-24T09:31:37.536 INFO:journalctl@ceph.osd.2.trial159.stdout:Feb 24 09:31:37 trial159 podman[102099]: 2026-02-24 09:31:37.343337665 +0000 UTC m=+0.083890025 container start b42d5acabd78a6b1c92bd1651d7e18f2e024e595d69ec17052c3e6675e1f6dd1 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-2-deactivate, CEPH_REF=wip-vshankar-testing-20260223.155722, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , ceph=True, io.buildah.version=1.41.3, org.label-schema.build-date=20260223, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.label-schema.license=GPLv2) 2026-02-24T09:31:37.536 INFO:journalctl@ceph.osd.2.trial159.stdout:Feb 24 09:31:37 trial159 podman[102099]: 2026-02-24 09:31:37.344140366 +0000 UTC m=+0.084692726 container attach b42d5acabd78a6b1c92bd1651d7e18f2e024e595d69ec17052c3e6675e1f6dd1 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-2-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.opencontainers.image.authors=Ceph Release Team , ceph=True) 2026-02-24T09:31:37.536 INFO:journalctl@ceph.osd.2.trial159.stdout:Feb 24 09:31:37 trial159 podman[102099]: 2026-02-24 09:31:37.279460558 +0000 UTC m=+0.020012928 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b 2026-02-24T09:31:37.621 DEBUG:teuthology.orchestra.run.trial159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.2.service' 2026-02-24T09:31:37.689 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:31:37.689 INFO:tasks.cephadm.osd.2:Stopped osd.2 2026-02-24T09:31:37.689 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2026-02-24T09:31:37.689 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.3 2026-02-24T09:31:38.109 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 24 09:31:37 trial028 systemd[1]: Stopping Ceph osd.3 for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:31:38.109 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 24 09:31:37 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-3[73566]: 2026-02-24T09:31:37.886+0000 7fb528b9e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T09:31:38.109 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 24 09:31:37 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-3[73566]: 2026-02-24T09:31:37.886+0000 7fb528b9e640 -1 osd.3 115 *** Got signal Terminated *** 2026-02-24T09:31:38.109 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 24 09:31:37 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-3[73566]: 2026-02-24T09:31:37.886+0000 7fb528b9e640 -1 osd.3 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T09:31:43.319 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 24 09:31:43 trial028 podman[125372]: 2026-02-24 09:31:43.022250569 +0000 UTC m=+5.159422072 container died 1194e7313aeecbdc577b72ea0de587eba489fbfd516ebc0d10f1b69e2a101f9c (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-3, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-vshankar-testing-20260223.155722, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.label-schema.build-date=20260223, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, OSD_FLAVOR=default) 2026-02-24T09:31:43.320 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 24 09:31:43 trial028 podman[125372]: 2026-02-24 09:31:43.081360423 +0000 UTC m=+5.218531926 container remove 1194e7313aeecbdc577b72ea0de587eba489fbfd516ebc0d10f1b69e2a101f9c (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, CEPH_REF=wip-vshankar-testing-20260223.155722, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , ceph=True, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0) 2026-02-24T09:31:43.320 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 24 09:31:43 trial028 bash[125372]: ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-3 2026-02-24T09:31:43.570 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 24 09:31:43 trial028 podman[125476]: 2026-02-24 09:31:43.319512009 +0000 UTC m=+0.027220128 container create 3a122eb2e7e75dd2623aa7fdbf1170298f978fb919f7ce5cd7b1e5bd2c45e4fa (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-3-deactivate, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-24T09:31:43.571 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 24 09:31:43 trial028 podman[125476]: 2026-02-24 09:31:43.367490987 +0000 UTC m=+0.075199116 container init 3a122eb2e7e75dd2623aa7fdbf1170298f978fb919f7ce5cd7b1e5bd2c45e4fa (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, OSD_FLAVOR=default, io.buildah.version=1.41.3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-vshankar-testing-20260223.155722, ceph=True) 2026-02-24T09:31:43.571 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 24 09:31:43 trial028 podman[125476]: 2026-02-24 09:31:43.373266209 +0000 UTC m=+0.080974328 container start 3a122eb2e7e75dd2623aa7fdbf1170298f978fb919f7ce5cd7b1e5bd2c45e4fa (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-3-deactivate, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.license=GPLv2, ceph=True) 2026-02-24T09:31:43.571 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 24 09:31:43 trial028 podman[125476]: 2026-02-24 09:31:43.374058661 +0000 UTC m=+0.081766790 container attach 3a122eb2e7e75dd2623aa7fdbf1170298f978fb919f7ce5cd7b1e5bd2c45e4fa (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-3-deactivate, org.label-schema.vendor=CentOS, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260223, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-vshankar-testing-20260223.155722) 2026-02-24T09:31:43.571 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 24 09:31:43 trial028 podman[125476]: 2026-02-24 09:31:43.310179993 +0000 UTC m=+0.017888112 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b 2026-02-24T09:31:43.656 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.3.service' 2026-02-24T09:31:43.729 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:31:43.730 INFO:tasks.cephadm.osd.3:Stopped osd.3 2026-02-24T09:31:43.730 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2026-02-24T09:31:43.730 DEBUG:teuthology.orchestra.run.trial074:> sudo systemctl stop ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.4 2026-02-24T09:31:44.124 INFO:journalctl@ceph.osd.4.trial074.stdout:Feb 24 09:31:43 trial074 systemd[1]: Stopping Ceph osd.4 for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:31:44.124 INFO:journalctl@ceph.osd.4.trial074.stdout:Feb 24 09:31:43 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-4[64243]: 2026-02-24T09:31:43.913+0000 7f4a37328640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T09:31:44.124 INFO:journalctl@ceph.osd.4.trial074.stdout:Feb 24 09:31:43 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-4[64243]: 2026-02-24T09:31:43.913+0000 7f4a37328640 -1 osd.4 115 *** Got signal Terminated *** 2026-02-24T09:31:44.124 INFO:journalctl@ceph.osd.4.trial074.stdout:Feb 24 09:31:43 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-4[64243]: 2026-02-24T09:31:43.913+0000 7f4a37328640 -1 osd.4 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T09:31:46.609 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:31:46 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-6[86503]: 2026-02-24T09:31:46.222+0000 7fe0e3427640 -1 osd.6 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:20.142428+0000 front 2026-02-24T09:31:20.142490+0000 (oldest deadline 2026-02-24T09:31:45.442437+0000) 2026-02-24T09:31:46.779 INFO:journalctl@ceph.osd.5.trial159.stdout:Feb 24 09:31:46 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-5[63490]: 2026-02-24T09:31:46.459+0000 7fae88145640 -1 osd.5 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:20.886017+0000 front 2026-02-24T09:31:20.885909+0000 (oldest deadline 2026-02-24T09:31:45.585878+0000) 2026-02-24T09:31:47.609 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:31:47 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-6[86503]: 2026-02-24T09:31:47.178+0000 7fe0e3427640 -1 osd.6 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:20.142428+0000 front 2026-02-24T09:31:20.142490+0000 (oldest deadline 2026-02-24T09:31:45.442437+0000) 2026-02-24T09:31:47.779 INFO:journalctl@ceph.osd.5.trial159.stdout:Feb 24 09:31:47 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-5[63490]: 2026-02-24T09:31:47.478+0000 7fae88145640 -1 osd.5 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:20.886017+0000 front 2026-02-24T09:31:20.885909+0000 (oldest deadline 2026-02-24T09:31:45.585878+0000) 2026-02-24T09:31:48.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:31:47 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:31:47.888+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:31:48.511 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:31:48 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-6[86503]: 2026-02-24T09:31:48.148+0000 7fe0e3427640 -1 osd.6 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:20.142428+0000 front 2026-02-24T09:31:20.142490+0000 (oldest deadline 2026-02-24T09:31:45.442437+0000) 2026-02-24T09:31:48.779 INFO:journalctl@ceph.osd.5.trial159.stdout:Feb 24 09:31:48 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-5[63490]: 2026-02-24T09:31:48.474+0000 7fae88145640 -1 osd.5 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:20.886017+0000 front 2026-02-24T09:31:20.885909+0000 (oldest deadline 2026-02-24T09:31:45.585878+0000) 2026-02-24T09:31:48.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:31:48 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:31:48.445+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:31:49.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:31:48 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:31:48.923+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:31:49.346 INFO:journalctl@ceph.osd.4.trial074.stdout:Feb 24 09:31:49 trial074 podman[101746]: 2026-02-24 09:31:49.040218417 +0000 UTC m=+5.150286469 container died 64083cadad939592d15f07db02ebebe9674a567327ab45bda04474e6aabee212 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-4, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260223, io.buildah.version=1.41.3) 2026-02-24T09:31:49.347 INFO:journalctl@ceph.osd.4.trial074.stdout:Feb 24 09:31:49 trial074 podman[101746]: 2026-02-24 09:31:49.098583323 +0000 UTC m=+5.208651365 container remove 64083cadad939592d15f07db02ebebe9674a567327ab45bda04474e6aabee212 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-4, org.label-schema.license=GPLv2, OSD_FLAVOR=default, ceph=True, CEPH_REF=wip-vshankar-testing-20260223.155722, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-24T09:31:49.347 INFO:journalctl@ceph.osd.4.trial074.stdout:Feb 24 09:31:49 trial074 bash[101746]: ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-4 2026-02-24T09:31:49.437 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:31:49 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-6[86503]: 2026-02-24T09:31:49.157+0000 7fe0e3427640 -1 osd.6 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:20.142428+0000 front 2026-02-24T09:31:20.142490+0000 (oldest deadline 2026-02-24T09:31:45.442437+0000) 2026-02-24T09:31:49.608 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:31:49 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:31:49.402+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:31:49.608 INFO:journalctl@ceph.osd.4.trial074.stdout:Feb 24 09:31:49 trial074 podman[101847]: 2026-02-24 09:31:49.345883468 +0000 UTC m=+0.026797273 container create 3bd8d95e0aba420b411bf3baec3ec15b6b5470e18daef7f4cfb28c084e53abeb (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-4-deactivate, CEPH_REF=wip-vshankar-testing-20260223.155722, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.label-schema.license=GPLv2, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-24T09:31:49.608 INFO:journalctl@ceph.osd.4.trial074.stdout:Feb 24 09:31:49 trial074 podman[101847]: 2026-02-24 09:31:49.400403343 +0000 UTC m=+0.081317148 container init 3bd8d95e0aba420b411bf3baec3ec15b6b5470e18daef7f4cfb28c084e53abeb (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-4-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.build-date=20260223, OSD_FLAVOR=default, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, io.buildah.version=1.41.3) 2026-02-24T09:31:49.608 INFO:journalctl@ceph.osd.4.trial074.stdout:Feb 24 09:31:49 trial074 podman[101847]: 2026-02-24 09:31:49.40571069 +0000 UTC m=+0.086624495 container start 3bd8d95e0aba420b411bf3baec3ec15b6b5470e18daef7f4cfb28c084e53abeb (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-4-deactivate, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.label-schema.license=GPLv2, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260223, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS) 2026-02-24T09:31:49.608 INFO:journalctl@ceph.osd.4.trial074.stdout:Feb 24 09:31:49 trial074 podman[101847]: 2026-02-24 09:31:49.406639938 +0000 UTC m=+0.087553743 container attach 3bd8d95e0aba420b411bf3baec3ec15b6b5470e18daef7f4cfb28c084e53abeb (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-4-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-vshankar-testing-20260223.155722, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b) 2026-02-24T09:31:49.609 INFO:journalctl@ceph.osd.4.trial074.stdout:Feb 24 09:31:49 trial074 podman[101847]: 2026-02-24 09:31:49.336240762 +0000 UTC m=+0.017154567 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b 2026-02-24T09:31:49.609 INFO:journalctl@ceph.osd.4.trial074.stdout:Feb 24 09:31:49 trial074 podman[101847]: 2026-02-24 09:31:49.593477051 +0000 UTC m=+0.274390856 container died 3bd8d95e0aba420b411bf3baec3ec15b6b5470e18daef7f4cfb28c084e53abeb (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-vshankar-testing-20260223.155722, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260223, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0) 2026-02-24T09:31:49.683 DEBUG:teuthology.orchestra.run.trial074:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.4.service' 2026-02-24T09:31:49.753 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:31:49.754 INFO:tasks.cephadm.osd.4:Stopped osd.4 2026-02-24T09:31:49.754 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2026-02-24T09:31:49.754 DEBUG:teuthology.orchestra.run.trial159:> sudo systemctl stop ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.5 2026-02-24T09:31:49.779 INFO:journalctl@ceph.osd.5.trial159.stdout:Feb 24 09:31:49 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-5[63490]: 2026-02-24T09:31:49.517+0000 7fae88145640 -1 osd.5 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:20.886017+0000 front 2026-02-24T09:31:20.885909+0000 (oldest deadline 2026-02-24T09:31:45.585878+0000) 2026-02-24T09:31:49.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:31:49 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:31:49.436+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.009885+0000 front 2026-02-24T09:31:24.009875+0000 (oldest deadline 2026-02-24T09:31:48.709990+0000) 2026-02-24T09:31:50.279 INFO:journalctl@ceph.osd.5.trial159.stdout:Feb 24 09:31:49 trial159 systemd[1]: Stopping Ceph osd.5 for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:31:50.280 INFO:journalctl@ceph.osd.5.trial159.stdout:Feb 24 09:31:49 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-5[63490]: 2026-02-24T09:31:49.943+0000 7fae8fa85640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T09:31:50.280 INFO:journalctl@ceph.osd.5.trial159.stdout:Feb 24 09:31:49 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-5[63490]: 2026-02-24T09:31:49.943+0000 7fae8fa85640 -1 osd.5 115 *** Got signal Terminated *** 2026-02-24T09:31:50.280 INFO:journalctl@ceph.osd.5.trial159.stdout:Feb 24 09:31:49 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-5[63490]: 2026-02-24T09:31:49.943+0000 7fae8fa85640 -1 osd.5 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T09:31:50.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:31:49 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:31:49.901+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:31:50.468 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:31:50 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-6[86503]: 2026-02-24T09:31:50.117+0000 7fe0e3427640 -1 osd.6 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:20.142428+0000 front 2026-02-24T09:31:20.142490+0000 (oldest deadline 2026-02-24T09:31:45.442437+0000) 2026-02-24T09:31:50.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:31:50 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:31:50.467+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.009885+0000 front 2026-02-24T09:31:24.009875+0000 (oldest deadline 2026-02-24T09:31:48.709990+0000) 2026-02-24T09:31:50.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:31:50 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:31:50.393+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:31:50.931 INFO:journalctl@ceph.osd.5.trial159.stdout:Feb 24 09:31:50 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-5[63490]: 2026-02-24T09:31:50.553+0000 7fae88145640 -1 osd.5 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:20.886017+0000 front 2026-02-24T09:31:20.885909+0000 (oldest deadline 2026-02-24T09:31:45.585878+0000) 2026-02-24T09:31:51.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:31:50 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:31:50.931+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:31:51.474 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:31:51 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-6[86503]: 2026-02-24T09:31:51.110+0000 7fe0e3427640 -1 osd.6 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:20.142428+0000 front 2026-02-24T09:31:20.142490+0000 (oldest deadline 2026-02-24T09:31:45.442437+0000) 2026-02-24T09:31:51.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:31:51 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:31:51.473+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.009885+0000 front 2026-02-24T09:31:24.009875+0000 (oldest deadline 2026-02-24T09:31:48.709990+0000) 2026-02-24T09:31:51.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:31:51 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:31:51.412+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:31:51.979 INFO:journalctl@ceph.osd.5.trial159.stdout:Feb 24 09:31:51 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-5[63490]: 2026-02-24T09:31:51.599+0000 7fae88145640 -1 osd.5 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:20.886017+0000 front 2026-02-24T09:31:20.885909+0000 (oldest deadline 2026-02-24T09:31:45.585878+0000) 2026-02-24T09:31:52.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:31:51 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:31:51.980+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:31:52.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:31:51 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:31:51.980+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:31:52.464 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:31:52 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-6[86503]: 2026-02-24T09:31:52.150+0000 7fe0e3427640 -1 osd.6 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:20.142428+0000 front 2026-02-24T09:31:20.142490+0000 (oldest deadline 2026-02-24T09:31:45.442437+0000) 2026-02-24T09:31:52.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:31:52 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:31:52.463+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.009885+0000 front 2026-02-24T09:31:24.009875+0000 (oldest deadline 2026-02-24T09:31:48.709990+0000) 2026-02-24T09:31:52.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:31:52 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:31:52.454+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:31:52.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:31:52 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:31:52.454+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.935726+0000 front 2026-02-24T09:31:29.935928+0000 (oldest deadline 2026-02-24T09:31:52.235848+0000) 2026-02-24T09:31:53.021 INFO:journalctl@ceph.osd.5.trial159.stdout:Feb 24 09:31:52 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-5[63490]: 2026-02-24T09:31:52.569+0000 7fae88145640 -1 osd.5 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:20.886017+0000 front 2026-02-24T09:31:20.885909+0000 (oldest deadline 2026-02-24T09:31:45.585878+0000) 2026-02-24T09:31:53.021 INFO:journalctl@ceph.osd.5.trial159.stdout:Feb 24 09:31:52 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-5[63490]: 2026-02-24T09:31:52.569+0000 7fae88145640 -1 osd.5 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.186722+0000 front 2026-02-24T09:31:30.186797+0000 (oldest deadline 2026-02-24T09:31:52.486665+0000) 2026-02-24T09:31:53.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:31:53 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:31:53.021+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:31:53.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:31:53 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:31:53.021+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:31:53.373 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:31:53 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7[76701]: 2026-02-24T09:31:53.080+0000 7f2da74c0640 -1 osd.7 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.093031+0000 front 2026-02-24T09:31:28.092318+0000 (oldest deadline 2026-02-24T09:31:52.792419+0000) 2026-02-24T09:31:53.447 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:31:53 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-6[86503]: 2026-02-24T09:31:53.185+0000 7fe0e3427640 -1 osd.6 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:20.142428+0000 front 2026-02-24T09:31:20.142490+0000 (oldest deadline 2026-02-24T09:31:45.442437+0000) 2026-02-24T09:31:53.779 INFO:journalctl@ceph.osd.5.trial159.stdout:Feb 24 09:31:53 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-5[63490]: 2026-02-24T09:31:53.528+0000 7fae88145640 -1 osd.5 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:20.886017+0000 front 2026-02-24T09:31:20.885909+0000 (oldest deadline 2026-02-24T09:31:45.585878+0000) 2026-02-24T09:31:53.780 INFO:journalctl@ceph.osd.5.trial159.stdout:Feb 24 09:31:53 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-5[63490]: 2026-02-24T09:31:53.528+0000 7fae88145640 -1 osd.5 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.186722+0000 front 2026-02-24T09:31:30.186797+0000 (oldest deadline 2026-02-24T09:31:52.486665+0000) 2026-02-24T09:31:53.780 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:31:53 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:31:53.704+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.896363+0000 front 2026-02-24T09:31:29.896557+0000 (oldest deadline 2026-02-24T09:31:53.396409+0000) 2026-02-24T09:31:53.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:31:53 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:31:53.446+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.009885+0000 front 2026-02-24T09:31:24.009875+0000 (oldest deadline 2026-02-24T09:31:48.709990+0000) 2026-02-24T09:31:53.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:31:53 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:31:53.446+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.710304+0000 front 2026-02-24T09:31:28.710672+0000 (oldest deadline 2026-02-24T09:31:52.810277+0000) 2026-02-24T09:31:53.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:31:53 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:31:53.475+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:31:53.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:31:53 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:31:53.475+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.935726+0000 front 2026-02-24T09:31:29.935928+0000 (oldest deadline 2026-02-24T09:31:52.235848+0000) 2026-02-24T09:31:54.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:31:54 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:31:54.007+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:31:54.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:31:54 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:31:54.007+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:31:54.373 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:31:54 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7[76701]: 2026-02-24T09:31:54.039+0000 7f2da74c0640 -1 osd.7 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.093031+0000 front 2026-02-24T09:31:28.092318+0000 (oldest deadline 2026-02-24T09:31:52.792419+0000) 2026-02-24T09:31:54.471 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:31:54 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-6[86503]: 2026-02-24T09:31:54.193+0000 7fe0e3427640 -1 osd.6 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:20.142428+0000 front 2026-02-24T09:31:20.142490+0000 (oldest deadline 2026-02-24T09:31:45.442437+0000) 2026-02-24T09:31:54.779 INFO:journalctl@ceph.osd.5.trial159.stdout:Feb 24 09:31:54 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-5[63490]: 2026-02-24T09:31:54.506+0000 7fae88145640 -1 osd.5 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:20.886017+0000 front 2026-02-24T09:31:20.885909+0000 (oldest deadline 2026-02-24T09:31:45.585878+0000) 2026-02-24T09:31:54.780 INFO:journalctl@ceph.osd.5.trial159.stdout:Feb 24 09:31:54 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-5[63490]: 2026-02-24T09:31:54.506+0000 7fae88145640 -1 osd.5 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.186722+0000 front 2026-02-24T09:31:30.186797+0000 (oldest deadline 2026-02-24T09:31:52.486665+0000) 2026-02-24T09:31:54.780 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:31:54 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:31:54.657+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.896363+0000 front 2026-02-24T09:31:29.896557+0000 (oldest deadline 2026-02-24T09:31:53.396409+0000) 2026-02-24T09:31:54.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:31:54 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:31:54.471+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.009885+0000 front 2026-02-24T09:31:24.009875+0000 (oldest deadline 2026-02-24T09:31:48.709990+0000) 2026-02-24T09:31:54.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:31:54 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:31:54.471+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.710304+0000 front 2026-02-24T09:31:28.710672+0000 (oldest deadline 2026-02-24T09:31:52.810277+0000) 2026-02-24T09:31:54.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:31:54 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:31:54.451+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:31:54.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:31:54 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:31:54.451+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.935726+0000 front 2026-02-24T09:31:29.935928+0000 (oldest deadline 2026-02-24T09:31:52.235848+0000) 2026-02-24T09:31:55.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:31:54 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:31:54.961+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:31:55.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:31:54 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:31:54.961+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:31:55.280 INFO:journalctl@ceph.osd.5.trial159.stdout:Feb 24 09:31:55 trial159 podman[102210]: 2026-02-24 09:31:55.079143899 +0000 UTC m=+5.159334211 container died 6acdf2ab6e3b61afe4979be7bdfc3a01476d31a88e4be44b43c24355e69cafea (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-5, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20260223, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, io.buildah.version=1.41.3, CEPH_REF=wip-vshankar-testing-20260223.155722, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-24T09:31:55.280 INFO:journalctl@ceph.osd.5.trial159.stdout:Feb 24 09:31:55 trial159 podman[102210]: 2026-02-24 09:31:55.137828552 +0000 UTC m=+5.218018864 container remove 6acdf2ab6e3b61afe4979be7bdfc3a01476d31a88e4be44b43c24355e69cafea (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-5, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, ceph=True, CEPH_REF=wip-vshankar-testing-20260223.155722, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2) 2026-02-24T09:31:55.280 INFO:journalctl@ceph.osd.5.trial159.stdout:Feb 24 09:31:55 trial159 bash[102210]: ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-5 2026-02-24T09:31:55.373 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:31:55 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7[76701]: 2026-02-24T09:31:55.033+0000 7f2da74c0640 -1 osd.7 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.093031+0000 front 2026-02-24T09:31:28.092318+0000 (oldest deadline 2026-02-24T09:31:52.792419+0000) 2026-02-24T09:31:55.484 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:31:55 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-6[86503]: 2026-02-24T09:31:55.208+0000 7fe0e3427640 -1 osd.6 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:20.142428+0000 front 2026-02-24T09:31:20.142490+0000 (oldest deadline 2026-02-24T09:31:45.442437+0000) 2026-02-24T09:31:55.484 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:31:55 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-6[86503]: 2026-02-24T09:31:55.208+0000 7fe0e3427640 -1 osd.6 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.543016+0000 front 2026-02-24T09:31:29.543041+0000 (oldest deadline 2026-02-24T09:31:54.842985+0000) 2026-02-24T09:31:55.628 INFO:journalctl@ceph.osd.5.trial159.stdout:Feb 24 09:31:55 trial159 podman[102311]: 2026-02-24 09:31:55.383916622 +0000 UTC m=+0.026772454 container create a3ffb0e77f068be5477455cb1551c3946c8916d54d82511f1bd7b3c1a102325a (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-5-deactivate, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-vshankar-testing-20260223.155722, ceph=True, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b) 2026-02-24T09:31:55.629 INFO:journalctl@ceph.osd.5.trial159.stdout:Feb 24 09:31:55 trial159 podman[102311]: 2026-02-24 09:31:55.428256556 +0000 UTC m=+0.071112398 container init a3ffb0e77f068be5477455cb1551c3946c8916d54d82511f1bd7b3c1a102325a (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-5-deactivate, org.label-schema.build-date=20260223, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, CEPH_REF=wip-vshankar-testing-20260223.155722, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2026-02-24T09:31:55.629 INFO:journalctl@ceph.osd.5.trial159.stdout:Feb 24 09:31:55 trial159 podman[102311]: 2026-02-24 09:31:55.433576542 +0000 UTC m=+0.076432384 container start a3ffb0e77f068be5477455cb1551c3946c8916d54d82511f1bd7b3c1a102325a (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-5-deactivate, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-vshankar-testing-20260223.155722, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, OSD_FLAVOR=default) 2026-02-24T09:31:55.629 INFO:journalctl@ceph.osd.5.trial159.stdout:Feb 24 09:31:55 trial159 podman[102311]: 2026-02-24 09:31:55.434512131 +0000 UTC m=+0.077367973 container attach a3ffb0e77f068be5477455cb1551c3946c8916d54d82511f1bd7b3c1a102325a (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-5-deactivate, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-vshankar-testing-20260223.155722) 2026-02-24T09:31:55.629 INFO:journalctl@ceph.osd.5.trial159.stdout:Feb 24 09:31:55 trial159 podman[102311]: 2026-02-24 09:31:55.374769881 +0000 UTC m=+0.017625733 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b 2026-02-24T09:31:55.629 INFO:journalctl@ceph.osd.5.trial159.stdout:Feb 24 09:31:55 trial159 podman[102311]: 2026-02-24 09:31:55.628895106 +0000 UTC m=+0.271750948 container died a3ffb0e77f068be5477455cb1551c3946c8916d54d82511f1bd7b3c1a102325a (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-5-deactivate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, OSD_FLAVOR=default, CEPH_REF=wip-vshankar-testing-20260223.155722, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260223) 2026-02-24T09:31:55.713 DEBUG:teuthology.orchestra.run.trial159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.5.service' 2026-02-24T09:31:55.825 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:31:55.825 INFO:tasks.cephadm.osd.5:Stopped osd.5 2026-02-24T09:31:55.825 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2026-02-24T09:31:55.825 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.6 2026-02-24T09:31:55.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:31:55 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:31:55.483+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.009885+0000 front 2026-02-24T09:31:24.009875+0000 (oldest deadline 2026-02-24T09:31:48.709990+0000) 2026-02-24T09:31:55.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:31:55 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:31:55.483+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.710304+0000 front 2026-02-24T09:31:28.710672+0000 (oldest deadline 2026-02-24T09:31:52.810277+0000) 2026-02-24T09:31:55.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:31:55 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:31:55.469+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:31:55.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:31:55 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:31:55.469+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.935726+0000 front 2026-02-24T09:31:29.935928+0000 (oldest deadline 2026-02-24T09:31:52.235848+0000) 2026-02-24T09:31:55.925 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:31:55 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:31:55.668+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.896363+0000 front 2026-02-24T09:31:29.896557+0000 (oldest deadline 2026-02-24T09:31:53.396409+0000) 2026-02-24T09:31:55.925 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:31:55 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:31:55.925+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:31:55.925 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:31:55 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:31:55.925+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:31:56.170 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:31:55 trial028 systemd[1]: Stopping Ceph osd.6 for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:31:56.170 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:31:56 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-6[86503]: 2026-02-24T09:31:56.011+0000 7fe0ead67640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T09:31:56.170 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:31:56 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-6[86503]: 2026-02-24T09:31:56.011+0000 7fe0ead67640 -1 osd.6 115 *** Got signal Terminated *** 2026-02-24T09:31:56.170 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:31:56 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-6[86503]: 2026-02-24T09:31:56.011+0000 7fe0ead67640 -1 osd.6 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T09:31:56.170 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:31:56 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-6[86503]: 2026-02-24T09:31:56.169+0000 7fe0e3427640 -1 osd.6 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:20.142428+0000 front 2026-02-24T09:31:20.142490+0000 (oldest deadline 2026-02-24T09:31:45.442437+0000) 2026-02-24T09:31:56.170 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:31:56 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-6[86503]: 2026-02-24T09:31:56.169+0000 7fe0e3427640 -1 osd.6 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.543016+0000 front 2026-02-24T09:31:29.543041+0000 (oldest deadline 2026-02-24T09:31:54.842985+0000) 2026-02-24T09:31:56.373 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:31:56 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7[76701]: 2026-02-24T09:31:56.068+0000 7f2da74c0640 -1 osd.7 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.093031+0000 front 2026-02-24T09:31:28.092318+0000 (oldest deadline 2026-02-24T09:31:52.792419+0000) 2026-02-24T09:31:56.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:31:56 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:31:56.434+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.009885+0000 front 2026-02-24T09:31:24.009875+0000 (oldest deadline 2026-02-24T09:31:48.709990+0000) 2026-02-24T09:31:56.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:31:56 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:31:56.434+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.710304+0000 front 2026-02-24T09:31:28.710672+0000 (oldest deadline 2026-02-24T09:31:52.810277+0000) 2026-02-24T09:31:56.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:31:56 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:31:56.426+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:31:56.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:31:56 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:31:56.426+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.935726+0000 front 2026-02-24T09:31:29.935928+0000 (oldest deadline 2026-02-24T09:31:52.235848+0000) 2026-02-24T09:31:57.030 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:31:56 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:31:56.711+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.896363+0000 front 2026-02-24T09:31:29.896557+0000 (oldest deadline 2026-02-24T09:31:53.396409+0000) 2026-02-24T09:31:57.030 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:31:56 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:31:56.935+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:31:57.030 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:31:56 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:31:56.935+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:31:57.373 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:31:57 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7[76701]: 2026-02-24T09:31:57.048+0000 7f2da74c0640 -1 osd.7 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.093031+0000 front 2026-02-24T09:31:28.092318+0000 (oldest deadline 2026-02-24T09:31:52.792419+0000) 2026-02-24T09:31:57.482 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:31:57 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-6[86503]: 2026-02-24T09:31:57.204+0000 7fe0e3427640 -1 osd.6 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:20.142428+0000 front 2026-02-24T09:31:20.142490+0000 (oldest deadline 2026-02-24T09:31:45.442437+0000) 2026-02-24T09:31:57.482 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:31:57 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-6[86503]: 2026-02-24T09:31:57.204+0000 7fe0e3427640 -1 osd.6 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.543016+0000 front 2026-02-24T09:31:29.543041+0000 (oldest deadline 2026-02-24T09:31:54.842985+0000) 2026-02-24T09:31:57.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:31:57 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:31:57.480+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.009885+0000 front 2026-02-24T09:31:24.009875+0000 (oldest deadline 2026-02-24T09:31:48.709990+0000) 2026-02-24T09:31:57.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:31:57 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:31:57.480+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.710304+0000 front 2026-02-24T09:31:28.710672+0000 (oldest deadline 2026-02-24T09:31:52.810277+0000) 2026-02-24T09:31:57.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:31:57 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:31:57.397+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:31:57.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:31:57 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:31:57.397+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.935726+0000 front 2026-02-24T09:31:29.935928+0000 (oldest deadline 2026-02-24T09:31:52.235848+0000) 2026-02-24T09:31:57.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:31:57 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:31:57.397+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:35.036724+0000 front 2026-02-24T09:31:35.036776+0000 (oldest deadline 2026-02-24T09:31:57.336638+0000) 2026-02-24T09:31:57.982 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:31:57 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:31:57.679+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.896363+0000 front 2026-02-24T09:31:29.896557+0000 (oldest deadline 2026-02-24T09:31:53.396409+0000) 2026-02-24T09:31:58.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:31:57 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:31:57.983+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:31:58.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:31:57 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:31:57.983+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:31:58.373 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:31:58 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7[76701]: 2026-02-24T09:31:58.001+0000 7f2da74c0640 -1 osd.7 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.093031+0000 front 2026-02-24T09:31:28.092318+0000 (oldest deadline 2026-02-24T09:31:52.792419+0000) 2026-02-24T09:31:58.515 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:31:58 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-6[86503]: 2026-02-24T09:31:58.249+0000 7fe0e3427640 -1 osd.6 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:20.142428+0000 front 2026-02-24T09:31:20.142490+0000 (oldest deadline 2026-02-24T09:31:45.442437+0000) 2026-02-24T09:31:58.515 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:31:58 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-6[86503]: 2026-02-24T09:31:58.249+0000 7fe0e3427640 -1 osd.6 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.543016+0000 front 2026-02-24T09:31:29.543041+0000 (oldest deadline 2026-02-24T09:31:54.842985+0000) 2026-02-24T09:31:58.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:31:58 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:31:58.513+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.009885+0000 front 2026-02-24T09:31:24.009875+0000 (oldest deadline 2026-02-24T09:31:48.709990+0000) 2026-02-24T09:31:58.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:31:58 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:31:58.513+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.710304+0000 front 2026-02-24T09:31:28.710672+0000 (oldest deadline 2026-02-24T09:31:52.810277+0000) 2026-02-24T09:31:58.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:31:58 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:31:58.388+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:31:58.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:31:58 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:31:58.388+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.935726+0000 front 2026-02-24T09:31:29.935928+0000 (oldest deadline 2026-02-24T09:31:52.235848+0000) 2026-02-24T09:31:58.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:31:58 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:31:58.388+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:35.036724+0000 front 2026-02-24T09:31:35.036776+0000 (oldest deadline 2026-02-24T09:31:57.336638+0000) 2026-02-24T09:31:58.961 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:31:58 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:31:58.696+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.896363+0000 front 2026-02-24T09:31:29.896557+0000 (oldest deadline 2026-02-24T09:31:53.396409+0000) 2026-02-24T09:31:59.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:31:58 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:31:58.961+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:31:59.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:31:58 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:31:58.961+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:31:59.373 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:31:59 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7[76701]: 2026-02-24T09:31:59.020+0000 7f2da74c0640 -1 osd.7 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.093031+0000 front 2026-02-24T09:31:28.092318+0000 (oldest deadline 2026-02-24T09:31:52.792419+0000) 2026-02-24T09:31:59.373 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:31:59 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7[76701]: 2026-02-24T09:31:59.020+0000 7f2da74c0640 -1 osd.7 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:32.792816+0000 front 2026-02-24T09:31:32.792783+0000 (oldest deadline 2026-02-24T09:31:58.692717+0000) 2026-02-24T09:31:59.609 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:31:59 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:31:59.474+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.009885+0000 front 2026-02-24T09:31:24.009875+0000 (oldest deadline 2026-02-24T09:31:48.709990+0000) 2026-02-24T09:31:59.609 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:31:59 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:31:59.474+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.710304+0000 front 2026-02-24T09:31:28.710672+0000 (oldest deadline 2026-02-24T09:31:52.810277+0000) 2026-02-24T09:31:59.610 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:31:59 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-6[86503]: 2026-02-24T09:31:59.285+0000 7fe0e3427640 -1 osd.6 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:20.142428+0000 front 2026-02-24T09:31:20.142490+0000 (oldest deadline 2026-02-24T09:31:45.442437+0000) 2026-02-24T09:31:59.610 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:31:59 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-6[86503]: 2026-02-24T09:31:59.285+0000 7fe0e3427640 -1 osd.6 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.543016+0000 front 2026-02-24T09:31:29.543041+0000 (oldest deadline 2026-02-24T09:31:54.842985+0000) 2026-02-24T09:31:59.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:31:59 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:31:59.382+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:31:59.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:31:59 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:31:59.382+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.935726+0000 front 2026-02-24T09:31:29.935928+0000 (oldest deadline 2026-02-24T09:31:52.235848+0000) 2026-02-24T09:31:59.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:31:59 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:31:59.382+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:35.036724+0000 front 2026-02-24T09:31:35.036776+0000 (oldest deadline 2026-02-24T09:31:57.336638+0000) 2026-02-24T09:31:59.968 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:31:59 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:31:59.671+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.896363+0000 front 2026-02-24T09:31:29.896557+0000 (oldest deadline 2026-02-24T09:31:53.396409+0000) 2026-02-24T09:32:00.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:31:59 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:31:59.969+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:32:00.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:31:59 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:31:59.969+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:32:00.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:31:59 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:31:59.969+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.096359+0000 front 2026-02-24T09:31:36.096470+0000 (oldest deadline 2026-02-24T09:31:59.596412+0000) 2026-02-24T09:32:00.373 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:32:00 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7[76701]: 2026-02-24T09:32:00.005+0000 7f2da74c0640 -1 osd.7 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.093031+0000 front 2026-02-24T09:31:28.092318+0000 (oldest deadline 2026-02-24T09:31:52.792419+0000) 2026-02-24T09:32:00.373 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:32:00 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7[76701]: 2026-02-24T09:32:00.005+0000 7f2da74c0640 -1 osd.7 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:32.792816+0000 front 2026-02-24T09:31:32.792783+0000 (oldest deadline 2026-02-24T09:31:58.692717+0000) 2026-02-24T09:32:00.609 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:00 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:00.425+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.009885+0000 front 2026-02-24T09:31:24.009875+0000 (oldest deadline 2026-02-24T09:31:48.709990+0000) 2026-02-24T09:32:00.609 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:00 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:00.425+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.710304+0000 front 2026-02-24T09:31:28.710672+0000 (oldest deadline 2026-02-24T09:31:52.810277+0000) 2026-02-24T09:32:00.610 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:32:00 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-6[86503]: 2026-02-24T09:32:00.310+0000 7fe0e3427640 -1 osd.6 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:20.142428+0000 front 2026-02-24T09:31:20.142490+0000 (oldest deadline 2026-02-24T09:31:45.442437+0000) 2026-02-24T09:32:00.610 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:32:00 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-6[86503]: 2026-02-24T09:32:00.310+0000 7fe0e3427640 -1 osd.6 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.543016+0000 front 2026-02-24T09:31:29.543041+0000 (oldest deadline 2026-02-24T09:31:54.842985+0000) 2026-02-24T09:32:00.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:00 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:00.383+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:32:00.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:00 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:00.383+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.935726+0000 front 2026-02-24T09:31:29.935928+0000 (oldest deadline 2026-02-24T09:31:52.235848+0000) 2026-02-24T09:32:00.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:00 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:00.383+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:35.036724+0000 front 2026-02-24T09:31:35.036776+0000 (oldest deadline 2026-02-24T09:31:57.336638+0000) 2026-02-24T09:32:00.964 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:00 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:00.635+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.896363+0000 front 2026-02-24T09:31:29.896557+0000 (oldest deadline 2026-02-24T09:31:53.396409+0000) 2026-02-24T09:32:00.964 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:00 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:00.635+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.296924+0000 front 2026-02-24T09:31:36.297088+0000 (oldest deadline 2026-02-24T09:31:59.796948+0000) 2026-02-24T09:32:01.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:00 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:00.963+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:32:01.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:00 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:00.963+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:32:01.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:00 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:00.963+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.096359+0000 front 2026-02-24T09:31:36.096470+0000 (oldest deadline 2026-02-24T09:31:59.596412+0000) 2026-02-24T09:32:01.373 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:32:01 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7[76701]: 2026-02-24T09:32:01.029+0000 7f2da74c0640 -1 osd.7 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.093031+0000 front 2026-02-24T09:31:28.092318+0000 (oldest deadline 2026-02-24T09:31:52.792419+0000) 2026-02-24T09:32:01.373 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:32:01 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7[76701]: 2026-02-24T09:32:01.029+0000 7f2da74c0640 -1 osd.7 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:32.792816+0000 front 2026-02-24T09:31:32.792783+0000 (oldest deadline 2026-02-24T09:31:58.692717+0000) 2026-02-24T09:32:01.431 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:32:01 trial028 podman[125589]: 2026-02-24 09:32:01.139658352 +0000 UTC m=+5.150749875 container died a1f1a8c77620108adba531a59196aec110ea34210d719e061277b541adca0492 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-6, org.label-schema.build-date=20260223, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , ceph=True, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, io.buildah.version=1.41.3, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, CEPH_REF=wip-vshankar-testing-20260223.155722, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-24T09:32:01.431 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:32:01 trial028 podman[125589]: 2026-02-24 09:32:01.198660355 +0000 UTC m=+5.209751878 container remove a1f1a8c77620108adba531a59196aec110ea34210d719e061277b541adca0492 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-6, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_REF=wip-vshankar-testing-20260223.155722, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, org.label-schema.build-date=20260223, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-24T09:32:01.431 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:32:01 trial028 bash[125589]: ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-6 2026-02-24T09:32:01.685 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:01 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:01.429+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.009885+0000 front 2026-02-24T09:31:24.009875+0000 (oldest deadline 2026-02-24T09:31:48.709990+0000) 2026-02-24T09:32:01.685 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:01 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:01.429+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.710304+0000 front 2026-02-24T09:31:28.710672+0000 (oldest deadline 2026-02-24T09:31:52.810277+0000) 2026-02-24T09:32:01.685 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:01 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:01.429+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.711430+0000 front 2026-02-24T09:31:36.711496+0000 (oldest deadline 2026-02-24T09:32:00.811235+0000) 2026-02-24T09:32:01.686 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:32:01 trial028 podman[125686]: 2026-02-24 09:32:01.441138994 +0000 UTC m=+0.027224496 container create f268d191de94da685cc6d5c93ef605d7827591ffcfdc8bd154a4b6b113fef68f (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-6-deactivate, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-24T09:32:01.686 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:32:01 trial028 podman[125686]: 2026-02-24 09:32:01.488059728 +0000 UTC m=+0.074145240 container init f268d191de94da685cc6d5c93ef605d7827591ffcfdc8bd154a4b6b113fef68f (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-6-deactivate, OSD_FLAVOR=default, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-vshankar-testing-20260223.155722, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, io.buildah.version=1.41.3, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0) 2026-02-24T09:32:01.686 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:32:01 trial028 podman[125686]: 2026-02-24 09:32:01.493349158 +0000 UTC m=+0.079434670 container start f268d191de94da685cc6d5c93ef605d7827591ffcfdc8bd154a4b6b113fef68f (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-6-deactivate, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-vshankar-testing-20260223.155722, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-24T09:32:01.686 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:32:01 trial028 podman[125686]: 2026-02-24 09:32:01.494165915 +0000 UTC m=+0.080251427 container attach f268d191de94da685cc6d5c93ef605d7827591ffcfdc8bd154a4b6b113fef68f (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-6-deactivate, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, org.label-schema.build-date=20260223, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-vshankar-testing-20260223.155722, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3) 2026-02-24T09:32:01.686 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 24 09:32:01 trial028 podman[125686]: 2026-02-24 09:32:01.430768911 +0000 UTC m=+0.016854423 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b 2026-02-24T09:32:01.772 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.6.service' 2026-02-24T09:32:01.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:01 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:01.375+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:32:01.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:01 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:01.375+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.935726+0000 front 2026-02-24T09:31:29.935928+0000 (oldest deadline 2026-02-24T09:31:52.235848+0000) 2026-02-24T09:32:01.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:01 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:01.375+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:35.036724+0000 front 2026-02-24T09:31:35.036776+0000 (oldest deadline 2026-02-24T09:31:57.336638+0000) 2026-02-24T09:32:01.883 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:32:01.883 INFO:tasks.cephadm.osd.6:Stopped osd.6 2026-02-24T09:32:01.883 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2026-02-24T09:32:01.884 DEBUG:teuthology.orchestra.run.trial074:> sudo systemctl stop ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.7 2026-02-24T09:32:01.991 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:01 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:01.629+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.896363+0000 front 2026-02-24T09:31:29.896557+0000 (oldest deadline 2026-02-24T09:31:53.396409+0000) 2026-02-24T09:32:01.991 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:01 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:01.629+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.296924+0000 front 2026-02-24T09:31:36.297088+0000 (oldest deadline 2026-02-24T09:31:59.796948+0000) 2026-02-24T09:32:02.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:01 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:01.991+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:32:02.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:01 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:01.991+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:32:02.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:01 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:01.991+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.096359+0000 front 2026-02-24T09:31:36.096470+0000 (oldest deadline 2026-02-24T09:31:59.596412+0000) 2026-02-24T09:32:02.373 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:32:01 trial074 systemd[1]: Stopping Ceph osd.7 for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:32:02.373 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:32:02 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7[76701]: 2026-02-24T09:32:02.009+0000 7f2da74c0640 -1 osd.7 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.093031+0000 front 2026-02-24T09:31:28.092318+0000 (oldest deadline 2026-02-24T09:31:52.792419+0000) 2026-02-24T09:32:02.374 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:32:02 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7[76701]: 2026-02-24T09:32:02.009+0000 7f2da74c0640 -1 osd.7 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:32.792816+0000 front 2026-02-24T09:31:32.792783+0000 (oldest deadline 2026-02-24T09:31:58.692717+0000) 2026-02-24T09:32:02.374 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:32:02 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7[76701]: 2026-02-24T09:32:02.062+0000 7f2daadf8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T09:32:02.374 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:32:02 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7[76701]: 2026-02-24T09:32:02.062+0000 7f2daadf8640 -1 osd.7 115 *** Got signal Terminated *** 2026-02-24T09:32:02.374 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:32:02 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7[76701]: 2026-02-24T09:32:02.062+0000 7f2daadf8640 -1 osd.7 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T09:32:02.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:02 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:02.399+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.009885+0000 front 2026-02-24T09:31:24.009875+0000 (oldest deadline 2026-02-24T09:31:48.709990+0000) 2026-02-24T09:32:02.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:02 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:02.399+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.710304+0000 front 2026-02-24T09:31:28.710672+0000 (oldest deadline 2026-02-24T09:31:52.810277+0000) 2026-02-24T09:32:02.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:02 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:02.399+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.711430+0000 front 2026-02-24T09:31:36.711496+0000 (oldest deadline 2026-02-24T09:32:00.811235+0000) 2026-02-24T09:32:02.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:02 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:02.383+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:32:02.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:02 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:02.383+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.935726+0000 front 2026-02-24T09:31:29.935928+0000 (oldest deadline 2026-02-24T09:31:52.235848+0000) 2026-02-24T09:32:02.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:02 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:02.383+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:35.036724+0000 front 2026-02-24T09:31:35.036776+0000 (oldest deadline 2026-02-24T09:31:57.336638+0000) 2026-02-24T09:32:02.989 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:02 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:02.628+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.896363+0000 front 2026-02-24T09:31:29.896557+0000 (oldest deadline 2026-02-24T09:31:53.396409+0000) 2026-02-24T09:32:02.990 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:02 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:02.628+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.296924+0000 front 2026-02-24T09:31:36.297088+0000 (oldest deadline 2026-02-24T09:31:59.796948+0000) 2026-02-24T09:32:02.990 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:02 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:02.989+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:32:02.990 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:02 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:02.989+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:32:03.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:02 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:02.989+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.096359+0000 front 2026-02-24T09:31:36.096470+0000 (oldest deadline 2026-02-24T09:31:59.596412+0000) 2026-02-24T09:32:03.373 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:32:02 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7[76701]: 2026-02-24T09:32:02.991+0000 7f2da74c0640 -1 osd.7 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.093031+0000 front 2026-02-24T09:31:28.092318+0000 (oldest deadline 2026-02-24T09:31:52.792419+0000) 2026-02-24T09:32:03.374 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:32:02 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7[76701]: 2026-02-24T09:32:02.991+0000 7f2da74c0640 -1 osd.7 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:32.792816+0000 front 2026-02-24T09:31:32.792783+0000 (oldest deadline 2026-02-24T09:31:58.692717+0000) 2026-02-24T09:32:03.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:03 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:03.450+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.009885+0000 front 2026-02-24T09:31:24.009875+0000 (oldest deadline 2026-02-24T09:31:48.709990+0000) 2026-02-24T09:32:03.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:03 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:03.450+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.710304+0000 front 2026-02-24T09:31:28.710672+0000 (oldest deadline 2026-02-24T09:31:52.810277+0000) 2026-02-24T09:32:03.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:03 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:03.450+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.711430+0000 front 2026-02-24T09:31:36.711496+0000 (oldest deadline 2026-02-24T09:32:00.811235+0000) 2026-02-24T09:32:03.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:03 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:03.376+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:32:03.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:03 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:03.376+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.935726+0000 front 2026-02-24T09:31:29.935928+0000 (oldest deadline 2026-02-24T09:31:52.235848+0000) 2026-02-24T09:32:03.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:03 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:03.376+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:35.036724+0000 front 2026-02-24T09:31:35.036776+0000 (oldest deadline 2026-02-24T09:31:57.336638+0000) 2026-02-24T09:32:03.971 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:03 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:03.594+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.896363+0000 front 2026-02-24T09:31:29.896557+0000 (oldest deadline 2026-02-24T09:31:53.396409+0000) 2026-02-24T09:32:03.972 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:03 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:03.594+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.296924+0000 front 2026-02-24T09:31:36.297088+0000 (oldest deadline 2026-02-24T09:31:59.796948+0000) 2026-02-24T09:32:03.972 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:03 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:03.971+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:32:03.972 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:03 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:03.971+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:32:03.972 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:03 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:03.971+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.096359+0000 front 2026-02-24T09:31:36.096470+0000 (oldest deadline 2026-02-24T09:31:59.596412+0000) 2026-02-24T09:32:04.373 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:32:03 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7[76701]: 2026-02-24T09:32:03.993+0000 7f2da74c0640 -1 osd.7 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.093031+0000 front 2026-02-24T09:31:28.092318+0000 (oldest deadline 2026-02-24T09:31:52.792419+0000) 2026-02-24T09:32:04.373 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:32:03 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7[76701]: 2026-02-24T09:32:03.993+0000 7f2da74c0640 -1 osd.7 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:32.792816+0000 front 2026-02-24T09:31:32.792783+0000 (oldest deadline 2026-02-24T09:31:58.692717+0000) 2026-02-24T09:32:04.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:04 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:04.459+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.009885+0000 front 2026-02-24T09:31:24.009875+0000 (oldest deadline 2026-02-24T09:31:48.709990+0000) 2026-02-24T09:32:04.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:04 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:04.459+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.710304+0000 front 2026-02-24T09:31:28.710672+0000 (oldest deadline 2026-02-24T09:31:52.810277+0000) 2026-02-24T09:32:04.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:04 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:04.459+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.711430+0000 front 2026-02-24T09:31:36.711496+0000 (oldest deadline 2026-02-24T09:32:00.811235+0000) 2026-02-24T09:32:04.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:04 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:04.403+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:32:04.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:04 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:04.403+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.935726+0000 front 2026-02-24T09:31:29.935928+0000 (oldest deadline 2026-02-24T09:31:52.235848+0000) 2026-02-24T09:32:04.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:04 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:04.403+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:35.036724+0000 front 2026-02-24T09:31:35.036776+0000 (oldest deadline 2026-02-24T09:31:57.336638+0000) 2026-02-24T09:32:04.972 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:04 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:04.573+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.896363+0000 front 2026-02-24T09:31:29.896557+0000 (oldest deadline 2026-02-24T09:31:53.396409+0000) 2026-02-24T09:32:04.973 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:04 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:04.573+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.296924+0000 front 2026-02-24T09:31:36.297088+0000 (oldest deadline 2026-02-24T09:31:59.796948+0000) 2026-02-24T09:32:05.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:04 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:04.972+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:32:05.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:04 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:04.972+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:32:05.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:04 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:04.972+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.096359+0000 front 2026-02-24T09:31:36.096470+0000 (oldest deadline 2026-02-24T09:31:59.596412+0000) 2026-02-24T09:32:05.373 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:32:04 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7[76701]: 2026-02-24T09:32:04.997+0000 7f2da74c0640 -1 osd.7 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.093031+0000 front 2026-02-24T09:31:28.092318+0000 (oldest deadline 2026-02-24T09:31:52.792419+0000) 2026-02-24T09:32:05.373 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:32:04 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7[76701]: 2026-02-24T09:32:04.997+0000 7f2da74c0640 -1 osd.7 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:32.792816+0000 front 2026-02-24T09:31:32.792783+0000 (oldest deadline 2026-02-24T09:31:58.692717+0000) 2026-02-24T09:32:05.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:05 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:05.426+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.009885+0000 front 2026-02-24T09:31:24.009875+0000 (oldest deadline 2026-02-24T09:31:48.709990+0000) 2026-02-24T09:32:05.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:05 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:05.426+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.710304+0000 front 2026-02-24T09:31:28.710672+0000 (oldest deadline 2026-02-24T09:31:52.810277+0000) 2026-02-24T09:32:05.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:05 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:05.426+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.711430+0000 front 2026-02-24T09:31:36.711496+0000 (oldest deadline 2026-02-24T09:32:00.811235+0000) 2026-02-24T09:32:05.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:05 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:05.405+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:32:05.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:05 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:05.405+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.935726+0000 front 2026-02-24T09:31:29.935928+0000 (oldest deadline 2026-02-24T09:31:52.235848+0000) 2026-02-24T09:32:05.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:05 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:05.405+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:35.036724+0000 front 2026-02-24T09:31:35.036776+0000 (oldest deadline 2026-02-24T09:31:57.336638+0000) 2026-02-24T09:32:05.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:05 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:05.405+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:42.037181+0000 front 2026-02-24T09:31:42.037149+0000 (oldest deadline 2026-02-24T09:32:04.937101+0000) 2026-02-24T09:32:05.968 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:05 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:05.575+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.896363+0000 front 2026-02-24T09:31:29.896557+0000 (oldest deadline 2026-02-24T09:31:53.396409+0000) 2026-02-24T09:32:05.968 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:05 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:05.575+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.296924+0000 front 2026-02-24T09:31:36.297088+0000 (oldest deadline 2026-02-24T09:31:59.796948+0000) 2026-02-24T09:32:05.969 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:05 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:05.575+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:41.497621+0000 front 2026-02-24T09:31:41.497555+0000 (oldest deadline 2026-02-24T09:32:04.997501+0000) 2026-02-24T09:32:05.969 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:05 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:05.968+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:32:05.969 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:05 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:05.968+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:32:05.969 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:05 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:05.968+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.096359+0000 front 2026-02-24T09:31:36.096470+0000 (oldest deadline 2026-02-24T09:31:59.596412+0000) 2026-02-24T09:32:06.373 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:32:05 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7[76701]: 2026-02-24T09:32:05.957+0000 7f2da74c0640 -1 osd.7 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.093031+0000 front 2026-02-24T09:31:28.092318+0000 (oldest deadline 2026-02-24T09:31:52.792419+0000) 2026-02-24T09:32:06.373 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:32:05 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7[76701]: 2026-02-24T09:32:05.957+0000 7f2da74c0640 -1 osd.7 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:32.792816+0000 front 2026-02-24T09:31:32.792783+0000 (oldest deadline 2026-02-24T09:31:58.692717+0000) 2026-02-24T09:32:06.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:06 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:06.378+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.009885+0000 front 2026-02-24T09:31:24.009875+0000 (oldest deadline 2026-02-24T09:31:48.709990+0000) 2026-02-24T09:32:06.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:06 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:06.378+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.710304+0000 front 2026-02-24T09:31:28.710672+0000 (oldest deadline 2026-02-24T09:31:52.810277+0000) 2026-02-24T09:32:06.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:06 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:06.378+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.711430+0000 front 2026-02-24T09:31:36.711496+0000 (oldest deadline 2026-02-24T09:32:00.811235+0000) 2026-02-24T09:32:06.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:06 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:06.378+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:40.811483+0000 front 2026-02-24T09:31:40.811535+0000 (oldest deadline 2026-02-24T09:32:05.511551+0000) 2026-02-24T09:32:06.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:06 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:06.450+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:32:06.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:06 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:06.450+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.935726+0000 front 2026-02-24T09:31:29.935928+0000 (oldest deadline 2026-02-24T09:31:52.235848+0000) 2026-02-24T09:32:06.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:06 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:06.450+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:35.036724+0000 front 2026-02-24T09:31:35.036776+0000 (oldest deadline 2026-02-24T09:31:57.336638+0000) 2026-02-24T09:32:06.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:06 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:06.450+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:42.037181+0000 front 2026-02-24T09:31:42.037149+0000 (oldest deadline 2026-02-24T09:32:04.937101+0000) 2026-02-24T09:32:06.985 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:06 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:06.620+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.896363+0000 front 2026-02-24T09:31:29.896557+0000 (oldest deadline 2026-02-24T09:31:53.396409+0000) 2026-02-24T09:32:06.985 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:06 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:06.620+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.296924+0000 front 2026-02-24T09:31:36.297088+0000 (oldest deadline 2026-02-24T09:31:59.796948+0000) 2026-02-24T09:32:06.985 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:06 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:06.620+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:41.497621+0000 front 2026-02-24T09:31:41.497555+0000 (oldest deadline 2026-02-24T09:32:04.997501+0000) 2026-02-24T09:32:07.253 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:32:06 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7[76701]: 2026-02-24T09:32:06.995+0000 7f2da74c0640 -1 osd.7 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.093031+0000 front 2026-02-24T09:31:28.092318+0000 (oldest deadline 2026-02-24T09:31:52.792419+0000) 2026-02-24T09:32:07.253 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:32:06 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7[76701]: 2026-02-24T09:32:06.995+0000 7f2da74c0640 -1 osd.7 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:32.792816+0000 front 2026-02-24T09:31:32.792783+0000 (oldest deadline 2026-02-24T09:31:58.692717+0000) 2026-02-24T09:32:07.253 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:32:07 trial074 podman[101958]: 2026-02-24 09:32:07.209350294 +0000 UTC m=+5.169080327 container died 011efe2065201a8bdd373e9af4e082df2220b332e0db6b3c4a5922e7d4da872a (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, io.buildah.version=1.41.3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260223, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-24T09:32:07.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:06 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:06.984+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:32:07.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:06 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:06.984+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:32:07.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:06 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:06.984+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.096359+0000 front 2026-02-24T09:31:36.096470+0000 (oldest deadline 2026-02-24T09:31:59.596412+0000) 2026-02-24T09:32:07.545 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:32:07 trial074 podman[101958]: 2026-02-24 09:32:07.268054366 +0000 UTC m=+5.227784389 container remove 011efe2065201a8bdd373e9af4e082df2220b332e0db6b3c4a5922e7d4da872a (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-vshankar-testing-20260223.155722, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, io.buildah.version=1.41.3, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-24T09:32:07.545 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:32:07 trial074 bash[101958]: ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7 2026-02-24T09:32:07.545 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:32:07 trial074 podman[102059]: 2026-02-24 09:32:07.504514154 +0000 UTC m=+0.027898182 container create ff1ef22924bcbdd9716678dad6636cb9c5cdc007624c05612cf8fd41f6f5e091 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7-deactivate, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, ceph=True, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-vshankar-testing-20260223.155722, OSD_FLAVOR=default) 2026-02-24T09:32:07.545 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:07 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:07.472+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:32:07.546 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:07 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:07.472+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.935726+0000 front 2026-02-24T09:31:29.935928+0000 (oldest deadline 2026-02-24T09:31:52.235848+0000) 2026-02-24T09:32:07.546 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:07 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:07.472+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:35.036724+0000 front 2026-02-24T09:31:35.036776+0000 (oldest deadline 2026-02-24T09:31:57.336638+0000) 2026-02-24T09:32:07.546 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:07 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:07.472+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:42.037181+0000 front 2026-02-24T09:31:42.037149+0000 (oldest deadline 2026-02-24T09:32:04.937101+0000) 2026-02-24T09:32:07.609 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:07 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:07.356+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.009885+0000 front 2026-02-24T09:31:24.009875+0000 (oldest deadline 2026-02-24T09:31:48.709990+0000) 2026-02-24T09:32:07.610 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:07 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:07.356+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.710304+0000 front 2026-02-24T09:31:28.710672+0000 (oldest deadline 2026-02-24T09:31:52.810277+0000) 2026-02-24T09:32:07.610 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:07 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:07.356+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.711430+0000 front 2026-02-24T09:31:36.711496+0000 (oldest deadline 2026-02-24T09:32:00.811235+0000) 2026-02-24T09:32:07.610 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:07 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:07.356+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:40.811483+0000 front 2026-02-24T09:31:40.811535+0000 (oldest deadline 2026-02-24T09:32:05.511551+0000) 2026-02-24T09:32:07.664 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:07 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:07.664+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.896363+0000 front 2026-02-24T09:31:29.896557+0000 (oldest deadline 2026-02-24T09:31:53.396409+0000) 2026-02-24T09:32:07.665 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:07 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:07.664+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.296924+0000 front 2026-02-24T09:31:36.297088+0000 (oldest deadline 2026-02-24T09:31:59.796948+0000) 2026-02-24T09:32:07.665 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:07 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:07.664+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:41.497621+0000 front 2026-02-24T09:31:41.497555+0000 (oldest deadline 2026-02-24T09:32:04.997501+0000) 2026-02-24T09:32:07.810 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:32:07 trial074 podman[102059]: 2026-02-24 09:32:07.557133585 +0000 UTC m=+0.080517623 container init ff1ef22924bcbdd9716678dad6636cb9c5cdc007624c05612cf8fd41f6f5e091 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0) 2026-02-24T09:32:07.810 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:32:07 trial074 podman[102059]: 2026-02-24 09:32:07.562468553 +0000 UTC m=+0.085852601 container start ff1ef22924bcbdd9716678dad6636cb9c5cdc007624c05612cf8fd41f6f5e091 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.build-date=20260223, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, OSD_FLAVOR=default, io.buildah.version=1.41.3) 2026-02-24T09:32:07.810 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:32:07 trial074 podman[102059]: 2026-02-24 09:32:07.563404373 +0000 UTC m=+0.086788411 container attach ff1ef22924bcbdd9716678dad6636cb9c5cdc007624c05612cf8fd41f6f5e091 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-vshankar-testing-20260223.155722, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b) 2026-02-24T09:32:07.810 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:32:07 trial074 podman[102059]: 2026-02-24 09:32:07.494248964 +0000 UTC m=+0.017632992 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b 2026-02-24T09:32:07.811 INFO:journalctl@ceph.osd.7.trial074.stdout:Feb 24 09:32:07 trial074 podman[102059]: 2026-02-24 09:32:07.747275389 +0000 UTC m=+0.270659427 container died ff1ef22924bcbdd9716678dad6636cb9c5cdc007624c05612cf8fd41f6f5e091 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-7-deactivate, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, ceph=True, OSD_FLAVOR=default) 2026-02-24T09:32:07.832 DEBUG:teuthology.orchestra.run.trial074:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.7.service' 2026-02-24T09:32:07.901 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:32:07.902 INFO:tasks.cephadm.osd.7:Stopped osd.7 2026-02-24T09:32:07.902 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2026-02-24T09:32:07.902 DEBUG:teuthology.orchestra.run.trial159:> sudo systemctl stop ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.8 2026-02-24T09:32:08.279 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:07 trial159 systemd[1]: Stopping Ceph osd.8 for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:32:08.280 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:08 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:08.091+0000 7f0449776640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T09:32:08.280 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:08 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:08.091+0000 7f0449776640 -1 osd.8 115 *** Got signal Terminated *** 2026-02-24T09:32:08.280 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:08 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:08.091+0000 7f0449776640 -1 osd.8 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T09:32:08.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:07 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:07.964+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:32:08.281 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:07 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:07.964+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:32:08.281 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:07 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:07.964+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.096359+0000 front 2026-02-24T09:31:36.096470+0000 (oldest deadline 2026-02-24T09:31:59.596412+0000) 2026-02-24T09:32:08.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:08 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:08.380+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.009885+0000 front 2026-02-24T09:31:24.009875+0000 (oldest deadline 2026-02-24T09:31:48.709990+0000) 2026-02-24T09:32:08.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:08 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:08.380+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.710304+0000 front 2026-02-24T09:31:28.710672+0000 (oldest deadline 2026-02-24T09:31:52.810277+0000) 2026-02-24T09:32:08.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:08 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:08.380+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.711430+0000 front 2026-02-24T09:31:36.711496+0000 (oldest deadline 2026-02-24T09:32:00.811235+0000) 2026-02-24T09:32:08.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:08 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:08.380+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:40.811483+0000 front 2026-02-24T09:31:40.811535+0000 (oldest deadline 2026-02-24T09:32:05.511551+0000) 2026-02-24T09:32:08.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:08 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:08.466+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:32:08.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:08 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:08.466+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.935726+0000 front 2026-02-24T09:31:29.935928+0000 (oldest deadline 2026-02-24T09:31:52.235848+0000) 2026-02-24T09:32:08.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:08 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:08.466+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:35.036724+0000 front 2026-02-24T09:31:35.036776+0000 (oldest deadline 2026-02-24T09:31:57.336638+0000) 2026-02-24T09:32:08.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:08 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:08.466+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:42.037181+0000 front 2026-02-24T09:31:42.037149+0000 (oldest deadline 2026-02-24T09:32:04.937101+0000) 2026-02-24T09:32:08.979 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:08 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:08.674+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.896363+0000 front 2026-02-24T09:31:29.896557+0000 (oldest deadline 2026-02-24T09:31:53.396409+0000) 2026-02-24T09:32:08.979 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:08 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:08.674+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.296924+0000 front 2026-02-24T09:31:36.297088+0000 (oldest deadline 2026-02-24T09:31:59.796948+0000) 2026-02-24T09:32:08.979 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:08 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:08.674+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:41.497621+0000 front 2026-02-24T09:31:41.497555+0000 (oldest deadline 2026-02-24T09:32:04.997501+0000) 2026-02-24T09:32:08.979 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:08 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:08.979+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:32:08.980 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:08 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:08.979+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:32:08.980 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:08 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:08.979+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.096359+0000 front 2026-02-24T09:31:36.096470+0000 (oldest deadline 2026-02-24T09:31:59.596412+0000) 2026-02-24T09:32:09.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:09 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:09.369+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.009885+0000 front 2026-02-24T09:31:24.009875+0000 (oldest deadline 2026-02-24T09:31:48.709990+0000) 2026-02-24T09:32:09.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:09 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:09.369+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.710304+0000 front 2026-02-24T09:31:28.710672+0000 (oldest deadline 2026-02-24T09:31:52.810277+0000) 2026-02-24T09:32:09.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:09 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:09.369+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.711430+0000 front 2026-02-24T09:31:36.711496+0000 (oldest deadline 2026-02-24T09:32:00.811235+0000) 2026-02-24T09:32:09.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:09 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:09.369+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:40.811483+0000 front 2026-02-24T09:31:40.811535+0000 (oldest deadline 2026-02-24T09:32:05.511551+0000) 2026-02-24T09:32:09.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:09 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:09.486+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:32:09.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:09 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:09.486+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.935726+0000 front 2026-02-24T09:31:29.935928+0000 (oldest deadline 2026-02-24T09:31:52.235848+0000) 2026-02-24T09:32:09.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:09 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:09.486+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:35.036724+0000 front 2026-02-24T09:31:35.036776+0000 (oldest deadline 2026-02-24T09:31:57.336638+0000) 2026-02-24T09:32:09.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:09 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:09.486+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:42.037181+0000 front 2026-02-24T09:31:42.037149+0000 (oldest deadline 2026-02-24T09:32:04.937101+0000) 2026-02-24T09:32:10.030 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:09 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:09.948+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:32:10.030 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:09 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:09.948+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:32:10.030 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:09 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:09.948+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.096359+0000 front 2026-02-24T09:31:36.096470+0000 (oldest deadline 2026-02-24T09:31:59.596412+0000) 2026-02-24T09:32:10.030 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:09 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:09.714+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.896363+0000 front 2026-02-24T09:31:29.896557+0000 (oldest deadline 2026-02-24T09:31:53.396409+0000) 2026-02-24T09:32:10.031 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:09 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:09.714+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.296924+0000 front 2026-02-24T09:31:36.297088+0000 (oldest deadline 2026-02-24T09:31:59.796948+0000) 2026-02-24T09:32:10.031 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:09 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:09.714+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:41.497621+0000 front 2026-02-24T09:31:41.497555+0000 (oldest deadline 2026-02-24T09:32:04.997501+0000) 2026-02-24T09:32:10.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:10 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:10.399+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.009885+0000 front 2026-02-24T09:31:24.009875+0000 (oldest deadline 2026-02-24T09:31:48.709990+0000) 2026-02-24T09:32:10.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:10 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:10.399+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.710304+0000 front 2026-02-24T09:31:28.710672+0000 (oldest deadline 2026-02-24T09:31:52.810277+0000) 2026-02-24T09:32:10.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:10 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:10.399+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.711430+0000 front 2026-02-24T09:31:36.711496+0000 (oldest deadline 2026-02-24T09:32:00.811235+0000) 2026-02-24T09:32:10.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:10 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:10.399+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:40.811483+0000 front 2026-02-24T09:31:40.811535+0000 (oldest deadline 2026-02-24T09:32:05.511551+0000) 2026-02-24T09:32:10.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:10 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:10.455+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:32:10.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:10 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:10.455+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.935726+0000 front 2026-02-24T09:31:29.935928+0000 (oldest deadline 2026-02-24T09:31:52.235848+0000) 2026-02-24T09:32:10.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:10 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:10.455+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:35.036724+0000 front 2026-02-24T09:31:35.036776+0000 (oldest deadline 2026-02-24T09:31:57.336638+0000) 2026-02-24T09:32:10.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:10 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:10.455+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:42.037181+0000 front 2026-02-24T09:31:42.037149+0000 (oldest deadline 2026-02-24T09:32:04.937101+0000) 2026-02-24T09:32:11.029 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:10 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:10.738+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.896363+0000 front 2026-02-24T09:31:29.896557+0000 (oldest deadline 2026-02-24T09:31:53.396409+0000) 2026-02-24T09:32:11.030 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:10 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:10.738+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.296924+0000 front 2026-02-24T09:31:36.297088+0000 (oldest deadline 2026-02-24T09:31:59.796948+0000) 2026-02-24T09:32:11.030 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:10 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:10.738+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:41.497621+0000 front 2026-02-24T09:31:41.497555+0000 (oldest deadline 2026-02-24T09:32:04.997501+0000) 2026-02-24T09:32:11.030 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:10 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:10.903+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:32:11.030 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:10 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:10.903+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:32:11.030 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:10 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:10.903+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.096359+0000 front 2026-02-24T09:31:36.096470+0000 (oldest deadline 2026-02-24T09:31:59.596412+0000) 2026-02-24T09:32:11.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:11 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:11.376+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.009885+0000 front 2026-02-24T09:31:24.009875+0000 (oldest deadline 2026-02-24T09:31:48.709990+0000) 2026-02-24T09:32:11.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:11 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:11.376+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.710304+0000 front 2026-02-24T09:31:28.710672+0000 (oldest deadline 2026-02-24T09:31:52.810277+0000) 2026-02-24T09:32:11.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:11 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:11.376+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.711430+0000 front 2026-02-24T09:31:36.711496+0000 (oldest deadline 2026-02-24T09:32:00.811235+0000) 2026-02-24T09:32:11.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:11 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:11.376+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:40.811483+0000 front 2026-02-24T09:31:40.811535+0000 (oldest deadline 2026-02-24T09:32:05.511551+0000) 2026-02-24T09:32:11.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:11 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:11.376+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:46.612094+0000 front 2026-02-24T09:31:46.612347+0000 (oldest deadline 2026-02-24T09:32:11.312054+0000) 2026-02-24T09:32:11.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:11 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:11.432+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:32:11.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:11 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:11.432+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.935726+0000 front 2026-02-24T09:31:29.935928+0000 (oldest deadline 2026-02-24T09:31:52.235848+0000) 2026-02-24T09:32:11.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:11 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:11.432+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:35.036724+0000 front 2026-02-24T09:31:35.036776+0000 (oldest deadline 2026-02-24T09:31:57.336638+0000) 2026-02-24T09:32:11.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:11 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:11.432+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:42.037181+0000 front 2026-02-24T09:31:42.037149+0000 (oldest deadline 2026-02-24T09:32:04.937101+0000) 2026-02-24T09:32:12.029 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:11 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:11.770+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.896363+0000 front 2026-02-24T09:31:29.896557+0000 (oldest deadline 2026-02-24T09:31:53.396409+0000) 2026-02-24T09:32:12.030 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:11 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:11.770+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.296924+0000 front 2026-02-24T09:31:36.297088+0000 (oldest deadline 2026-02-24T09:31:59.796948+0000) 2026-02-24T09:32:12.030 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:11 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:11.770+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:41.497621+0000 front 2026-02-24T09:31:41.497555+0000 (oldest deadline 2026-02-24T09:32:04.997501+0000) 2026-02-24T09:32:12.030 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:11 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:11.770+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:48.497993+0000 front 2026-02-24T09:31:48.498079+0000 (oldest deadline 2026-02-24T09:32:10.797989+0000) 2026-02-24T09:32:12.030 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:11 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:11.854+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:32:12.030 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:11 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:11.854+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:32:12.031 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:11 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:11.854+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.096359+0000 front 2026-02-24T09:31:36.096470+0000 (oldest deadline 2026-02-24T09:31:59.596412+0000) 2026-02-24T09:32:12.031 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:11 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:11.854+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:48.897729+0000 front 2026-02-24T09:31:48.897457+0000 (oldest deadline 2026-02-24T09:32:11.797415+0000) 2026-02-24T09:32:12.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:12 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:12.424+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.009885+0000 front 2026-02-24T09:31:24.009875+0000 (oldest deadline 2026-02-24T09:31:48.709990+0000) 2026-02-24T09:32:12.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:12 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:12.424+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.710304+0000 front 2026-02-24T09:31:28.710672+0000 (oldest deadline 2026-02-24T09:31:52.810277+0000) 2026-02-24T09:32:12.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:12 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:12.424+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.711430+0000 front 2026-02-24T09:31:36.711496+0000 (oldest deadline 2026-02-24T09:32:00.811235+0000) 2026-02-24T09:32:12.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:12 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:12.424+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:40.811483+0000 front 2026-02-24T09:31:40.811535+0000 (oldest deadline 2026-02-24T09:32:05.511551+0000) 2026-02-24T09:32:12.861 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:12 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:12.424+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:46.612094+0000 front 2026-02-24T09:31:46.612347+0000 (oldest deadline 2026-02-24T09:32:11.312054+0000) 2026-02-24T09:32:12.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:12 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:12.430+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:32:12.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:12 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:12.430+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.935726+0000 front 2026-02-24T09:31:29.935928+0000 (oldest deadline 2026-02-24T09:31:52.235848+0000) 2026-02-24T09:32:12.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:12 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:12.430+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:35.036724+0000 front 2026-02-24T09:31:35.036776+0000 (oldest deadline 2026-02-24T09:31:57.336638+0000) 2026-02-24T09:32:12.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:12 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:12.430+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:42.037181+0000 front 2026-02-24T09:31:42.037149+0000 (oldest deadline 2026-02-24T09:32:04.937101+0000) 2026-02-24T09:32:13.030 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:12 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:12.767+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.896363+0000 front 2026-02-24T09:31:29.896557+0000 (oldest deadline 2026-02-24T09:31:53.396409+0000) 2026-02-24T09:32:13.030 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:12 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:12.767+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.296924+0000 front 2026-02-24T09:31:36.297088+0000 (oldest deadline 2026-02-24T09:31:59.796948+0000) 2026-02-24T09:32:13.030 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:12 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:12.767+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:41.497621+0000 front 2026-02-24T09:31:41.497555+0000 (oldest deadline 2026-02-24T09:32:04.997501+0000) 2026-02-24T09:32:13.031 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:12 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8[76329]: 2026-02-24T09:32:12.767+0000 7f0445e3e640 -1 osd.8 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:48.497993+0000 front 2026-02-24T09:31:48.498079+0000 (oldest deadline 2026-02-24T09:32:10.797989+0000) 2026-02-24T09:32:13.031 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:12 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:12.850+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:32:13.031 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:12 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:12.850+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:32:13.031 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:12 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:12.850+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.096359+0000 front 2026-02-24T09:31:36.096470+0000 (oldest deadline 2026-02-24T09:31:59.596412+0000) 2026-02-24T09:32:13.031 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:12 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:12.850+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:48.897729+0000 front 2026-02-24T09:31:48.897457+0000 (oldest deadline 2026-02-24T09:32:11.797415+0000) 2026-02-24T09:32:13.529 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:13 trial159 podman[102424]: 2026-02-24 09:32:13.229056805 +0000 UTC m=+5.159459805 container died ed054192455a958e83faa743ad8ead20b06cbd8058682cfb02fe212e4e05a43c (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-vshankar-testing-20260223.155722, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2) 2026-02-24T09:32:13.529 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:13 trial159 podman[102424]: 2026-02-24 09:32:13.286627836 +0000 UTC m=+5.217030826 container remove ed054192455a958e83faa743ad8ead20b06cbd8058682cfb02fe212e4e05a43c (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, CEPH_REF=wip-vshankar-testing-20260223.155722, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True) 2026-02-24T09:32:13.529 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:13 trial159 bash[102424]: ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8 2026-02-24T09:32:13.779 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:13 trial159 podman[102531]: 2026-02-24 09:32:13.529478082 +0000 UTC m=+0.029268509 container create 47e95fb5fc89592aef9d3d52ded6286625786cce0697feccc90b353c9fe2cbe5 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.label-schema.vendor=CentOS, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, OSD_FLAVOR=default, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.build-date=20260223) 2026-02-24T09:32:13.780 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:13 trial159 podman[102531]: 2026-02-24 09:32:13.586174327 +0000 UTC m=+0.085964754 container init 47e95fb5fc89592aef9d3d52ded6286625786cce0697feccc90b353c9fe2cbe5 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8-deactivate, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223, org.label-schema.vendor=CentOS, CEPH_REF=wip-vshankar-testing-20260223.155722, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.label-schema.license=GPLv2, OSD_FLAVOR=default) 2026-02-24T09:32:13.780 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:13 trial159 podman[102531]: 2026-02-24 09:32:13.591304648 +0000 UTC m=+0.091095076 container start 47e95fb5fc89592aef9d3d52ded6286625786cce0697feccc90b353c9fe2cbe5 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8-deactivate, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.label-schema.build-date=20260223, org.label-schema.vendor=CentOS, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, OSD_FLAVOR=default, CEPH_REF=wip-vshankar-testing-20260223.155722) 2026-02-24T09:32:13.780 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:13 trial159 podman[102531]: 2026-02-24 09:32:13.592197398 +0000 UTC m=+0.091987825 container attach 47e95fb5fc89592aef9d3d52ded6286625786cce0697feccc90b353c9fe2cbe5 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-8-deactivate, org.label-schema.build-date=20260223, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, OSD_FLAVOR=default, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.vendor=CentOS) 2026-02-24T09:32:13.780 INFO:journalctl@ceph.osd.8.trial159.stdout:Feb 24 09:32:13 trial159 podman[102531]: 2026-02-24 09:32:13.519645489 +0000 UTC m=+0.019435927 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b 2026-02-24T09:32:13.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:13 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:13.462+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.009885+0000 front 2026-02-24T09:31:24.009875+0000 (oldest deadline 2026-02-24T09:31:48.709990+0000) 2026-02-24T09:32:13.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:13 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:13.462+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.710304+0000 front 2026-02-24T09:31:28.710672+0000 (oldest deadline 2026-02-24T09:31:52.810277+0000) 2026-02-24T09:32:13.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:13 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:13.462+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.711430+0000 front 2026-02-24T09:31:36.711496+0000 (oldest deadline 2026-02-24T09:32:00.811235+0000) 2026-02-24T09:32:13.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:13 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:13.462+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:40.811483+0000 front 2026-02-24T09:31:40.811535+0000 (oldest deadline 2026-02-24T09:32:05.511551+0000) 2026-02-24T09:32:13.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:13 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:13.462+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:46.612094+0000 front 2026-02-24T09:31:46.612347+0000 (oldest deadline 2026-02-24T09:32:11.312054+0000) 2026-02-24T09:32:13.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:13 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:13.415+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:32:13.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:13 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:13.415+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.935726+0000 front 2026-02-24T09:31:29.935928+0000 (oldest deadline 2026-02-24T09:31:52.235848+0000) 2026-02-24T09:32:13.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:13 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:13.415+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:35.036724+0000 front 2026-02-24T09:31:35.036776+0000 (oldest deadline 2026-02-24T09:31:57.336638+0000) 2026-02-24T09:32:13.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:13 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:13.415+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:42.037181+0000 front 2026-02-24T09:31:42.037149+0000 (oldest deadline 2026-02-24T09:32:04.937101+0000) 2026-02-24T09:32:13.884 DEBUG:teuthology.orchestra.run.trial159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.8.service' 2026-02-24T09:32:13.955 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:32:13.955 INFO:tasks.cephadm.osd.8:Stopped osd.8 2026-02-24T09:32:13.955 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2026-02-24T09:32:13.955 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.9 2026-02-24T09:32:14.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:13 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:13.895+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:32:14.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:13 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:13.895+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:32:14.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:13 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:13.895+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.096359+0000 front 2026-02-24T09:31:36.096470+0000 (oldest deadline 2026-02-24T09:31:59.596412+0000) 2026-02-24T09:32:14.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:13 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:13.895+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:48.897729+0000 front 2026-02-24T09:31:48.897457+0000 (oldest deadline 2026-02-24T09:32:11.797415+0000) 2026-02-24T09:32:14.359 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:14 trial028 systemd[1]: Stopping Ceph osd.9 for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:32:14.359 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:14 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:14.139+0000 7f20b898c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T09:32:14.360 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:14 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:14.139+0000 7f20b898c640 -1 osd.9 115 *** Got signal Terminated *** 2026-02-24T09:32:14.360 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:14 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:14.139+0000 7f20b898c640 -1 osd.9 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T09:32:14.775 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:14 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:14.398+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:32:14.775 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:14 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:14.398+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.935726+0000 front 2026-02-24T09:31:29.935928+0000 (oldest deadline 2026-02-24T09:31:52.235848+0000) 2026-02-24T09:32:14.775 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:14 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:14.398+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:35.036724+0000 front 2026-02-24T09:31:35.036776+0000 (oldest deadline 2026-02-24T09:31:57.336638+0000) 2026-02-24T09:32:14.775 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:14 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:14.398+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:42.037181+0000 front 2026-02-24T09:31:42.037149+0000 (oldest deadline 2026-02-24T09:32:04.937101+0000) 2026-02-24T09:32:14.775 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:14 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:14.398+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:47.837517+0000 front 2026-02-24T09:31:47.837550+0000 (oldest deadline 2026-02-24T09:32:13.737595+0000) 2026-02-24T09:32:14.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:14 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:14.432+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.009885+0000 front 2026-02-24T09:31:24.009875+0000 (oldest deadline 2026-02-24T09:31:48.709990+0000) 2026-02-24T09:32:14.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:14 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:14.432+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.710304+0000 front 2026-02-24T09:31:28.710672+0000 (oldest deadline 2026-02-24T09:31:52.810277+0000) 2026-02-24T09:32:14.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:14 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:14.432+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.711430+0000 front 2026-02-24T09:31:36.711496+0000 (oldest deadline 2026-02-24T09:32:00.811235+0000) 2026-02-24T09:32:14.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:14 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:14.432+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:40.811483+0000 front 2026-02-24T09:31:40.811535+0000 (oldest deadline 2026-02-24T09:32:05.511551+0000) 2026-02-24T09:32:14.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:14 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:14.432+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:46.612094+0000 front 2026-02-24T09:31:46.612347+0000 (oldest deadline 2026-02-24T09:32:11.312054+0000) 2026-02-24T09:32:15.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:14 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:14.853+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:32:15.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:14 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:14.853+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:32:15.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:14 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:14.853+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.096359+0000 front 2026-02-24T09:31:36.096470+0000 (oldest deadline 2026-02-24T09:31:59.596412+0000) 2026-02-24T09:32:15.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:14 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:14.853+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:48.897729+0000 front 2026-02-24T09:31:48.897457+0000 (oldest deadline 2026-02-24T09:32:11.797415+0000) 2026-02-24T09:32:15.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:15 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:15.408+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.009885+0000 front 2026-02-24T09:31:24.009875+0000 (oldest deadline 2026-02-24T09:31:48.709990+0000) 2026-02-24T09:32:15.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:15 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:15.408+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.710304+0000 front 2026-02-24T09:31:28.710672+0000 (oldest deadline 2026-02-24T09:31:52.810277+0000) 2026-02-24T09:32:15.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:15 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:15.408+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.711430+0000 front 2026-02-24T09:31:36.711496+0000 (oldest deadline 2026-02-24T09:32:00.811235+0000) 2026-02-24T09:32:15.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:15 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:15.408+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:40.811483+0000 front 2026-02-24T09:31:40.811535+0000 (oldest deadline 2026-02-24T09:32:05.511551+0000) 2026-02-24T09:32:15.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:15 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:15.408+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:46.612094+0000 front 2026-02-24T09:31:46.612347+0000 (oldest deadline 2026-02-24T09:32:11.312054+0000) 2026-02-24T09:32:15.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:15 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:15.444+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:32:15.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:15 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:15.444+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.935726+0000 front 2026-02-24T09:31:29.935928+0000 (oldest deadline 2026-02-24T09:31:52.235848+0000) 2026-02-24T09:32:15.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:15 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:15.444+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:35.036724+0000 front 2026-02-24T09:31:35.036776+0000 (oldest deadline 2026-02-24T09:31:57.336638+0000) 2026-02-24T09:32:15.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:15 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:15.444+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:42.037181+0000 front 2026-02-24T09:31:42.037149+0000 (oldest deadline 2026-02-24T09:32:04.937101+0000) 2026-02-24T09:32:15.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:15 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:15.444+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:47.837517+0000 front 2026-02-24T09:31:47.837550+0000 (oldest deadline 2026-02-24T09:32:13.737595+0000) 2026-02-24T09:32:16.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:15 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:15.804+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:32:16.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:15 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:15.804+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:32:16.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:15 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:15.804+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.096359+0000 front 2026-02-24T09:31:36.096470+0000 (oldest deadline 2026-02-24T09:31:59.596412+0000) 2026-02-24T09:32:16.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:15 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:15.804+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:48.897729+0000 front 2026-02-24T09:31:48.897457+0000 (oldest deadline 2026-02-24T09:32:11.797415+0000) 2026-02-24T09:32:16.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:15 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:15.804+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6812 osd.5 since back 2026-02-24T09:31:51.797623+0000 front 2026-02-24T09:31:51.797676+0000 (oldest deadline 2026-02-24T09:32:15.297710+0000) 2026-02-24T09:32:16.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:16 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:16.408+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.009885+0000 front 2026-02-24T09:31:24.009875+0000 (oldest deadline 2026-02-24T09:31:48.709990+0000) 2026-02-24T09:32:16.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:16 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:16.408+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.710304+0000 front 2026-02-24T09:31:28.710672+0000 (oldest deadline 2026-02-24T09:31:52.810277+0000) 2026-02-24T09:32:16.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:16 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:16.408+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.711430+0000 front 2026-02-24T09:31:36.711496+0000 (oldest deadline 2026-02-24T09:32:00.811235+0000) 2026-02-24T09:32:16.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:16 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:16.408+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:40.811483+0000 front 2026-02-24T09:31:40.811535+0000 (oldest deadline 2026-02-24T09:32:05.511551+0000) 2026-02-24T09:32:16.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:16 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:16.408+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:46.612094+0000 front 2026-02-24T09:31:46.612347+0000 (oldest deadline 2026-02-24T09:32:11.312054+0000) 2026-02-24T09:32:16.859 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:16 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:16.408+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.159:6812 osd.5 since back 2026-02-24T09:31:51.312385+0000 front 2026-02-24T09:31:51.312357+0000 (oldest deadline 2026-02-24T09:32:15.412277+0000) 2026-02-24T09:32:16.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:16 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:16.454+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:32:16.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:16 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:16.454+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.935726+0000 front 2026-02-24T09:31:29.935928+0000 (oldest deadline 2026-02-24T09:31:52.235848+0000) 2026-02-24T09:32:16.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:16 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:16.454+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:35.036724+0000 front 2026-02-24T09:31:35.036776+0000 (oldest deadline 2026-02-24T09:31:57.336638+0000) 2026-02-24T09:32:16.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:16 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:16.454+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:42.037181+0000 front 2026-02-24T09:31:42.037149+0000 (oldest deadline 2026-02-24T09:32:04.937101+0000) 2026-02-24T09:32:16.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:16 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:16.454+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:47.837517+0000 front 2026-02-24T09:31:47.837550+0000 (oldest deadline 2026-02-24T09:32:13.737595+0000) 2026-02-24T09:32:17.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:16 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:16.781+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:32:17.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:16 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:16.781+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:32:17.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:16 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:16.781+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.096359+0000 front 2026-02-24T09:31:36.096470+0000 (oldest deadline 2026-02-24T09:31:59.596412+0000) 2026-02-24T09:32:17.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:16 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:16.781+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:48.897729+0000 front 2026-02-24T09:31:48.897457+0000 (oldest deadline 2026-02-24T09:32:11.797415+0000) 2026-02-24T09:32:17.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:16 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:16.781+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6812 osd.5 since back 2026-02-24T09:31:51.797623+0000 front 2026-02-24T09:31:51.797676+0000 (oldest deadline 2026-02-24T09:32:15.297710+0000) 2026-02-24T09:32:17.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:17 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:17.364+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.009885+0000 front 2026-02-24T09:31:24.009875+0000 (oldest deadline 2026-02-24T09:31:48.709990+0000) 2026-02-24T09:32:17.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:17 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:17.364+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.710304+0000 front 2026-02-24T09:31:28.710672+0000 (oldest deadline 2026-02-24T09:31:52.810277+0000) 2026-02-24T09:32:17.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:17 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:17.364+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.711430+0000 front 2026-02-24T09:31:36.711496+0000 (oldest deadline 2026-02-24T09:32:00.811235+0000) 2026-02-24T09:32:17.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:17 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:17.364+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:40.811483+0000 front 2026-02-24T09:31:40.811535+0000 (oldest deadline 2026-02-24T09:32:05.511551+0000) 2026-02-24T09:32:17.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:17 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:17.364+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:46.612094+0000 front 2026-02-24T09:31:46.612347+0000 (oldest deadline 2026-02-24T09:32:11.312054+0000) 2026-02-24T09:32:17.860 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:17 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:17.364+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.159:6812 osd.5 since back 2026-02-24T09:31:51.312385+0000 front 2026-02-24T09:31:51.312357+0000 (oldest deadline 2026-02-24T09:32:15.412277+0000) 2026-02-24T09:32:17.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:17 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:17.462+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:32:17.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:17 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:17.462+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.935726+0000 front 2026-02-24T09:31:29.935928+0000 (oldest deadline 2026-02-24T09:31:52.235848+0000) 2026-02-24T09:32:17.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:17 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:17.462+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:35.036724+0000 front 2026-02-24T09:31:35.036776+0000 (oldest deadline 2026-02-24T09:31:57.336638+0000) 2026-02-24T09:32:17.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:17 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:17.462+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:42.037181+0000 front 2026-02-24T09:31:42.037149+0000 (oldest deadline 2026-02-24T09:32:04.937101+0000) 2026-02-24T09:32:17.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:17 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:17.462+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:47.837517+0000 front 2026-02-24T09:31:47.837550+0000 (oldest deadline 2026-02-24T09:32:13.737595+0000) 2026-02-24T09:32:18.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:17 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:17.787+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:32:18.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:17 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:17.787+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:32:18.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:17 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:17.787+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.096359+0000 front 2026-02-24T09:31:36.096470+0000 (oldest deadline 2026-02-24T09:31:59.596412+0000) 2026-02-24T09:32:18.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:17 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:17.787+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:48.897729+0000 front 2026-02-24T09:31:48.897457+0000 (oldest deadline 2026-02-24T09:32:11.797415+0000) 2026-02-24T09:32:18.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:17 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:17.787+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6812 osd.5 since back 2026-02-24T09:31:51.797623+0000 front 2026-02-24T09:31:51.797676+0000 (oldest deadline 2026-02-24T09:32:15.297710+0000) 2026-02-24T09:32:18.609 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:18 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:18.337+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.009885+0000 front 2026-02-24T09:31:24.009875+0000 (oldest deadline 2026-02-24T09:31:48.709990+0000) 2026-02-24T09:32:18.610 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:18 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:18.337+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:28.710304+0000 front 2026-02-24T09:31:28.710672+0000 (oldest deadline 2026-02-24T09:31:52.810277+0000) 2026-02-24T09:32:18.610 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:18 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:18.337+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.711430+0000 front 2026-02-24T09:31:36.711496+0000 (oldest deadline 2026-02-24T09:32:00.811235+0000) 2026-02-24T09:32:18.610 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:18 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:18.337+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:40.811483+0000 front 2026-02-24T09:31:40.811535+0000 (oldest deadline 2026-02-24T09:32:05.511551+0000) 2026-02-24T09:32:18.610 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:18 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:18.337+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:46.612094+0000 front 2026-02-24T09:31:46.612347+0000 (oldest deadline 2026-02-24T09:32:11.312054+0000) 2026-02-24T09:32:18.610 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:18 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9[99115]: 2026-02-24T09:32:18.337+0000 7f20b5054640 -1 osd.9 115 heartbeat_check: no reply from 10.20.193.159:6812 osd.5 since back 2026-02-24T09:31:51.312385+0000 front 2026-02-24T09:31:51.312357+0000 (oldest deadline 2026-02-24T09:32:15.412277+0000) 2026-02-24T09:32:18.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:18 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:18.412+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:32:18.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:18 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:18.412+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.935726+0000 front 2026-02-24T09:31:29.935928+0000 (oldest deadline 2026-02-24T09:31:52.235848+0000) 2026-02-24T09:32:18.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:18 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:18.412+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:35.036724+0000 front 2026-02-24T09:31:35.036776+0000 (oldest deadline 2026-02-24T09:31:57.336638+0000) 2026-02-24T09:32:18.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:18 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:18.412+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:42.037181+0000 front 2026-02-24T09:31:42.037149+0000 (oldest deadline 2026-02-24T09:32:04.937101+0000) 2026-02-24T09:32:18.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:18 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:18.412+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:47.837517+0000 front 2026-02-24T09:31:47.837550+0000 (oldest deadline 2026-02-24T09:32:13.737595+0000) 2026-02-24T09:32:18.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:18 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:18.412+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6812 osd.5 since back 2026-02-24T09:31:53.737862+0000 front 2026-02-24T09:31:53.737918+0000 (oldest deadline 2026-02-24T09:32:17.837870+0000) 2026-02-24T09:32:19.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:18 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:18.818+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:32:19.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:18 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:18.818+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:32:19.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:18 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:18.818+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.096359+0000 front 2026-02-24T09:31:36.096470+0000 (oldest deadline 2026-02-24T09:31:59.596412+0000) 2026-02-24T09:32:19.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:18 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:18.818+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:48.897729+0000 front 2026-02-24T09:31:48.897457+0000 (oldest deadline 2026-02-24T09:32:11.797415+0000) 2026-02-24T09:32:19.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:18 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:18.818+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6812 osd.5 since back 2026-02-24T09:31:51.797623+0000 front 2026-02-24T09:31:51.797676+0000 (oldest deadline 2026-02-24T09:32:15.297710+0000) 2026-02-24T09:32:19.574 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:19 trial028 podman[125797]: 2026-02-24 09:32:19.275983946 +0000 UTC m=+5.158998324 container died 394049a480bce50f35e59d787b600976c71c1004a89c69d97aff64f81667d1bb (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.build-date=20260223, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-24T09:32:19.575 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:19 trial028 podman[125797]: 2026-02-24 09:32:19.33433997 +0000 UTC m=+5.217354348 container remove 394049a480bce50f35e59d787b600976c71c1004a89c69d97aff64f81667d1bb (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-vshankar-testing-20260223.155722, OSD_FLAVOR=default, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-24T09:32:19.575 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:19 trial028 bash[125797]: ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9 2026-02-24T09:32:19.831 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:19 trial028 podman[125896]: 2026-02-24 09:32:19.574765798 +0000 UTC m=+0.027809583 container create 3c63dfa1ed53494634427dc851f24f57a2cc6f2ddd6dd9340ba4d78b3ada9f71 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, org.label-schema.build-date=20260223) 2026-02-24T09:32:19.831 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:19 trial028 podman[125896]: 2026-02-24 09:32:19.626777744 +0000 UTC m=+0.079821529 container init 3c63dfa1ed53494634427dc851f24f57a2cc6f2ddd6dd9340ba4d78b3ada9f71 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260223, ceph=True, CEPH_REF=wip-vshankar-testing-20260223.155722, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.license=GPLv2) 2026-02-24T09:32:19.831 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:19 trial028 podman[125896]: 2026-02-24 09:32:19.632362954 +0000 UTC m=+0.085406739 container start 3c63dfa1ed53494634427dc851f24f57a2cc6f2ddd6dd9340ba4d78b3ada9f71 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, io.buildah.version=1.41.3, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.schema-version=1.0, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2) 2026-02-24T09:32:19.831 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:19 trial028 podman[125896]: 2026-02-24 09:32:19.633364122 +0000 UTC m=+0.086407907 container attach 3c63dfa1ed53494634427dc851f24f57a2cc6f2ddd6dd9340ba4d78b3ada9f71 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-9-deactivate, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, ceph=True, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260223, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-24T09:32:19.831 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 24 09:32:19 trial028 podman[125896]: 2026-02-24 09:32:19.564749161 +0000 UTC m=+0.017792946 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b 2026-02-24T09:32:19.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:19 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:19.379+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:32:19.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:19 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:19.379+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.935726+0000 front 2026-02-24T09:31:29.935928+0000 (oldest deadline 2026-02-24T09:31:52.235848+0000) 2026-02-24T09:32:19.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:19 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:19.379+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:35.036724+0000 front 2026-02-24T09:31:35.036776+0000 (oldest deadline 2026-02-24T09:31:57.336638+0000) 2026-02-24T09:32:19.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:19 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:19.379+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:42.037181+0000 front 2026-02-24T09:31:42.037149+0000 (oldest deadline 2026-02-24T09:32:04.937101+0000) 2026-02-24T09:32:19.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:19 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:19.379+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:47.837517+0000 front 2026-02-24T09:31:47.837550+0000 (oldest deadline 2026-02-24T09:32:13.737595+0000) 2026-02-24T09:32:19.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:19 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:19.379+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6812 osd.5 since back 2026-02-24T09:31:53.737862+0000 front 2026-02-24T09:31:53.737918+0000 (oldest deadline 2026-02-24T09:32:17.837870+0000) 2026-02-24T09:32:19.949 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.9.service' 2026-02-24T09:32:20.021 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:32:20.021 INFO:tasks.cephadm.osd.9:Stopped osd.9 2026-02-24T09:32:20.021 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2026-02-24T09:32:20.022 DEBUG:teuthology.orchestra.run.trial074:> sudo systemctl stop ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.10 2026-02-24T09:32:20.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:19 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:19.804+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:32:20.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:19 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:19.804+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:32:20.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:19 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:19.804+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.096359+0000 front 2026-02-24T09:31:36.096470+0000 (oldest deadline 2026-02-24T09:31:59.596412+0000) 2026-02-24T09:32:20.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:19 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:19.804+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:48.897729+0000 front 2026-02-24T09:31:48.897457+0000 (oldest deadline 2026-02-24T09:32:11.797415+0000) 2026-02-24T09:32:20.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:19 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:19.804+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6812 osd.5 since back 2026-02-24T09:31:51.797623+0000 front 2026-02-24T09:31:51.797676+0000 (oldest deadline 2026-02-24T09:32:15.297710+0000) 2026-02-24T09:32:20.373 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:20 trial074 systemd[1]: Stopping Ceph osd.10 for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:32:20.374 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:20 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:20.200+0000 7fb5e8789640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T09:32:20.374 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:20 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:20.200+0000 7fb5e8789640 -1 osd.10 115 *** Got signal Terminated *** 2026-02-24T09:32:20.374 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:20 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:20.200+0000 7fb5e8789640 -1 osd.10 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T09:32:20.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:20 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:20.415+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:32:20.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:20 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:20.415+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.935726+0000 front 2026-02-24T09:31:29.935928+0000 (oldest deadline 2026-02-24T09:31:52.235848+0000) 2026-02-24T09:32:20.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:20 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:20.415+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:35.036724+0000 front 2026-02-24T09:31:35.036776+0000 (oldest deadline 2026-02-24T09:31:57.336638+0000) 2026-02-24T09:32:20.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:20 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:20.415+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:42.037181+0000 front 2026-02-24T09:31:42.037149+0000 (oldest deadline 2026-02-24T09:32:04.937101+0000) 2026-02-24T09:32:20.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:20 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:20.415+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:47.837517+0000 front 2026-02-24T09:31:47.837550+0000 (oldest deadline 2026-02-24T09:32:13.737595+0000) 2026-02-24T09:32:20.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:20 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:20.415+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6812 osd.5 since back 2026-02-24T09:31:53.737862+0000 front 2026-02-24T09:31:53.737918+0000 (oldest deadline 2026-02-24T09:32:17.837870+0000) 2026-02-24T09:32:21.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:20 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:20.791+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:32:21.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:20 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:20.791+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:32:21.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:20 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:20.791+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.096359+0000 front 2026-02-24T09:31:36.096470+0000 (oldest deadline 2026-02-24T09:31:59.596412+0000) 2026-02-24T09:32:21.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:20 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:20.791+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:48.897729+0000 front 2026-02-24T09:31:48.897457+0000 (oldest deadline 2026-02-24T09:32:11.797415+0000) 2026-02-24T09:32:21.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:20 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:20.791+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6812 osd.5 since back 2026-02-24T09:31:51.797623+0000 front 2026-02-24T09:31:51.797676+0000 (oldest deadline 2026-02-24T09:32:15.297710+0000) 2026-02-24T09:32:21.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:21 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:21.379+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:32:21.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:21 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:21.379+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.935726+0000 front 2026-02-24T09:31:29.935928+0000 (oldest deadline 2026-02-24T09:31:52.235848+0000) 2026-02-24T09:32:21.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:21 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:21.379+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:35.036724+0000 front 2026-02-24T09:31:35.036776+0000 (oldest deadline 2026-02-24T09:31:57.336638+0000) 2026-02-24T09:32:21.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:21 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:21.379+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:42.037181+0000 front 2026-02-24T09:31:42.037149+0000 (oldest deadline 2026-02-24T09:32:04.937101+0000) 2026-02-24T09:32:21.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:21 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:21.379+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:47.837517+0000 front 2026-02-24T09:31:47.837550+0000 (oldest deadline 2026-02-24T09:32:13.737595+0000) 2026-02-24T09:32:21.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:21 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:21.379+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6812 osd.5 since back 2026-02-24T09:31:53.737862+0000 front 2026-02-24T09:31:53.737918+0000 (oldest deadline 2026-02-24T09:32:17.837870+0000) 2026-02-24T09:32:22.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:21 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:21.827+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:32:22.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:21 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:21.827+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:32:22.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:21 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:21.827+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.096359+0000 front 2026-02-24T09:31:36.096470+0000 (oldest deadline 2026-02-24T09:31:59.596412+0000) 2026-02-24T09:32:22.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:21 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:21.827+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:48.897729+0000 front 2026-02-24T09:31:48.897457+0000 (oldest deadline 2026-02-24T09:32:11.797415+0000) 2026-02-24T09:32:22.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:21 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:21.827+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6812 osd.5 since back 2026-02-24T09:31:51.797623+0000 front 2026-02-24T09:31:51.797676+0000 (oldest deadline 2026-02-24T09:32:15.297710+0000) 2026-02-24T09:32:22.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:22 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:22.410+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:32:22.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:22 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:22.410+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.935726+0000 front 2026-02-24T09:31:29.935928+0000 (oldest deadline 2026-02-24T09:31:52.235848+0000) 2026-02-24T09:32:22.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:22 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:22.410+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:35.036724+0000 front 2026-02-24T09:31:35.036776+0000 (oldest deadline 2026-02-24T09:31:57.336638+0000) 2026-02-24T09:32:22.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:22 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:22.410+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:42.037181+0000 front 2026-02-24T09:31:42.037149+0000 (oldest deadline 2026-02-24T09:32:04.937101+0000) 2026-02-24T09:32:22.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:22 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:22.410+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:47.837517+0000 front 2026-02-24T09:31:47.837550+0000 (oldest deadline 2026-02-24T09:32:13.737595+0000) 2026-02-24T09:32:22.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:22 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:22.410+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6812 osd.5 since back 2026-02-24T09:31:53.737862+0000 front 2026-02-24T09:31:53.737918+0000 (oldest deadline 2026-02-24T09:32:17.837870+0000) 2026-02-24T09:32:23.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:22 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:22.850+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:32:23.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:22 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:22.850+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:32:23.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:22 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:22.850+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.096359+0000 front 2026-02-24T09:31:36.096470+0000 (oldest deadline 2026-02-24T09:31:59.596412+0000) 2026-02-24T09:32:23.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:22 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:22.850+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:48.897729+0000 front 2026-02-24T09:31:48.897457+0000 (oldest deadline 2026-02-24T09:32:11.797415+0000) 2026-02-24T09:32:23.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:22 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:22.850+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6812 osd.5 since back 2026-02-24T09:31:51.797623+0000 front 2026-02-24T09:31:51.797676+0000 (oldest deadline 2026-02-24T09:32:15.297710+0000) 2026-02-24T09:32:23.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:23 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:23.413+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:32:23.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:23 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:23.413+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.935726+0000 front 2026-02-24T09:31:29.935928+0000 (oldest deadline 2026-02-24T09:31:52.235848+0000) 2026-02-24T09:32:23.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:23 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:23.413+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:35.036724+0000 front 2026-02-24T09:31:35.036776+0000 (oldest deadline 2026-02-24T09:31:57.336638+0000) 2026-02-24T09:32:23.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:23 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:23.413+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:42.037181+0000 front 2026-02-24T09:31:42.037149+0000 (oldest deadline 2026-02-24T09:32:04.937101+0000) 2026-02-24T09:32:23.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:23 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:23.413+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:47.837517+0000 front 2026-02-24T09:31:47.837550+0000 (oldest deadline 2026-02-24T09:32:13.737595+0000) 2026-02-24T09:32:23.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:23 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:23.413+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6812 osd.5 since back 2026-02-24T09:31:53.737862+0000 front 2026-02-24T09:31:53.737918+0000 (oldest deadline 2026-02-24T09:32:17.837870+0000) 2026-02-24T09:32:23.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:23 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:23.413+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6822 osd.6 since back 2026-02-24T09:31:57.838151+0000 front 2026-02-24T09:31:57.838226+0000 (oldest deadline 2026-02-24T09:32:23.138121+0000) 2026-02-24T09:32:24.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:23 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:23.869+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:32:24.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:23 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:23.869+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:32:24.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:23 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:23.869+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.096359+0000 front 2026-02-24T09:31:36.096470+0000 (oldest deadline 2026-02-24T09:31:59.596412+0000) 2026-02-24T09:32:24.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:23 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:23.869+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:48.897729+0000 front 2026-02-24T09:31:48.897457+0000 (oldest deadline 2026-02-24T09:32:11.797415+0000) 2026-02-24T09:32:24.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:23 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:23.869+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6812 osd.5 since back 2026-02-24T09:31:51.797623+0000 front 2026-02-24T09:31:51.797676+0000 (oldest deadline 2026-02-24T09:32:15.297710+0000) 2026-02-24T09:32:24.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:23 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:23.869+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6822 osd.6 since back 2026-02-24T09:32:00.998743+0000 front 2026-02-24T09:32:00.998777+0000 (oldest deadline 2026-02-24T09:32:23.298725+0000) 2026-02-24T09:32:24.873 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:24 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:24.406+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:24.735170+0000 front 2026-02-24T09:31:24.735347+0000 (oldest deadline 2026-02-24T09:31:48.235273+0000) 2026-02-24T09:32:24.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:24 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:24.406+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:29.935726+0000 front 2026-02-24T09:31:29.935928+0000 (oldest deadline 2026-02-24T09:31:52.235848+0000) 2026-02-24T09:32:24.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:24 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:24.406+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:35.036724+0000 front 2026-02-24T09:31:35.036776+0000 (oldest deadline 2026-02-24T09:31:57.336638+0000) 2026-02-24T09:32:24.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:24 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:24.406+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-24T09:31:42.037181+0000 front 2026-02-24T09:31:42.037149+0000 (oldest deadline 2026-02-24T09:32:04.937101+0000) 2026-02-24T09:32:24.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:24 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:24.406+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:47.837517+0000 front 2026-02-24T09:31:47.837550+0000 (oldest deadline 2026-02-24T09:32:13.737595+0000) 2026-02-24T09:32:24.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:24 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:24.406+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.159:6812 osd.5 since back 2026-02-24T09:31:53.737862+0000 front 2026-02-24T09:31:53.737918+0000 (oldest deadline 2026-02-24T09:32:17.837870+0000) 2026-02-24T09:32:24.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:24 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10[88889]: 2026-02-24T09:32:24.406+0000 7fb5e0e49640 -1 osd.10 115 heartbeat_check: no reply from 10.20.193.28:6822 osd.6 since back 2026-02-24T09:31:57.838151+0000 front 2026-02-24T09:31:57.838226+0000 (oldest deadline 2026-02-24T09:32:23.138121+0000) 2026-02-24T09:32:25.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:24 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:24.833+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:32:25.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:24 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:24.833+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:32:25.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:24 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:24.833+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.096359+0000 front 2026-02-24T09:31:36.096470+0000 (oldest deadline 2026-02-24T09:31:59.596412+0000) 2026-02-24T09:32:25.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:24 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:24.833+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:48.897729+0000 front 2026-02-24T09:31:48.897457+0000 (oldest deadline 2026-02-24T09:32:11.797415+0000) 2026-02-24T09:32:25.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:24 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:24.833+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6812 osd.5 since back 2026-02-24T09:31:51.797623+0000 front 2026-02-24T09:31:51.797676+0000 (oldest deadline 2026-02-24T09:32:15.297710+0000) 2026-02-24T09:32:25.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:24 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:24.833+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6822 osd.6 since back 2026-02-24T09:32:00.998743+0000 front 2026-02-24T09:32:00.998777+0000 (oldest deadline 2026-02-24T09:32:23.298725+0000) 2026-02-24T09:32:25.616 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:25 trial074 podman[102174]: 2026-02-24 09:32:25.317179907 +0000 UTC m=+5.139026239 container died 6a1ec3feaa909ff7a5f4b3dba630fce7678faca4ccd65e0334660c21354808ee (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260223, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, io.buildah.version=1.41.3, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-24T09:32:25.617 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:25 trial074 podman[102174]: 2026-02-24 09:32:25.37403005 +0000 UTC m=+5.195876372 container remove 6a1ec3feaa909ff7a5f4b3dba630fce7678faca4ccd65e0334660c21354808ee (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.build-date=20260223, io.buildah.version=1.41.3, CEPH_REF=wip-vshankar-testing-20260223.155722, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-24T09:32:25.617 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:25 trial074 bash[102174]: ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10 2026-02-24T09:32:25.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:25 trial074 podman[102276]: 2026-02-24 09:32:25.615506602 +0000 UTC m=+0.026835033 container create 39475dfb8d38ef3a13247b6c156df310ba9887976246726c12e4f21b572bbcc7 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10-deactivate, ceph=True, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260223, CEPH_REF=wip-vshankar-testing-20260223.155722, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-24T09:32:25.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:25 trial074 podman[102276]: 2026-02-24 09:32:25.66763282 +0000 UTC m=+0.078961251 container init 39475dfb8d38ef3a13247b6c156df310ba9887976246726c12e4f21b572bbcc7 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_REF=wip-vshankar-testing-20260223.155722, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, io.buildah.version=1.41.3, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-24T09:32:25.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:25 trial074 podman[102276]: 2026-02-24 09:32:25.673053629 +0000 UTC m=+0.084382060 container start 39475dfb8d38ef3a13247b6c156df310ba9887976246726c12e4f21b572bbcc7 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10-deactivate, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.license=GPLv2, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260223, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3) 2026-02-24T09:32:25.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:25 trial074 podman[102276]: 2026-02-24 09:32:25.673903138 +0000 UTC m=+0.085231569 container attach 39475dfb8d38ef3a13247b6c156df310ba9887976246726c12e4f21b572bbcc7 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10-deactivate, io.buildah.version=1.41.3, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.build-date=20260223, CEPH_REF=wip-vshankar-testing-20260223.155722, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-24T09:32:25.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:25 trial074 podman[102276]: 2026-02-24 09:32:25.60609596 +0000 UTC m=+0.017424401 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b 2026-02-24T09:32:25.874 INFO:journalctl@ceph.osd.10.trial074.stdout:Feb 24 09:32:25 trial074 podman[102276]: 2026-02-24 09:32:25.845449792 +0000 UTC m=+0.256778213 container died 39475dfb8d38ef3a13247b6c156df310ba9887976246726c12e4f21b572bbcc7 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-10-deactivate, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.license=GPLv2) 2026-02-24T09:32:25.928 DEBUG:teuthology.orchestra.run.trial074:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.10.service' 2026-02-24T09:32:25.998 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:32:25.999 INFO:tasks.cephadm.osd.10:Stopped osd.10 2026-02-24T09:32:25.999 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2026-02-24T09:32:25.999 DEBUG:teuthology.orchestra.run.trial159:> sudo systemctl stop ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.11 2026-02-24T09:32:26.189 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:25 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:25.825+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:32:26.189 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:25 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:25.825+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:32:26.189 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:25 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:25.825+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.096359+0000 front 2026-02-24T09:31:36.096470+0000 (oldest deadline 2026-02-24T09:31:59.596412+0000) 2026-02-24T09:32:26.190 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:25 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:25.825+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:48.897729+0000 front 2026-02-24T09:31:48.897457+0000 (oldest deadline 2026-02-24T09:32:11.797415+0000) 2026-02-24T09:32:26.190 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:25 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:25.825+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6812 osd.5 since back 2026-02-24T09:31:51.797623+0000 front 2026-02-24T09:31:51.797676+0000 (oldest deadline 2026-02-24T09:32:15.297710+0000) 2026-02-24T09:32:26.190 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:25 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:25.825+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6822 osd.6 since back 2026-02-24T09:32:00.998743+0000 front 2026-02-24T09:32:00.998777+0000 (oldest deadline 2026-02-24T09:32:23.298725+0000) 2026-02-24T09:32:26.190 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:26 trial159 systemd[1]: Stopping Ceph osd.11 for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:32:26.190 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:26 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:26.188+0000 7f1b02e4a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T09:32:26.190 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:26 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:26.188+0000 7f1b02e4a640 -1 osd.11 115 *** Got signal Terminated *** 2026-02-24T09:32:26.190 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:26 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:26.188+0000 7f1b02e4a640 -1 osd.11 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T09:32:27.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:26 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:26.841+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:32:27.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:26 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:26.841+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:32:27.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:26 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:26.841+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.096359+0000 front 2026-02-24T09:31:36.096470+0000 (oldest deadline 2026-02-24T09:31:59.596412+0000) 2026-02-24T09:32:27.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:26 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:26.841+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:48.897729+0000 front 2026-02-24T09:31:48.897457+0000 (oldest deadline 2026-02-24T09:32:11.797415+0000) 2026-02-24T09:32:27.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:26 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:26.841+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6812 osd.5 since back 2026-02-24T09:31:51.797623+0000 front 2026-02-24T09:31:51.797676+0000 (oldest deadline 2026-02-24T09:32:15.297710+0000) 2026-02-24T09:32:27.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:26 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:26.841+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6822 osd.6 since back 2026-02-24T09:32:00.998743+0000 front 2026-02-24T09:32:00.998777+0000 (oldest deadline 2026-02-24T09:32:23.298725+0000) 2026-02-24T09:32:28.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:27 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:27.839+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:32:28.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:27 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:27.839+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:32:28.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:27 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:27.839+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.096359+0000 front 2026-02-24T09:31:36.096470+0000 (oldest deadline 2026-02-24T09:31:59.596412+0000) 2026-02-24T09:32:28.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:27 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:27.839+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:48.897729+0000 front 2026-02-24T09:31:48.897457+0000 (oldest deadline 2026-02-24T09:32:11.797415+0000) 2026-02-24T09:32:28.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:27 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:27.839+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6812 osd.5 since back 2026-02-24T09:31:51.797623+0000 front 2026-02-24T09:31:51.797676+0000 (oldest deadline 2026-02-24T09:32:15.297710+0000) 2026-02-24T09:32:28.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:27 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:27.839+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6822 osd.6 since back 2026-02-24T09:32:00.998743+0000 front 2026-02-24T09:32:00.998777+0000 (oldest deadline 2026-02-24T09:32:23.298725+0000) 2026-02-24T09:32:29.279 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:28 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:28.808+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:32:29.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:28 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:28.808+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:32:29.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:28 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:28.808+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.096359+0000 front 2026-02-24T09:31:36.096470+0000 (oldest deadline 2026-02-24T09:31:59.596412+0000) 2026-02-24T09:32:29.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:28 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:28.808+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:48.897729+0000 front 2026-02-24T09:31:48.897457+0000 (oldest deadline 2026-02-24T09:32:11.797415+0000) 2026-02-24T09:32:29.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:28 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:28.808+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6812 osd.5 since back 2026-02-24T09:31:51.797623+0000 front 2026-02-24T09:31:51.797676+0000 (oldest deadline 2026-02-24T09:32:15.297710+0000) 2026-02-24T09:32:29.280 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:28 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:28.808+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6822 osd.6 since back 2026-02-24T09:32:00.998743+0000 front 2026-02-24T09:32:00.998777+0000 (oldest deadline 2026-02-24T09:32:23.298725+0000) 2026-02-24T09:32:30.029 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:29 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:29.761+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:32:30.030 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:29 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:29.761+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:32:30.030 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:29 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:29.761+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.096359+0000 front 2026-02-24T09:31:36.096470+0000 (oldest deadline 2026-02-24T09:31:59.596412+0000) 2026-02-24T09:32:30.030 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:29 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:29.761+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:48.897729+0000 front 2026-02-24T09:31:48.897457+0000 (oldest deadline 2026-02-24T09:32:11.797415+0000) 2026-02-24T09:32:30.030 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:29 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:29.761+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6812 osd.5 since back 2026-02-24T09:31:51.797623+0000 front 2026-02-24T09:31:51.797676+0000 (oldest deadline 2026-02-24T09:32:15.297710+0000) 2026-02-24T09:32:30.030 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:29 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:29.761+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6822 osd.6 since back 2026-02-24T09:32:00.998743+0000 front 2026-02-24T09:32:00.998777+0000 (oldest deadline 2026-02-24T09:32:23.298725+0000) 2026-02-24T09:32:31.029 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:30 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:30.775+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-24T09:31:22.695704+0000 front 2026-02-24T09:31:22.695416+0000 (oldest deadline 2026-02-24T09:31:47.395390+0000) 2026-02-24T09:32:31.029 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:30 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:30.775+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6804 osd.1 since back 2026-02-24T09:31:30.295915+0000 front 2026-02-24T09:31:30.295930+0000 (oldest deadline 2026-02-24T09:31:51.395919+0000) 2026-02-24T09:32:31.029 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:30 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:30.775+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6804 osd.2 since back 2026-02-24T09:31:36.096359+0000 front 2026-02-24T09:31:36.096470+0000 (oldest deadline 2026-02-24T09:31:59.596412+0000) 2026-02-24T09:32:31.029 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:30 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:30.775+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6812 osd.4 since back 2026-02-24T09:31:48.897729+0000 front 2026-02-24T09:31:48.897457+0000 (oldest deadline 2026-02-24T09:32:11.797415+0000) 2026-02-24T09:32:31.029 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:30 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:30.775+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.159:6812 osd.5 since back 2026-02-24T09:31:51.797623+0000 front 2026-02-24T09:31:51.797676+0000 (oldest deadline 2026-02-24T09:32:15.297710+0000) 2026-02-24T09:32:31.030 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:30 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:30.775+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.28:6822 osd.6 since back 2026-02-24T09:32:00.998743+0000 front 2026-02-24T09:32:00.998777+0000 (oldest deadline 2026-02-24T09:32:23.298725+0000) 2026-02-24T09:32:31.030 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:30 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11[88772]: 2026-02-24T09:32:30.775+0000 7f1afb50a640 -1 osd.11 115 heartbeat_check: no reply from 10.20.193.74:6820 osd.7 since back 2026-02-24T09:32:05.499385+0000 front 2026-02-24T09:32:05.499414+0000 (oldest deadline 2026-02-24T09:32:30.199358+0000) 2026-02-24T09:32:31.615 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:31 trial159 podman[102649]: 2026-02-24 09:32:31.325256608 +0000 UTC m=+5.160581502 container died afba6e97fa154d14f9713dabf088a5ff9e7e75ce5e16710843355ed6358c9588 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11, org.label-schema.build-date=20260223, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-vshankar-testing-20260223.155722, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-24T09:32:31.616 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:31 trial159 podman[102649]: 2026-02-24 09:32:31.383400971 +0000 UTC m=+5.218725865 container remove afba6e97fa154d14f9713dabf088a5ff9e7e75ce5e16710843355ed6358c9588 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.build-date=20260223, OSD_FLAVOR=default, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3) 2026-02-24T09:32:31.616 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:31 trial159 bash[102649]: ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11 2026-02-24T09:32:31.879 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:31 trial159 podman[102749]: 2026-02-24 09:32:31.616548518 +0000 UTC m=+0.026312303 container create 4a45c32d85b6aee86387a1788e2a5f5d80f834bdadab4abb9a0da0f549d34ec1 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-24T09:32:31.879 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:31 trial159 podman[102749]: 2026-02-24 09:32:31.6660915 +0000 UTC m=+0.075855285 container init 4a45c32d85b6aee86387a1788e2a5f5d80f834bdadab4abb9a0da0f549d34ec1 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11-deactivate, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, ceph=True, io.buildah.version=1.41.3) 2026-02-24T09:32:31.880 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:31 trial159 podman[102749]: 2026-02-24 09:32:31.671219637 +0000 UTC m=+0.080983422 container start 4a45c32d85b6aee86387a1788e2a5f5d80f834bdadab4abb9a0da0f549d34ec1 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11-deactivate, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.vendor=CentOS, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-24T09:32:31.880 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:31 trial159 podman[102749]: 2026-02-24 09:32:31.672112937 +0000 UTC m=+0.081876722 container attach 4a45c32d85b6aee86387a1788e2a5f5d80f834bdadab4abb9a0da0f549d34ec1 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11-deactivate, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-24T09:32:31.880 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:31 trial159 podman[102749]: 2026-02-24 09:32:31.607624033 +0000 UTC m=+0.017387828 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b 2026-02-24T09:32:31.880 INFO:journalctl@ceph.osd.11.trial159.stdout:Feb 24 09:32:31 trial159 podman[102749]: 2026-02-24 09:32:31.866549402 +0000 UTC m=+0.276313177 container died 4a45c32d85b6aee86387a1788e2a5f5d80f834bdadab4abb9a0da0f549d34ec1 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-osd-11-deactivate, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-vshankar-testing-20260223.155722, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.schema-version=1.0) 2026-02-24T09:32:31.953 DEBUG:teuthology.orchestra.run.trial159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@osd.11.service' 2026-02-24T09:32:32.025 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:32:32.026 INFO:tasks.cephadm.osd.11:Stopped osd.11 2026-02-24T09:32:32.026 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2026-02-24T09:32:32.026 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.a 2026-02-24T09:32:32.359 INFO:journalctl@ceph.mds.a.trial028.stdout:Feb 24 09:32:32 trial028 systemd[1]: Stopping Ceph mds.a for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:32:32.360 INFO:journalctl@ceph.mds.a.trial028.stdout:Feb 24 09:32:32 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-a[109619]: 2026-02-24T09:32:32.212+0000 7fe1da660640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T09:32:32.360 INFO:journalctl@ceph.mds.a.trial028.stdout:Feb 24 09:32:32 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-a[109619]: 2026-02-24T09:32:32.212+0000 7fe1da660640 -1 mds.a *** got signal Terminated *** 2026-02-24T09:32:33.329 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.a.service' 2026-02-24T09:32:33.397 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:32:33.397 INFO:tasks.cephadm.mds.a:Stopped mds.a 2026-02-24T09:32:33.398 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2026-02-24T09:32:33.398 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.d 2026-02-24T09:32:33.860 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 24 09:32:33 trial028 systemd[1]: Stopping Ceph mds.d for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:32:33.860 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 24 09:32:33 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-d[108764]: 2026-02-24T09:32:33.627+0000 7f0e958bb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T09:32:33.860 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 24 09:32:33 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-d[108764]: 2026-02-24T09:32:33.628+0000 7f0e958bb640 -1 mds.d *** got signal Terminated *** 2026-02-24T09:32:34.748 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.d.service' 2026-02-24T09:32:34.816 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:32:34.817 INFO:tasks.cephadm.mds.d:Stopped mds.d 2026-02-24T09:32:34.817 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2026-02-24T09:32:34.817 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.g 2026-02-24T09:32:35.360 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 24 09:32:34 trial028 systemd[1]: Stopping Ceph mds.g for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:32:35.360 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 24 09:32:34 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-g[109323]: 2026-02-24T09:32:34.995+0000 7f239589a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T09:32:35.360 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 24 09:32:34 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-g[109323]: 2026-02-24T09:32:34.995+0000 7f239589a640 -1 mds.g *** got signal Terminated *** 2026-02-24T09:32:36.113 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.g.service' 2026-02-24T09:32:36.178 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:32:36.178 INFO:tasks.cephadm.mds.g:Stopped mds.g 2026-02-24T09:32:36.178 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2026-02-24T09:32:36.178 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.j 2026-02-24T09:32:36.609 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 24 09:32:36 trial028 systemd[1]: Stopping Ceph mds.j for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:32:36.610 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 24 09:32:36 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-j[108449]: 2026-02-24T09:32:36.355+0000 7fd77e9bf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T09:32:36.610 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 24 09:32:36 trial028 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-j[108449]: 2026-02-24T09:32:36.355+0000 7fd77e9bf640 -1 mds.j *** got signal Terminated *** 2026-02-24T09:32:37.470 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.j.service' 2026-02-24T09:32:37.538 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:32:37.538 INFO:tasks.cephadm.mds.j:Stopped mds.j 2026-02-24T09:32:37.538 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2026-02-24T09:32:37.538 DEBUG:teuthology.orchestra.run.trial074:> sudo systemctl stop ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.b 2026-02-24T09:32:37.873 INFO:journalctl@ceph.mds.b.trial074.stdout:Feb 24 09:32:37 trial074 systemd[1]: Stopping Ceph mds.b for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:32:37.874 INFO:journalctl@ceph.mds.b.trial074.stdout:Feb 24 09:32:37 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-b[97806]: 2026-02-24T09:32:37.717+0000 7fe8c4254640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T09:32:37.874 INFO:journalctl@ceph.mds.b.trial074.stdout:Feb 24 09:32:37 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-b[97806]: 2026-02-24T09:32:37.717+0000 7fe8c4254640 -1 mds.b *** got signal Terminated *** 2026-02-24T09:32:38.846 DEBUG:teuthology.orchestra.run.trial074:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.b.service' 2026-02-24T09:32:38.915 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:32:38.916 INFO:tasks.cephadm.mds.b:Stopped mds.b 2026-02-24T09:32:38.916 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2026-02-24T09:32:38.916 DEBUG:teuthology.orchestra.run.trial074:> sudo systemctl stop ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.e 2026-02-24T09:32:39.373 INFO:journalctl@ceph.mds.e.trial074.stdout:Feb 24 09:32:39 trial074 systemd[1]: Stopping Ceph mds.e for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:32:39.373 INFO:journalctl@ceph.mds.e.trial074.stdout:Feb 24 09:32:39 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-e[97215]: 2026-02-24T09:32:39.131+0000 7fc572532640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T09:32:39.373 INFO:journalctl@ceph.mds.e.trial074.stdout:Feb 24 09:32:39 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-e[97215]: 2026-02-24T09:32:39.131+0000 7fc572532640 -1 mds.e *** got signal Terminated *** 2026-02-24T09:32:40.254 DEBUG:teuthology.orchestra.run.trial074:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.e.service' 2026-02-24T09:32:40.322 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:32:40.322 INFO:tasks.cephadm.mds.e:Stopped mds.e 2026-02-24T09:32:40.322 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2026-02-24T09:32:40.322 DEBUG:teuthology.orchestra.run.trial074:> sudo systemctl stop ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.h 2026-02-24T09:32:40.623 INFO:journalctl@ceph.mds.h.trial074.stdout:Feb 24 09:32:40 trial074 systemd[1]: Stopping Ceph mds.h for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:32:40.624 INFO:journalctl@ceph.mds.h.trial074.stdout:Feb 24 09:32:40 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-h[97510]: 2026-02-24T09:32:40.497+0000 7f1d20fc9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T09:32:40.624 INFO:journalctl@ceph.mds.h.trial074.stdout:Feb 24 09:32:40 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-h[97510]: 2026-02-24T09:32:40.497+0000 7f1d20fc9640 -1 mds.h *** got signal Terminated *** 2026-02-24T09:32:41.614 DEBUG:teuthology.orchestra.run.trial074:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.h.service' 2026-02-24T09:32:41.680 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:32:41.681 INFO:tasks.cephadm.mds.h:Stopped mds.h 2026-02-24T09:32:41.681 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2026-02-24T09:32:41.681 DEBUG:teuthology.orchestra.run.trial074:> sudo systemctl stop ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.k 2026-02-24T09:32:42.124 INFO:journalctl@ceph.mds.k.trial074.stdout:Feb 24 09:32:41 trial074 systemd[1]: Stopping Ceph mds.k for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:32:42.124 INFO:journalctl@ceph.mds.k.trial074.stdout:Feb 24 09:32:41 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-k[96919]: 2026-02-24T09:32:41.856+0000 7f7eca83a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T09:32:42.124 INFO:journalctl@ceph.mds.k.trial074.stdout:Feb 24 09:32:41 trial074 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-k[96919]: 2026-02-24T09:32:41.856+0000 7f7eca83a640 -1 mds.k *** got signal Terminated *** 2026-02-24T09:32:42.976 DEBUG:teuthology.orchestra.run.trial074:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.k.service' 2026-02-24T09:32:43.041 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:32:43.042 INFO:tasks.cephadm.mds.k:Stopped mds.k 2026-02-24T09:32:43.042 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2026-02-24T09:32:43.042 DEBUG:teuthology.orchestra.run.trial159:> sudo systemctl stop ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.c 2026-02-24T09:32:43.530 INFO:journalctl@ceph.mds.c.trial159.stdout:Feb 24 09:32:43 trial159 systemd[1]: Stopping Ceph mds.c for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:32:43.530 INFO:journalctl@ceph.mds.c.trial159.stdout:Feb 24 09:32:43 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-c[97899]: 2026-02-24T09:32:43.229+0000 7f0a40279640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T09:32:43.530 INFO:journalctl@ceph.mds.c.trial159.stdout:Feb 24 09:32:43 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-c[97899]: 2026-02-24T09:32:43.229+0000 7f0a40279640 -1 mds.c *** got signal Terminated *** 2026-02-24T09:32:44.358 DEBUG:teuthology.orchestra.run.trial159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.c.service' 2026-02-24T09:32:44.426 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:32:44.427 INFO:tasks.cephadm.mds.c:Stopped mds.c 2026-02-24T09:32:44.427 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2026-02-24T09:32:44.427 DEBUG:teuthology.orchestra.run.trial159:> sudo systemctl stop ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.f 2026-02-24T09:32:44.780 INFO:journalctl@ceph.mds.f.trial159.stdout:Feb 24 09:32:44 trial159 systemd[1]: Stopping Ceph mds.f for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:32:44.780 INFO:journalctl@ceph.mds.f.trial159.stdout:Feb 24 09:32:44 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-f[97605]: 2026-02-24T09:32:44.615+0000 7f5bc0eee640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T09:32:44.780 INFO:journalctl@ceph.mds.f.trial159.stdout:Feb 24 09:32:44 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-f[97605]: 2026-02-24T09:32:44.615+0000 7f5bc0eee640 -1 mds.f *** got signal Terminated *** 2026-02-24T09:32:45.738 DEBUG:teuthology.orchestra.run.trial159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.f.service' 2026-02-24T09:32:45.804 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:32:45.804 INFO:tasks.cephadm.mds.f:Stopped mds.f 2026-02-24T09:32:45.804 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2026-02-24T09:32:45.804 DEBUG:teuthology.orchestra.run.trial159:> sudo systemctl stop ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.i 2026-02-24T09:32:46.279 INFO:journalctl@ceph.mds.i.trial159.stdout:Feb 24 09:32:45 trial159 systemd[1]: Stopping Ceph mds.i for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:32:46.280 INFO:journalctl@ceph.mds.i.trial159.stdout:Feb 24 09:32:45 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-i[98194]: 2026-02-24T09:32:45.982+0000 7fed3f590640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T09:32:46.280 INFO:journalctl@ceph.mds.i.trial159.stdout:Feb 24 09:32:45 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-i[98194]: 2026-02-24T09:32:45.982+0000 7fed3f590640 -1 mds.i *** got signal Terminated *** 2026-02-24T09:32:47.107 DEBUG:teuthology.orchestra.run.trial159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.i.service' 2026-02-24T09:32:47.173 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:32:47.174 INFO:tasks.cephadm.mds.i:Stopped mds.i 2026-02-24T09:32:47.174 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2026-02-24T09:32:47.174 DEBUG:teuthology.orchestra.run.trial159:> sudo systemctl stop ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.l 2026-02-24T09:32:47.529 INFO:journalctl@ceph.mds.l.trial159.stdout:Feb 24 09:32:47 trial159 systemd[1]: Stopping Ceph mds.l for e9ad50af-1160-11f1-800e-d404e6e7d460... 2026-02-24T09:32:47.529 INFO:journalctl@ceph.mds.l.trial159.stdout:Feb 24 09:32:47 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-l[97313]: 2026-02-24T09:32:47.356+0000 7f6577c22640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T09:32:47.529 INFO:journalctl@ceph.mds.l.trial159.stdout:Feb 24 09:32:47 trial159 ceph-e9ad50af-1160-11f1-800e-d404e6e7d460-mds-l[97313]: 2026-02-24T09:32:47.356+0000 7f6577c22640 -1 mds.l *** got signal Terminated *** 2026-02-24T09:32:48.472 DEBUG:teuthology.orchestra.run.trial159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9ad50af-1160-11f1-800e-d404e6e7d460@mds.l.service' 2026-02-24T09:32:48.537 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:32:48.537 INFO:tasks.cephadm.mds.l:Stopped mds.l 2026-02-24T09:32:48.537 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 --force --keep-logs 2026-02-24T09:32:48.725 INFO:teuthology.orchestra.run.trial028.stdout:Deleting cluster with fsid: e9ad50af-1160-11f1-800e-d404e6e7d460 2026-02-24T09:32:51.921 DEBUG:teuthology.orchestra.run.trial074:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 --force --keep-logs 2026-02-24T09:32:52.107 INFO:teuthology.orchestra.run.trial074.stdout:Deleting cluster with fsid: e9ad50af-1160-11f1-800e-d404e6e7d460 2026-02-24T09:32:55.298 DEBUG:teuthology.orchestra.run.trial159:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 --force --keep-logs 2026-02-24T09:32:55.485 INFO:teuthology.orchestra.run.trial159.stdout:Deleting cluster with fsid: e9ad50af-1160-11f1-800e-d404e6e7d460 2026-02-24T09:32:58.664 DEBUG:teuthology.orchestra.run.trial028:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-24T09:32:58.722 DEBUG:teuthology.orchestra.run.trial074:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-24T09:32:58.781 DEBUG:teuthology.orchestra.run.trial159:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-24T09:32:58.842 INFO:tasks.cephadm:Archiving crash dumps... 2026-02-24T09:32:58.846 DEBUG:teuthology.misc:Transferring archived files from trial028:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/vshankar-2026-02-24_05:06:44-fs-wip-vshankar-testing-20260223.155722-testing-default-trial/67086/remote/trial028/crash 2026-02-24T09:32:58.847 DEBUG:teuthology.orchestra.run.trial028:> sudo tar c -f - -C /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/crash -- . 2026-02-24T09:32:58.902 INFO:teuthology.orchestra.run.trial028.stderr:tar: /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-24T09:32:58.903 INFO:teuthology.orchestra.run.trial028.stderr:tar: Error is not recoverable: exiting now 2026-02-24T09:32:58.906 DEBUG:teuthology.misc:Transferring archived files from trial074:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/vshankar-2026-02-24_05:06:44-fs-wip-vshankar-testing-20260223.155722-testing-default-trial/67086/remote/trial074/crash 2026-02-24T09:32:58.908 DEBUG:teuthology.orchestra.run.trial074:> sudo tar c -f - -C /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/crash -- . 2026-02-24T09:32:58.965 INFO:teuthology.orchestra.run.trial074.stderr:tar: /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-24T09:32:58.966 INFO:teuthology.orchestra.run.trial074.stderr:tar: Error is not recoverable: exiting now 2026-02-24T09:32:58.969 DEBUG:teuthology.misc:Transferring archived files from trial159:/var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/vshankar-2026-02-24_05:06:44-fs-wip-vshankar-testing-20260223.155722-testing-default-trial/67086/remote/trial159/crash 2026-02-24T09:32:58.970 DEBUG:teuthology.orchestra.run.trial159:> sudo tar c -f - -C /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/crash -- . 2026-02-24T09:32:59.028 INFO:teuthology.orchestra.run.trial159.stderr:tar: /var/lib/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-24T09:32:59.028 INFO:teuthology.orchestra.run.trial159.stderr:tar: Error is not recoverable: exiting now 2026-02-24T09:32:59.031 INFO:tasks.cephadm:Checking cluster log for badness... 2026-02-24T09:32:59.031 DEBUG:teuthology.orchestra.run.trial028:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | head -n 1 2026-02-24T09:32:59.092 INFO:tasks.cephadm:Compressing logs... 2026-02-24T09:32:59.093 DEBUG:teuthology.orchestra.run.trial028:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T09:32:59.097 DEBUG:teuthology.orchestra.run.trial074:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T09:32:59.100 DEBUG:teuthology.orchestra.run.trial159:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T09:32:59.147 INFO:teuthology.orchestra.run.trial028.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-24T09:32:59.147 INFO:teuthology.orchestra.run.trial028.stderr:: No such file or directory 2026-02-24T09:32:59.148 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2026-02-24T09:32:59.148 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mon.a.log 2026-02-24T09:32:59.149 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.d.log 2026-02-24T09:32:59.150 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.j.log 2026-02-24T09:32:59.150 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mon.a.log: /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.0.log 2026-02-24T09:32:59.151 INFO:teuthology.orchestra.run.trial074.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-24T09:32:59.152 INFO:teuthology.orchestra.run.trial074.stderr:: No such file or directory 2026-02-24T09:32:59.153 INFO:teuthology.orchestra.run.trial074.stderr:gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mgr.y.log 2026-02-24T09:32:59.153 INFO:teuthology.orchestra.run.trial074.stderr:gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.b.log/var/log/ceph/cephadm.log: 2026-02-24T09:32:59.154 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.3.log 2026-02-24T09:32:59.154 INFO:teuthology.orchestra.run.trial028.stderr: 92.8% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-24T09:32:59.154 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.0.log: /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph.cephadm.log 2026-02-24T09:32:59.154 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.a.log 2026-02-24T09:32:59.154 INFO:teuthology.orchestra.run.trial028.stderr: 95.0% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.d.log.gz 2026-02-24T09:32:59.155 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph.cephadm.log: 95.1% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.j.log.gz 2026-02-24T09:32:59.155 INFO:teuthology.orchestra.run.trial028.stderr: 84.5% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph.cephadm.log.gz 2026-02-24T09:32:59.157 INFO:teuthology.orchestra.run.trial074.stderr:gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.h.log 2026-02-24T09:32:59.157 INFO:teuthology.orchestra.run.trial074.stderr:/var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mgr.y.log: 92.0% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-24T09:32:59.157 INFO:teuthology.orchestra.run.trial074.stderr:/var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.7.log 2026-02-24T09:32:59.158 INFO:teuthology.orchestra.run.trial074.stderr:/var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph.cephadm.log 2026-02-24T09:32:59.158 INFO:teuthology.orchestra.run.trial074.stderr:/var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.10.log 2026-02-24T09:32:59.158 INFO:teuthology.orchestra.run.trial074.stderr:/var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.4.log 2026-02-24T09:32:59.158 INFO:teuthology.orchestra.run.trial074.stderr: 84.3% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph.cephadm.log.gz 2026-02-24T09:32:59.158 INFO:teuthology.orchestra.run.trial074.stderr:/var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.10.log: 92.1% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mgr.y.log.gz 2026-02-24T09:32:59.158 INFO:teuthology.orchestra.run.trial074.stderr:gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph.audit.log 2026-02-24T09:32:59.168 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.g.log 2026-02-24T09:32:59.169 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph.audit.log 2026-02-24T09:32:59.169 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-volume.log 2026-02-24T09:32:59.169 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.6.log 2026-02-24T09:32:59.169 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.6.log: 90.6% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph.audit.log.gz 2026-02-24T09:32:59.169 INFO:teuthology.orchestra.run.trial028.stderr: 95.1% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.g.log.gz 2026-02-24T09:32:59.169 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mgr.x.log 2026-02-24T09:32:59.169 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph.log 2026-02-24T09:32:59.169 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.9.log 2026-02-24T09:32:59.169 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph.log: /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.9.log: 93.8% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-volume.log.gz 2026-02-24T09:32:59.169 INFO:teuthology.orchestra.run.trial028.stderr: 87.1% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph.log.gz 2026-02-24T09:32:59.170 INFO:teuthology.orchestra.run.trial074.stderr:gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mon.b.log 2026-02-24T09:32:59.171 INFO:teuthology.orchestra.run.trial074.stderr:/var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.4.log: /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-volume.log 2026-02-24T09:32:59.171 INFO:teuthology.orchestra.run.trial074.stderr:/var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mon.b.log: 90.7% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph.audit.log.gz 2026-02-24T09:32:59.171 INFO:teuthology.orchestra.run.trial074.stderr:gzip -5 --verbose --/var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-volume.log: /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.1.log 2026-02-24T09:32:59.171 INFO:teuthology.orchestra.run.trial074.stderr:gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph.log 2026-02-24T09:32:59.171 INFO:teuthology.orchestra.run.trial074.stderr:/var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph.log: /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.k.log 2026-02-24T09:32:59.171 INFO:teuthology.orchestra.run.trial074.stderr:gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.e.log 2026-02-24T09:32:59.171 INFO:teuthology.orchestra.run.trial074.stderr:/var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.k.log: 93.8% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-volume.log.gz 2026-02-24T09:32:59.171 INFO:teuthology.orchestra.run.trial074.stderr: 87.1% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph.log.gz 2026-02-24T09:32:59.171 INFO:teuthology.orchestra.run.trial159.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-24T09:32:59.172 INFO:teuthology.orchestra.run.trial159.stderr:: No such file or directory 2026-02-24T09:32:59.172 INFO:teuthology.orchestra.run.trial159.stderr:gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.2.log 2026-02-24T09:32:59.172 INFO:teuthology.orchestra.run.trial159.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.i.log 2026-02-24T09:32:59.172 INFO:teuthology.orchestra.run.trial159.stderr:/var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mon.c.log 2026-02-24T09:32:59.172 INFO:teuthology.orchestra.run.trial159.stderr: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-24T09:32:59.172 INFO:teuthology.orchestra.run.trial159.stderr:/var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.f.log 2026-02-24T09:32:59.172 INFO:teuthology.orchestra.run.trial159.stderr:/var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.5.log 2026-02-24T09:32:59.172 INFO:teuthology.orchestra.run.trial159.stderr:/var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph.cephadm.log 2026-02-24T09:32:59.172 INFO:teuthology.orchestra.run.trial159.stderr:/var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.11.log 2026-02-24T09:32:59.173 INFO:teuthology.orchestra.run.trial159.stderr:/var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph.audit.log 2026-02-24T09:32:59.173 INFO:teuthology.orchestra.run.trial159.stderr: 84.2% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph.cephadm.log.gz 2026-02-24T09:32:59.173 INFO:teuthology.orchestra.run.trial159.stderr:/var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-volume.log 2026-02-24T09:32:59.173 INFO:teuthology.orchestra.run.trial159.stderr: 95.0% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.f.log.gz 2026-02-24T09:32:59.173 INFO:teuthology.orchestra.run.trial159.stderr:/var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph.audit.log: 90.7% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph.audit.log.gz 2026-02-24T09:32:59.173 INFO:teuthology.orchestra.run.trial159.stderr:gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mgr.z.log 2026-02-24T09:32:59.173 INFO:teuthology.orchestra.run.trial159.stderr:/var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.l.log 2026-02-24T09:32:59.173 INFO:teuthology.orchestra.run.trial159.stderr:gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.c.log 2026-02-24T09:32:59.174 INFO:teuthology.orchestra.run.trial074.stderr:/var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.e.log: 94.9% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.k.log.gz 2026-02-24T09:32:59.175 INFO:teuthology.orchestra.run.trial159.stderr:/var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mgr.z.log: /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.c.log: /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.l.log: 92.1% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mgr.z.log.gz 2026-02-24T09:32:59.175 INFO:teuthology.orchestra.run.trial159.stderr:gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph.log 2026-02-24T09:32:59.175 INFO:teuthology.orchestra.run.trial159.stderr: 93.8% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-volume.log.gz 2026-02-24T09:32:59.175 INFO:teuthology.orchestra.run.trial159.stderr:gzip -5 --verbose -- /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.8.log 2026-02-24T09:32:59.175 INFO:teuthology.orchestra.run.trial159.stderr:/var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph.log: /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.8.log: 87.1% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph.log.gz 2026-02-24T09:32:59.178 INFO:teuthology.orchestra.run.trial159.stderr: 95.0% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.l.log.gz 2026-02-24T09:32:59.186 INFO:teuthology.orchestra.run.trial074.stderr: 93.3% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.h.log.gz 2026-02-24T09:32:59.188 INFO:teuthology.orchestra.run.trial028.stderr: 93.1% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.a.log.gz 2026-02-24T09:32:59.206 INFO:teuthology.orchestra.run.trial074.stderr: 94.5% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.e.log.gz 2026-02-24T09:32:59.207 INFO:teuthology.orchestra.run.trial159.stderr: 93.5% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.i.log.gz 2026-02-24T09:32:59.212 INFO:teuthology.orchestra.run.trial159.stderr: 94.3% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.c.log.gz 2026-02-24T09:32:59.329 INFO:teuthology.orchestra.run.trial028.stderr: 90.5% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mgr.x.log.gz 2026-02-24T09:32:59.354 INFO:teuthology.orchestra.run.trial074.stderr: 92.0% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mon.b.log.gz 2026-02-24T09:32:59.354 INFO:teuthology.orchestra.run.trial159.stderr: 92.1% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mon.c.log.gz 2026-02-24T09:32:59.366 INFO:teuthology.orchestra.run.trial074.stderr: 92.8% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mds.b.log.gz 2026-02-24T09:32:59.680 INFO:teuthology.orchestra.run.trial028.stderr: 90.2% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-mon.a.log.gz 2026-02-24T09:33:02.865 INFO:teuthology.orchestra.run.trial028.stderr: 94.1% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.9.log.gz 2026-02-24T09:33:03.311 INFO:teuthology.orchestra.run.trial159.stderr: 94.1% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.8.log.gz 2026-02-24T09:33:03.544 INFO:teuthology.orchestra.run.trial074.stderr: 94.1% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.4.log.gz 2026-02-24T09:33:03.620 INFO:teuthology.orchestra.run.trial028.stderr: 94.2% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.6.log.gz 2026-02-24T09:33:03.749 INFO:teuthology.orchestra.run.trial159.stderr: 94.2% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.11.log.gz 2026-02-24T09:33:03.781 INFO:teuthology.orchestra.run.trial159.stderr: 94.1% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.2.log.gz 2026-02-24T09:33:03.814 INFO:teuthology.orchestra.run.trial074.stderr: 94.1% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.10.log.gz 2026-02-24T09:33:03.907 INFO:teuthology.orchestra.run.trial074.stderr: 94.2% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.7.log.gz 2026-02-24T09:33:04.011 INFO:teuthology.orchestra.run.trial074.stderr: 94.1% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.1.log.gz 2026-02-24T09:33:04.013 INFO:teuthology.orchestra.run.trial074.stderr: 2026-02-24T09:33:04.013 INFO:teuthology.orchestra.run.trial074.stderr:real 0m4.881s 2026-02-24T09:33:04.013 INFO:teuthology.orchestra.run.trial074.stderr:user 0m17.092s 2026-02-24T09:33:04.013 INFO:teuthology.orchestra.run.trial074.stderr:sys 0m2.080s 2026-02-24T09:33:04.060 INFO:teuthology.orchestra.run.trial028.stderr: 94.2% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.0.log.gz 2026-02-24T09:33:04.233 INFO:teuthology.orchestra.run.trial159.stderr: 94.1% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.5.log.gz 2026-02-24T09:33:04.236 INFO:teuthology.orchestra.run.trial159.stderr: 2026-02-24T09:33:04.236 INFO:teuthology.orchestra.run.trial159.stderr:real 0m5.099s 2026-02-24T09:33:04.236 INFO:teuthology.orchestra.run.trial159.stderr:user 0m16.715s 2026-02-24T09:33:04.236 INFO:teuthology.orchestra.run.trial159.stderr:sys 0m2.060s 2026-02-24T09:33:04.265 INFO:teuthology.orchestra.run.trial028.stderr: 94.1% -- replaced with /var/log/ceph/e9ad50af-1160-11f1-800e-d404e6e7d460/ceph-osd.3.log.gz 2026-02-24T09:33:07.500 INFO:teuthology.orchestra.run.trial028.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2026-02-24T09:33:07.503 INFO:teuthology.orchestra.run.trial028.stderr: 2026-02-24T09:33:07.503 INFO:teuthology.orchestra.run.trial028.stderr:real 0m8.375s 2026-02-24T09:33:07.503 INFO:teuthology.orchestra.run.trial028.stderr:user 0m24.004s 2026-02-24T09:33:07.503 INFO:teuthology.orchestra.run.trial028.stderr:sys 0m3.321s 2026-02-24T09:33:07.503 INFO:tasks.cephadm:Archiving logs... 2026-02-24T09:33:07.504 DEBUG:teuthology.misc:Transferring archived files from trial028:/var/log/ceph to /home/teuthworker/mnt/teuthology/vshankar-2026-02-24_05:06:44-fs-wip-vshankar-testing-20260223.155722-testing-default-trial/67086/remote/trial028/log 2026-02-24T09:33:07.506 DEBUG:teuthology.orchestra.run.trial028:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-24T09:33:09.308 DEBUG:teuthology.misc:Transferring archived files from trial074:/var/log/ceph to /home/teuthworker/mnt/teuthology/vshankar-2026-02-24_05:06:44-fs-wip-vshankar-testing-20260223.155722-testing-default-trial/67086/remote/trial074/log 2026-02-24T09:33:09.309 DEBUG:teuthology.orchestra.run.trial074:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-24T09:33:10.719 DEBUG:teuthology.misc:Transferring archived files from trial159:/var/log/ceph to /home/teuthworker/mnt/teuthology/vshankar-2026-02-24_05:06:44-fs-wip-vshankar-testing-20260223.155722-testing-default-trial/67086/remote/trial159/log 2026-02-24T09:33:10.720 DEBUG:teuthology.orchestra.run.trial159:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-24T09:33:12.100 INFO:tasks.cephadm:Removing cluster... 2026-02-24T09:33:12.100 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 --force 2026-02-24T09:33:12.288 INFO:teuthology.orchestra.run.trial028.stdout:Deleting cluster with fsid: e9ad50af-1160-11f1-800e-d404e6e7d460 2026-02-24T09:33:12.600 DEBUG:teuthology.orchestra.run.trial074:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 --force 2026-02-24T09:33:12.787 INFO:teuthology.orchestra.run.trial074.stdout:Deleting cluster with fsid: e9ad50af-1160-11f1-800e-d404e6e7d460 2026-02-24T09:33:13.097 DEBUG:teuthology.orchestra.run.trial159:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e9ad50af-1160-11f1-800e-d404e6e7d460 --force 2026-02-24T09:33:13.284 INFO:teuthology.orchestra.run.trial159.stdout:Deleting cluster with fsid: e9ad50af-1160-11f1-800e-d404e6e7d460 2026-02-24T09:33:13.583 INFO:tasks.cephadm:Removing cephadm ... 2026-02-24T09:33:13.583 DEBUG:teuthology.orchestra.run.trial028:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-24T09:33:13.623 DEBUG:teuthology.orchestra.run.trial074:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-24T09:33:13.663 DEBUG:teuthology.orchestra.run.trial159:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-24T09:33:13.703 INFO:tasks.cephadm:Teardown complete 2026-02-24T09:33:13.703 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-24T09:33:13.720 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-24T09:33:13.720 DEBUG:teuthology.orchestra.run.trial028:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-24T09:33:13.724 DEBUG:teuthology.orchestra.run.trial074:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-24T09:33:13.728 DEBUG:teuthology.orchestra.run.trial159:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-24T09:33:14.023 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-24T09:33:14.035 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-24T09:33:14.035 DEBUG:teuthology.orchestra.run.trial028:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T09:33:14.038 DEBUG:teuthology.orchestra.run.trial074:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T09:33:14.041 DEBUG:teuthology.orchestra.run.trial159:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T09:33:14.071 INFO:teuthology.orchestra.run.trial028.stderr:bash: line 1: ntpq: command not found 2026-02-24T09:33:14.074 INFO:teuthology.orchestra.run.trial074.stderr:bash: line 1: ntpq: command not found 2026-02-24T09:33:14.077 INFO:teuthology.orchestra.run.trial159.stderr:bash: line 1: ntpq: command not found 2026-02-24T09:33:14.109 INFO:teuthology.orchestra.run.trial028.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T09:33:14.110 INFO:teuthology.orchestra.run.trial028.stdout:=============================================================================== 2026-02-24T09:33:14.110 INFO:teuthology.orchestra.run.trial028.stdout:^* ntp.speculation.org 2 7 377 96 -572us[ -320us] +/- 75ms 2026-02-24T09:33:14.110 INFO:teuthology.orchestra.run.trial028.stdout:^+ white.web-ster.com 2 7 377 93 +3617us[+3617us] +/- 73ms 2026-02-24T09:33:14.110 INFO:teuthology.orchestra.run.trial028.stdout:^+ 170-187-147-56.ip.linode> 2 6 377 33 -5242us[-5242us] +/- 78ms 2026-02-24T09:33:14.110 INFO:teuthology.orchestra.run.trial028.stdout:^+ ip229.ip-51-81-226.us 2 7 377 98 +5249us[+5500us] +/- 95ms 2026-02-24T09:33:14.110 INFO:teuthology.orchestra.run.trial074.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T09:33:14.110 INFO:teuthology.orchestra.run.trial074.stdout:=============================================================================== 2026-02-24T09:33:14.110 INFO:teuthology.orchestra.run.trial074.stdout:^- 23.157.160.168 2 7 377 32 +1842us[+1869us] +/- 55ms 2026-02-24T09:33:14.110 INFO:teuthology.orchestra.run.trial074.stdout:^* chi3.us.ntp.li 2 6 377 32 -25us[ +962ns] +/- 11ms 2026-02-24T09:33:14.110 INFO:teuthology.orchestra.run.trial074.stdout:^- 172-233-189-68.ip.linode> 2 7 377 99 -1823us[-1612us] +/- 88ms 2026-02-24T09:33:14.110 INFO:teuthology.orchestra.run.trial074.stdout:^- 50-203-248-23-static.hfc> 2 7 377 30 +3091us[+3091us] +/- 35ms 2026-02-24T09:33:14.113 INFO:teuthology.orchestra.run.trial159.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T09:33:14.113 INFO:teuthology.orchestra.run.trial159.stdout:=============================================================================== 2026-02-24T09:33:14.113 INFO:teuthology.orchestra.run.trial159.stdout:^+ 69-10-208-170.rainiercon> 2 7 377 30 +1000us[+1000us] +/- 68ms 2026-02-24T09:33:14.113 INFO:teuthology.orchestra.run.trial159.stdout:^* ip74-208-14-149.pbiaas.c> 2 7 377 97 +1237us[+1271us] +/- 25ms 2026-02-24T09:33:14.113 INFO:teuthology.orchestra.run.trial159.stdout:^+ 172-238-164-57.ip.linode> 4 7 377 96 -2036us[-2036us] +/- 33ms 2026-02-24T09:33:14.113 INFO:teuthology.orchestra.run.trial159.stdout:^- jmpxus.no.sigint.today 3 8 255 21 +5985us[+5985us] +/- 88ms 2026-02-24T09:33:14.114 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-24T09:33:14.127 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-24T09:33:14.128 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-24T09:33:14.141 DEBUG:teuthology.orchestra.run.trial028:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-24T09:33:14.267 DEBUG:teuthology.orchestra.run.trial074:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-24T09:33:14.377 DEBUG:teuthology.orchestra.run.trial159:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-24T09:33:14.487 DEBUG:teuthology.orchestra.run.trial028:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2026-02-24T09:33:14.548 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T09:33:14.549 DEBUG:teuthology.orchestra.run.trial074:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2026-02-24T09:33:14.609 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T09:33:14.609 DEBUG:teuthology.orchestra.run.trial159:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2026-02-24T09:33:14.670 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T09:33:14.671 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-24T09:33:14.688 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-24T09:33:14.704 INFO:teuthology.task.internal:Duration was 1599.558773 seconds 2026-02-24T09:33:14.704 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-24T09:33:14.716 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-24T09:33:14.716 DEBUG:teuthology.orchestra.run.trial028:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-24T09:33:14.719 DEBUG:teuthology.orchestra.run.trial074:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-24T09:33:14.722 DEBUG:teuthology.orchestra.run.trial159:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-24T09:33:14.799 INFO:teuthology.orchestra.run.trial028.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T09:33:14.802 INFO:teuthology.orchestra.run.trial074.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T09:33:14.807 INFO:teuthology.orchestra.run.trial159.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T09:33:15.073 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-24T09:33:15.073 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial028.front.sepia.ceph.com 2026-02-24T09:33:15.074 DEBUG:teuthology.orchestra.run.trial028:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-24T09:33:15.124 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial074.front.sepia.ceph.com 2026-02-24T09:33:15.125 DEBUG:teuthology.orchestra.run.trial074:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-24T09:33:15.175 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial159.front.sepia.ceph.com 2026-02-24T09:33:15.176 DEBUG:teuthology.orchestra.run.trial159:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-24T09:33:15.222 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-24T09:33:15.222 DEBUG:teuthology.orchestra.run.trial028:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T09:33:15.226 DEBUG:teuthology.orchestra.run.trial074:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T09:33:15.231 DEBUG:teuthology.orchestra.run.trial159:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T09:33:15.537 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-24T09:33:15.537 DEBUG:teuthology.orchestra.run.trial028:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T09:33:15.542 DEBUG:teuthology.orchestra.run.trial074:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T09:33:15.547 DEBUG:teuthology.orchestra.run.trial159:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T09:33:15.592 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T09:33:15.592 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T09:33:15.593 INFO:teuthology.orchestra.run.trial028.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T09:33:15.593 INFO:teuthology.orchestra.run.trial028.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-24T09:33:15.594 INFO:teuthology.orchestra.run.trial028.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-24T09:33:15.599 INFO:teuthology.orchestra.run.trial074.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T09:33:15.600 INFO:teuthology.orchestra.run.trial074.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T09:33:15.601 INFO:teuthology.orchestra.run.trial074.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T09:33:15.601 INFO:teuthology.orchestra.run.trial074.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-24T09:33:15.601 INFO:teuthology.orchestra.run.trial074.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-24T09:33:15.602 INFO:teuthology.orchestra.run.trial159.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T09:33:15.603 INFO:teuthology.orchestra.run.trial159.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T09:33:15.603 INFO:teuthology.orchestra.run.trial159.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T09:33:15.603 INFO:teuthology.orchestra.run.trial159.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-24T09:33:15.604 INFO:teuthology.orchestra.run.trial159.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-24T09:33:15.624 INFO:teuthology.orchestra.run.trial074.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 87.8% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-24T09:33:15.628 INFO:teuthology.orchestra.run.trial159.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 88.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-24T09:33:15.651 INFO:teuthology.orchestra.run.trial028.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 90.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-24T09:33:15.655 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-24T09:33:15.679 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-24T09:33:15.680 DEBUG:teuthology.orchestra.run.trial028:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-24T09:33:15.735 DEBUG:teuthology.orchestra.run.trial074:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-24T09:33:15.791 DEBUG:teuthology.orchestra.run.trial159:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-24T09:33:15.849 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-24T09:33:15.860 DEBUG:teuthology.orchestra.run.trial028:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-24T09:33:15.865 DEBUG:teuthology.orchestra.run.trial074:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-24T09:33:15.870 DEBUG:teuthology.orchestra.run.trial159:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-24T09:33:15.935 INFO:teuthology.orchestra.run.trial028.stdout:kernel.core_pattern = core 2026-02-24T09:33:15.938 INFO:teuthology.orchestra.run.trial074.stdout:kernel.core_pattern = core 2026-02-24T09:33:15.944 INFO:teuthology.orchestra.run.trial159.stdout:kernel.core_pattern = core 2026-02-24T09:33:15.972 DEBUG:teuthology.orchestra.run.trial028:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-24T09:33:16.007 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T09:33:16.008 DEBUG:teuthology.orchestra.run.trial074:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-24T09:33:16.046 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T09:33:16.047 DEBUG:teuthology.orchestra.run.trial159:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-24T09:33:16.083 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T09:33:16.084 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-24T09:33:16.103 INFO:teuthology.task.internal:Transferring archived files... 2026-02-24T09:33:16.104 DEBUG:teuthology.misc:Transferring archived files from trial028:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/vshankar-2026-02-24_05:06:44-fs-wip-vshankar-testing-20260223.155722-testing-default-trial/67086/remote/trial028 2026-02-24T09:33:16.105 DEBUG:teuthology.orchestra.run.trial028:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-24T09:33:16.186 DEBUG:teuthology.misc:Transferring archived files from trial074:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/vshankar-2026-02-24_05:06:44-fs-wip-vshankar-testing-20260223.155722-testing-default-trial/67086/remote/trial074 2026-02-24T09:33:16.186 DEBUG:teuthology.orchestra.run.trial074:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-24T09:33:16.255 DEBUG:teuthology.misc:Transferring archived files from trial159:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/vshankar-2026-02-24_05:06:44-fs-wip-vshankar-testing-20260223.155722-testing-default-trial/67086/remote/trial159 2026-02-24T09:33:16.256 DEBUG:teuthology.orchestra.run.trial159:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-24T09:33:16.326 INFO:teuthology.task.internal:Removing archive directory... 2026-02-24T09:33:16.326 DEBUG:teuthology.orchestra.run.trial028:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-24T09:33:16.330 DEBUG:teuthology.orchestra.run.trial074:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-24T09:33:16.335 DEBUG:teuthology.orchestra.run.trial159:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-24T09:33:16.374 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-24T09:33:16.397 INFO:teuthology.task.internal:Not uploading archives. 2026-02-24T09:33:16.397 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-24T09:33:16.417 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-24T09:33:16.417 DEBUG:teuthology.orchestra.run.trial028:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-24T09:33:16.420 DEBUG:teuthology.orchestra.run.trial074:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-24T09:33:16.424 DEBUG:teuthology.orchestra.run.trial159:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-24T09:33:16.457 INFO:teuthology.orchestra.run.trial028.stdout: 1048593 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 24 09:33 /home/ubuntu/cephtest 2026-02-24T09:33:16.460 INFO:teuthology.orchestra.run.trial074.stdout: 1048605 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 24 09:33 /home/ubuntu/cephtest 2026-02-24T09:33:16.462 INFO:teuthology.orchestra.run.trial159.stdout: 1048593 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 24 09:33 /home/ubuntu/cephtest 2026-02-24T09:33:16.464 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-24T09:33:16.487 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-24T09:33:16.532 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated-and-quota} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/suites/iozone}} duration: 1599.55877327919 flavor: default mon.a-kernel-sha1: 8dec4b357aab872d3b63ec979924962a64be83dd mon.b-kernel-sha1: 8dec4b357aab872d3b63ec979924962a64be83dd mon.c-kernel-sha1: 8dec4b357aab872d3b63ec979924962a64be83dd owner: scheduled_vshankar@soko04.front.sepia.ceph.com success: true 2026-02-24T09:33:16.532 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T09:33:16.635 INFO:teuthology.run:pass